PofoliaShared via Pofolia

· 2024

Mip-Splatting: Alias-Free 3D Gaussian Splatting

Zehao Yu, Anpei Chen, Binbin Huang, Torsten Sattler et al.

Short summary

Mip-Splatting introduces a 3D smoothing filter and a Mip filter to eliminate aliasing artifacts in 3D Gaussian Splatting, enabling high-fidelity novel view synthesis across varying zoom levels.

AI-generated from the title and abstract; the full text is not read.

Key points

  • Introduces a 3D smoothing filter to constrain Gaussian primitive sizes based on input view sampling frequencies.
  • Replaces 2D dilation with a Mip filter (simulating a 2D box filter) to reduce aliasing.
  • Eliminates high-frequency artifacts and dilation issues during novel view synthesis.
  • Demonstrates effectiveness in single-scale training and multi-scale testing scenarios.

AI-generated from the title and abstract; the full text is not read.

Abstract

Recently, 3D Gaussian Splatting has demonstrated impressive novel view synthesis results, reaching high fidelity and efficiency. However, strong artifacts can be observed when changing the sampling rate, e.g., by changing focal length or camera distance. We find that the source for this phenomenon can be attributed to the lack of 3D frequency constraints and the usage of a 2D dilation filter. To address this problem, we introduce a 3D smoothing filter to constrains the size of the 3D Gaussian primitives based on the maximal sampling frequency induced by the input views. It eliminates high-frequency artifacts when zooming in. Moreover, replacing 2D dilation with a 2D Mip filter, which simulates a 2D box filter, effectively mitigates aliasing and dilation issues. Our evaluation, including scenarios such a training on single-scale images and testing on multiple scales, validates the effectiveness of our approach.

The authors' abstract, as published at the source., 2024 · DOI ↗

TakeawaysPremium
Ask the paperFree account

Continue with a free account

Ask the paper: 3 free questions a day about this paper; save it, get its citation, new summaries every day for your field. Takeaways are Premium.

Continue free on the web

Sign in with Google or Apple; no card needed. You come back to this paper.

On your phone:

Field: Computer Graphics and Computer-Aided Design

Computer Graphics and Computer-Aided DesignComputer Science