· 2024
4D Gaussian Splatting for Real-Time Dynamic Scene Rendering
- 569citations
- 2024year
Short summary
4D Gaussian Splatting (4D-GS) achieves real-time dynamic scene rendering at 82 FPS (800x800 resolution on RTX 3090) by representing scenes with 3D Gaussians and 4D neural voxels, outperforming prior methods.
AI-generated from the title and abstract; the full text is not read.
Key points
- Introduces 4D Gaussian Splatting (4D-GS) for dynamic scene representation and rendering.
- Combines explicit 3D Gaussians with 4D neural voxels for efficient feature building.
- Achieves real-time rendering at 82 FPS for 800x800 resolution on an RTX 3090 GPU.
- Maintains comparable or superior visual quality compared to previous methods.
AI-generated from the title and abstract; the full text is not read.
Abstract
Representing and rendering dynamic scenes has been an important but challenging task. Especially, to accurately model complex motions, high efficiency is usually hard to guarantee. To achieve real-time dynamic scene rendering while also enjoying high training and storage efficiency, we propose 4D Gaussian Splatting (4D-GS) as a holistic representation for dynamic scenes rather than applying 3D-GS for each individual frame. In 4D-GS, a novel explicit representation containing both 3D Gaussians and 4D neural voxels is proposed. A decomposed neural voxel encoding algorithm inspired by HexPlane is proposed to efficiently build Gaussian features from 4D neural voxels and then a lightweight MLP is applied to predict Gaussian deformations at novel timestamps. Our 4D-GS method achieves real-time rendering under high resolutions, 82 FPS at an 800x800 resolution on an RTX 3090 GPU while maintaining comparable or better quality than previous state- of-the-art methods. More demos and code are available at https://guanjunwu.github.io/4dgs/.
The authors' abstract, as published at the source., 2024 · DOI ↗
Continue with a free account
Ask the paper: 3 free questions a day about this paper; save it, get its citation, new summaries every day for your field. Takeaways are Premium.
Continue free on the webSign in with Google or Apple; no card needed. You come back to this paper.
On your phone:
Field: Computer Graphics and Computer-Aided Design
Computer Graphics and Computer-Aided DesignComputer Science