Magic3D: High-Resolution Text-to-3D Content Creation

🤖 Plain-English Summary

DreamFusion has recently demonstrated the utility of a pretrained text-to-image diffusion model to optimize Neural Radiance Fields (NeRF) , achieving remarkable text-to-3D synthesis results. User studies show 61.7% raters to prefer our approach over DreamFusion.

🔑 Key Findings

• However, the method has two inherent limitations: (a) extremely slow optimization of NeRF and (b) low-resolution image space supervision on NeRF, leading to low-quality 3D models with a long processing time.
• In this paper, we address these limitations by utilizing a two-stage optimization framework.
• First, we obtain a coarse model using a low-resolution diffusion prior and accelerate with a sparse 3D hash grid structure.

🔗 Related Resources