PlenOctrees for Real-time Rendering of Neural Radiance Fields

🤖 Plain-English Summary

We introduce a method to render Neural Radiance Fields (NeRFs) in real time using PlenOctrees, an octree-based 3D representation which supports view-dependent effects. Our real-time neural rendering approach may potentially enable new applications such as 6-DOF industrial and product visualizations, as well as next generation AR/VR systems.

🔑 Key Findings

• Our method can render 800×800 images at more than 150 FPS, which is over 3000 times faster than conventional NeRFs.
• We do so without sacrificing quality while preserving the ability of NeRFs to perform free-viewpoint rendering of scenes with arbitrary geometry and view-dependent effects.
• Real-time performance is achieved by pre-tabulating the NeRF into a PlenOctree.

🔗 Related Resources