Title: Ref-NeRF
Open Graph Title: Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fields
X Title: Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fields
Open Graph Description: Neural Radiance Fields (NeRF) is a popular view synthesis technique that represents a scene as a continuous volumetric function, parameterized by multilayer perceptrons that provide the volume density and view-dependent emitted radiance at each location. While NeRF-based techniques excel at representing fine geometric structures with smoothly varying view-dependent appearance, they often fail to accurately capture and reproduce the appearance of glossy surfaces. We address this limitation by introducing Ref-NeRF, which replaces NeRF's parameterization of view-dependent outgoing radiance with a representation of reflected radiance and structures this function using a collection of spatially-varying scene properties. We show that together with a regularizer on normal vectors, our model significantly improves the realism and accuracy of specular reflections. Furthermore, we show that our model's internal representation of outgoing radiance is interpretable and useful for scene editing.
X Description: Neural Radiance Fields (NeRF) is a popular view synthesis technique that represents a scene as a continuous volumetric function, parameterized by multilayer perceptrons that provide the volume density and view-dependent emitted radiance at each location. While NeRF-based techniques excel at representing fine geometric structures with smoothly varying view-dependent appearance, they often fail to accurately capture and reproduce the appearance of glossy surfaces. We address this limitation by introducing Ref-NeRF, which replaces NeRF's parameterization of view-dependent outgoing radiance with a representation of reflected radiance and structures this function using a collection of spatially-varying scene properties. We show that together with a regularizer on normal vectors, our model significantly improves the realism and accuracy of specular reflections. Furthermore, we show that our model's internal representation of outgoing radiance is interpretable and useful for scene editing.
Opengraph URL: https://dorverbin.github.io/refnerf
Domain: dorverbin.github.io
| None | ie=edge |
| og:image | https://dorverbin.github.io/refnerf/img/refnerf_titlecard.jpg |
| og:image:type | image/png |
| og:image:width | 1200 |
| og:image:height | 630 |
| og:type | website |
| twitter:card | summary_large_image |
| twitter:image | https://dorverbin.github.io/refnerf/img/refnerf_titlecard.jpg |
Links:
| Dor Verbin | https://scholar.harvard.edu/dorverbin/home |
| Peter Hedman | https://phogzone.com/ |
| Ben Mildenhall | http://bmild.github.io/ |
| Todd Zickler | http://www.eecs.harvard.edu/~zickler/Main/HomePage |
| Jonathan T. Barron | https://jonbarron.info/ |
| Pratul P. Srinivasan | https://pratulsrinivasan.github.io/ |
| Paper | https://arxiv.org/abs/2112.03907 |
| Video | https://youtu.be/qrdRH9irAlk |
| Shiny Dataset | https://storage.googleapis.com/gresearch/refraw360/ref.zip |
| Shiny Dataset Source | https://dorverbin.github.io/refnerf/data/shiny_blender_source.zip |
| Real Dataset | https://storage.googleapis.com/gresearch/refraw360/ref_real.zip |
| Code | https://github.com/google-research/multinerf |
| http://iaifi.org | http://iaifi.org |
| Michaël Gharbi | http://mgharbi.com/ |
Viewport: width=device-width, initial-scale=1