René's URL Explorer Experiment


Title: DiffusionLight: Light Probes for Free by Painting a Chrome Ball

Open Graph Title: DiffusionLight: Light Probes for Free by Painting a Chrome Ball

Description: We present a simple yet effective technique to estimate lighting in a single input image. Our research uncovers a surprising relationship between the appearance of chrome balls and the initial diffusion noise map, which we utilize to consistently generate high-quality chrome balls. We further fine-tune an LDR diffusion model (Stable Diffusion XL) with LoRA, enabling it to perform exposure bracketing for HDR light estimation. Our method produces convincing light estimates across diverse settings and demonstrates superior generalization to in-the-wild scenarios.

Open Graph Description: We present a simple yet effective technique to estimate lighting in a single input image. Our research uncovers a surprising relationship between the appearance of chrome balls and the initial diffusion noise map, which we utilize to consistently generate high-quality chrome balls. We further fine-tune an LDR diffusion model (Stable Diffusion XL) with LoRA, enabling it to perform exposure bracketing for HDR light estimation. Our method produces convincing light estimates across diverse settings and demonstrates superior generalization to in-the-wild scenarios.

Keywords:

Opengraph URL: https://diffusionlight.github.io/

direct link

Domain: diffusionlight.github.io

og:typearticle
og:imagehttps://diffusionlight.github.io/assets/images/in-the-wild/bed_ev-00_seed400.jpg
google-site-verificationvKQD2CjY58aKxMAkgWU1kc7DUQqt2_GChgsbpaQXFJY

Links:

🚀 x60 Faster, Similar Quality → Click to Learn More https://diffusionlight.github.io/turbo
Supasorn Suwajanakornhttps://www.supasorn.com/
Paper https://arxiv.org/abs/2312.09168
Code https://github.com/DiffusionLight/DiffusionLight
Colab notebook https://colab.research.google.com/drive/15pC4qb9mEtRYsW3utXkk-jnaeVxUy-0S?usp=sharing&sandboxMode=true
HuggingFace model card https://huggingface.co/DiffusionLight/DiffusionLight
Score measurement https://vistec-my.sharepoint.com/:f:/g/personal/pakkapon_p_s19_vistec_ac_th/EvBHbnLrVnZArhQTcboh6qkBGcSqUqzdgx13iZ2IsLPzOw?e=D9lSPq
Unsplash.com.https://unsplash.com/
More resultshttps://diffusionlight.github.io/in-the-wild.html
Poly Haven Rendering of 3 spheres in indoor & outdoor scenes https://diffusionlight.github.io/compare.html?dataset=polyhaven
Laval Indoor Rendering of 3 spheres in indoor scenes https://diffusionlight.github.io/compare.html?dataset=indoor
Array of Spheres Rendering of spheres on a plane in indoor scenes https://diffusionlight.github.io/compare.html?dataset=array_of_spheres
DiFaReli: Diffusion Face Relighting ICCV 2023 https://diffusion-face-relighting.github.io/
Zero-guidance Segmentation Using Zero Segment Labels ICCV 2023 https://zero-guide-seg.github.io/
Learning Geometric-aware Properties in 2D Representation Using Lightweight CAD Models, or Zero Real 3D Pairs CVPR 2023 https://geoaware2drepusingcad.github.io/
StyleGAN Salon: Multi-View Latent Optimization for Pose-Invariant Hairstyle Transfer CVPR 2023 https://stylegan-salon.github.io/
https://vistec.ist/vision
https://vistec.ac.th/

Viewport: width=device-width, initial-scale=1

URLs of crawlers that visited me.