LuxRemix: Lighting Decomposition and Remixing for Indoor Scenes

Ruofan Liang1,2 Norman Müller1 Ethan Weber1 Duncan Zauss1
Nandita Vijaykumar2,* Peter Kontschieder1,* Christian Richardt1,*
1Meta Reality Labs 2University of Toronto
* Joint advising
preprint
Paper arXiv BibTeX

Hover over the images to see the animations.

LuxRemix Teaser 1 LuxRemix Teaser 3
LuxRemix Teaser 2 LuxRemix Teaser 4

LuxRemix enables interactive light editing of indoor scenes. Our method decomposes complex scene lighting into one-light-at-a-time (OLAT) sources and ambient lighting, which can be remixed for relighting effects. In the top right, we apply our method to single images, where we can change lights and their colors. LuxRemix also enables multi-view-consistent harmonization of the decomposed lighting across multi-view images. By combining these capabilities, we enable real-time relighting of indoor scenes using 3D Gaussian splatting.

Abstract

We present a novel approach for interactive light editing in indoor scenes from a single multi-view scene capture. Our method leverages a generative image-based light decomposition model that factorizes complex indoor scene illumination into its constituent light sources. This factorization enables independent manipulation of individual light sources, specifically allowing control over their state (on/off), chromaticity, and intensity. We further introduce multi-view lighting harmonization to ensure consistent propagation of the lighting decomposition across all scene views. This is integrated into a relightable 3D Gaussian splatting representation, providing real-time interactive control over the individual light sources. Our results demonstrate highly photorealistic lighting decomposition and relighting outcomes across diverse indoor scenes. We evaluate our method on both synthetic and real-world datasets and provide a quantitative and qualitative comparison to state-of-the-art techniques.

Method Overview

LuxRemix Pipeline

Given a multi-view capture of an indoor scene, we apply our single-image lighting decomposition model to generate one-light-at-a-time (OLAT) decompositions. We propagate these decompositions across all views using multi-view lighting harmonization with geometric constraints. Repeating this for each light source yields a complete multi-view OLAT dataset. We train a relightable 3D Gaussian splatting representation on these decompositions, enabling real-time interactive control over each light from any viewpoint.

Single-Image Lighting Decomposition

Our method decomposes complex scene lighting into individually controllable light sources from a single image.

Multi-View Lighting Harmonization

We consistently propagate lighting decompositions across all scene views using multi-view lighting harmonization.

Real-time Remixable Lighting

Our relightable 3D Gaussian splatting representation enables real-time interactive manipulation of individual light sources.

Interactive Lighting Blend Explorer

Use the controls below to interactively remix the lighting of various scenes. You can adjust the intensity and color of individual light sources, change the ambient light, and download your result.

Fine-grained Control Panel

Input
Input
Relighted Blend
Masks
Loading assets...

BibTeX

@unpublished{liang2026luxremix,
  title  = {{LuxRemix}: Lighting Decomposition and Remixing for Indoor Scenes},
  author = {Ruofan Liang and Normal M{\"u}ller and Ethan Weber and Duncan Zauss and
            Nandita Vijaykumar and Peter Kontschieder and Christian Richardt},
  note   = {arXiv},
  year   = {2026},
}