Interactive Virtual Relighting and Remodeling of Real Scenes

Lighting design is often tedious due to the required physical manipulation of real light sources and objects. As an alternative, we present an interactive system to virtually modify the lighting and geometry of scenes with both real and synthetic objects, including mixed real/virtual lighting and shadows. In our method, real scene geometry is first approximately reconstructed from photographs. Additional images are taken from a single viewpoint with a real light in different positions to estimate reflectance. A filtering process is used to compensate for inaccuracies, and per image reflectances are averaged to generate an approximate reflectance image for the given viewpoint, removing shadows in the process. This estimate is used to initialise a global illumination hierarchical radiosity system, representing real-world secondary illumination; the system is optimized for interactive updates. Direct illumination from lights is calculated separately using ray-casting and a table for efficient reuse of data where appro-priate. Our system allows interactive modification of light emission and object positions, all with mixed real/virtual illumination effects. Real objects can also be virtually removed using texture-filling algorithms for reflectance estimation.

Domaines

Synthèse d'image et réalité virtuelle [cs.GR]

Fichier principal

loscos_c_1.pdf (238.84 Ko)

doorAddLight.gif (66.66 Ko)

BothLight.h.gif (33.93 Ko)

Figure2CL0.gif (10.18 Ko)

Figure2CL6.gif (9.54 Ko)

Figure2Merge.gif (78.1 Ko)

Figure2Reflectance0.gif (85.77 Ko)

Figure2Reflectance6.gif (90.55 Ko)

Figure2View0.gif (89.2 Ko)

Figure2View6.gif (90.85 Ko)

Figure4bReprojGamma.h.gif (30.38 Ko)

Figure4c500600800.h.gif (30.65 Ko)

PortableInitial.h.gif (37.28 Ko)

Reproj2.gif (58.6 Ko)

Reproj2.h.gif (44.85 Ko)

TwoLights.gif (31.42 Ko)

TwoLightsVirtual.gif (49.01 Ko)

Virt.gif (31.43 Ko)

VirtualLight.gif (21.21 Ko)

VirtualObjects.gif (49.61 Ko)

boite.h.gif (50 Ko)

doorAddChair.gif (85.23 Ko)

doorRemov.gif (84.33 Ko)

doorReproj.gif (81.46 Ko)

port.h.gif (49.23 Ko)

portrefl.h.gif (49.74 Ko)

remov.gif (57.93 Ko)

Origine	Fichiers produits par l'(les) auteur(s)

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Format	Figure, Image

Team Artis : Connectez-vous pour contacter le contributeur

https://inria.hal.science/inria-00527577

Soumis le : mardi 19 octobre 2010-16:06:14

Dernière modification le : lundi 29 avril 2024-11:16:03

Archivage à long terme le : mardi 18 septembre 2012-13:05:50

Dates et versions

inria-00527577 , version 1 (19-10-2010)

Identifiants

HAL Id : inria-00527577 , version 1
DOI : 10.1007/978-3-7091-6809-7_29

Citer

Céline Loscos, Marie-Claude Frasson, George Drettakis, Bruce Walter, Xavier Granier, et al.. Interactive Virtual Relighting and Remodeling of Real Scenes. 10th Eurographics Workshop on Rendering, Jun 1999, Granada, Spain. pp.329-340, ⟨10.1007/978-3-7091-6809-7_29⟩. ⟨inria-00527577⟩

Exporter

BibTeX XML-TEI Dublin Core DC Terms EndNote DataCite

Collections

UNIV-RENNES1 UGA IMAG CNRS INRIA IRISA INRIA2 UR1-MATH-STIC UR1-UFR-ISTIC UNIV-RENNES UR1-MATH-NUM

349 Consultations

240 Téléchargements