SIGGRAPH 2000 Course #19 - 3D July 24, 2000 Photography Modeling and Rendering Architecture Modeling and Rendering Architecture from Photographs from Photographs Paul Debevec Paul Debevec University of Southern California University of Southern California Institute for Creative Technologies Institute for Creative Technologies SIGGRAPH 2000 Course #19, 3D Photography SIGGRAPH 2000 Course #19, 3D Photography Brian Curless and Steve Seitz, organizers Brian Curless and Steve Seitz, organizers July 24, 2000 July 24, 2000 ZZZ�GHEHYHF�RUJ ZZZ�GHEHYHF�RUJ Paul Debevec - "Modeling and Rendering Architecture from Photographs" - www.debevec.org 4-1
SIGGRAPH 2000 Course #19 - 3D July 24, 2000 Photography The Chevette Project The Chevette Project The Chevette Project 1991 Stereo Stereo Image Image Pair Pair Stereo Image Capture Stereo Image Capture Depth Depth Rig Rig Map Map Immersion ‘94 Immersion ‘94 Michael Naimark Naimark Michael John Woodfill Woodfill John Synthetic Synthetic Paul Debevec Paul Debevec Views Views Leo Villareal Leo Villareal Ramin Zabih Ramin Zabih Interval Research Interval Research Corporation Corporation Ramin Zabih and John Woodfill. Non-parametric local transforms for determining visual correspondence. ECCV, May 1994. Paul Debevec - "Modeling and Rendering Architecture from Photographs" - www.debevec.org 4-2
SIGGRAPH 2000 Course #19 - 3D July 24, 2000 Photography Modeling and Rendering Architecure from Photographs Modeling and Rendering Architecure from Photographs (Debevec, Taylor, and Malik 1996) (Debevec, Taylor, and Malik 1996) Block Model Block Model User User- -Marked Edges Marked Edges Recovered Model Recovered Model Façade Debevec, Taylor, and Malik SIGGRAPH 96 Paul Debevec - "Modeling and Rendering Architecture from Photographs" - www.debevec.org 4-3
SIGGRAPH 2000 Course #19 - 3D July 24, 2000 Photography Façade Blocks Façade Blocks Parameterized Block Parameterized Block Parameter Parameter References References Paul Debevec - "Modeling and Rendering Architecture from Photographs" - www.debevec.org 4-4
SIGGRAPH 2000 Course #19 - 3D July 24, 2000 Photography Model Model Hierarchy Hierarchy Relation can be: Relation can be: * Arbitrary 6 DOF * Arbitrary 6 DOF * Fixed Rotation * Fixed Rotation * Fixed Translation * Fixed Translation * Geometric Relationship * Geometric Relationship Reconstruction Algorithm Reconstruction Algorithm An objective function O measures the An objective function O measures the misalignment between the marked edges misalignment between the marked edges and the corresponding projected edges of and the corresponding projected edges of the model the model O is minimized with respect to the model O is minimized with respect to the model parameters and camera positions parameters and camera positions An initial estimate is obtained by a separate An initial estimate is obtained by a separate procedure procedure Paul Debevec - "Modeling and Rendering Architecture from Photographs" - www.debevec.org 4-5
SIGGRAPH 2000 Course #19 - 3D July 24, 2000 Photography Completed Completed Reconstruction Reconstruction and Reprojection and Reprojection Marked Edge Marked Edge Projected Model Model Edge Model Edge Error Area Error Area Algorithm with Initial Estimate Procedure Algorithm with Initial Estimate Procedure 1. Solve for camera rotations, independently, 1. Solve for camera rotations, independently, based on edge orientations based on edge orientations 2. Hold camea rotations fixed; solve for other 2. Hold camea rotations fixed; solve for other parameters (often linear) parameters (often linear) 3. Perform full non-linear optimization, 3. Perform full non-linear optimization, starting from near the solution starting from near the solution Paul Debevec - "Modeling and Rendering Architecture from Photographs" - www.debevec.org 4-6
SIGGRAPH 2000 Course #19 - 3D July 24, 2000 Photography Video Video Photogrammetric Modeling Summary Modeling with blocks works works because: because: Modeling with blocks Convenient for architecture Convenient for architecture Recovers Complete Models Recovers Complete Models Reduces number of model parameters, e.g. Reduces number of model parameters, e.g. Campanile model has: Campanile model has: 2,896 parameters as independent edges 2,896 parameters as independent edges 240 parameters as independent blocks 240 parameters as independent blocks 33 parameters as constrained blocks 33 parameters as constrained blocks • → Few marked features required • → Few marked features required • → Easier to solve • → Easier to solve Paul Debevec - "Modeling and Rendering Architecture from Photographs" - www.debevec.org 4-7
SIGGRAPH 2000 Course #19 - 3D July 24, 2000 Photography Surfaces of Revolution Surfaces of Revolution Synthetic View Synthetic View Photograph Photograph Recovered Model Recovered Model Arches and Arches and Surfaces of Revolution Surfaces of Revolution Taj Mahal Taj Mahal modeled from modeled from one photograph one photograph Paul Debevec - "Modeling and Rendering Architecture from Photographs" - www.debevec.org 4-8
SIGGRAPH 2000 Course #19 - 3D July 24, 2000 Photography Rendering with Projective Texture Mapping Rendering with Projective Texture Mapping Rendering with View-Dependent Rendering with View-Dependent Texture Mapping Texture Mapping To render, determine to which To render, determine to which triangle the viewpoint triangle the viewpoint 2 5 2 5 belongs belongs Compute Barycentric weights Compute Barycentric weights 1 1 for the triangle vertices for the triangle vertices Render the polygon with a Render the polygon with a 4 4 weighted average of the weighted average of the three vertex images three vertex images 3 3 Debevec, Borshukov, and Yu. Eurographics Rendering Workshop 1998. Debevec, Borshukov, and Yu. Eurographics Rendering Workshop 1998. Paul Debevec - "Modeling and Rendering Architecture from Photographs" - www.debevec.org 4-9
SIGGRAPH 2000 Course #19 - 3D July 24, 2000 Photography View-Dependent Texture Mapping View-Dependent Texture Mapping View View- -Dependent Weighting Dependent Weighting Function Function Image-Based Modeling, Rendering, Image-Based Modeling, Rendering, and Lighting and Lighting SIGGRAPH 2000 Course #35 SIGGRAPH 2000 Course #35 SIGGRAPH 2000 Course #35 Tuesday, July 25, 2000 Tuesday, July 25, 2000 Tuesday, July 25, 2000 Room 243- -245, Ernest N. 245, Ernest N. Morial Morial Convention Center Convention Center Room 243 Room 243-245, Ernest N. Morial Convention Center 8:30am 8:30am - - 5:00pm 5:00pm 8:30am - 5:00pm Paul Debevec Paul Debevec Michael Cohen Michael Cohen Michael Cohen UC Berkeley UC Berkeley Microsoft Research Microsoft Research Microsoft Research Leonard McMillan Chris Bregler Bregler Leonard McMillan Chris Chris Bregler MIT MIT Stanford University Stanford University Stanford University Richard Szeliski Szeliski François Sillion Sillion Richard Richard Szeliski François François Sillion Microsoft Research Microsoft Research iMAGIS - GRAVIR/IMAG iMAGIS - GRAVIR/IMAG Microsoft Research Paul Debevec - "Modeling and Rendering Architecture from Photographs" - www.debevec.org 4-10
SIGGRAPH 2000 Course #19 - 3D July 24, 2000 Photography Scene with Geometric Detail Scene with Geometric Detail Model-Based Model-Based Stereo Stereo Approximate Block Model Approximate Block Model Model-Based Stereo Given a key and an offset image, Given a key and an offset image, • Project the offset image onto the model • Project the offset image onto the model • View the model through the key camera • View the model through the key camera → Warped offset image → Warped offset image Stereo becomes feasible between key and Stereo becomes feasible between key and warped offset images because: warped offset images because: • Disparities are small • Disparities are small • Foreshortening is greatly reduced • Foreshortening is greatly reduced Paul Debevec - "Modeling and Rendering Architecture from Photographs" - www.debevec.org 4-11
SIGGRAPH 2000 Course #19 - 3D July 24, 2000 Photography Key Image Key Image Warped Offset Image Warped Offset Image Offset Image Offset Image Disparity Map Disparity Map Synthetic Views Synthetic Views of Refined Model of Refined Model Four images composited with Four images composited with Model-Based Stereo and Model-Based Stereo and VDTM VDTM Paul Debevec - "Modeling and Rendering Architecture from Photographs" - www.debevec.org 4-12
SIGGRAPH 2000 Course #19 - 3D July 24, 2000 Photography Application: Rouen Revisited Application: Rouen Revisited (Golan Levin and Paul Debevec) (Golan Levin and Paul Debevec) www.debevec.org/Rouen www.debevec.org/Rouen Synthetic View: Synthetic View: Synthetic View: Synthetic View: Synthetic View: Synthetic View: 1996 1996 1896 1896 Monet Painting Monet Painting ( (Uncalibrated Uncalibrated Views) Views) Video Video Paul Debevec - "Modeling and Rendering Architecture from Photographs" - www.debevec.org 4-13
Recommend
More recommend
