Full Body Scanning by Daniel Evora. Calibration Left & Right.
-
Upload
philomena-norton -
Category
Documents
-
view
229 -
download
0
Transcript of Full Body Scanning by Daniel Evora. Calibration Left & Right.
![Page 1: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/1.jpg)
Full Body Scanning by Daniel Evora
![Page 2: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/2.jpg)
Calibration
![Page 3: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/3.jpg)
Left & Right
![Page 4: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/4.jpg)
Mesh
101158 triangles
![Page 5: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/5.jpg)
3D RECONSTRUCTION USING STRUCTURED LIGHT by Stefanie Handojo
COMPSCI 117
PROJECT IN COMPUTER VISION
STEFANIE HANDOJO
![Page 6: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/6.jpg)
Extracting 2D Points from the images
Decode Construct the 3D Points
Triangulation
![Page 7: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/7.jpg)
Create Mesh Getting Rid of Long edges / Far away Neighbors
Filling Holes and Mesh Smoothing
![Page 8: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/8.jpg)
Mesh Alignment Combining Meshes into Final Model Poisson Surface Reconstruction Software
![Page 9: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/9.jpg)
Josh Tutwiler
• Goal: to construct a 3-D model of a bowling pin from 2-D images.
![Page 10: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/10.jpg)
Smooth the Mesh
• nbr_smooth– Move each point to the mean of its neighbors
![Page 11: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/11.jpg)
Meshes
![Page 12: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/12.jpg)
![Page 13: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/13.jpg)
![Page 14: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/14.jpg)
Computer Vision Default Project by Patrick Flynn
Original Image
![Page 15: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/15.jpg)
Computer Vision Default Project
Image Scans – 3 viewpoints
![Page 16: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/16.jpg)
Computer Vision Default Project
Manually Cleaned Up
![Page 17: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/17.jpg)
Computer Vision Default Project
Aligned with my ICP (lsqnonlin)
![Page 18: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/18.jpg)
Default Project by Phong VuongRight
Left
![Page 19: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/19.jpg)
Mesh Cleaning
![Page 20: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/20.jpg)
Mesh Alignment
![Page 21: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/21.jpg)
Poisson Surface Reconstruction
![Page 22: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/22.jpg)
Default Project by Roula Lagaditis
Chosen Object: Bender-bot
Using structured light, recovered front, back, right and left
![Page 23: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/23.jpg)
Default Project
Chosen Object: Bender-bot
Mesh Aligning - Front and Back scanned images, using “rigid-alignment”
![Page 24: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/24.jpg)
Default Project
Chosen Object: Bender-botFinal recovered shape
![Page 25: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/25.jpg)
CS117 Final ProjectDanny Miller
3 objects
~ 7 scans per object
~ 2 GB of pictures
Idea – adding a green backdrop could make it easy to filter out the background
Green tablecloth from Party City - 79¢
![Page 26: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/26.jpg)
![Page 27: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/27.jpg)
Green Removal
• Created a windows program in C# to remove the green from pictures.
![Page 28: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/28.jpg)
Problems - Reflectivity
![Page 29: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/29.jpg)
Scans
• 5 stage scanning process– Auto-Pruning
• Several passes
– User Pruning• 3 views in 2d• 30 views in 2d
– Smoothing• Several passes
– Normals– Colors
![Page 30: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/30.jpg)
Alignment
• Using the linear algebra approach
![Page 31: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/31.jpg)
Color?
![Page 32: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/32.jpg)
Mesh Creation
![Page 33: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/33.jpg)
![Page 34: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/34.jpg)
Object Centric Photo BrowsingTony Tran
Input
![Page 35: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/35.jpg)
Part3: Estimating relationship between images.Image i’s sift points Image j’s.sift points
Input:
Find Correspondences(matches)
Compute Essential matrixand remove outlier matches RANSAC
E
Remove incoherent matchesbased on a triangulation heuristic
Remove bad matchesWith triangulation heuristic
![Page 36: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/36.jpg)
CS 117 Project: Motion CaptureBy Blake Atkinson
• Materials• 5 different colored sets of
appx. 3v LEDs
• Electrical tape
• Glove
• 9v Batteries
• Red and Black Wire
• More patience than you have
![Page 37: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/37.jpg)
Since the epipolar lines are calculated using the Fundamental Matrix, which is calculated from your initial SIFT points, they too should land on the epipolar lines. If not you’ve done something wrong. Here we have the SIFT points (red & yellow) and the corresponding epipolar lines (blue) based on those points. The left image gets it’s epipolar equations from the right points, and vice versa.
Epipolar Geometry by Nick Schiffelbein
![Page 38: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/38.jpg)
Automating Camera CalibrationSam Hallman
But how do you solve for a matrix??
![Page 39: Full Body Scanning by Daniel Evora. Calibration Left & Right.](https://reader035.fdocuments.us/reader035/viewer/2022081503/56649e685503460f94b65480/html5/thumbnails/39.jpg)
Try #2 with the MK symbol