Applications of Light fields in Computer vision Week 1
description
Transcript of Applications of Light fields in Computer vision Week 1
![Page 1: Applications of Light fields in Computer vision Week 1](https://reader036.fdocuments.us/reader036/viewer/2022062322/56814bd9550346895db8b36f/html5/thumbnails/1.jpg)
APPLICATIONS OF LIGHT
FIELDS IN COMPUTER VISIONWEEK 1
REU STUDENT: AMARI LEWIS
P.H.D STUDENT: AIDEAN SHARGHI
![Page 2: Applications of Light fields in Computer vision Week 1](https://reader036.fdocuments.us/reader036/viewer/2022062322/56814bd9550346895db8b36f/html5/thumbnails/2.jpg)
APPLICATIONS OF LIGHT FIELDS IN COMPUTER VISION
•THE GOALS OF THIS PROJECT IS TO EXAMINE :a) OBJECT RECOGNITION
b) OCCLUSION DETECTION
c) 3D RECONSTRUCTION OF A SCENE
![Page 3: Applications of Light fields in Computer vision Week 1](https://reader036.fdocuments.us/reader036/viewer/2022062322/56814bd9550346895db8b36f/html5/thumbnails/3.jpg)
WHAT IS OBJECT RECOGNITION?• GIVEN TEST IMAGE, WE WANT TO DETERMINE WHAT THE IMAGE IS.
• STEPS FOR CONVENTIONAL OBJECT RECOGNITION:
• COLLECT DATASET
• DIVIDE INTO POSITIVE/ NEGATIVE DATA
• EXTRACT FEATURES (EX: SIFT..)
• TRAIN A CLASSIFIER FOR EXTRACTED FEATURES
• GIVEN A TEST IMAGE: EXTRACT THE FEATURES
• USE THE CLASSIFIER TO DETERMINE WHICH OBJECT IT IS
![Page 4: Applications of Light fields in Computer vision Week 1](https://reader036.fdocuments.us/reader036/viewer/2022062322/56814bd9550346895db8b36f/html5/thumbnails/4.jpg)
THE PROBLEM
• CONVENTIONAL METHODS USE 2D INFORMATION OF THE OBJECTS FOR DETECTION.
• EXAMPLE: A BOTTLE AND A PICTURE OF A BOTTLE ON A PIECE OF PAPER.
![Page 5: Applications of Light fields in Computer vision Week 1](https://reader036.fdocuments.us/reader036/viewer/2022062322/56814bd9550346895db8b36f/html5/thumbnails/5.jpg)
LYTRO LIGHT FIELD CAMERA
• USING THE LYTRO CAMERA WE ARE ABLE TO INCLUDE 3D INFORMATION WITH ONE SINGLE SHOT.
• THE CAMERA MANAGES TO CAPTURE ALL THE LIGHT FIELD DIRECTION, INTENSITY AND COLOR.
![Page 6: Applications of Light fields in Computer vision Week 1](https://reader036.fdocuments.us/reader036/viewer/2022062322/56814bd9550346895db8b36f/html5/thumbnails/6.jpg)
LIGHT FIELD CAMERAHOW IT WORKS…
![Page 7: Applications of Light fields in Computer vision Week 1](https://reader036.fdocuments.us/reader036/viewer/2022062322/56814bd9550346895db8b36f/html5/thumbnails/7.jpg)
STEREO
\.
• The conventional way of capturing 3d information is using stereo • Finding the correspondents
is difficult• However finding the
correspondents can be avoided…
![Page 8: Applications of Light fields in Computer vision Week 1](https://reader036.fdocuments.us/reader036/viewer/2022062322/56814bd9550346895db8b36f/html5/thumbnails/8.jpg)
EPI
• EPIPOLAR PLANE IMAGES
• CAN BE USED TO REPRESENT 3D INFORMATION OF THE OBJECT
• THIS PROJECT/RESEARCH IS BASED ON USING EPI TO DESCRIBE THE OBJECTS AND INCREASE THE OBJECT RECOGNITION ACCURACY
![Page 9: Applications of Light fields in Computer vision Week 1](https://reader036.fdocuments.us/reader036/viewer/2022062322/56814bd9550346895db8b36f/html5/thumbnails/9.jpg)
![Page 10: Applications of Light fields in Computer vision Week 1](https://reader036.fdocuments.us/reader036/viewer/2022062322/56814bd9550346895db8b36f/html5/thumbnails/10.jpg)
STEPS: i. CHOOSE 5 CATEGORIES FOR CLASSIFICATION
ii. COLLECT DATASET USING THE LIGHT FIELD CAMERA
iii.EXTRACT THE PHOTOS, USING THE LYTRO SOFTWARE
![Page 11: Applications of Light fields in Computer vision Week 1](https://reader036.fdocuments.us/reader036/viewer/2022062322/56814bd9550346895db8b36f/html5/thumbnails/11.jpg)
i. 5 CATEGORIES FOR DATASET USING LIGHT FIELD CAMERA
1.BICYCLES
2.BUS
3.TREES/FLOWERS
4.BUILDINGS
5.TRUCKS
![Page 12: Applications of Light fields in Computer vision Week 1](https://reader036.fdocuments.us/reader036/viewer/2022062322/56814bd9550346895db8b36f/html5/thumbnails/12.jpg)
II. COLLECT DATASET USING THE LIGHT FIELD CAMERA
Tree
![Page 13: Applications of Light fields in Computer vision Week 1](https://reader036.fdocuments.us/reader036/viewer/2022062322/56814bd9550346895db8b36f/html5/thumbnails/13.jpg)
III. REFOCUS THE IMAGE TO THE SPECIFIC OBJECTbicycles
![Page 14: Applications of Light fields in Computer vision Week 1](https://reader036.fdocuments.us/reader036/viewer/2022062322/56814bd9550346895db8b36f/html5/thumbnails/14.jpg)
![Page 15: Applications of Light fields in Computer vision Week 1](https://reader036.fdocuments.us/reader036/viewer/2022062322/56814bd9550346895db8b36f/html5/thumbnails/15.jpg)
ASSIGNMENT • THERE HAS BEEN A SIMILAR STUDY TO IMPROVE OBJECT RECOGNITION AND
TRACKING
• SCALE-INVARIANT REPRESENTATION OF LIGHT FIELD IMAGES FOR OBJECT RECOGNITION AND TRACKING
• ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE (SWITZERLAND)
![Page 16: Applications of Light fields in Computer vision Week 1](https://reader036.fdocuments.us/reader036/viewer/2022062322/56814bd9550346895db8b36f/html5/thumbnails/16.jpg)
REFERENCES
• NG, REN (2006). DIGITAL LIGHT FIELD PHOTOGRAPHY (DOCTORAL DISSERTATION).
STANFORD UNIVERSITY, STANFORD, CALIFORNIA.
![Page 17: Applications of Light fields in Computer vision Week 1](https://reader036.fdocuments.us/reader036/viewer/2022062322/56814bd9550346895db8b36f/html5/thumbnails/17.jpg)
THANK YOU !!