Future with Machine Vision
-
Upload
nazlitemu -
Category
Engineering
-
view
159 -
download
1
Transcript of Future with Machine Vision
![Page 1: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/1.jpg)
Art of the Tech
Future with Machine Vision
Nazli Temur
Computer Vision Engineer @ ATP
![Page 2: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/2.jpg)
#dfist #Devfest17
Outline
Computer Vision Introduction
Teaching Machines Human Perceived World.
Challenges of Visual Perception
Computer Vision through Deep Learning
Conclusion
Demo
![Page 3: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/3.jpg)
#dfist #Devfest17
Computer Vision IntroductionVision
![Page 4: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/4.jpg)
#dfist #Devfest17
![Page 5: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/5.jpg)
#dfist #Devfest17
“Computer Vision” is about
extracting semantic information
through visual perceptions.
![Page 6: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/6.jpg)
#dfist #Devfest17
Domain Examples
![Page 7: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/7.jpg)
#dfist #Devfest17
How did we come here
Orthographic Projection
Perspective Projection
Photography
![Page 8: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/8.jpg)
#dfist #Devfest17
Where we are..
Stereo Projection(Epipolar)
Fisheye Projection
![Page 9: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/9.jpg)
#dfist #Devfest17
Where we go through
We run after an enhanced way of
capturing the visual information
![Page 10: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/10.jpg)
#dfist #Devfest17
Human Machine Interaction
Teaching machines humans’
visual world.
![Page 11: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/11.jpg)
#dfist #Devfest17
Judgements Perceptions+ = Thinking
can explain the past ,
understand the present,
estimate the future
Cause and Effect
[Activities/Happenings] [Visual Information]
Visual Perceptions
-detection/tracking/recognition
Video Activity Recognition
?
![Page 12: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/12.jpg)
#dfist #Devfest17
It is quoted by Professor David Derkins from Harvard University: ‘’up to 90% of errors in thinking are in perception not judgement’’.
When visual information is perceived or processed incorrectly, it cannot be matched or integrated with our other
senses.
![Page 13: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/13.jpg)
#dfist #Devfest17
For a machine which is capable
of thinking like a human, the
ultimate need is ;
Because it combines our visual perception
with our judgements.
“Video Activity Recognition”
![Page 14: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/14.jpg)
14
So, for a machine what is “activity recognition” about?
![Page 15: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/15.jpg)
#dfist #Devfest17
Activity Recognition
![Page 16: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/16.jpg)
#dfist #Devfest17
Activity Recognition
![Page 17: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/17.jpg)
#dfist #Devfest17
For machine easiest way to achieve “activity recognition” is copying
cognitive subprocess underlying our visual perception and judgements
![Page 18: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/18.jpg)
#dfist #Devfest17
Artificial Intelligence
Computer Vision through Deep
Learning
![Page 19: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/19.jpg)
#dfist #Devfest17
What is Deep Learning?
Deep Learning is a subfield of machine learning concerned with
algorithms inspired by the structure and function of the brain called
artificial neural networks.
![Page 20: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/20.jpg)
#dfist #Devfest17
Deep Learning Examples on Art
![Page 21: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/21.jpg)
#dfist #Devfest17
Is the deep learning complete ?
The knowledge about physical properties of the objects can not be gained by perception…
[Kant]
![Page 22: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/22.jpg)
#dfist #Devfest17
Deep Learning Examples on Art
![Page 23: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/23.jpg)
#dfist #Devfest17
So, what do we expect from deep learning (AI) ?
![Page 24: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/24.jpg)
#dfist #Devfest17
![Page 25: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/25.jpg)
#dfist #Devfest17
or by This!
![Page 26: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/26.jpg)
#dfist #Devfest17
or by This!
![Page 27: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/27.jpg)
#dfist #Devfest17
Available Deep Learning
Frameworks - ToolsSoftware Development
![Page 28: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/28.jpg)
#dfist #Devfest17
caffe
theano
torch
tensorflow
mxnet
![Page 29: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/29.jpg)
#dfist #Devfest17
Challenges - Visual PerceptionComputer Vision
![Page 30: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/30.jpg)
#dfist #Devfest17
Calibration
We need to ensure that everybody sees
straight line straight and curvature as curve.
An example with honeybee on mobile robots is here
https://www.ncbi.nlm.nih.gov/pubmed/12009050
![Page 31: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/31.jpg)
12
3
31
Occlusions
Perspective effect
Noise
Detection Challenges
![Page 32: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/32.jpg)
12
3
32
Re-identification
Noise
Real-time Processing
Tracking Challenges
![Page 33: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/33.jpg)
#dfist #Devfest17
Activity Recognition Challenges
Human is a complex & complicated.
Activities are compositional.
Environment is unconstrained.
Context impact the level of detail.
Realtime happenings require high computation
![Page 34: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/34.jpg)
#dfist #Devfest17
Futurism
Concluding with Brave New
Future with Machine Vision
![Page 35: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/35.jpg)
#dfist #Devfest17
Heraclitus said ‘’expect the unexpected’’http://www.mirror.co.uk/news/uk-news/killer-robots-use-facial-recognition-11557764
![Page 36: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/36.jpg)
#dfist #Devfest17
Conclusion
•Machines are getting smarter, mobile and intractable
•We create them to involve our lives , so they will be following our rules.
•If only we design them according to human visual perception and judgements.
• Deep Learning is in-directly associated with human judgement.
•Deep learning can help us better defining activities and knowing about human s
•For a better future we need to convince Computer Scientists and AI Geeks :D
![Page 37: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/37.jpg)
#dfist #Devfest17
Audience
Poll LinkReset
![Page 39: Future with Machine Vision](https://reader031.fdocuments.us/reader031/viewer/2022020301/5a649faa7f8b9a3b568b5073/html5/thumbnails/39.jpg)
Thank you!Questions?Questions?
Twitter: @DahaNlr
Gmail: [email protected]
Linkedin: https://www.linkedin.com/in/nazlitemur/
39