Advanced Topics in Scalable Searching and...
Transcript of Advanced Topics in Scalable Searching and...
![Page 1: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/1.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 1
CSE 6392 Lecture 1 Administration & Introduction
Junzhou Huang, Ph.D.Department of Computer Science and Engineering
Advanced Topics in Scalable
Searching and Optimization
![Page 2: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/2.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 2
Administration
• Course CSE6392– What: Advanced Topics in Scalable Searching and Optimization– When: Friday 4:00 ~ 6:50pm– Where: WH221– Who: Junzhou Huang (Office ERB 650) [email protected]– Office Hour: FRIDAY 1:00 ~ 4:00pm and/or appointments– Webpage: http://ranger.uta.edu/~huang/teaching/CSE6392.htm
(Please check this page regularly)• Lecturer
– PhD in CS from Rutgers, the State University of New Jersey– Research areas: machine learning , data mining, computer vision, medical
imaging, medical informatics• GTA
![Page 3: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/3.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 3
Study materials
• Prerequisites– Algorithm and Data Structures (CSE2320)– Introduction to Computers & Programming (CSE 1310 )– What this really means:
You know at least one programming language.Elementary knowledge of Linear AlgebraElementary knowledge of Data Structure Elementary knowledge of Algorithms
• More (Not Necessary)– Computer Vision– Machine learning– Data Mining– Image Processing
![Page 4: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/4.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 4
Study Materials
• Text book– None Necessary– Cutting-Edge Topics
• Related Textbooks– "The elements of statistical learning : data mining, inference, and prediction,
2nd Edition”, by Hastie, T., Tibshirani, R., Friedman J. Springer, 2009– "Computer Vision -- A modern approach", by David Forsyth and Jean
Ponce, Prentice Hall, 2002– "Fundamentals of Medical Imaging, 2nd Edition“, by Paul Suetens,
Cambridge University Press, 2009.
• Acknowledgments– Material from textbook sites or other class sites– Lots of material available on the web (via google search, wikipedia)– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD
![Page 5: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/5.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 5
Grading
• Distribution– 40% Class Presentation– 30% Slide Preparation – 30% Answering Questions – 100%
• Attention– Attendance though not mandatory, but is HIGHLY encouraged.– No midterm or final exam for this course. – Please read the selected paper and prepare the final presentation as early as
possible– This is research seminar course. Asking questions and discussion are highly
encouraged
![Page 6: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/6.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 6
Optional Assignments
• Paper Selection– You can choose any papers from the paper lists in the class– Please talk to the lecturer if you prefer to select a paper out of the list– The selected paper has to be confirmed by the fist week after spring break
• Project– Assigned in the course website, typically due 1 or 2 weeks before the end of
the semester– MATLAB programming environment. Please write the code by yourself– You can use the toolsets learned in the class.
• Collaboration– You may discuss assignments with others, but must write up them
individually. Please identify collaborators on your report– Failure to comply with this policy is a violation of academic integrity
• Start early !!!
![Page 7: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/7.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 7
Information
• Course Webpage – Check the web page regularly (per week). – Announcements and lecture notes will be posted there.
• Grade Appeal– You may appeal the grade in writing (email) within 3 class days. – Please refer to the UTA Catalog for the detailed guide of grade appeals.
• Drop Policy– The university withdrawal policy will be strictly adhered to.
• Others– Accommodating students with disabilities – Student Support Services– Etc.
![Page 8: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/8.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 8
Questions
![Page 9: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/9.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 9
Course Overview
• What is it? – Advanced Topics in Scalable Searching and Optimization
• Why is a CSE course?!?– Hardware & Software
• Will I really ever use this stuff again?– Important knowledge for a CSE student– You may not become a professional guys in this field but you need know
what it is, which will help you to follow this rapidly changing world.– GOOGLE, FACEBOOK, YOUTUBE, MICROSOFT, KINECT
• How to succeed in this course?– Attend the class and follow the slides– Read the studying materials– Asking questions
![Page 10: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/10.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 10
Why are you in this class?
• Something interesting about you– Why you picked your major? – Job and Market
• Learn background of advanced topics– Sparse learning, data mining, computer vision, image searching, numeric
optimization, statistical learning, etc.
• Learn the problem and techniques– Learn where the problems come from– Learn what the related techniques to solve them
• Prepare for understanding recent innovations– Fast optimization for big data analysis– Image searching, Video Annotation, Prediction, etc– Face detection/tracking/recognition, Facial behavior/Status
![Page 11: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/11.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 11
What is the focus?
Using computational tools to maximize information for knowledge gain
![Page 12: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/12.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 12
What is the goals?
• Automatic understanding of images and video– Computing properties of the 3D world – from visual data
(measurement)– Algorithms and representations to allow a machine to recognize objects,
people, scenes, and activities. (perception and interpretation)– Algorithms to mine, search, and interact with visual data (search and
organization)
![Page 13: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/13.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 13
Measurement
![Page 14: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/14.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 14
Perception and Interpretation
![Page 15: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/15.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 15
Searching and Recognition
![Page 16: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/16.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 16
Searching and Recognition
• A fundamental part of perception– Robots, – Autonomous agents, – intelligent system– For example: Kinect game system
• Organize and give access to visual content– Connect to information– Detect trends and themes– Make prediction and avoid risk
![Page 17: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/17.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 17
Motivation
![Page 18: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/18.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 18
Motivation
![Page 19: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/19.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 19
Motivation
![Page 20: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/20.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 20
Why Scalable Searching and Optimization?
![Page 21: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/21.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 21
Big Data in the Wild
[L. Lazebnik]
![Page 22: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/22.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 22
Big Data in the Wild
[L. Lazebnik]
![Page 23: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/23.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 23
How machine detect objects?
![Page 24: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/24.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 24
Mobile Computing
http://www.cs.utexas.edu/~grauman/
![Page 25: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/25.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 25
Searching in Shopping
http://www.cs.utexas.edu/~grauman/
![Page 26: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/26.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 26
Exploring community photo collections
http://www.cs.utexas.edu/~grauman/
![Page 27: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/27.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 27
Pattern Discovery
http://www.cs.utexas.edu/~grauman/
![Page 28: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/28.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 28
Why Challenge?
![Page 29: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/29.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 29
Motivation: Scalable Searching
4m50 Thousand Images
![Page 30: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/30.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 30
Motivation: Scalable Searching
![Page 31: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/31.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 31
Motivation: Scalable Searching
![Page 32: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/32.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 32
Motivation: Scalable Searching 10 Billion Images?
![Page 33: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/33.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 33
Scalable Searching and Optimization
10 Billion Images in 1 Seconds
![Page 34: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/34.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 34
• Data Complexity– Billions of images indexed by Google Image Search – Millions of videos every day– Thousands to millions of pixels in an image– 3,000-30,000 human recognizable object categories– 30+ degrees of freedom in the pose of articulated objects (humans)– 18 billion+ prints produced from digital camera images in 2004– 295.5 million camera phones sold in 2005– About half of the cerebral cortex in primates is devoted to processing
visual information [Felleman and van Essen 1991]• Computational Complexity
– How to search interested data in a blink?
Summary of Challenges
http://www.cs.utexas.edu/~grauman/
![Page 35: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/35.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 35
What We have?
![Page 36: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/36.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 36
• Text-based multimedia search– File IDs, Keywords, Captions
Text based Searching
![Page 37: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/37.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 37
Searching and Recognition
![Page 38: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/38.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 38
Searching and Recognition
![Page 39: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/39.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 39
Searching and Recognition
![Page 40: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/40.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 40
Searching and Recognition
![Page 41: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/41.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 41
Course Goals
• Teaching Goals– Introduction to the mathematical, statistic and computational principles
underlying modern searching, imaging, learning and vision systems.– Fundamentals of imaging and learning techniques as well as more general
concepts required for them– Popular techniques in image search and retrieval for fast query,
localization and analysis of image and video data, as well as applications of searching and learning to image-guided intervention and healthcare.
– Application-driven and includes newly emerged topics in imaging, learning and vision.
– Selected hot topics relating to the emerging random theory and sparse learning techniques.
![Page 42: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/42.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 42
Course Expectation
• What to expect from the course:– Will cover key issues and concepts in class..– A mid-term exam and a final exam (None)– Paper Reading
• What do I expect of you:– Come to class– Read the papers (Listening to me is not good enough)– Work through the problems in the papers (not really homework… but it
helps) – Ask questions (IMPORTANT)
![Page 43: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/43.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 43
What will you get out of the course?
• Basic Elements of algebra– Vector, matrix, norm, least square, PCA
• Basic Elements of Vision– Feature extraction, image transformation– Segmentation, registration, detection and tracking
• Basic Elements of Learning– Regression, Classification, Pattern Recognition– Prediction and diagnosis
• Basic Elements of Optimization– Performance vs cost tradeoffs– Gradient descent, proximal gradient, newton, et al.
![Page 44: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/44.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 44
How to read and review research papers?
• Brief (2-3 sentences) summary
• Main contribution
• Strengths? Weaknesses?
• How convincing are the experiments?
• Suggestions to improve them?
• Extensions?
• Additional comments, unclear points
• Relationships between different papers
http://www.cs.utexas.edu/~grauman/
![Page 45: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/45.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 45
Presentation Guide
• Procedure– Read the selected papers that you are interested in– Prepare for a well talk about 30 minutes
• What should be included– Problem overview, motivation, background– Algorithm explanation, technical details– What kinds of experiment conducted?– Any similarity and dissimilarity between techniques in the papers– Weakness, why? Strong, why?– Any possible extension
![Page 46: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/46.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 46
Quick Tour
![Page 47: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/47.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 47
Scalable Search and Recognition via Vocabulary Tree
http://vis.uky.edu/~stewe/
![Page 48: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/48.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 48
Adding, Querying and Removing Images
Add Remove
Query
![Page 49: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/49.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 49
Training and Addition are Separate
Common Approach Scalable approach
![Page 50: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/50.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 50
![Page 51: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/51.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 51
![Page 52: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/52.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 52
![Page 53: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/53.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 53
![Page 54: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/54.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 54
![Page 55: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/55.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 55
![Page 56: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/56.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 56
![Page 57: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/57.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 57
![Page 58: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/58.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 58
![Page 59: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/59.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 59
![Page 60: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/60.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 60
![Page 61: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/61.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 61
![Page 62: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/62.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 62
![Page 63: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/63.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 63
![Page 64: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/64.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 64
![Page 65: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/65.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 65
![Page 66: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/66.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 66
![Page 67: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/67.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 67
![Page 68: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/68.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 68
![Page 69: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/69.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 69
![Page 70: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/70.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 70
![Page 71: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/71.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 71
![Page 72: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/72.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 72
![Page 73: Advanced Topics in Scalable Searching and Optimizationranger.uta.edu/~huang/teaching/CSE6392/CSE6392_Lecture1.pdf– Papers from proceedings of CVPR, ICCV, ICML, NIPS, KDD UT Arlington](https://reader036.fdocuments.us/reader036/viewer/2022071405/60fb040da380a32f044be9dd/html5/thumbnails/73.jpg)
UT Arlington CSE 6392 Advanced Topics in Scalable Searching and Optimization 73
Performance