Avoid expensive electronic dumping grounds by auto-tagging content
Auto-Tagging, Search and Image Synthesis - IPTC...IDS London Auto-Tagging,Search and Image Synthesis...
Transcript of Auto-Tagging, Search and Image Synthesis - IPTC...IDS London Auto-Tagging,Search and Image Synthesis...
![Page 1: Auto-Tagging, Search and Image Synthesis - IPTC...IDS London Auto-Tagging,Search and Image Synthesis - Mayank Sagar In brief –Auto-tagging or keywording –Search with computer vision](https://reader033.fdocuments.us/reader033/viewer/2022060216/5f06101a7e708231d4161abd/html5/thumbnails/1.jpg)
IDS London
Auto-Tagging, Search and Image Synthesis
- Mayank Sagar
![Page 2: Auto-Tagging, Search and Image Synthesis - IPTC...IDS London Auto-Tagging,Search and Image Synthesis - Mayank Sagar In brief –Auto-tagging or keywording –Search with computer vision](https://reader033.fdocuments.us/reader033/viewer/2022060216/5f06101a7e708231d4161abd/html5/thumbnails/2.jpg)
In brief
– Auto-tagging or keywording
– Search with computer vision
– Semantic Labelling
– Object Detection and Analysis
– IDS AutoColourise and Style Transfer
– the future with Image synthesis
IDS London
![Page 3: Auto-Tagging, Search and Image Synthesis - IPTC...IDS London Auto-Tagging,Search and Image Synthesis - Mayank Sagar In brief –Auto-tagging or keywording –Search with computer vision](https://reader033.fdocuments.us/reader033/viewer/2022060216/5f06101a7e708231d4161abd/html5/thumbnails/3.jpg)
• A brief history of search
– Build an index
– Add content
• Finding pictures
– Keywording or Tagging
– Too few – images get missed
– Too many words makes keywording meaningless
IDS London
![Page 5: Auto-Tagging, Search and Image Synthesis - IPTC...IDS London Auto-Tagging,Search and Image Synthesis - Mayank Sagar In brief –Auto-tagging or keywording –Search with computer vision](https://reader033.fdocuments.us/reader033/viewer/2022060216/5f06101a7e708231d4161abd/html5/thumbnails/5.jpg)
• Guessing game between researcher & keyworder
• AI driven keywording
IDS London
![Page 7: Auto-Tagging, Search and Image Synthesis - IPTC...IDS London Auto-Tagging,Search and Image Synthesis - Mayank Sagar In brief –Auto-tagging or keywording –Search with computer vision](https://reader033.fdocuments.us/reader033/viewer/2022060216/5f06101a7e708231d4161abd/html5/thumbnails/7.jpg)
• Major players
– Clarifai
– AWS Rekognition
– Imagga
• RESTful APIs with JSON formatting
• Translations
• Variables – confidence score
• Custom training
IDS London
![Page 8: Auto-Tagging, Search and Image Synthesis - IPTC...IDS London Auto-Tagging,Search and Image Synthesis - Mayank Sagar In brief –Auto-tagging or keywording –Search with computer vision](https://reader033.fdocuments.us/reader033/viewer/2022060216/5f06101a7e708231d4161abd/html5/thumbnails/8.jpg)
Visual Search
• Use an image to find the same or duplicate image – reverse image search
• Use an image to find similar images
IDS London
![Page 12: Auto-Tagging, Search and Image Synthesis - IPTC...IDS London Auto-Tagging,Search and Image Synthesis - Mayank Sagar In brief –Auto-tagging or keywording –Search with computer vision](https://reader033.fdocuments.us/reader033/viewer/2022060216/5f06101a7e708231d4161abd/html5/thumbnails/12.jpg)
Enter Machine Learning..
• Train a network to identify presence of features of interest within images
• Object detection and Analysis
IDS London
![Page 15: Auto-Tagging, Search and Image Synthesis - IPTC...IDS London Auto-Tagging,Search and Image Synthesis - Mayank Sagar In brief –Auto-tagging or keywording –Search with computer vision](https://reader033.fdocuments.us/reader033/viewer/2022060216/5f06101a7e708231d4161abd/html5/thumbnails/15.jpg)
Machine Learning
• Train a network to identify presence of features of interest within videos
• Logos
• Objects
IDS London
![Page 17: Auto-Tagging, Search and Image Synthesis - IPTC...IDS London Auto-Tagging,Search and Image Synthesis - Mayank Sagar In brief –Auto-tagging or keywording –Search with computer vision](https://reader033.fdocuments.us/reader033/viewer/2022060216/5f06101a7e708231d4161abd/html5/thumbnails/17.jpg)
• Semantic labelling = What’s in the picture
• Colour histogram matching
IDS London
![Page 18: Auto-Tagging, Search and Image Synthesis - IPTC...IDS London Auto-Tagging,Search and Image Synthesis - Mayank Sagar In brief –Auto-tagging or keywording –Search with computer vision](https://reader033.fdocuments.us/reader033/viewer/2022060216/5f06101a7e708231d4161abd/html5/thumbnails/18.jpg)
• Semantic labelling = What’s in the picture
• Colour histogram matching = How it looks
IDS London
![Page 31: Auto-Tagging, Search and Image Synthesis - IPTC...IDS London Auto-Tagging,Search and Image Synthesis - Mayank Sagar In brief –Auto-tagging or keywording –Search with computer vision](https://reader033.fdocuments.us/reader033/viewer/2022060216/5f06101a7e708231d4161abd/html5/thumbnails/31.jpg)
Image Synthesis
• GANs – Generative Adversarial Networks
• Making stuff from basic inputs
• Making stuff from nothing
IDS London
![Page 47: Auto-Tagging, Search and Image Synthesis - IPTC...IDS London Auto-Tagging,Search and Image Synthesis - Mayank Sagar In brief –Auto-tagging or keywording –Search with computer vision](https://reader033.fdocuments.us/reader033/viewer/2022060216/5f06101a7e708231d4161abd/html5/thumbnails/47.jpg)
IDS AutoTag
religion, art, furniture,
painting, god,
decoration, gold,
church, interior,
sculpture, spirituality,
temple, holy, prayer,
symbol, people, worship, saint, ancient
IDS London