Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca V&L Net workshop on Vision and...
-
Upload
chance-faircloth -
Category
Documents
-
view
217 -
download
2
Transcript of Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca V&L Net workshop on Vision and...
![Page 1: Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca V&L Net workshop on Vision and Language Brighton, September 15 th, 2011 Exploiting Natural-Language.](https://reader036.fdocuments.us/reader036/viewer/2022062511/551bc08c550346b4588b4a4e/html5/thumbnails/1.jpg)
Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca
V&L Net workshop on Vision and LanguageBrighton, September 15th, 2011
Exploiting Natural-Language Interaction in Video Surveillance Systems
![Page 2: Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca V&L Net workshop on Vision and Language Brighton, September 15 th, 2011 Exploiting Natural-Language.](https://reader036.fdocuments.us/reader036/viewer/2022062511/551bc08c550346b4588b4a4e/html5/thumbnails/2.jpg)
2
UNDERSTAND videos with humans … (or actions in images) …to EXPLAIN them in their context (or classify, search…)
ISE Lab: Research Lab on Image Sequence Evaluation
![Page 3: Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca V&L Net workshop on Vision and Language Brighton, September 15 th, 2011 Exploiting Natural-Language.](https://reader036.fdocuments.us/reader036/viewer/2022062511/551bc08c550346b4588b4a4e/html5/thumbnails/3.jpg)
3
• Detection• Segmentation• Agent/body/face tracking• Activity recognition• Scene understanding• Behavior recognition• Video annotation/ retrieval• Augmented reality• NL descriptions
human
horse
ISE Lab: some research we do...
![Page 4: Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca V&L Net workshop on Vision and Language Brighton, September 15 th, 2011 Exploiting Natural-Language.](https://reader036.fdocuments.us/reader036/viewer/2022062511/551bc08c550346b4588b4a4e/html5/thumbnails/4.jpg)
An example: the MIPRCV project
156 : …
203 : Lo vianant surt per la part inferior dreta...
252 : ...
4
![Page 5: Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca V&L Net workshop on Vision and Language Brighton, September 15 th, 2011 Exploiting Natural-Language.](https://reader036.fdocuments.us/reader036/viewer/2022062511/551bc08c550346b4588b4a4e/html5/thumbnails/5.jpg)
5
Control Terminal
3 Dedicated Servers
Giga Ethernet cam
Servolens with integrated Zoom
Pan & Tilt
Network Infrastructure
An example: the MIPRCV demonstrator
![Page 6: Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca V&L Net workshop on Vision and Language Brighton, September 15 th, 2011 Exploiting Natural-Language.](https://reader036.fdocuments.us/reader036/viewer/2022062511/551bc08c550346b4588b4a4e/html5/thumbnails/6.jpg)
6
PTZ control
![Page 7: Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca V&L Net workshop on Vision and Language Brighton, September 15 th, 2011 Exploiting Natural-Language.](https://reader036.fdocuments.us/reader036/viewer/2022062511/551bc08c550346b4588b4a4e/html5/thumbnails/7.jpg)
7
Terminal for Active Video Surveillance
![Page 8: Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca V&L Net workshop on Vision and Language Brighton, September 15 th, 2011 Exploiting Natural-Language.](https://reader036.fdocuments.us/reader036/viewer/2022062511/551bc08c550346b4588b4a4e/html5/thumbnails/8.jpg)
8
Natural Language Understanding
![Page 9: Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca V&L Net workshop on Vision and Language Brighton, September 15 th, 2011 Exploiting Natural-Language.](https://reader036.fdocuments.us/reader036/viewer/2022062511/551bc08c550346b4588b4a4e/html5/thumbnails/9.jpg)
What happened today?
9
![Page 10: Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca V&L Net workshop on Vision and Language Brighton, September 15 th, 2011 Exploiting Natural-Language.](https://reader036.fdocuments.us/reader036/viewer/2022062511/551bc08c550346b4588b4a4e/html5/thumbnails/10.jpg)
Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca
http://iselab.cvc.uab.es/
Exploiting Natural-Language Interaction in Video Surveillance Systems