Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks ›...
Transcript of Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks ›...
![Page 1: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/1.jpg)
Developing Visual Analytics Applications: Lessons Learned from the Trenches
John Stasko & Carsten Görg
Information Interfaces Research Group
School of Interactive Computing
Georgia Institute of Technology
Dec. 3, 2009
![Page 2: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/2.jpg)
Jigsaw
• Visualization for Investigative Analysis and Sense-making across Document Collections
“Putting the pieces together”
2
![Page 3: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/3.jpg)
3
Blogs
DBs
Documents/case reports
![Page 4: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/4.jpg)
Example Documents
4
![Page 5: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/5.jpg)
Our Focus
• Entities within the documents
– Person, place, organization, phone number, date, license plate, etc.
• Thesis: A bigger story or insight from the documents will involve a set of interconnected entities working in coordination
• (We use entity identification software from others)
5
![Page 6: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/6.jpg)
Connections
• Entities relate/connect to each other to make a larger “story”
• Connection definition:
– Two entities are connected if they appear in a document together
– The more documents they appear in together, the stronger the connection
6
![Page 7: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/7.jpg)
Jigsaw
• Multiple visualizations (views) of documents, entities, & their connections
• Views are highly interactive and coordinated
• User actions generate eventsthat are transmitted to and (possibly) reflected in other views
7
![Page 8: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/8.jpg)
System Views
8
![Page 9: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/9.jpg)
The Need for Pixels
9
![Page 10: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/10.jpg)
Even More!
10
![Page 11: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/11.jpg)
Even More!
11
![Page 12: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/12.jpg)
Demo Data
• NSF awards from 2000-now (abstract & key meta-data)
• Big thanks to Remco Chang & UNCC folks
• Demo focus: CSE awards (12,243)
12
![Page 13: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/13.jpg)
13
![Page 14: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/14.jpg)
14
![Page 15: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/15.jpg)
15
Demo
![Page 16: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/16.jpg)
What We’re Working On
• Jigsaw is heavy on the user-directed visual exploration, but light on the automated computational analysis
16
![Page 17: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/17.jpg)
Recommend Related Entities
17
![Page 18: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/18.jpg)
Adding Computational Analysis
• Document themes & clustering
18
![Page 19: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/19.jpg)
19
![Page 20: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/20.jpg)
Adding Computational Analysis
• Document themes & clustering
• Document similarity
20
![Page 21: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/21.jpg)
21
Similarity
Most similar
![Page 22: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/22.jpg)
Adding Computational Analysis
• Document themes & clustering
• Document similarity
• Document summarization
22
![Page 23: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/23.jpg)
23
Earthquake hits Pacific island of Vanuatu.
![Page 24: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/24.jpg)
Adding Computational Analysis
• Document themes & clustering
• Document similarity
• Document summarization
• Sentiment analysis
24
![Page 25: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/25.jpg)
25
Most positive
Most negative
![Page 26: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/26.jpg)
Lessons Learned
• A quick recap of some things we’ve learned from working with partners from
– Homeland security
– Law enforcement
– Intelligence analysis
– Investigative reporting
– Business intelligence
and from our experience developing systems like Jigsaw
26
![Page 27: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/27.jpg)
Focus on the user’s task & goals
27
![Page 28: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/28.jpg)
But in many instances, you don’t know the questions
28
![Page 29: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/29.jpg)
As the data scales up, we still want interactive visualization
29
![Page 30: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/30.jpg)
Online algorithms are better than offline algorithms
– Real-time is great
30
![Page 31: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/31.jpg)
For real systems, pragmatics matter
– “Common” programming languages
– Others must be able to access your code
– Documentation, tutorials, …
– “Good” is usually good enough, especially at first (great would be wonderful)
31
![Page 32: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/32.jpg)
You don’t get training data
32
![Page 33: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/33.jpg)
Real data doesn’t necessarily have nice clusters
33
![Page 34: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/34.jpg)
Evaluation doesn’t necessarily have a good quantitative measure
34
![Page 35: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/35.jpg)
35
Fundamentalalgorithmicresearch
Application-drivenproblems
![Page 36: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches](https://reader033.fdocuments.us/reader033/viewer/2022053018/5f1e162967e49b58d5476465/html5/thumbnails/36.jpg)
Acknowledgments
• Work conducted as part of the Southeastern Regional Visualization and Analytics Center, supported by DHS and NVAC and the new DHS Center of Excellence in Command, Control & Interoperability (VACCINE Center)
• Supported by NSF IIS-0414667, CCF-0808863 (FODAVA lead), NSF IIS-0915788
36