Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other...
Transcript of Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other...
![Page 1: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/1.jpg)
Interactive Visual Discovery in Temporal Event Sequences:
Electronic Health Records & Other Applications
Ben Shneiderman [email protected]
Founding Director (1983-2000), Human-Computer Interaction LabProfessor, Department of Computer Science
Member, Institute for Advanced Computer Studies
![Page 2: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/2.jpg)
Interdisciplinary research community - Computer Science & Info Studies - Psych, Socio, Educ, Jour & MITH
www.cs.umd.edu/hcil vimeo.com/72440805
![Page 3: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/3.jpg)
Design Issues
• Input devices & strategies• Keyboards, pointing devices, voice• Direct manipulation• Menus, forms, commands
• Output devices & formats• Screens, windows, color, sound• Text, tables, graphics• Instructions, messages, help
• Collaboration & Social Media• Help, tutorials, training• Search
www.awl.com/DTUI
Fifth Edition: 2010
• Visualization
![Page 4: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/4.jpg)
Information Visualization & Visual Analytics
• Visual bands• Human percle
• Trend, clus..• Color, size,..
• Three challe• Meaningful vi • Interaction: w• Process mo
1999
![Page 5: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/5.jpg)
Information Visualization & Visual Analytics
• Visual bandwidth is enormous• Human perceptual skills are remarkable
• Trend, cluster, gap, outlier...• Color, size, shape, proximity...
• Three challenges• Meaningful visual displays of massive da • Interaction: widgets & window coordinati• Process models for discovery
1999 2004
![Page 6: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/6.jpg)
Information Visualization & Visual Analytics
• Visual bandwidth is enormous• Human perceptual skills are remarkable
• Trend, cluster, gap, outlier...• Color, size, shape, proximity...
• Three challenges• Meaningful visual displays of massive data • Interaction: widgets & window coordination• Process models for discovery
1999 2004 2010
![Page 7: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/7.jpg)
Spotfire: Retinol’s role in embryos & vision
![Page 8: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/8.jpg)
Spotfire: DC natality data
![Page 9: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/9.jpg)
http://registration.spotfire.com/eval/default_edu.asp
![Page 10: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/10.jpg)
10M - 100M pixels: Large displays
![Page 11: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/11.jpg)
16M pixels: My New Workstation
![Page 12: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/12.jpg)
100M-pixels & more
![Page 13: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/13.jpg)
1M-pixels & less Small mobile devices
![Page 14: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/14.jpg)
Information Visualization: Mantra
• Overview, zoom & filter, details-on-demand• Overview, zoom & filter, details-on-demand• Overview, zoom & filter, details-on-demand• Overview, zoom & filter, details-on-demand• Overview, zoom & filter, details-on-demand• Overview, zoom & filter, details-on-demand• Overview, zoom & filter, details-on-demand• Overview, zoom & filter, details-on-demand• Overview, zoom & filter, details-on-demand• Overview, zoom & filter, details-on-demand
(The Eyes Have It, IEEE VL, 1996)
![Page 15: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/15.jpg)
Information Visualization: Data Types
• 1-D Linear Document Lens, SeeSoft, Info Mural
• 2-D Map GIS, ArcView, PageMaker, Medical imagery
• 3-D World CAD, Medical, Molecules, Architecture
• Multi-Var Spotfire, Tableau, Qliktech, Visual Insight
• Temporal EventFlow, TimeSearcher, Palantir, RecordedFuture
• Tree Windows Explorer, SpaceTree, Treemap
• Network Pajek, UCINet, NodeXL, Gephi, Tom Sawyer
In
foV
iz
S
ciV
iz .
flowingdata.com visualcomplexity.com eagereyes.orginfosthetics.com perceptualedge.com datakind.orgvisual.ly visualizing.org infovis.org
![Page 16: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/16.jpg)
Patient ID: 45851737
12/02/2008 14:26 Arrival12/02/2008 14:36 Emergency12/02/2008 22:44 ICU12/05/2008 05:07 Floor12/14/2008 06:19 Exit
Time
EmergencyICU
FloorExit
EHRs: Temporal data
04/26/2010 10:00 31.0304/26/2010 10:15 31.0104/26/2010 10:30 31.0204/26/2010 10:45 31.0804/26/2010 11:00 31.16
Categorical Events
Stock: Microsoft
Numerical Events
Arrival
![Page 17: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/17.jpg)
Patient Histories: Our Research
www.cs.umd.edu/hcil/toolname
Tool EventTypes
Records Display
LifeLines Points, Intervals
One Individual
LifeLines2 Points Many Individual,Summary
Similan Points Many Individual
LifeFlow Points Many Individual,Aggregate
EventFlow Points, Intervals
Many Individual,Aggregate
![Page 18: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/18.jpg)
LifeLines: Patient Histories
www.cs.umd.edu/hcil/lifelines
![Page 19: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/19.jpg)
LifeLines2: Align-Rank-Filter & Summarize
www.cs.umd.edu/hcil/lifelines2
![Page 20: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/20.jpg)
LifeFlow: Interface with User Controls
![Page 21: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/21.jpg)
![Page 22: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/22.jpg)
Children’s Hospital in DC: Trauma Bay
![Page 23: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/23.jpg)
EventFlow
AirwayBreathing
CirculationDisability
Secondary Survey
www.cs.umd.edu/hcil/eventflow
![Page 24: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/24.jpg)
EventFlow: Temporal Events
http://youtu.be/dz86_nSXt-M
![Page 25: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/25.jpg)
![Page 26: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/26.jpg)
![Page 27: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/27.jpg)
![Page 28: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/28.jpg)
![Page 29: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/29.jpg)
![Page 30: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/30.jpg)
![Page 31: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/31.jpg)
![Page 32: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/32.jpg)
![Page 33: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/33.jpg)
![Page 34: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/34.jpg)
Nu
mb
er
of R
eco
rds
Time
![Page 35: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/35.jpg)
Children’s Hospital Trauma Care: EventFlow
![Page 36: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/36.jpg)
Children’s Hospital Trauma Care: EventFlow
![Page 37: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/37.jpg)
Children’s Hospital Trauma Care: EventFlow
![Page 38: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/38.jpg)
UM-Baltimore: CHIB Projects
Radiation Therapy: Metastatic Prostate Cancer
Warfarin Usage in Patients with Traumatic Brain Injury
![Page 39: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/39.jpg)
Yale Medical: Seth Powsner & Tami Sullivan
![Page 40: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/40.jpg)
Future Directions: EventFlow
• Refine software to add business features• Make backend database• Scalability of many kinds• Validation across usage domains• Build community• Launch startup company?
![Page 41: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/41.jpg)
Cohort Comparison: Dual EventFlow
![Page 42: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/42.jpg)
Cohort Comparison: CoCo
![Page 43: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/43.jpg)
Thanks for getting us to this stage
Catherine Plaisant• LifeLines• LifeLines2 (David Wang)
• LifeFlow (Krist Wongsuphasawat)
• EventFlow team Megan Monroe, Chris Imbriano
Sana Malik, Fan Du, Chris Musialek, Christi Capati, Duke Chan
THANKS! Sponsors: NIH, Oracle, CHIB
![Page 44: Interactive Visual Discovery in Temporal Event Sequences: Electronic Health Records & Other Applications Ben Shneiderman ben@cs.umd.edu Founding Director.](https://reader036.fdocuments.us/reader036/viewer/2022062518/56649e165503460f94b0103b/html5/thumbnails/44.jpg)
@benbendc
Workshop Website www.cs.umd.edu/hcil/eventflow/workshop2014/