INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is...

35
1 Contents © 2015 Uncharted Software Inc, and respective image holders. Do not redistribute without written permission. INDUSTRIAL VISUALIZATION U of T, Info Vis Oct 31, 2016

Transcript of INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is...

Page 1: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

1Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

INDUSTRIAL VISUALIZATION

U of T, Info Vis

Oct 31, 2016

Page 2: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

From CBS News Show 60 Minutes: http://www.cbsnews.com/news/new-search-engine-exposes-the-dark-web/

Page 3: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

3Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

From Wired.comwired.com/?p=1961132

Page 4: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

4Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

BaseballChanging the game answer scenarios visually based on past performance

Pitch Data• MLB data for every pitch – pitch

type, speed, result, where it went in the field, batter, pitcher, inning, count, video, etc. More than 1Tb per season

Pitches Analysis• Every pitch over plate and where

hit. Color-coded, shapes, filters, linking, workflow. E.g. see only fastballs that resulted in a hit.

Benefits• Full pitching analysis workflow:

Explore top level patterns; Analyze specific slices; Review in detail video.

• The two teams using this software the most are in the 2010 World Series. Two teams that didn’t use it were eliminated in the league finals. Next year 75% of teams adopted the software.

Texas Rangers center fielder Josh Hamilton vs. All Pitchers

1. All pitches thrown to Josh last 2 months

2. Where all of Josh’s hits were fielded.

3. Highlight only Josh’s deep hits (400+ feet)

4. See where all the pitches were over the plate that resulted in deep hits.

5. Bookmark those plays and review video (e.g. on iPad).

6. Review with players and staff to find solutions.

MoreVideo from Strata conference: http://bit.ly/1rOwf7S Slides from Strata conference: http://bit.ly/PoZcBvTeaser video of pitch patterns: http://bit.ly/1QOlJS5Poster with story: https://uncharted.software/assets/pdfs/BSportsPro_Poster_Uncharted_Finalc3.pdf

Paper at visualization conference: http://workshop.sportvis.com/papers/BSports-BigData-2013-v4a.pdf

Video of coach using system: https://www.youtube.com/watch?v=uUYY1kYrR8g

Page 5: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

5Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Page 6: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

6Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

© Copyright 2000, The Nasdaq Stock Market, Inc., Reprinted with the permission of The Nasdaq Stock Market, Inc., Photo credit: Peter Aaron/Esto

Page 7: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

7Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.© Copyright 2000, The Nasdaq Stock Market, Inc., Reprinted with the permission of The Nasdaq Stock Market, Inc., Photo credit: Peter Aaron/Esto

Page 8: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

8Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

BACKSTORY

(models I built to represent the world – architectural, CG, early dataviz)

Page 9: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

9Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Page 10: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

10Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Page 11: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

11Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Page 12: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

12Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Page 13: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

13Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Page 14: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

14Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Page 15: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

15Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Page 16: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

16Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Page 17: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

17Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Page 18: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

18Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Management Decision Support

Page 19: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

19Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Sample Yahoo Finance Web Page: http://finance.yahoo.com/quote/F?p=F

Page 20: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

20Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Sample Google Finance Web Page: https://www.google.com/finance?q=NYSE%3AF

Page 21: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

21Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.Sample Bloomberg Terminal Chart: www.bloomberg.com/professional/charts/

Page 22: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

22Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

What

Page 23: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

23Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

What we doSolve challenging business tasks

More Information

required to make a Decision

Faster Time

to Insight

Dashboard

Basic Charts

for

Current

Status

‘Slice and Dice’

Generic tools

to Explore Data

Uncharted

Visual Analytics System

Report

Static

Snapshot

(Big/Fast) Data

Analytics

Visualization

Page 24: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

24Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Uncharted Tellfinder:https://tellfinder.com/

Page 25: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

25Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Uncharted Influent:http://influent.io/

Page 26: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

26Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

2m Chelsea FC Tweets

o WHERE: Pockets of fans all around the

world.

o WITH WHO: Links to who they are talking

to. World-wide and local conversations

o ABOUT WHO: Text overtop is most

mentioned players.

o Zoom, layer, filter, drill, access tweet, etc.

Page 27: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

27Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Page 28: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

28Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Graph Analysis and Visualization

Commercial book published by Wiley (2015)o Richard Brath and David Jonker authors (Uncharted Partners)o https://www.amazon.com/Graph-Analysis-Visualization-Discovering-Opportunity/dp/1118845846

=WEBSERVICE("https://viralheat.com/api/sentim

ent/review.xml?text="&ENCODEURL(LEFT(Vertices

[[#This

Row],[Tweet]],360))&"&api_key=your_key_here")

Facebook Data collection via Excel

Topic extraction via formulas

Sentiment extraction via web service

=IF(AND(ISERROR(SEARCH(AL$2,Vertices[[#This

Row],[Tweet]],1)),ISERROR(SEARCH(AL$1,Vertice

s[[#This Row],[Tweet]],1))),0,1)

Email into graph via python script, layout, select, color, size to reveal key connectors

Excel to collect data, model graph, advanced analytics then visualize communities

Log files into directed graph, line color & style to characterize components

Communities over time: fade, small multiples & separation, show evolution

Market basket analysis on 2M products and reviewers. Rich interaction.

Page 29: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

29Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Flow on the TorNetworkwhere are the nodes, how much traffic, what are the access points, how does that correlate with other events

https://torflow.uncharted.software

Page 30: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

30Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

1,000,000’s Superbowl Retweets

o WHICH TWEETS: Are getting re-tweeted

the most?

o WHICH BRANDS: Are getting re-tweeted

the most?

o WHO: If being talked about the most.

o STAYING POWER: Which tweets plateau,

which keep growing.

o Zoom, layer, filter, drill, access tweet, etc.

Page 31: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

31Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Salt

Salt is an open source library for creating interactive

visualizations of massive datasets.

Visualizing big data is hard. Usually this means creating highly

aggregated visualizations that can conceal localized patterns behind

sums and averages. Salt helps you scalably transform your data, so

that it can be explored interactively at increasing levels of detail.

Salt generates scalable representations of billions of data points,

enabling visualizations including geographic heatmaps, cross-plots

or time series, and the layering of multiple data sources and

dimensions for contextual overlay.

Uncharted Open Source software:http://unchartedsoftware.github.io/salt-core/

Page 32: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

32Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Besides Research and Development (aka coding)

o Sales, marketing, pre-sales, HR, …

o Strategic analysis, data analysis, data science, design,…

o Working with end-users…

Page 33: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

33Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Ideation

A BCenter of gravity

A BImbalance of flow

Page 34: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

34Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Page 35: INDUSTRIAL VISUALIZATIONfchevali/fannydotnet//csc2524-infovis/guest... · Visualizing big data is hard. Usually this means creating highly aggregated visualizations that can conceal

35Contents © 2015 Uncharted Software Inc, and respective image holders.

Do not redistribute without written permission.

Key Takeaways (so far)

o Dashboards: plug and play visualization

o Custom visual analytics:

big, complex, data, analytics, design, systems

o Business Value really important

o Design is really important…