Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf ·...

34
Computing + Statistics = Data Science Dr Graham Cormode

Transcript of Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf ·...

Page 1: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons

Computing + Statistics =

Data Science

Dr Graham Cormode

Page 2: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 3: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 4: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 5: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 6: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 7: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 8: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 9: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons

Data Science: “What can we do with

all this data?”

Page 10: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons

10 minutes of data analysis

Page 11: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 12: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons

0

10

20

30

40

50

60

70

80

90

100

Dislike

Neutral

Like

0

10

20

30

40

50

60

70

80

90

100

Dislike

Neutral

Like

Page 13: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons

0

10

20

30

40

50

60

70

80

90

100

Dislike

Neutral

Like0102030405060708090

100

Dislike

Neutral

Like

Page 14: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons

0%

20%

40%

60%

80%

100%

Male Female

Ke$ha

Dislike

Neutral

Like

0%

20%

40%

60%

80%

100%

Male Female

Ke$ha

Dislike

Neutral

Like

Page 15: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons

Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons --> Dislike Justin Bieber (90%) Like Muse --> Like Daft Punk (65%) Dislike One.Direction --> Like Daft.Punk (60%)

Like Rihanna --> Like Adele (81%) Like Muse --> Dislike Justin Bieber (88%) Dislike One Direction --> Dislike Justin Bieber (97%) Dislike One Direction --> Like Muse (56%)

Page 16: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons

Like Ryvita --> Like Apples (100%) Dislike Tofu --> Like Burgers (89%)

Like Burgers --> Like Chips (92%) Like Ryvita --> Like Apples (96%) Like Marmite --> Like Curry (80%) Dislike Sushi --> Dislike Marmite (71%)

Page 17: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons

Like Muse --> Like Curry (79%) Like Rihanna --> Dislike Marmite (68%) Like Taylor.Swift --> Dislike Tofu (64%)

Like Daft Punk --> Like Chips (97%) Like Mumford and Sons --> Like Curry (93%) Like Ryvita --> Dislike Justin.Bieber (89%)

Page 18: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons

http://xkcd.com/552/

Page 19: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 20: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 21: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 22: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 23: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons

What are the big questions?

Page 24: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons

Healthcare

Page 25: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 26: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 27: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 28: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 29: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 30: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 31: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons
Page 32: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons

What are the tools?

• Foundations – Maths

– Computer Science

– Statistics

– Sociology

• Concepts – Machine learning/AI

– Data mining

– Software Engineering: Big data

Page 33: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons

• A Very Short History Of Data Science http://www.forbes.com/sites/gilpress/2013/05/28/a-very-short-history-of-data-science/ Data Scientist: The Sexiest Job of the 21st Century http://hbr.org/2012/10/data-scientist-the-sexiest-job-of-the-21st-century/ The role of Statistics in the Higgs Boson discovery http://blog.revolutionanalytics.com/2012/07/discovering-the-higgs-boson-with-statistics.html

Lots more information online

Page 34: Computing + Statistics = Data Sciencedimacs.rutgers.edu/~graham/pubs/slides/datsciout.pdf · 2018-01-02 · Dislike One Direction --> Dislike Justin Bieber (95%) Like Mumford & Sons

Questions?