Sp meetup 17 slidedeck

58
MEETUP #17 Big Data, Open Data – What are they really?

Transcript of Sp meetup 17 slidedeck

Page 1: Sp meetup 17 slidedeck

MEETUP #17Big Data, Open Data – What

are they really? 

Page 2: Sp meetup 17 slidedeck

Our SpeakersDennis Brink, Executive Director of Canadian Open Data Institute

Trish Garner, Manager at Open Data at City of Toronto

Mark MacDonnell, Software Developer at SELA Canada

Adam Muise, Principal Architect at Horton Works

Jason Lavigne, Founder & CEO, Black & White Logic

Page 3: Sp meetup 17 slidedeck

Open Data – What is it?

Dennis BrinkExecutive Director, Canadian Open Data Institute

IAMCP Director and RIC Advisor

Page 4: Sp meetup 17 slidedeck

Open Government

Open Data

Open Knowledge

Page 5: Sp meetup 17 slidedeck

Open Data Definition fromOpen Knowledge Foundation (OKF)

• https://okfn.org/opendata/

‘Open knowledge’ is any content, information or data that people are free to use, re-use and redistribute — without any legal, technological or social restriction.

Page 6: Sp meetup 17 slidedeck

Creative Commons & License Types

• Attribution-ShareAlike 4.0 International

• “CC BY-SA 4.0”

• Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made.

• ShareAlike — If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original.

Page 7: Sp meetup 17 slidedeck

Creative Commons & License Types

• Attribution-ShareAlike 4.0 International

• “CC BY-SA 4.0” • You are free to:• Share — copy and redistribute the material

in any medium or format• Adapt — remix, transform, and build upon

the material for any purpose, even commercially.

• The licensor cannot revoke these freedoms as long as you follow the license terms.

Page 8: Sp meetup 17 slidedeck

Examples of Open Data Not For Profit’sSunlight Foundation (US) sunlightfoundation.com

The Open Data Institute (UK) theodi.org

Page 9: Sp meetup 17 slidedeck

Directory for Open Data

http://data.gc.ca/eng/maps/open-data-canada

Page 10: Sp meetup 17 slidedeck

Example of Federal Data - Census

http://data.gc.ca/data/en/dataset/e3586bbf-93b8-40e8-8b5a-14023e1e705e

Population by home language, by province and territory (2011 Census)

Language spoken most often at home[1] Canadanumber

Total 33,121,175English 21,457,075French 6,827,865Non-official language 3,673,865English and French 131,205English and non-official language 875,135French and non-official language 109,705English, French and non-official language 46,325 [E] : use with caution. 1. Refers to the language spoken most often at home by the individual at the time of the census (May 10, 2011). Source: Statistics Canada, 2011 Census of Population. Last modified: 2013-02-13.

Page 11: Sp meetup 17 slidedeck

Example of Provincial Data - baby names

http://www.ontario.ca/government/ontario-top-baby-names-male

Page 12: Sp meetup 17 slidedeck

Example of City Data - parking ticketshttp://www1.toronto.ca/wps/portal/contentonly?vgnextoid=9e56e03bb8d1e310VgnVCM10000071d60f89RCRD

Page 13: Sp meetup 17 slidedeck

Shawn Petersen aka “Saint John Shawn”

• Propertize.ca a New Brunswick property tax assessment comparison tool.

• location detection to see all nearby properties

Address PID PAN Assessment (Year, Amount, Levy) Change Last Sale(s) Property Description Tax Class

228 Lancaster Avenue

33357 1698246 2013 - $633,000.00 - $30,386.542012 - $600,900.00 - $29,341.352011 - $573,400.00 - $27,998.55

5.34% PARTS DEPOT Fully Taxable

266 Lancaster Avenue

33225 1698115 2013 - $358,300.00 - $11,645.832012 - $340,600.00 - $11,274.882011 - $317,900.00 - $10,523.45

5.20% APT HOUSES & LAND Fully Taxable

Lancaster Avenue 55146310 5103560 2013 - $113,500.00 - $3,633.942012 - $111,900.00 - $3,649.852011 - $103,900.00 - $3,388.92

1.43% PARK AREA Fully Taxable

248 Lancaster Avenue

55012132 1701756 2013 - $736,900.00 - $35,374.152012 - $732,800.00 - $35,781.892011 - $722,100.00 - $35,259.43

0.56% BOWLING CENTRE Fully Taxable

Page 14: Sp meetup 17 slidedeck

Data Marketplace – Microsoft

http://datamarket.azure.com/browse/data?price=paid

Page 15: Sp meetup 17 slidedeck

Big Data vs. Open Data

How are they Different?

• Look at the 3 V’s in a Big Data World

Page 16: Sp meetup 17 slidedeck

Big Data vs. Open Data

• Volume – ever increasing– storage issue

• Variety– unstructured– external– social/mobile/IoT’s

• Velocity– daily or live streaming

Page 17: Sp meetup 17 slidedeck

Big Data vs. Open Data

How are they Different?

• All V’s are different

• Census:– static, structured, and 60 GB in size

Page 18: Sp meetup 17 slidedeck

NYU’s GovLab Survey

• OpenData500.com

• Survey of companies using Open Data for commercial purposes.

• Attempting to expand to other countries.

–We want Canada represented!

Page 19: Sp meetup 17 slidedeck

NYU’s GovLab Open Data 500

Page 20: Sp meetup 17 slidedeck

Questions?

Please consider helping with the Canadian Open Data survey project!

Page 21: Sp meetup 17 slidedeck

App Example from Sela Canada

Page 22: Sp meetup 17 slidedeck

Silicon Peel Meetup

Page 23: Sp meetup 17 slidedeck

About SELA Group

• Over 20 years in IT industry

• A global training, consulting and outsourcing

company, with offices in Canada, US, India,

Singapore & Israel

• Known for its high quality and lead in the

demanding Hi-Tech market

© Copyright SELA software & Education Labs

Ltd.

23

Page 24: Sp meetup 17 slidedeck

SELA Group - Selected Customers

© Copyright SELA software & Education Labs

Ltd.

24

Page 25: Sp meetup 17 slidedeck

SELA and Microsoft

Page 26: Sp meetup 17 slidedeck

SELA & Microsoft

© Copyright SELA software & Education Labs

Ltd.

26

Page 27: Sp meetup 17 slidedeck

SELA and YOU

Page 28: Sp meetup 17 slidedeck

SELA & YOU

© Copyright SELA software & Education Labs

Ltd.

28

Training• .NET• Java• C/C++• ISTQB• Onsite• Online

Consulting• Mentorship• Short term• Long term• Onsite• Remote

Outsourcing• Near shore• Offshore

Page 29: Sp meetup 17 slidedeck

Contact SELA Canada

Eran [email protected] www.selacanada.ca

© Copyright SELA software & Education Labs Ltd.

29

Page 30: Sp meetup 17 slidedeck

Thank You

Page 31: Sp meetup 17 slidedeck

Making Money with Open DataMark MacDonnell, Software Developer, SELA Diamond Program

Page 32: Sp meetup 17 slidedeck

What is (good) open data?

• Has a license declaring it open

• Can be accessed freely and easily

• Provided in a standard, structured way

• Reliable

Page 33: Sp meetup 17 slidedeck

Why publish your data?

• Provide a data subset or sample

• Allows you to focus on core services

• Bring attention to your services

• Better information sharing

• Foster more open data

Page 34: Sp meetup 17 slidedeck

Why consume open data?

• Avoid maintenance costs

• Amalgamate information

• Support your own data

• Foster more open data

Page 35: Sp meetup 17 slidedeck

Communicating: The Triangle

Data Owners

Developers

Public

Page 36: Sp meetup 17 slidedeck

The “actual” Triangle

Data Owners

DevelopersPublic

Page 37: Sp meetup 17 slidedeck

Getting the word out

• To developers– Blogs– Social media– Emails

• To the public– Press

releases– News

conferences

To data owners◦ Emails◦ Social media◦ Comments

To the public◦ Apps◦ Blog

To data owners◦ Contact◦ FAQs

To developers◦ Reviews◦ Downloads◦ Un-installs

Data Owners Developers The Public

Page 38: Sp meetup 17 slidedeck

What to do?

• Have a clear audience– Don’t forget the other audience

• Be proactive

• Say where you’re going– Secrets don’t help

• Always be communicating– Make it easy (RSS, Twitter, etc.)

Page 39: Sp meetup 17 slidedeck

Provision

Create data sets from webpages

Automatically crawls site for data

Currently growing

Useful for internal activities

Tools for building APIs from data

Value added to the open data

Live in the wild

Good for exposing your data

Page 40: Sp meetup 17 slidedeck

Consumption

• Gather the data and do research

• Combine open data with closed data

• Process the data

• Value added

Page 41: Sp meetup 17 slidedeck

Thank you

Mark MacDonnell✉ [email protected]

🌐

markmacdonnell.wordpress.com @MacDonnellMark

Page 42: Sp meetup 17 slidedeck

Break

Page 43: Sp meetup 17 slidedeck

Demo Me

Harpreet Singh, Lab B

Page 44: Sp meetup 17 slidedeck

logo

Page 45: Sp meetup 17 slidedeck
Page 46: Sp meetup 17 slidedeck
Page 47: Sp meetup 17 slidedeck
Page 48: Sp meetup 17 slidedeck

1. 76 percent reported an increase in productivity

2. 93 percent said their social circle had increased a lot

3. 86 percent said their business network had grown

BENEFITS

Source: Global Coworking Survey 2013

Page 49: Sp meetup 17 slidedeck

What makes coworking different from business office centers?

Page 50: Sp meetup 17 slidedeck

Community > Space

Page 51: Sp meetup 17 slidedeck

Source: Global Coworking Survey 2013

Introductory Membership for the First 10:

$150

Page 52: Sp meetup 17 slidedeck

Drop in: $10

Page 53: Sp meetup 17 slidedeck

COHIP(Coworking Ontario Health Insurance

Plan)

Page 54: Sp meetup 17 slidedeck
Page 55: Sp meetup 17 slidedeck
Page 56: Sp meetup 17 slidedeck
Page 57: Sp meetup 17 slidedeck

Word from our Sponsors

Page 58: Sp meetup 17 slidedeck

Thank You