Machine Learning with Spark - Meetupfiles.meetup.com/19103884/3_ML_intro.pdf · Mercedes-Benz ML...

12
Machine Learning with Spark What is Machine Learning?

Transcript of Machine Learning with Spark - Meetupfiles.meetup.com/19103884/3_ML_intro.pdf · Mercedes-Benz ML...

Page 1: Machine Learning with Spark - Meetupfiles.meetup.com/19103884/3_ML_intro.pdf · Mercedes-Benz ML 270 turbodiesel cat CD' € 04/2000 251,000 km 120 kW hp 9 private, 1-00038 vatmontone

Machine Learning with Spark

What is Machine Learning?

Page 2: Machine Learning with Spark - Meetupfiles.meetup.com/19103884/3_ML_intro.pdf · Mercedes-Benz ML 270 turbodiesel cat CD' € 04/2000 251,000 km 120 kW hp 9 private, 1-00038 vatmontone
Page 3: Machine Learning with Spark - Meetupfiles.meetup.com/19103884/3_ML_intro.pdf · Mercedes-Benz ML 270 turbodiesel cat CD' € 04/2000 251,000 km 120 kW hp 9 private, 1-00038 vatmontone

Gain wisdom around 500 BC Input/Output system

? Wisdom

Question

Wisdom

Page 4: Machine Learning with Spark - Meetupfiles.meetup.com/19103884/3_ML_intro.pdf · Mercedes-Benz ML 270 turbodiesel cat CD' € 04/2000 251,000 km 120 kW hp 9 private, 1-00038 vatmontone

Gain wisdom around 1990 Input/Output system

? Wisdom

Question

Page 5: Machine Learning with Spark - Meetupfiles.meetup.com/19103884/3_ML_intro.pdf · Mercedes-Benz ML 270 turbodiesel cat CD' € 04/2000 251,000 km 120 kW hp 9 private, 1-00038 vatmontone

? Wisdom

Question

Gain wisdom around 2016 Input/Output system

Page 6: Machine Learning with Spark - Meetupfiles.meetup.com/19103884/3_ML_intro.pdf · Mercedes-Benz ML 270 turbodiesel cat CD' € 04/2000 251,000 km 120 kW hp 9 private, 1-00038 vatmontone

Work 1 month for 30data points

Wait 1 second for 30.000 points

Page 7: Machine Learning with Spark - Meetupfiles.meetup.com/19103884/3_ML_intro.pdf · Mercedes-Benz ML 270 turbodiesel cat CD' € 04/2000 251,000 km 120 kW hp 9 private, 1-00038 vatmontone

“More data usually beats better algorithms”Anand Rajaraman (when teaching at Stanford)

http://anand.typepad.com/datawocky/2008/03/more-data-usual.html

Old Skool StatisticsOld Skool Statistics Big Data!Big Data!

Nice read!

Page 8: Machine Learning with Spark - Meetupfiles.meetup.com/19103884/3_ML_intro.pdf · Mercedes-Benz ML 270 turbodiesel cat CD' € 04/2000 251,000 km 120 kW hp 9 private, 1-00038 vatmontone
Page 9: Machine Learning with Spark - Meetupfiles.meetup.com/19103884/3_ML_intro.pdf · Mercedes-Benz ML 270 turbodiesel cat CD' € 04/2000 251,000 km 120 kW hp 9 private, 1-00038 vatmontone

Use Cases with Spark

Page 10: Machine Learning with Spark - Meetupfiles.meetup.com/19103884/3_ML_intro.pdf · Mercedes-Benz ML 270 turbodiesel cat CD' € 04/2000 251,000 km 120 kW hp 9 private, 1-00038 vatmontone

MLlib demo recommendation engine

Page 11: Machine Learning with Spark - Meetupfiles.meetup.com/19103884/3_ML_intro.pdf · Mercedes-Benz ML 270 turbodiesel cat CD' € 04/2000 251,000 km 120 kW hp 9 private, 1-00038 vatmontone

RDD

ML Model

Result

1. Create an RDD, Map/Reduce to clean the Data

2. Use a pre-build Spark ML technique to calculate a Model

3. Buy my next Car

MLlib demo car market model

Page 12: Machine Learning with Spark - Meetupfiles.meetup.com/19103884/3_ML_intro.pdf · Mercedes-Benz ML 270 turbodiesel cat CD' € 04/2000 251,000 km 120 kW hp 9 private, 1-00038 vatmontone

MLlib overview

Next Meetup?Play around with

Spark, Mllib?

Kaggle Competition?


Obese Patients: General or Combined Anaesthesia?medcraveonline.com/JACCOA/JACCOA-01-00038.pdf · In comparison with general anaesthesia, numerous studies have found that combined

Obese Patients: General or Combined Anaesthesia?medcraveonline.com/JACCOA/JACCOA-01-00038.pdf · In comparison with general anaesthesia, numerous studies have found that combined

THE FIRST TURBODIESEL OUTBOARD WITH TWIN … WITH TWIN CRANKSHAFT TECHNOLOGY ... level unknown so far to the industry. 1 History and birth of ... discovered by Nissan independently

THE FIRST TURBODIESEL OUTBOARD WITH TWIN … WITH TWIN CRANKSHAFT TECHNOLOGY ... level unknown so far to the industry. 1 History and birth of ... discovered by Nissan independently

library.e.abb.com...TOCCÐÜCRMI -C-DÈHB49:B.00038 009935W TP Houep 6naHKa) O (CB0Aax "pa BLT), npHMeHfleMbtx n06P0f$0AbH0ii c06moaeHHRTpeó0Bawuìi -rexnnqecrcoro peraaMewra Ha HMeHOBaßfHC

library.e.abb.com...TOCCÐÜCRMI -C-DÈHB49:B.00038 009935W TP Houep 6naHKa) O (CB0Aax "pa BLT), npHMeHfleMbtx n06P0f$0AbH0ii c06moaeHHRTpeó0Bawuìi -rexnnqecrcoro peraaMewra Ha HMeHOBaßfHC

Public Law 91-142 - U.S. Government Publishing Office Army Ammunition Plant, Kansas: Utilities, $251,000. Wiite Sands Missile Range, New Mexico: Research, development, and test facilities,

Public Law 91-142 - U.S. Government Publishing Office Army Ammunition Plant, Kansas: Utilities, $251,000. Wiite Sands Missile Range, New Mexico: Research, development, and test facilities,

INDIANA EPARTMENT OF NVIRONMENTALpermits.air.idem.in.gov/35939d.pdf · Nucor Steel Crawfordsville, Indiana Permit Reviewer: Kristen Willoughby Page 2 of 2 SPM No.107-35939-00038 DRAFT

INDIANA EPARTMENT OF NVIRONMENTALpermits.air.idem.in.gov/35939d.pdf · Nucor Steel Crawfordsville, Indiana Permit Reviewer: Kristen Willoughby Page 2 of 2 SPM No.107-35939-00038 DRAFT

Natural Resources Trust Fund Project Status · MICHIGAN NATURAL RESOURCES TRUST FUND PROJECT STATUS REVIEW FOR PERIOD ENDING MARCH 31, 2013 ... Mills Township Ogemaw 07-051 251,000

Natural Resources Trust Fund Project Status · MICHIGAN NATURAL RESOURCES TRUST FUND PROJECT STATUS REVIEW FOR PERIOD ENDING MARCH 31, 2013 ... Mills Township Ogemaw 07-051 251,000

Case 2:10-cv-00038-GAF-SH Document 1 Filed 01/05/2010 Page 1 … · 2010. 1. 7. · Case 2:10-cv-00038-GAF-SH Document 1 Filed 01/05/2010 Page 1 of 41. Case 2:10-cv-00038-GAF-SH Document

Case 2:10-cv-00038-GAF-SH Document 1 Filed 01/05/2010 Page 1 … · 2010. 1. 7. · Case 2:10-cv-00038-GAF-SH Document 1 Filed 01/05/2010 Page 1 of 41. Case 2:10-cv-00038-GAF-SH Document

Protracted Relief and Recovery Operation – Bangladesh ...€¦ · the presence of 251,000 refugees. By 1997, following a large repatriation operation, this figure decreased to below

Protracted Relief and Recovery Operation – Bangladesh ...€¦ · the presence of 251,000 refugees. By 1997, following a large repatriation operation, this figure decreased to below

IS THE PERIPHYTIC STRUCTURE OF TESTACEANS …epa.oszk.hu/02500/02583/00038/pdf/EPA02583_applied_ ecology_2015_01_085097.pdf · Alves Corrêa et al.: Is the periphytic structure of

IS THE PERIPHYTIC STRUCTURE OF TESTACEANS …epa.oszk.hu/02500/02583/00038/pdf/EPA02583_applied_ ecology_2015_01_085097.pdf · Alves Corrêa et al.: Is the periphytic structure of

Case 1:13-cv-00038-KBF Document 11-2 Filed 02/26/13 Page 1 ... · 31/07/1996  · Case 1:13-cv-00038-KBF Document 11-2 Filed 02/26/13 Page 12 of 44 Case 1:13-cv-00038-KBF Document

Case 1:13-cv-00038-KBF Document 11-2 Filed 02/26/13 Page 1 ... · 31/07/1996  · Case 1:13-cv-00038-KBF Document 11-2 Filed 02/26/13 Page 12 of 44 Case 1:13-cv-00038-KBF Document

Mowbray Collectables Group Annual Report 2011 · $251,000 Bill Hammond, A Lullaby of Birdland $251,000 Bill Hammond, All Along the Heaphy Highway $240,000 Colin McCahon, Seaweed on

Mowbray Collectables Group Annual Report 2011 · $251,000 Bill Hammond, A Lullaby of Birdland $251,000 Bill Hammond, All Along the Heaphy Highway $240,000 Colin McCahon, Seaweed on

Case 7:08-cv-00038 Document 12 Filed 05/05/2008 Page 1 of 20 · 2015-08-06 · Case 7 08-cv-00038 Document 11 Filed 04/11/2008 Page 4 of 20 I. INTRODUCTION (A) On June 9, 2006, the

Case 7:08-cv-00038 Document 12 Filed 05/05/2008 Page 1 of 20 · 2015-08-06 · Case 7 08-cv-00038 Document 11 Filed 04/11/2008 Page 4 of 20 I. INTRODUCTION (A) On June 9, 2006, the

SNpprslailFieiagsufdcimages.uflib.ufl.edu › AA › 00 › 06 › 29 › 47 › 00038 › 00008.pdfCornnuittee, J. H. Crosby, W. N. .~ndit x d oelo, gI e whtpreml.hole rcsidelt..,

SNpprslailFieiagsufdcimages.uflib.ufl.edu › AA › 00 › 06 › 29 › 47 › 00038 › 00008.pdfCornnuittee, J. H. Crosby, W. N. .~ndit x d oelo, gI e whtpreml.hole rcsidelt..,

Marine Protected Areas in Washingtonwdfw.wa.gov/publications/00038/wdfw00038.pdf · Marine Protected Areas in Washington: ... Protection Level ... tribes also have a management interest

Marine Protected Areas in Washingtonwdfw.wa.gov/publications/00038/wdfw00038.pdf · Marine Protected Areas in Washington: ... Protection Level ... tribes also have a management interest

User Manual - Instrumart · Coriolis Flow Meters, RCT1000 with RCS005…300 Sensors. Page ii CRL-UM-00038-EN-08. February 2017

User Manual - Instrumart · Coriolis Flow Meters, RCT1000 with RCS005…300 Sensors. Page ii CRL-UM-00038-EN-08. February 2017

MARKET REVIEW Q1 Q1 2015pdf.dng.ie/pdf/Q12015DNGReport.pdfNote: the CSO RPPI Q1 2015 data only relates to the months of January and February 2015 Up to €250,000 €251,000 to €350,001

MARKET REVIEW Q1 Q1 2015pdf.dng.ie/pdf/Q12015DNGReport.pdfNote: the CSO RPPI Q1 2015 data only relates to the months of January and February 2015 Up to €250,000 €251,000 to €350,001

Notice of Decision: Approval – Effective Immediatelypermits.air.idem.in.gov/32627f.pdf · Nucor Steel 2nd SPM No. 107-32627-00038 Page 4 of 197 Crawfordsville, Indiana Modified

Notice of Decision: Approval – Effective Immediatelypermits.air.idem.in.gov/32627f.pdf · Nucor Steel 2nd SPM No. 107-32627-00038 Page 4 of 197 Crawfordsville, Indiana Modified

DIVERSITY AND ECOLOGY OF DIATOMS IN NORTHWEST OF …epa.oszk.hu › 02500 › 02583 › 00038 › pdf › EPA02583_applied... · study will contribute to the database of Algerian

DIVERSITY AND ECOLOGY OF DIATOMS IN NORTHWEST OF …epa.oszk.hu › 02500 › 02583 › 00038 › pdf › EPA02583_applied... · study will contribute to the database of Algerian

Ran1645-Hsupa 16qam Trial Report Rso Ro 00038

Ran1645-Hsupa 16qam Trial Report Rso Ro 00038

Case 9:19-mj-00038-JCL Document 3-2 Filed 06/18/19 Page 1 ...

Case 9:19-mj-00038-JCL Document 3-2 Filed 06/18/19 Page 1 ...