7 Fun Things to do with MapReduce Chris Hillman – Teradata Data
-
Upload
hannah-young -
Category
Documents
-
view
217 -
download
0
description
Transcript of 7 Fun Things to do with MapReduce Chris Hillman – Teradata Data
7 Fun Things to do with MapReduce
Chris Hillman – Teradata Data Scientist [email protected]@chillax7
AgendaMap Tasks
Face DetectionCharacter RecognitionSpeech to Text
ShufflingMass Spectrometer processing
ReducersText MiningActual Mining
Cluster Building
Face Detection in ImagesStepStep 1.
Get a good Open Source Library
Step 2.Check the
Example Code
@chillax7
Character RecognitionStepMore Complex Task
than Face DetectionSELECT * FROM RecognizeNumberPlate( ON anpr.vehiclelogs imagecol('recognizedobject'));
@chillax7
Speech to TextStep
Fed up with word count examples?
How about counting words in a recorded wav
file?@chillax7
ProteomicsStepMass Spectrometers
Create a lot of data….In XML format….It’s nasty to work with
@chillax7
Text MiningStepFirst phases are map
tasksText Extraction andParsing
@chillax7
Actual MiningStepComparing Seismic
surveys taken at different points in time??
@chillax7
Cluster BuildingStepWhy Build your own
cluster?• It’s fun• You learn lots• It gets you invited
to parties
Physical or Virtual?
Physical – more fun, looks
impressive, harder to build,
maintain, use, cost of power
Virtual – performance? Easier
to test, try different versions,
configurations@chillax7
Thank youChris [email protected]@chillax7www.bigdatablog.co.uk
=+ +