Big Data and Wee Data by Avery Rosen
-
Upload
hakka-labs -
Category
Technology
-
view
312 -
download
0
description
Transcript of Big Data and Wee Data by Avery Rosen
![Page 1: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/1.jpg)
MongoDB and Wee Data
hacking a workflow
![Page 2: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/2.jpg)
what it’s all about
• MongoDB lets you persist and investigate your application data while getting out of your way
• p.s. BDD
![Page 3: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/3.jpg)
me
• http://bringingfire.com/
• @4BringingFire
• expertise at the intersection of technology, product formulation, and business strategy
![Page 4: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/4.jpg)
stuff I’m into
• products > tech
• UX testing
• iterative, analytics-driven dev
• agility in production
![Page 6: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/6.jpg)
these guys © wired.com
![Page 8: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/8.jpg)
total projectsbig data projects= ?< 1%NOT AN
ACTUAL FACT
![Page 9: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/9.jpg)
what is wee data?
• query performance is not an issue
• in fact it might fit in RAM
• in fact it might fit in 2MB
![Page 10: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/10.jpg)
where mongo fits
• scales down nicely
• access programmatically without SQL
• persists for free
• query later, too
![Page 11: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/11.jpg)
ORMpuh-lease.
![Page 13: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/13.jpg)
Behavior Driven Development
• “Outside-in” approach
• Everything is behavior
• Acceptance-test-driven planning
• Ubiquitous language
![Page 14: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/14.jpg)
Cucumber
![Page 15: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/15.jpg)
Cucumber
![Page 16: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/16.jpg)
Cucumber
![Page 17: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/17.jpg)
Cucumber
![Page 18: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/18.jpg)
rspec
• specification
• object doubles (mocks, fakes, stubs, spies)
• method stubbing
• expectations
![Page 19: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/19.jpg)
![Page 20: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/20.jpg)
Behavior Driven Development
• http://cukes.info/
• http://rspec.info/
![Page 21: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/21.jpg)
Name Materials Price Description
fancy menorah gold, silver 600
plain menorah pewter 150
the Penrose ETL pipeline
Product Spreadsheets
.csv.csv.csv
CSV files Product Descriptions
Blah blah blah exquisite
craftsmanship
db.products.aggregate( { $match : { product_type : “menorah” } }, { $group : { _id: “$material”, count:
{ $sum : 1 } } )
Buy AdWords?
![Page 22: Big Data and Wee Data by Avery Rosen](https://reader034.fdocuments.us/reader034/viewer/2022052505/554f4656b4c90572088b569f/html5/thumbnails/22.jpg)
Q & A