It's not the size of your cluster, it's how you use it
22
It's Not the Size of Your Cluster, It's How You Use It David Darden – Director of BI Engineering Don Smith – BI Manager
-
Upload
hadoop-summit -
Category
Technology
-
view
394 -
download
4
Transcript of It's not the size of your cluster, it's how you use it
It's Not the Size of Your Cluster, It's How You Use ItDavid Darden Director of BI EngineeringDon Smith BI Manager
1
AgendaAbout UsHow We Pitched the Initial InvestmentHow We Structured the TeamHow We Approached the Initial Build OutQ & A
About Us
About UsBig Fish Business Intelligence Engineering TeamWorld's largest producer and distributor of casual gamesBig Fish has distributed more than 2.5 billion games to customers in more than 150 countriesSmall, agile, business focused Owners of the Enterprise Data Warehouse
David Darden [email protected] [email protected]
Gummy Drop
5
High Level GoalsProvide the right data to the right people at the right timeDeliver business value fastGive people the tools they need to do their jobMinimize reliance on engineering
Business intelligence (BI) is the set of techniques and tools for the transformation of raw data into meaningful and useful information for business analysis
Major Use Cases
7
Our Architecture
How We Pitched the Initial Investment
Where We StartedHeld on to goals tightly, methods looselyLet the business need buildAssessed technology on current/future stateUsed partners
10
What WorkedSetting up the optionsFocusing on compelling business deliverablesIterating over key business problemsTying business and technology goals together
11
What We LearnedWhat Didnt WorkPredicting the futureFulfilling all use cases
TakeawaysFocus on the business caseLeverage your partnersMaintain flexibility
12
How We Structured the Team
13
Where We StartedBegan with little expertise / lots of smart peopleWorked with partnersTried to hire experienced engineers
14
What WorkedBringing in people with experiencePairing and sharing knowledgeLearning through doing real projects
What We LearnedWhat Didnt WorkHiringGetting people up to speedSegmenting the team
TakeawaysUse expertise / train internallySwitch people out judiciously
16
How We Approached the Initial Build Out
Where We StartedFocused on incremental deliveryUsed business projects to address platform projectsShared ownership across organizationCommunicated frequently
18
What WorkedTackling one-off projectsIncrementally building systems/showing valueTransitioning users gradually
19
What We LearnedWhat Didnt WorkAssuming our old support approach would workUnderestimating Total Cost of OwnershipCommunicating platform status
TakeawaysLeverage your vendor(s)Plan for total cost (money and people)Prepare for upgradesInspect and adapt frequently
20
Questions?
Thank you!David Darden [email protected] [email protected]
![RESEARCH OpenAccess Acluster-basedselectivecooperative ......the cluster header. A similar problem can be observed in the cluster scheme in [9], though the optimal cluster size to](https://static.fdocuments.us/doc/165x107/6078dd37d7034c682c4151e3/research-openaccess-acluster-basedselectivecooperative-the-cluster-header.jpg)