DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in...
-
Upload
duongxuyen -
Category
Documents
-
view
213 -
download
0
Transcript of DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in...
![Page 1: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes](https://reader031.fdocuments.us/reader031/viewer/2022022515/5afa20267f8b9aff288e1253/html5/thumbnails/1.jpg)
June 28, 2017 Predictable Hybrid Big Data
DataOps at Scale – Taking Apache Hadoop Enterprise-Wide
![Page 2: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes](https://reader031.fdocuments.us/reader031/viewer/2022022515/5afa20267f8b9aff288e1253/html5/thumbnails/2.jpg)
@ODPiOrg
TODAY’S PRESENTERS
2
John Mertic, Director of Program Management, ODPi
Tamara Dull, Director of Emerging Technologies,SAS Institute
![Page 3: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes](https://reader031.fdocuments.us/reader031/viewer/2022022515/5afa20267f8b9aff288e1253/html5/thumbnails/3.jpg)
@ODPiOrg
![Page 4: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes](https://reader031.fdocuments.us/reader031/viewer/2022022515/5afa20267f8b9aff288e1253/html5/thumbnails/4.jpg)
@ODPiOrg
SIZE ISN’T THE REAL CHALLENGE
![Page 5: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes](https://reader031.fdocuments.us/reader031/viewer/2022022515/5afa20267f8b9aff288e1253/html5/thumbnails/5.jpg)
@ODPiOrg
ENTERPRISE HADOOP DEPLOYMENT CONTINUUM
![Page 6: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes](https://reader031.fdocuments.us/reader031/viewer/2022022515/5afa20267f8b9aff288e1253/html5/thumbnails/6.jpg)
@ODPiOrg6
Does your company use Hadoop in production?
a. Yes
b.No
c. Unsure
d.What is Hadoop in production?
POLLING QUESTION #1
![Page 7: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes](https://reader031.fdocuments.us/reader031/viewer/2022022515/5afa20267f8b9aff288e1253/html5/thumbnails/7.jpg)
@ODPiOrg
DATAOPS @ ENTERPRISE-WIDE
![Page 8: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes](https://reader031.fdocuments.us/reader031/viewer/2022022515/5afa20267f8b9aff288e1253/html5/thumbnails/8.jpg)
@ODPiOrg8
What stage are most of your Hadoop deployments?
a. Lab
b.PoC
c. Pilot
d.Enterprise-wide production
POLLING QUESTION #2
![Page 9: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes](https://reader031.fdocuments.us/reader031/viewer/2022022515/5afa20267f8b9aff288e1253/html5/thumbnails/9.jpg)
@ODPiOrg
ENTERPRISE PRODUCTION HADOOP NEEDS
![Page 10: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes](https://reader031.fdocuments.us/reader031/viewer/2022022515/5afa20267f8b9aff288e1253/html5/thumbnails/10.jpg)
@ODPiOrg10
What challenges did you encounter while expanding Hadoop use?
a. Data governance and security
b.App lifecycle management
c. Deployment cloud/on-prem
d.Application portability
POLLING QUESTION #3
![Page 11: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes](https://reader031.fdocuments.us/reader031/viewer/2022022515/5afa20267f8b9aff288e1253/html5/thumbnails/11.jpg)
@ODPiOrg
ENTERPRISE HADOOP ADOPTIONHardening Hadoop as an Enterprise-wide Production Platform
![Page 12: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes](https://reader031.fdocuments.us/reader031/viewer/2022022515/5afa20267f8b9aff288e1253/html5/thumbnails/12.jpg)
@ODPiOrg
ENTERPRISE HADOOP CHALLENGES
Modern data tools and platforms are non-trivial ( by design )
Enterprise deployment pattern considerations don’t make it upstream
Interoperability standards are inconsistent, even though
platform vendors often derive from the same codebase
![Page 13: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes](https://reader031.fdocuments.us/reader031/viewer/2022022515/5afa20267f8b9aff288e1253/html5/thumbnails/13.jpg)
@ODPiOrg
13
INFRASTRUCTURE NOT BOUND TO A DATACENTER
![Page 14: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes](https://reader031.fdocuments.us/reader031/viewer/2022022515/5afa20267f8b9aff288e1253/html5/thumbnails/14.jpg)
@ODPiOrg
GET INVOLVED WITH ODPi
![Page 15: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes](https://reader031.fdocuments.us/reader031/viewer/2022022515/5afa20267f8b9aff288e1253/html5/thumbnails/15.jpg)
@ODPiOrg