Cahill Technical singlepageTitle Cahill Technical singlepage Created Date 6/25/2015 12:39:56 PM
Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application...
Transcript of Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application...
![Page 1: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/1.jpg)
Big Data Architectures
Tom Cahill, Vice President Worldwide Channels, Jaspersoft
![Page 2: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/2.jpg)
Jaspersoft + Big Data = Fast Insights
©2012 Jaspersoft Corporation. Proprietary and Confidential 2
“Success in the Big
Data era is more than
about size. It’s about
getting insight from
these huge data sets
more quickly”
Doug Henschen
InformationWeek
![Page 3: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/3.jpg)
©2012 Jaspersoft Corporation. Proprietary and Confidential 3
“Big Data”
Large data sets, growing too big for conventional DBMS
tools
Where? Science (meteorology, genomics, connectomics, complex physics
simulations, biological environmental research)
Industry / government (information-sensing devices, aerial sensory
technologies (remote sensing), software logs, cameras, microphones,
radio-frequency identification readers (RFID), and wireless sensor
networks
Consumers / consumer-related (social networks, social data, internet text
and documents, internet search indexing, call detail records, web logs,
medical records, photography archives, video archives…
![Page 4: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/4.jpg)
©2012 Jaspersoft Corporation. Proprietary and Confidential 4
Challenges
Managing
capture, storage, search, sharing, analytics and visualization
Validity
relevance, value, interpretation and time
Who
younger, consumer-type decision-makers, self-service
expectations, ubiquity of access (mobile), simplicity of use,
elegance of design
![Page 5: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/5.jpg)
©2012 Jaspersoft Corporation. Proprietary and Confidential 5
More definitions…
Hadoop (Apache)
A framework to support distributed applications
Enables applications to work with many (many) independent
computers and lots (lots) of data
Derived from Google MapReduce
Free, OS
…with a number of commercial offerings (IBM, Greenplum,
Cloudera etc)
MapReduce
Google patent
Interface “too low-level” for today’s needs in big data…?
Recent Hadoop and HBase developments move the story
forward…
![Page 6: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/6.jpg)
©2012 Jaspersoft Corporation. Proprietary and Confidential 6
More definitions Contd…
Hbase
Non-relational, distributed database
Adding BigTable capabilities to Hadoop
Also OS
Hive
Data Warehouse built on Hadoop
Originally developed by Facebook; now used by eg Netflix
Included on Amazon Web Services
![Page 7: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/7.jpg)
©2012 Jaspersoft Corporation. Proprietary and Confidential 7
Jaspersoft – Leading BI for Big Data
Most Comprehensive Big Data support
Partnerships
Access methods
Connectors
![Page 8: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/8.jpg)
Big Data Partnerships
©2012 Jaspersoft Corporation. Proprietary and Confidential
Hadoop NoSQL/NewSQL Analytic DBMS
![Page 9: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/9.jpg)
©2012 Jaspersoft Corporation. Proprietary and Confidential 9
Big Data Access Methods
Support for batch oriented reporting & analysis HIVE or standard JDBC interface
ETL or ELT out of Hadoop into RDBMS for analysis/reporting
Formatted layout, delivered daily, weekly, monthly, etc.
Support for interactive reporting & analysis Uses native interfaces to HBase, MongoDB, etc.
Ideal for data exploration
Low-latency ‘speed of thought’ queries
Presented via intuitive Ad Hoc Analysis UI for broader appeal & adoption
Unified Analysis Interface supports relational, OLAP, and Big Data source
exploration
![Page 10: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/10.jpg)
Approach Interactive Exploration Direct Batch Reporting Indirect Batch Analysis
Use Case For data analysts and data scientists
who want to discover real-time
patterns as they emerge from their
Big Data content
For executives and operational
managers who want summarized,
pre-built daily reports on Big Data
content
For data analysts and operational
managers who want to analyze historical
trends based upon pre-defined
questions in their Big Data content
Latency Low Medium High
Big Data HBase, NoSQL, Analytic DBMS Hive, NoSQL, Analytic DBMS Hadoop, NoSQL, Analytic DBMS
Connectivity Native Native, SQL ETL
Architecture
3 Approaches to Big Data Analysis
©2012 Jaspersoft Corporation. Proprietary and Confidential
10
BI Platform
BIG
DATA
In-Memory Engine
Native
BI Platform
BIG
DATA
Native SQL
BI Platform
BIG
DATA
OLAP Engine
Data
Mart
ETL
Multi-Dimensional
Analysis
Reports &
Dashboards
Multi-Dimensional
Analysis
![Page 11: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/11.jpg)
Technical Details of Big Data
Connectors – HBase example
Direct, native connectivity to HBase Using a JSON-like query language
Supports all of HBase filter APIs StartRow, EndRow, RowFilter, FamilyFilter, ValueFilter etc.
Can specify exactly the ColumnFamilies and/or Qualifiers returned
Contains a deserialization (SerDe) engine framework Users can plug in their own deserialization .jars
Converts HBase raw bytes into meaningful data types
Optimized performance
©2012 Jaspersoft Corporation. Proprietary and Confidential 11
![Page 12: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/12.jpg)
Big Data Connectors
Cassandra
CouchDB
EhCache
GemFire
Hadoop Avro
Hadoop HBase
Hadoop Hive
MarkLogic
Membase
MongoDb
Neo4j
Redis
Solr
SpringData – Redis
VoltDb
©2012 Jaspersoft Corporation. Proprietary and Confidential 12
![Page 13: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/13.jpg)
©2012 Jaspersoft Corporation. Proprietary and Confidential 13
Trends in Big Data Sources
![Page 14: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/14.jpg)
ABOUT JASPERSOFT
©2012 Jaspersoft Corporation. Proprietary and Confidential 14
![Page 15: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/15.jpg)
More than 40 global partners including:
Quick Jaspersoft Company Data
Recognized by industry
analysts and journalists: 50%-60% Growth FY’09 – FY’12 Year-over-Year sales growth
Magic Quadrants
![Page 16: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/16.jpg)
Jaspersoft Community
©2012 Jaspersoft Corporation. Proprietary and Confidential 16
Worldwide Adoption
Over 15 million product downloads
Over 14,000 Commercial Customers
Over 1,000 Software Subscribers
175,000 production deployments
250,000 registered community members
Every Minute …
6 product downloads
Every Day …
250 new community members
30,000 users building BI apps
Every Month …
250 New Customers
![Page 17: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/17.jpg)
Jaspersoft Customers
©2012 Jaspersoft Corporation. Proprietary and Confidential 17
Software & Technology
Financial Services
Public Sector
Telecommunications
Travel & Transportation
Manufacturing
Healthcare/Pharmaceutical
250,000 Community. 175,000 Production Deployments. 14,000 Customers.
![Page 18: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/18.jpg)
Jaspersoft Big Data Customers
©2012 Jaspersoft Corporation. Proprietary and Confidential
Customer Description
Connecting to Hadoop
Using Jaspersoft withMongoDB
connector
Connection to Hapoop Hive
![Page 19: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/19.jpg)
A Modern End-to-End BI Suite
Intuitive, consumer web application look-and-feel
Interactive reports, analysis & dashboards for BI self service
Native and browser-based mobile business intelligence
©2012 Jaspersoft Corporation. Proprietary and Confidential 19
“New prospects see the dashboards, the drag-and-drop ad hoc query, and aesthetics,
and say: ‘Wow. We didn’t know you guys could do this.’ And it’s getting us new business – lots of it.” Bruce Belvin,
President
![Page 20: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/20.jpg)
A Flexible End-to-End BI Suite
Easy to deploy standalone or embedded
Easy to deploy on-premises or in the cloud
Easy to customize or extend and include any data source
©2012 Jaspersoft Corporation. Proprietary and Confidential 20
Events (.js)
Presentation (.css)
Structure (.jsp)
Business Logic (.java)
Exte
nsiv
e A
PIs
100% Web-Standards Architecture “It’s all standards-based and we were able to apply the skills we had developed elsewhere. It was very easy for us to absorb the Jaspersoft technology into our system architecture” Jeremy
Walters, Director, Systems Development
![Page 21: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/21.jpg)
An Affordable End-to-End BI Suite
Affordable commercial open source subscription
Fast, low-cost implementations
Cost-effective support, commercial or community
©2012 Jaspersoft Corporation. Proprietary and Confidential 21
“Because we wanted to be able to grow and change as our needs evolved, we chose what we felt was the more ‘future-proof’ platform. That and a very low cost of ownership made our choice fairly easy.” John Sweet-
Escott, Project Director
Source: Third Nature, ”Lowering the Cost of Business Intelligence
with Open Source” 2011
![Page 22: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/22.jpg)
Try Out Jaspersoft Today
Download Download 30-day Evaluation of Jaspersoft BI
Enterprise at Jaspersoft.com
Go to Jaspersoft.com/getting-started for setup tips
On-Demand Trial Try our Live Online version – NO INSTALLATION!
Go to Jaspersoft.com/jaspersoft-live-trial
Use for 7-days
© 2012 Jaspersoft Corporation.
![Page 23: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/23.jpg)
Q & A
© 2012 Jaspersoft Corporation.
@Jaspersoft
France: + 33 9 70 44 40 19
openbookonbi.blogspot.com – Brian Gentile CEO
![Page 24: Big Data Architectures Tom Cahill,A Modern End-to-End BI Suite Intuitive, consumer web application look-and-feel Interactive reports, analysis & dashboards for BI self service Native](https://reader034.fdocuments.us/reader034/viewer/2022042301/5ecc4a6c605884719c086ba6/html5/thumbnails/24.jpg)
Thank You