Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm
-
Upload
spagoworld -
Category
Technology
-
view
492 -
download
1
description
Transcript of Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm
![Page 1: Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm](https://reader034.fdocuments.us/reader034/viewer/2022042814/5538b0c9550346b4378b47fa/html5/thumbnails/1.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Extracting value from Big Data through a new information exploration paradigm
Monica Franceschini - SpagoBI Architect
SpagoBI Competency Center - Engineering Group
![Page 2: Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm](https://reader034.fdocuments.us/reader034/viewer/2022042814/5538b0c9550346b4378b47fa/html5/thumbnails/2.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
big data dimensions
![Page 3: Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm](https://reader034.fdocuments.us/reader034/viewer/2022042814/5538b0c9550346b4378b47fa/html5/thumbnails/3.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
3 scenarios
BYTES STREAM
SEMANTIC
BIG DATASETS
Analytics
SpagoBI for Big Data
![Page 4: Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm](https://reader034.fdocuments.us/reader034/viewer/2022042814/5538b0c9550346b4378b47fa/html5/thumbnails/4.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
big data storages
Data Source
Data Set
Visualization
In-MemoryIn-MemoryPersistencyPersistency
HiveQL
HBQL
CQL
SchedulationSchedulation
….
Impala
![Page 5: Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm](https://reader034.fdocuments.us/reader034/viewer/2022042814/5538b0c9550346b4378b47fa/html5/thumbnails/5.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
real-time
Data Streaming
In-MemoryIn-Memory
Event Dispatcher
VisualizationVisualization
SpagoBI Adapter
● Web Service
● Java API
● Queue
● ...
Event Handlers
● Dataset
● Alerts
● SMS
PersistencyPersistency
![Page 6: Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm](https://reader034.fdocuments.us/reader034/viewer/2022042814/5538b0c9550346b4378b47fa/html5/thumbnails/6.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
semantic approach
Semantic database
Explorative AnalysisExplorative AnalysisNetwork Analysis as Network Analysis as DRIVERDRIVER
Network Analysis Engine
MQL,Cypher, MQL,Cypher, SPARQLSPARQL......
Freebase,Freebase,Orient DB, Orient DB, Neo4J...Neo4J...
Classify and Categorize unstructured and heterogeneous data through semantic annotations, using domain ontologies.
FILTERFILTER
VisualizationVisualization
![Page 7: Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm](https://reader034.fdocuments.us/reader034/viewer/2022042814/5538b0c9550346b4378b47fa/html5/thumbnails/7.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
use casesTelecommunication companies: need to extract value from mobile data traffic information to improve services and advance new solutions
Public administration: need to extract value from information gathered from different sources (consumption, highway traffic, voice traffic) in order to improve the supply of tourist, environmental, social services
VALUE
BIG DATA
OPEN DATA
![Page 8: Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm](https://reader034.fdocuments.us/reader034/viewer/2022042814/5538b0c9550346b4378b47fa/html5/thumbnails/8.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
big data platform
RDBMSRDBMS DWHDWH Open Open DataData
NoSQLNoSQL
Local Local ServicesServices
AP
I OR
CH
ES
TR
AT
ION
AP
I OR
CH
ES
TR
AT
ION
Data Data MarketplaceMarketplace
Pro
cess
/P
roce
ss/
Ser
vice
s d
esig
ner
Ser
vice
s d
esig
ner
Cloud Cloud servicesservices
Dataset SpagoBI
SpagoBISpagoBI ......
API
Data Data MarketplaceMarketplaceSpagoBISpagoBI
......
Cleaning & IntegrationCleaning & Integration
Analysis & VisualizationAnalysis & Visualization
![Page 9: Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm](https://reader034.fdocuments.us/reader034/viewer/2022042814/5538b0c9550346b4378b47fa/html5/thumbnails/9.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
data “measures”
Data
Does size matter?Does size matter?Big Data are different Big Data are different types...Big Data are types...Big Data are something more!!!something more!!!
![Page 10: Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm](https://reader034.fdocuments.us/reader034/viewer/2022042814/5538b0c9550346b4378b47fa/html5/thumbnails/10.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
dashboardsUse cockpits to:
Aggregate analysis to Aggregate analysis to get information at a get information at a
glanceglance
Filter data using Filter data using specific documents specific documents
Make different kinds of Make different kinds of documents interact documents interact
with each otherwith each other
![Page 11: Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm](https://reader034.fdocuments.us/reader034/viewer/2022042814/5538b0c9550346b4378b47fa/html5/thumbnails/11.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
self-serviceUse Free Enquiry
engine to:
Define your own queries Define your own queries over datasetsover datasets
Create new datasets in a Create new datasets in a graphical and smart waygraphical and smart way
Refine your analysisRefine your analysis
![Page 12: Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm](https://reader034.fdocuments.us/reader034/viewer/2022042814/5538b0c9550346b4378b47fa/html5/thumbnails/12.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
ad-hoc reportingUse
Worksheet to:
Provide an instant Provide an instant graphical meaning to graphical meaning to
your datasetsyour datasetsCreate a prototype for Create a prototype for your projectyour project
Interact with Qbe to Interact with Qbe to refresh your datarefresh your data
![Page 13: Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm](https://reader034.fdocuments.us/reader034/viewer/2022042814/5538b0c9550346b4378b47fa/html5/thumbnails/13.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
agile developmentQuery
Create charts
Refine the query
Persist
New query
![Page 14: Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm](https://reader034.fdocuments.us/reader034/viewer/2022042814/5538b0c9550346b4378b47fa/html5/thumbnails/14.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
what comes next?Unstructured &
heterogeneous data
Statistical computing
Text mining
Sentiment analysis
...and more...
NEW VISUALIZATION
![Page 15: Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm](https://reader034.fdocuments.us/reader034/viewer/2022042814/5538b0c9550346b4378b47fa/html5/thumbnails/15.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
open-source as a resource
Big-data through Open Source tools:– Technologically feasible– No product costs– Experimental proposals on well-known
domains– Exploration of new domains– Investment skills (data scientist)
![Page 16: Solutions Linux 2013: Extracting value from Big Data through a new information exploration paradigm](https://reader034.fdocuments.us/reader034/viewer/2022042814/5538b0c9550346b4378b47fa/html5/thumbnails/16.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
contacts
http://www.caribbean-tour.com/Contact-Us.html
Find out all information (demo, documentation, tutorials, services and much more)
and download all SpagoBI components at:www.spagobi.orgwww.spagobi.org
Contact [email protected]@eng.it