New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe

28
ISC BIG DATA – October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum THE BIG PROJECT: RESULTS AND IMPACT October 2nd, Heidelberg Edward Curry, Insight @ NUI Galway Nuria de Lama, Representative of Atos Research & Innovation to the EC

description

In this video from the ISC Big Data'14 Conference, Edward Curry from the NUI Galway & Nuria de Lama Sanchez from Atos present: New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe. "In this talk we summarize the results of the BIG project including analysis of foundational Big Data research technologies, technology and strategy roadmaps to enable business to understand the potential of Big Data technologies across different sectors, together with the necessary collaboration and dissemination infrastructure to link technology suppliers, integrators and leading user organizations." Learn more: http://www.isc-events.com/bigdata14/schedule.html and http://big-project.eu/ Watch the video presentation: http://wp.me/p3RLEV-37G

Transcript of New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe

  • 1. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum THE BIG PROJECT: RESULTS AND IMPACT October 2nd, Heidelberg Edward Curry, Insight @ NUI Galway Nuria de Lama, Representative of Atos Research & Innovation to the EC
  • 2. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 2 BIG DATA: EUROPE NEEDS TO REACT! Big Data is mainstream in North America, but Europe lagged behind due to Size factor: smaller organizations and smaller data sets Expensive, scarce data analytics skills Economic crisis, cautiousness in new investments
  • 3. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 3 BIG DATA IN EUROPE Possibly one of the few last chances for Europes software industry to take a true leadership K-H Streibich, CEO This is a revolution: and I want the EU to be right at the front of it. Neelie Kroes, Vice-President of the European Commission responsible for the Digital Agenda, March 2013
  • 4. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 4 The BIG Project BIG aims to promote a well-developed EU industrial landscape in Big Data: Providing a clear picture of existing technology trends and their maturity Acquiring a sharp understanding of how Big Data can be applied to concrete environments / use cases Pushing European Big Data research and innovation to contribute to European competitiveness (define how the future should look like) Building a self-sustainable, industry-led initiative (implementation) Overall Objective Work at technical, business and policy levels, shaping the future through the positioning of IIM and Big Data specifically in Horizon 2020. Bringing the necessary stakeholders into a self-sustainable industry-led initiative, which will greatly contribute to enhance the EU competitiveness taking full advantage of Big Data technologies.
  • 5. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 5 A PAN-EUROPEAN EFFORT Funding: Euros 2.499.998,00 Duration: 26 months
  • 6. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 6 BIG - THREE LEVEL APPROACH Big Data Public Private Partnership Impact Assessment Sustainability Towards Horizon 2020 Roadmapping activity Individual roadmap elaboration (per sector) Roadmap consolidation (cross-sectorial) Technology state of the art and sector analysis Definition of the proposed application sectors Asses the impact/applicability of the different technologies Big Data Initiative definition
  • 7. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 7 HOW: SECTORIAL FORUMS AND TECHNICAL WORKING GROUPS Health Public Sector Finance & Insurance Telco, Media& Entertainment Manufacturing, Retail, Energy, Transport Needs Offerings Big Data Value Chain Technical Working Groups Industry Driven Sectorial Forums Data Acquisition Data Analysis Data Curation Data Storage Data Usage Structured data Unstructured data Event processing Sensor networks Protocols Real-time Data streams Multimodality Stream mining Semantic analysis Machine learning Information extraction Linked Data Data discovery Whole world semantics Ecosystems Community data analysis Cross-sectorial data analysis Data Quality Trust / Provenance Annotation Data validation Human-Data Interaction Top-down/Bottom-up Community / Crowd Human Computation Curation at scale Incentivisation Automation Interoperability In-Memory DBs NoSQL DBs NewSQL DBs Cloud storage Query Interfaces Scalability and Performance Data Models Consistency, Availability, Partition- tolerance Security and Privacy Standardization Decision support Prediction In-use analytics Simulation Exploration Visualisation Modeling Control Domain-specific usage
  • 8. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 8 RELEVANT SOURCES: SUBJECT MATTER EXPERT INTERVIEWS
  • 9. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 9 AVAILABILITY OF A WIDE SPECTRUM OF RESULTS Interviews, Technical White Papers, Sector's requisites and Roadmaps available on: http://www.big-project.eu Expert Interviews Technical Whitepapers Executive Overview Key Insights Social & Economic Impact Concise State of the Art Future Requirements & Emerging Trends Sector-specific Case Studies
  • 10. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 10 THE DATA LANDSCAPE Big Data technology is mostly evolutionary Old technologies applied in a new context Volume, Variety, Velocity, Value Business processes change must be revolutionary to enable new opportunities Technology Evolution Process Revolution The long tail of data variety is a major shift in the data landscape Variety Reuse Cross-sectorial uses of Big Data will open up new business opportunities
  • 11. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 11 BIGGEST BLOCKERS Lack of Business-driven Big Data strategies Undiscovered & unclaimed business values Data Sharing & Exchange Need for format and technology standards Data Privacy and Security Regulations & markets for data access Legal frameworks for data sharing & communication are needed Human resources Lack of skilled data scientists and data engineers Key Technical Requirements
  • 12. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 12 COMMON REQUIREMENTS Data Privacy and Security Legal frameowrks for data sharing & communication are needed Investment Long-term investments require conjoint engagement of several partners Not-Technology-related Data Digitalization only small percentage of data is documented (lack of time) with low quality Data Enrichment transform unstructured data into structured format Data Sharing & Integration Overcome data silos and inflexible interfaces Business Cases Undiscovered und unclaimed potential business values Regulation & Technology Technology-related Data Quality Reliable insights for health-related decisions require high data quality Openness Leadership to promote common standards for Open Data: APIs, format and schemas, as well as covering licensing and legal aspects Data ownership Fragmentation of data ownership that leads to the data silo and interoperability issues
  • 13. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 13 SECTORIAL ROADMAPS Health Public Sector Finance & Insurance Telco, Media& Entertainment Manufacturing, Retail, Energy, Transport
  • 14. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum PUBLIC PRIVATE PARTNERSHIP
  • 15. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 15 MOTIVATION Needs for everyone to remain competitive Opportunities for only a few?
  • 16. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 16 Europe has to react! A Call for Action a public private partnershipcan be a powerful way to work togetherPublic money is not free money. Before you can unlock it you need a very clear plan, showing how any public investment will work, how it connects to the activities around it, and how it will pay offwe need a Strategic Research and Innovation Agenda from a broad, inclusive and representative basis, pulling together different priorities, so they make sense we need to do all this quickly, and to the highest quality Neelie Kroes Vice-President of the European Commission
  • 17. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 17 DRIVERS NESSI Partners NESSI Membership > 450 members http://www.nessi-europe.eu/ http://www.big-project.eu/ http://www.bigdatavalue.eu/
  • 18. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 18 THE BIG DATA VALUE PPP (PUBLIC-PRIVATE PARTNERSHIP) The goal of the Big Data Public Private partnership is to increase the amount of productive European economic activities and the number of European jobs that depend on the availability of high quality data assets and the technologies needed to derive value from them. European cross-organizational and cross-sector environments Meeting point for different stakeholders (small, big companies, academiasupply & demand) to discover economic opportunities based on data integration and analysis Resources to develop working prototypes to test the viability of actual business development Availablity of data assets (secure environments to enhance data sharing; i.e. not only open data) Technologies to derive value from them (this could entail bringing analytics close to data)
  • 19. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 19 MUTIDISCIPLINARITY
  • 20. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 20 I-SPACES: THE RELEVANCE OF THE ECOSYSTEM Technology A true open innovation ecosystem
  • 21. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 21 BUILDING UPON EXISTING INFRASTRUCTURES AND TECHNOLOGIES: DATA INCUBATORS TeraLab (FR): digital services platform that provides both the research community and businesses, with an environment conducive to research and experimentation focused on innovative applications and industrial prototypes in the field of Big Data Physical resources (including a substantial processing capacity with several teraoctets of RAM), huge databases and various cutting-edge applications and tools (through SAAS/PAAS model) Facilitating batch or real-time processing and storage of huge amounts of data Data assets: anonymous, publicly-available information (e.g. OpenStreetMap, Common Crawl), and open data, but also data which has been processed to render it anonymous, provided by professional sources Access via secure and ultra-secure systems using technology provided by the CASD (Centre for Secure Remote Access). SDIL (DE): Similar approach in the domains of Industry 4.0 Energy Smart Cities Health
  • 22. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 22 RESEARCH PRIORITIES Privacy and anonymisation mechanisms Improving understanding of data by deep analytics (e.g. predictive modelling, graph mining, ...) Optimized Architectures for analysing data including real-time data (e.g.recommendation engines, ...) Visualization and user experience (e.g. User adaptive systems, search capabilities, ...) Data management engineering (e.g. Data integration, data integrity, ...) Innovation Spaces serve as hubs for bringing the technology and application developments together and cater for the development of skills, competence, and best practices. Lighthouse Projects Large scale demonstrations focusing on certain sectors and domains Research Priorities Instruments
  • 23. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 23 ESTIMATED EXPECTED R&D OUTCOMES Year 1 Year 2 Year 3 Year 4 Year 5 Priority : privacy and anonymisation Generalisation of Secure Remote Data Access Centre techniques. Method for deletion of data and data minimization. Robust anonymisation algorithms Priority : deep analysis Improved statistical models by enabling fast non-linear approximations in very large datasets Predictive modeling Graph mining techniques applied on extremely large graphs Real-time analytics Semantic analysis in near-real-time Algorithms for multimedia data mining Deep learning techniques Descriptive language for deep analytics. Contextualisation. Priority : architectures for analytics of data at rest and in motion Optimized tools for the integration of existing components to new types of platforms with both data at rest and in motion. Synergies between massively parallel architectures (MPP) and batch processing/stream processing architectures Priority : advance visualisation New data search solutions / paradigms Semantic driven data visualisation stronger links between visualization and analytics User adaptation Collaborative real- time, dynamic 3D solutions Priority : engineering data management APIs for improving the process of data transformation Collaborative Tools and techniques for Data Quality (including integrity and veracity check) Harmonized description format for meta-data Methodology, models and tools for data lifecycle management Data management as a service
  • 24. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 24 BIG DATA CHALLENGES EXPAND TECHNOLOGY Privacy & Regulation Incentives and awareness to foster adoption Traditional industries New industries Business models and commercialization Skills
  • 25. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 25 PROCESS & TIMING Launch of the BDV PPP Investment of approximately 1068M for [2016-2020]
  • 26. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 26 STAKEHOLDER INVOLVEMENT Big Data Strategies of User Industry, Source: Morgan Stanley
  • 27. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 27 VALUE PROPOSITION Technology and data assets development Means for benchmarking and testing performance of some core technologies (querying, indexing, feature extraction, predictive analytics, visualization) business applications evaluated according to different criteria (ex. usability) Development of business models Optimizing existing industries New business models along new value chains Improvement of the skills of data scientists and domain practitioners (enrich educational offering) Dissemination of best practices showcases to stimulate big data adoption and transfer of solutions across sectors Analysis of societal impact transfer of data management practices to domains of societal interest (health, environment)
  • 28. ISC BIG DATA October 2nd, 2014 - Heidelberg BIG Big Data Public Private Forum 28 FORMAL SIGNING EVENT OF THE PPP Date: 13th October 2014 Place: Brussels Contact: [email protected], mentioning "Event for the Big Data PPP Signature" in the subject field