Apache’IgniteTM...

11
Apache®, Apache Ignite, Ignite®, and the Apache Ignite logo are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. DMITRIY SETRAKYAN Founder, PPMC Apache Ignite TM (Incubating) InMemory Data Fabric Fast Data Meets Open Source http://www.ignite.incubator.apache.org @apacheignite @dsetrakyan

Transcript of Apache’IgniteTM...

Page 1: Apache’IgniteTM (Incubating))A)In:Memory’Data’Fabric’files.meetup.com/3168962/Apache-Ignite...Data...15.pdfApache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

DMITRIY  SETRAKYAN  Founder,  PPMC  

Apache  IgniteTM  (Incubating)  -­‐  In-­‐Memory  Data  Fabric  Fast  Data  Meets  Open  Source

http://www.ignite.incubator.apache.org @apacheignite @dsetrakyan

http://www.ignite.incubator.apache.org
Page 2: Apache’IgniteTM (Incubating))A)In:Memory’Data’Fabric’files.meetup.com/3168962/Apache-Ignite...Data...15.pdfApache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

Apache  Ignite  In-­‐Memory  Data  Fabric

Page 3: Apache’IgniteTM (Incubating))A)In:Memory’Data’Fabric’files.meetup.com/3168962/Apache-Ignite...Data...15.pdfApache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

• JCache  (JSR  107)  – Basic  Cache  Operations  – ConcurrentMap  APIs  – Collocated  Processing  (EntryProcessor)  – Events  and  Metrics  – Pluggable  Persistence  

• Ignite  Data  Grid  – ACID  Transactions  – SQL  Queries  (ANSI  99)  – In-­‐Memory  Indexes  – On-­‐Heap  &  Off-­‐Heap  Memory  – Automatic  RDBMS  Integration

Data  Grid:  JCache  (JSR  107)

Page 4: Apache’IgniteTM (Incubating))A)In:Memory’Data’Fabric’files.meetup.com/3168962/Apache-Ignite...Data...15.pdfApache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

Data  Grid:  Partitioned  Cache

Page 5: Apache’IgniteTM (Incubating))A)In:Memory’Data’Fabric’files.meetup.com/3168962/Apache-Ignite...Data...15.pdfApache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

Data  Grid:  Replicated  Cache

Page 6: Apache’IgniteTM (Incubating))A)In:Memory’Data’Fabric’files.meetup.com/3168962/Apache-Ignite...Data...15.pdfApache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

• ANSI-­‐99  SQL  • Always  Consistent  • Fault  Tolerant  • In-­‐Memory  Indexes  (On-­‐Heap  and  Off-­‐Heap)  • Automatic  Group  By,  Aggregations,  Sorting  • Cross-­‐Cache  Joins,  Unions,  etc.  • Ad-­‐Hoc  SQL  Support

Data  Grid:  Ad-­‐Hoc  SQL  (ANSI  99)

Page 7: Apache’IgniteTM (Incubating))A)In:Memory’Data’Fabric’files.meetup.com/3168962/Apache-Ignite...Data...15.pdfApache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

• Direct  API  for  MapReduce  • Zero  Deployment  • Cron-­‐like  Task  Scheduling  • State  Checkpoints  • Load  Balancing  • Automatic  Failover  • Full  Cluster  Management  • Pluggable  SPI  Design

Clustering  &  Compute

Page 8: Apache’IgniteTM (Incubating))A)In:Memory’Data’Fabric’files.meetup.com/3168962/Apache-Ignite...Data...15.pdfApache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

• Streaming  Data  Never  Ends  • Branching  Pipelines  • Sliding  Windows  • SQL  &  Pluggable  Indexing  • CEP  &  Continuous  Queries  • Customizable  Event  Workflow  • Collocation  with  Data  Grid

In-­‐Memory  Streaming  and  CEP

Page 9: Apache’IgniteTM (Incubating))A)In:Memory’Data’Fabric’files.meetup.com/3168962/Apache-Ignite...Data...15.pdfApache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

• Singletons  on  the  Cluster  – Cluster  Singleton  – Node  Singleton  – Key  Singleton  

• Custom  Contracts  – Any  Number  of  Instances  – Custom  Deployment  

• Guaranteed  Availability  – Auto  Redeployment  in  Case  of  Failures

In-­‐Memory  Data  Fabric:  Service  Grid

Page 10: Apache’IgniteTM (Incubating))A)In:Memory’Data’Fabric’files.meetup.com/3168962/Apache-Ignite...Data...15.pdfApache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

• IgniteRDD    – Share  RDD  across  jobs  on  the  host  – Share  RDD  across  jobs  in  the  application  – Share  RDD  globally  

• Faster  SQL  – In-­‐Memory  Indexes  – SQL  on  top  of  Shared  RDD

Share  RDDs  Across  Spark  Jobs  

Page 11: Apache’IgniteTM (Incubating))A)In:Memory’Data’Fabric’files.meetup.com/3168962/Apache-Ignite...Data...15.pdfApache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

ANY  QUESTIONS?

Thank  you  for  joining  us.  Follow  the  conversation.

http://www.ignite.incubator.apache.org

@apacheignite

@dsetrakyan

http://www.ignite.incubator.apache.org

Apache Igniteand Apache Spark - events.static.linuxfound.org · Apache®, Apache Ignite, Ignite®, and the Apache Ignite logo are either registered trademarks or trademarks of the

Apache Igniteand Apache Spark - events.static.linuxfound.org · Apache®, Apache Ignite, Ignite®, and the Apache Ignite logo are either registered trademarks or trademarks of the

Apache Ignite Extensions - Modularization

Apache Ignite Extensions - Modularization

Apache Ignite for Node.js Developers - GridGain Systems · Apache Ignite Support –Faster Time to Reliable Ignite •Get up and running faster with 2 hours initial consultation •Ensure

Apache Ignite for Node.js Developers - GridGain Systems · Apache Ignite Support –Faster Time to Reliable Ignite •Get up and running faster with 2 hours initial consultation •Ensure

Better together: Fast Data with Apache Spark™ and Apache Ignite™ by Mike Griggs

Better together: Fast Data with Apache Spark™ and Apache Ignite™ by Mike Griggs

Apache ignite Datagrid

Apache ignite Datagrid

In-Memory Performance Durability of Disk...Apache Ignite In-Memory Computing Platform Memory-Centric Storage Ignite Native Persistence (Flash, SSD, Intel 3D XPoint) Third-Party Persistence

In-Memory Performance Durability of Disk...Apache Ignite In-Memory Computing Platform Memory-Centric Storage Ignite Native Persistence (Flash, SSD, Intel 3D XPoint) Third-Party Persistence

Overview SCALE14x 2016. Agenda/Schedule -Apache Bigtop Overview -Apache Spark Overview/Getting Started -Lunch Break -Apache Ignite -Workshop, tutorial,

Overview SCALE14x 2016. Agenda/Schedule -Apache Bigtop Overview -Apache Spark Overview/Getting Started -Lunch Break -Apache Ignite -Workshop, tutorial,

An Introduction to Apache Ignite - Mandhir Gidda - Codemotion Rome 2017

An Introduction to Apache Ignite - Mandhir Gidda - Codemotion Rome 2017

Apache Mahout - events.static.linuxfound.org · Suneel Marthi did a ‘Distributed Machine Learning with Apache Mahout’ talk at Big Data Ignite, Grand Rapids, Michigan - September

Apache Mahout - events.static.linuxfound.org · Suneel Marthi did a ‘Distributed Machine Learning with Apache Mahout’ talk at Big Data Ignite, Grand Rapids, Michigan - September

IMCS Apache Ignite as MPP Accelerator Ignite as MPP Accelerator Alexander Ermakov, CTO • About us • Why do traditional DWH needs in-memory grid? • Real Time Analytics for Telco

IMCS Apache Ignite as MPP Accelerator Ignite as MPP Accelerator Alexander Ermakov, CTO • About us • Why do traditional DWH needs in-memory grid? • Real Time Analytics for Telco

Apache Ignite - In-Memory Data Fabric

Apache Ignite - In-Memory Data Fabric

Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache’IgniteTM (Incubating))A)In:Memory’Data’Fabric’gotocon.com/dl/goto-chicago-2015/slides/DmitriySetraky… ·  · 2015-05-11meetup/) Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)

Apache’IgniteTM (Incubating))A)In:Memory’Data’Fabric’gotocon.com/dl/goto-chicago-2015/slides/DmitriySetraky… ·  · 2015-05-11meetup/) Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)

Building)Consistentand)Highly)Available)Distributed ... · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)So8ware)Foundaon)in)the)United)States)and

Building)Consistentand)Highly)Available)Distributed ... · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)So8ware)Foundaon)in)the)United)States)and

HowtoChoosetheBest …...©2015"GridGain"Systems,"Inc." DMITRIY’SETRAKYAN’ GridGain"Founder" Apache"Ignite"PMC"Chair" HowtoChoosetheBest In7Memory’Solu=ons’for’Your’Apps

HowtoChoosetheBest …...©2015"GridGain"Systems,"Inc." DMITRIY’SETRAKYAN’ GridGain"Founder" Apache"Ignite"PMC"Chair" HowtoChoosetheBest In7Memory’Solu=ons’for’Your’Apps

Архитектура Apache Ignite .NET

Архитектура Apache Ignite .NET

Security Guide Apache Ignite and GridGain...2003/04/20  · Mainframe Ignite Persistence NoSQL Hadoop Persistent Layer RDBMS Machine and Deep Learning Messaging Streaming Events Transaction

Security Guide Apache Ignite and GridGain...2003/04/20  · Mainframe Ignite Persistence NoSQL Hadoop Persistent Layer RDBMS Machine and Deep Learning Messaging Streaming Events Transaction

Be#er%Together–)Apache%Ignite%&%Apache%Spark% · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)So8ware)Foundaon)in)the)United)States)and

Be#er%Together–)Apache%Ignite%&%Apache%Spark% · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)So8ware)Foundaon)in)the)United)States)and

High Performance in-memory computing with Apache Ignite

High Performance in-memory computing with Apache Ignite

Troubleshooting Apache® Ignite™ · 2019 © GridGain Systems Apache Ignite Support –Faster Time to Reliable Ignite •Get up and running faster with 2 hours initial consultation

Troubleshooting Apache® Ignite™ · 2019 © GridGain Systems Apache Ignite Support –Faster Time to Reliable Ignite •Get up and running faster with 2 hours initial consultation