Kafka Messaging JavaCro2019 IBM pdfv · Integrating Kafka with Enterprise Java for establishing a...
22
Integrating Kafka with Enterprise Java for establishing a high performant distributed messaging infrastructure Anamarija Talijanac, Irena Kezić IBM Services 13 th May, 2019
Transcript of Kafka Messaging JavaCro2019 IBM pdfv · Integrating Kafka with Enterprise Java for establishing a...
Integrating Kafka with Enterprise Java for establishing a high performant distributed messaging infrastructure
Anamarija Talijanac, Irena KezićIBM Services13th May, 2019
Integrating Kafka with Enterprise Java for establishing a high performant distributed messaging infrastructure
Anamarija Talijanac, Irena KezićIBM Services13th May, 2019
• Kafka basics• Kafka Use Cases• Java Connector Architecture• Distributed messaging challenges• Reliable Kafka Processing• IBM Event Streams
Agenda
© 2019 IBM Corporation
Architectural overview
© 2019 IBM Corporation
Architectural overview
© 2019 IBM Corporation
Kafka basics
HIGH THROUGHPUT
DURABILITY RELIABILITY SCALABILITY
© 2019 IBM Corporation
Kafka basics
6
• Cluster / Broker• Topic / Partition• Producer / Consumer
© 2019 IBM Corporation
Kafka Use Cases
7
• Activity tracking• Commit Log• Metrics and Logging• Unit of Order• Stream processing
© 2019 IBM Corporation
Java Connector Architecture
© 2019 IBM Corporation
• The Java EE standard for integrating application servers with EIS.• Unified common client interface for heterogeneous resource providers
Java Connector Architecture
© 2019 IBM Corporation
• Lifecycle management Contract• Work management Contract• Connection Management Contract• Transaction Management Contract• Security Contract• Transaction Inflow Contract• Message Inflow Contract• Generic Context Contract
Java Connector Architecture
© 2019 IBM Corporation
EXACTLY ONCE DELIVERY
GUARANTEED ORDER OF MESSAGES
RELIABLE MESSAGING
Distributed messagingchallenges
© 2019 IBM Corporation
BEGIN TRANSACTION
CONSUME MESSAGE FROM KAFKA TOPIC
INSERT ROW INTO TARGET DATABASE
COMMIT TRANSACTION
XA with Kafka
© 2019 IBM Corporation
Reliable Kafka Processing
© 2019 IBM Corporation
Reliable Kafka Processing
© 2019 IBM Corporation
Reliable Kafka Processing
© 2019 IBM Corporation
Reliable Kafka Processing
© 2019 IBM Corporation
Reliable Kafka Processing
© 2019 IBM Corporation
Reliable Kafka Processing
© 2019 IBM Corporation
Reliable Kafka Processing
© 2019 IBM Corporation
IBM Event Streams
• IBM has years of operational expertise running Apache Kafka for Enterprises
• Event Streams makes Kafka easy to run, manage & consume, reducing skill requirements and raising speed of deployment for faster time to value
• Support you can Trust – IBM has decades of experience supporting the World’s toughest environments
© 2019 IBM Corporation
IBM Event StreamsVisualisation of your topic
data
Tools to boost productivity
![Chapter 1: Introduction to Messaging System...Chapter 3: Deep Dive into Kafka Producers. Graphics Bundle [ 10 ] Graphics Bundle [ 11 ] Chapter 4: Deep Dive into Kafka Consumers. Graphics](https://static.fdocuments.us/doc/165x107/5ece2e93ee11c142a623e03b/chapter-1-introduction-to-messaging-system-chapter-3-deep-dive-into-kafka.jpg)
![Chapter 1: Introduction to Messaging System - Packt · Chapter 1: Introduction to Messaging System. Graphics Bundle [ 2 ] Graphics Bundle [ 3 ] ... Using Kafka Streams. Graphics Bundle](https://static.fdocuments.us/doc/165x107/5aed5cf87f8b9a3b2e9073e8/chapter-1-introduction-to-messaging-system-packt-1-introduction-to-messaging.jpg)