Go for Real Time Streaming Architectures - DotGo 2017
22
Go for Real Time Streaming Architectures
-
Upload
mickael-remond -
Category
Technology
-
view
900 -
download
2
Transcript of Go for Real Time Streaming Architectures - DotGo 2017
Go for Real Time Streaming Architectures
What are Streaming Architectures ?
Events
Events
≠ Shared States
Pipelines
DataAppChannel Channel
Data App Data …
Reactive Architecture
Microservices
Traditional Design
Central Realtime Engine
App
App
App
Publishers
KafkaEvents
Processing Frameworks
Processing Frameworks
App
App
App
Publishers
KafkaEvents
Streaming engine / frameworks:
Consumers
App
App
- Spark Streaming- Flink- Kafka Streams- Akka Streams- …
The cloud-native way
The cloud-native way
‣Standalone Go application ‣ Kafka ‣ Sarama
The cloud-native way
‣Sarama Cluster
The cloud-native way
‣Protobuf
The cloud-native way
‣Nats
The cloud-native way
‣ Docker ‣Kubernetes
The cloud-native way
App
App
App
Publishers
KafkaEvents
Consumers
App
App
Events
Benefits
‣ Simple / manageable code
Benefits
‣ Simple / manageable code
‣ Performance
Benefits
‣ Simple / manageable code
‣ Performance
‣ Easily scalable
Go is a modern tool to build cloud-native, high-performance, realtime streaming applications
Mickaël Rémond — @mickael
![Quality Adaptive Peer-to-Peer Streaming Using Scalable ...the Peer-to-Peer (P2P) architectures. As an example of client/server streaming, Youtube [2] is a popular medium for viewing](https://static.fdocuments.us/doc/165x107/5f4986cc7a2936128e2c215d/quality-adaptive-peer-to-peer-streaming-using-scalable-the-peer-to-peer-p2p.jpg)
