Spring Boot and Netflix OSS

Spring Cloud, Spring Boot and NetflixOSS

Spencer Gibbtwitter: @spencerbgibbemail: sgibb@pivotal.io

Dave Syertwitter: @david_syeremail: dsyer@pivotal.io

(Spring Boot and Netflix OSSor Spring Cloud Components)

http://presos.dsyer.com/decks/cloud-boot-netflix.html

1 of 44 24/09/14 21:52

Outline

Define microservices

Outline some distributed system problems

Introduce Netflix OSS and its integration with Spring Boot

Spring Cloud demos

2 of 44 24/09/14 21:52

What are micro-services?

Not monolithic :-)

Smaller units of a larger system

Runs in its own process

Lightweight communication protocols

Single Responsibility Principle

The UNIX way

http://www.slideshare.net/ewolff/micro-services-small-is-beautiful http://martinfowler.com/articles/microservices.htmlhttp://davidmorgantini.blogspot.com/2013/08/micro-services-what-are-micro-services.html

3 of 44 24/09/14 21:52

Lightweight Services andREST

There is a strong trend in distributed systems withlightweight architectures

People have started to call them "microservices"

4 of 44 24/09/14 21:52

Spring Boot

It needs to be super easy to implement and update a service:

@RestControllerclass ThisWillActuallyRun { @RequestMapping("/") String home() { Hello World! }}

and you don't get much more "micro" than that.

5 of 44 24/09/14 21:52

Cloudfoundry

Deploying services needs to be simple and reproducible

$ cf push app.groovy

and you don't get much more convenient than that.

(Same argument for other PaaS solutions)

6 of 44 24/09/14 21:52

Continuous Delivery

Microservices lend themselves to continuous delivery.

You actually need continuous delivery to extract maximumvalue.

Book (Humble and Farley): http://continuousdelivery.comNetflix Blog: http://techblog.netflix.com/2013/08/deploying-netflix-api.html

7 of 44 24/09/14 21:52

Example DistributedSystem: Minified

8 of 44 24/09/14 21:52

No Man (Microservice) isan Island

It's excellent to be able to implement a microservice reallyeasily (Spring Boot), but building a system that way surfaces"non-functional" requirements that you otherwise didn'thave.

There are laws of physics that make some problemsunsolvable (consistency, latency), but brittleness andmanageability can be addressed with generic, boiler platepatterns.

9 of 44 24/09/14 21:52

Emergent features ofmicro-services systems

Coordination of distributed systems leads to boiler platepatterns

Distributed/versioned configuration

Service registration and discovery

Routing

Service-to-service calls

Load balancing

Circuit Breaker

Asynchronous

Distributed messaging

10 of 44 24/09/14 21:52

Spring IO Platformhttp://presos.dsyer.com/decks/cloud-boot-netflix.html

11 of 44 24/09/14 21:52

Example: CoordinationBoiler Plate

12 of 44 24/09/14 21:52

Bootification

How to bring the ease of Spring Boot to a micro-servicesarchitecture?

Netflix OSS

Consul

zookeeper

custom

doozerd

ha proxy

Typesafe Config

and many more... what to choose?

13 of 44 24/09/14 21:52

Netflix OSS

Eureka

Hystrix & Turbine

Ribbon

Archaius

Curator

Asgaard

Mikey Cohen Netflix edge architecture, http://goo.gl/M159zi

14 of 44 24/09/14 21:52

Example: Spring Cloudand Netflix

15 of 44 24/09/14 21:52

Configuration Server

Pluggable source

Git implementation

Versioned

Rollback-able

Configuration client auto-configured via starter

16 of 44 24/09/14 21:52

Spring CloudConfiguration Server

Supports applications <appname>.properties

Supports environments <appname>-<envname>.yml

Default environment application.propertiesapplies to all applications and environments

17 of 44 24/09/14 21:52

Config Client

Consumers of config server can use client library as SpringBoot plugin

Features:

Bootstrap Environment from server

POST to /env to change Environment

@RefreshScope for atomic changes to beans via Springlifecycle

POST to /refresh

POST to /restart

18 of 44 24/09/14 21:52

Environment Endpoint

POST to /env

Re-binds @ConfigurationProperties

Resets loggers if any logging.level changes are detected

Sends EnvironmentChangeEvent with list of propertiesthat changed

19 of 44 24/09/14 21:52

Refresh Endpoint

POST to /refresh

Re-loads configuration including remote config server

Re-binds @ConfigurationProperties

Resets @RefreshScope cache

20 of 44 24/09/14 21:52

RefreshScope

Annotate @Beans

Atomic updates during /refresh

@EnableConfigurationProperties(MyProps)public class Application {

@Autowired private MyProps props

@RefreshScope @Bean public Service service() { new Service(props.name) }}

21 of 44 24/09/14 21:52

Restart Endpoint

POST to /restart closes application context andrefreshes it

Probably more useful in development than production(leaks?)

Disabled by default

22 of 44 24/09/14 21:52

Encrypted Properties

Authenticated clients have access to unencrypted data.

Only encrypted data is stored in git.

Support for server side or client side decryption

23 of 44 24/09/14 21:52

Discovery: Eureka

Service Registration Server

Highly Available

In AWS terms, multi Availability Zone and Region aware

24 of 44 24/09/14 21:52

Eureka Client

Register service instances with Eureka Server

@EnableEurekaClient auto registers instance inserver

Eureka Server

Eureka Client

@EnableEurekaClientpublic class Application {}

25 of 44 24/09/14 21:52

Circuit Breaker: Hystrix

latency and fault tolerance

isolates access to other services

stops cascading failures

enables resilience

circuit breaker pattern

dashboard

Release It!: https://pragprog.com/book/mnee/release-it

26 of 44 24/09/14 21:52

Declarative Hystrix

Programmatic access is cumbersome

@HystrixCommand to the rescue

@EnableHystrix via starter pom

Wires up spring aop aspect

27 of 44 24/09/14 21:52

Hystrix Synchronous

private String getDefaultMessage() { return "Hello World Default";}

@HystrixCommand(fallbackMethod="getDefaultMessage")public String getMessage() { return restTemplate.getForObject(/*...*/);}

28 of 44 24/09/14 21:52

Hystrix Future

@HystrixCommand(fallbackMethod="getDefaultMessage")public Future<String> getMessageFuture() { return new AsyncResult<String>() { public String invoke() { return restTemplate.getForObject(/*...*/); } };}

//somewhere elseservice.getMessageFuture().get();

29 of 44 24/09/14 21:52

Hystrix Observable

@HystrixCommand(fallbackMethod="getDefaultMessage")public Observable<String> getMessageRx() { return new ObservableResult<String>() { public String invoke() { return restTemplate.getForObject(/*...*/); } };}

//somewhere elsehelloService.getMessageRx().subscribe(newObserver<String>() { @Override public void onCompleted() {} @Override public void onError(Throwable e) {} @Override public void onNext(String s) {}});

30 of 44 24/09/14 21:52

Circuit Breaker Metrics

Via actuator /metrics

Server side event stream /hystrix.stream

Dashboard app via @EnableHystrixDashboard

More coming...

31 of 44 24/09/14 21:52

Metric Aggregation:Turbine

Aggregator for Hystrix data

Pluggable locator

Static list

Eureka

32 of 44 24/09/14 21:52

Ribbon

Client side load balancer

Pluggable transport

Protocols: http, tcp, udp

Pluggable load balancing algorithms

Round robin, “best available”, random, response timebased

Pluggable source for server list

Static list, Eureka!

33 of 44 24/09/14 21:52

Declarative web service client definition

Annotate an interface

Highly customizable

Encoders/decoders

Annotation processors (Feign, JAX-RS)

Logging

Supports Ribbon and therefore Eureka

34 of 44 24/09/14 21:52

Feign cont.

Auto-configuration

Support for Spring MVC annotations

Uses Spring MessageConverter’s for decoder/encoder

35 of 44 24/09/14 21:52

Feign cont.

public interface HelloClient { @RequestMapping(method = RequestMethod.GET, value = "/hello") Message hello();

@RequestMapping(method = RequestMethod.POST, value = "/hello", consumes = "application/json") Message hello(Message message);}

36 of 44 24/09/14 21:52

Routing: Zuul

JVM based router and filter

Similar routing role as httpd, nginx, or CF go router

Fully programmable rules and filters

Groovy

any JVM language

37 of 44 24/09/14 21:52

How Netflix uses Zuul

Authentication

Insights

Stress Testing

Canary Testing

Dynamic Routing

Service Migration

Load Shedding

Security

Static Response handling

Active/Active traffic management

38 of 44 24/09/14 21:52

Spring Cloud Zuul Proxy

Store routing rules in config serverzuul.proxy.route.customers: /customers

uses Hystrix->Ribbon->Eureka to forward requeststo appropriate service

@EnableZuulProxy@Controllerclass Application { @RequestMapping("/") String home() { return 'redirect:/index.html#/customers' }}

39 of 44 24/09/14 21:52

Configuration: Archaius

Client side configuration library

extends apache commons config

extendible sources

Polling or push updates

DynamicStringProperty myprop =DynamicPropertyFactory.getInstance() .getStringProperty("my.prop");someMethod(myprop.get());

40 of 44 24/09/14 21:52

Archaius: SpringEnvironment Bridge

Auto-configured

Allows Archaius Dynamic*Properties to find valuesvia Spring Environment

Existing Netflix libraries configured via application.{properties,yml} and/or Spring Cloud Config Server

41 of 44 24/09/14 21:52

Spring Cloud Bus

Lightweight messaging bus using spring integrationabstractions

spring-amqp, rabbitmq and httpother implementations possible

Send messages to all services or...

To just one applications nodes (ie just service x)?destination=x

Post to /bus/env sends environment updates

Post to /bus/refresh sends a refresh command

42 of 44 24/09/14 21:52

Spring Cloud Starters

spring-cloud-starter spring-cloud-starter-hystrix

spring-cloud-starter-bus-amqp

spring-cloud-starter-hystrix-dashboard

spring-cloud-starter-cloudfoundry

spring-cloud-starter-turbine

spring-cloud-starter-eureka spring-cloud-starter-zuul

spring-cloud-starter-eureka-server

43 of 44 24/09/14 21:52

http://github.com/spring-cloud

http://github.com/spring-cloud-samples

http://blog.spring.io

Twitter: @spencerbgibb, @david_syer

Email: sgibb@pivotal.io, dsyer@pivotal.io

44 of 44 24/09/14 21:52

Spring Boot and Netflix OSS

Software

Transcript of Spring Boot and Netflix OSS

SF Gradle Meetup - Netflix OSS

Netflix OSS Meetup Season 4 Episode 4

Spring Cloud, Spring Boot and Netflix OSS - Jfokus · Spring Cloud, Spring Boot and Netflix OSS Spencer Gibb twitter: @spencerbgibb email: sgibb@pivotal.io ... Service registration

QCon SP 2016 - Construindo Microservices Auto-curáveis com Spring Cloud e Netflix OSS

Microservices with Netflix OSS and Spring Cloud

Spring Cloud, Spring Boot and Netflix OSS - QCon London · Spring Cloud, Spring Boot and Netflix OSS Spencer Gibb twitter: @ ... How to bring the ease of Spring Boot to a micro-services

CONNECTING THE DIGITAL WORLD · Amazon, Facebook, Google, and Netflix, have subverted the mobile ... Operations support systems (OSS) and business support systems (BSS) Information

Netflix oss season 2 episode 1 - meetup Lightning talks

OSS NOTE CARDS · Title: OSS NOTE CARDS Subject: OSS NOTE CARDS Keywords

Netflix oss past-present-future

Building Distributed Systems with Netflix OSS and Spring Cloud

Quo Vadis Netflix Stack? - Java Forum Stuttgart 2020 · 04/07/2019 · Netflix OSS – Well known Projects 2019-07-04 / Java Forum Stuttgart / Baris Cubukcuoglu & Fabian Keller 4

Microservices with Netflix OSS & Spring Cloud - Arnaud Cogoluègnes

Kubernetes + netflix oss

Netflix OSS and HATEOAS deployed on production - JavaLand

Microservices with Netflix OSS & Hypermedia APIs - JavaDay Kiev

Maintaining the Front Door to Netflix : The Netflix API

Dev309 from asgard to zuul - netflix oss-final

Construindo Microservices Auto-curáveis com Spring Cloud e ... · Construindo Microservices Auto-curáveis com Spring Cloud e Netflix OSS Rodrigo Cândido da Silva @rcandidosilva

Istio Service Mesh Managing microservices with · 2019-10-04 · NetFlix OSS ﬁrst microservices patterns and libraries open-sourced 2013 Spring Cloud Enterprise microservice framework