Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

57
Feedback in Continuous Delivery Feedback from Testing in Continuous Delivery Process by Pavel Chunyayev, 14-7-2016 Amsterdam, ABN AMRO Continuous Delivery meetup

Transcript of Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

Page 1: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

Feedback in Continuous Delivery

Feedback from Testing in Continuous Delivery Processby Pavel Chunyayev, 14-7-2016

Amsterdam, ABN AMROContinuous Delivery meetup

Page 2: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Amsterdam

Levi9 HQAmsterdam – 2005

25 people

Novi Sad

SerbiaNovi Sad – 2005

350+ people

Zrenjanin

SerbiaZrenjanin– 2014

50+ people

Iasi

RomaniaIasi – 2007

100+ people

Kyiv

UkraineKyiv – 2008

160+ people

Lviv

Belgrade

UkraineLviv– 201620+ people

Page 3: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

E-Retail Digital Marketing Traffic and Transport FinTech Software Services

Page 4: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Customer satisfaction 2015

• 4th year great results in Outsourcing Performance study

• 2015: 100% customer recommendation scoreExcellent trust score

Page 5: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

About me

• 12 years of IT experience• Lived and worked in Ukraine and Estonia • Two years ago moved to the Netherlands

• Love cycling• Love Dutch language• Love software development processes• Love working with people

Page 7: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Feedback is information about actions returned to the source of the actions.

— Wikipedia

Page 10: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Continuous Delivery

Plan Code Build Test Release OperateEnvision

Page 12: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Keep the product releasableBuild quality in

Page 13: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Continuous Delivery

Plan Code Build Test Release OperateEnvision

Page 14: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Continuous Delivery

Plan Code Build Test Release OperateEnvision

Page 22: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

What kind of feedback is possible in CD?

Plan Code Build Test Release OperateEnvision

Page 23: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

What kind of feedback does development need?

Plan Code Build Test Release OperateEnvision

Page 24: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Plan Code Build Test Release OperateEnvision

Page 25: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

What kind of feedback does business need?

Plan Code Build Test Release OperateEnvision

Page 26: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Plan Code Build Test Release OperateEnvision

Page 27: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Plan Code Build Test Release OperateEnvision

Page 29: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Testing pyramid

Exec

ution

tim

e

Mor

e bu

sines

s fee

dbac

k

Mor

e de

velo

pmen

t fee

dbac

k

Page 30: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Feedback from unit testing

Page 31: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Feedback from integration testing

Page 32: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Feedback from contract testing

Page 33: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Feedback from end-to-end testing

Page 36: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Updating the contract

Page 37: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Updating the contract

Page 38: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Updating the contract

Page 39: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Updating the contract

Page 40: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Updating the contract

Page 41: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Don’t break the contract!

Page 42: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Contracts testingPerformance testing

Page 43: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Contracts testingPerformance testingManual testing

Page 44: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Contracts testingPerformance testingExploratory testing

Page 45: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Contracts testingPerformance testingExploratory testingResilience testing

Page 53: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Who creates tests?Instability and slowliness

Page 54: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Who creates tests?Instability and slowlinessRelease vs deployment

Page 56: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Continuous DeliveryKeep the product releasable

Build quality in

Frequent, incremental releasesContinuous improvement

Plan Code Build Test Release OperateEnvision

Page 57: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016

@PavelChunyayev

Thank you :)Keep the product releasable

Build quality in

Frequent, incremental releasesContinuous feedback +31 6 2117 5817

[email protected]

Plan Code Build Test Release OperateEnvision