Cotton Testing Procedures. Production & Modules Cotton Testing Procedures Production & Modules.
Testing in production
-
Upload
jyrki-pulliainen -
Category
Technology
-
view
52 -
download
0
Transcript of Testing in production
![Page 1: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/1.jpg)
Testing in ProductionWhy should you do it?
![Page 2: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/2.jpg)
Outline
• What testing in production is not
• Why should you do it
• How should you do it
![Page 3: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/3.jpg)
Disclaimer
![Page 4: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/4.jpg)
@nailor
![Page 5: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/5.jpg)
Testing in Production
![Page 6: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/6.jpg)
![Page 7: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/7.jpg)
What it is not?
![Page 8: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/8.jpg)
It’s not a way to make you care less
![Page 9: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/9.jpg)
It’s not the replacement for all the testing
![Page 10: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/10.jpg)
It’s not the end of the world.
![Page 11: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/11.jpg)
Why should you do it?
![Page 12: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/12.jpg)
Let’s have a short quiz
![Page 13: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/13.jpg)
Staging environment?
![Page 14: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/14.jpg)
Problem free staging environment?
![Page 15: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/15.jpg)
ProductionStaging environment on steroids
![Page 16: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/16.jpg)
The environment
![Page 17: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/17.jpg)
The data
![Page 18: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/18.jpg)
The users
![Page 19: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/19.jpg)
How to test in production?
![Page 20: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/20.jpg)
(Like steroids, it comes with downsides)
![Page 21: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/21.jpg)
![Page 22: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/22.jpg)
You want to limit the blast radius
![Page 23: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/23.jpg)
Limiter #1: Feature flags
![Page 24: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/24.jpg)
[ ] Feature A
[x] Feature B
![Page 25: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/25.jpg)
Add broken code behind the flag
![Page 26: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/26.jpg)
Staged roll-outs
![Page 27: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/27.jpg)
Easy to support
![Page 28: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/28.jpg)
Limiter #2: Dark load
![Page 29: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/29.jpg)
One request Two execution paths
One response
![Page 30: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/30.jpg)
Real usereal problems
![Page 31: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/31.jpg)
Trickier to implement
![Page 32: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/32.jpg)
Limiter #3:Easy rollback
![Page 33: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/33.jpg)
Knowing that breaking things is not fatal is the
key
![Page 34: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/34.jpg)
How?
![Page 35: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/35.jpg)
Checklists
![Page 36: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/36.jpg)
![Page 37: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/37.jpg)
What do you gain?
![Page 38: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/38.jpg)
Confidence in your code
![Page 39: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/39.jpg)
A / B testing
![Page 40: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/40.jpg)
Verifiability of ideas
![Page 41: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/41.jpg)
Speed
![Page 42: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/42.jpg)
Go and test in production!
(Author takes no responsibility for anything)
![Page 43: Testing in production](https://reader034.fdocuments.us/reader034/viewer/2022042522/55d6e736bb61eb724e8b4707/html5/thumbnails/43.jpg)
Thank [email protected] / @nailor