Crash Test Your Application at Websummit Dublin

42
Game Days: Crash-Test Your Application Danilo Poccia | Technical Evangelist [email protected] @danilop

description

In this talk from the Dublin Websummit 2014 AWS Technical Evangelist Danilo Poccia introduces the concept of 'Game Days' - focused simulation and testing events that your organisation can use to prepare for unexpected events and improve your response to such events.

Transcript of Crash Test Your Application at Websummit Dublin

Page 1: Crash Test Your Application at Websummit Dublin

Game Days: Crash-Test Your Application Danilo Poccia | Technical Evangelist [email protected] @danilop

Page 2: Crash Test Your Application at Websummit Dublin

GO BEYOND YOUR TEST ENVIRONMENT

Page 3: Crash Test Your Application at Websummit Dublin

PLAY IN A SIMULATED ENVIRONMENT

Page 4: Crash Test Your Application at Websummit Dublin
Page 5: Crash Test Your Application at Websummit Dublin
Page 6: Crash Test Your Application at Websummit Dublin

SIMULATION ENVIRONMENT

Page 7: Crash Test Your Application at Websummit Dublin

SIMULATION ENVIRONMENT FOR CRISIS SITUATIONS

Page 8: Crash Test Your Application at Websummit Dublin

GOOD WEATHER DOESN’T MAKE GOOD SAILORS

Page 9: Crash Test Your Application at Websummit Dublin

PREPARE FOR EXTREME SITUATIONS

Page 10: Crash Test Your Application at Websummit Dublin

THINGS ARE UNRELIABLE UNTIL THEY ARE TESTED

Page 11: Crash Test Your Application at Websummit Dublin

HOW TO PLAY ? GAME PREPARATION

Page 12: Crash Test Your Application at Websummit Dublin

SUPERVISORS & PLAYERS

Page 13: Crash Test Your Application at Websummit Dublin

MAKE A PLAN ROLE PLAY & SCOPE DEFINITION

Page 14: Crash Test Your Application at Websummit Dublin

SET A DATE (DEADLINE) MAKE IT FUN

Page 15: Crash Test Your Application at Websummit Dublin

CREATE THE SIMULATION ENVIRONMENT

Page 16: Crash Test Your Application at Websummit Dublin

GAMEDAY ENVIRONMENT

AWS ACCOUNT A

PRODUCTION ENVIRONMENT

AWS ACCOUNT B

Page 17: Crash Test Your Application at Websummit Dublin

CLOUDFORMATION TEMPLATE

Page 18: Crash Test Your Application at Websummit Dublin

USE AWS IAM CONTROL WHO CAN DO WHAT

DURING THE GAME

Page 19: Crash Test Your Application at Websummit Dublin

ACTIVATE AWS CLOUDTRAIL GAMEPLAY RECORDING & AUDITING

Page 20: Crash Test Your Application at Websummit Dublin
Page 21: Crash Test Your Application at Websummit Dublin

SIMULATE ACTIVITY

Page 22: Crash Test Your Application at Websummit Dublin

PRE-RECORDED NETWORK ACTIVITY

Page 23: Crash Test Your Application at Websummit Dublin

(THROTTLED) LOAD TEST USE SPOT INSTANCES + TOOLS

Page 24: Crash Test Your Application at Websummit Dublin
Page 25: Crash Test Your Application at Websummit Dublin

USING AMAZON EC2 TO SIMULATE

2.4 MILLION PLAYERS

Page 26: Crash Test Your Application at Websummit Dublin

COMMUNICATION CHANNELS IRC, SHARED DOCS, VIBER, …

Page 27: Crash Test Your Application at Websummit Dublin

PLAY ! THE FUN PART

Page 28: Crash Test Your Application at Websummit Dublin
Page 29: Crash Test Your Application at Websummit Dublin

SIMULATE FAILURES

Page 30: Crash Test Your Application at Websummit Dublin

TERMINATE RESOURCES CHANGE SECURITY GROUPS CHANGE IAM ROLES DISABLE IAM USER CHANGE /ETC/HOSTS FILE AMAZON RDS FAIL-OVER TEST

Page 31: Crash Test Your Application at Websummit Dublin
Page 32: Crash Test Your Application at Websummit Dublin

RECORD & ANNOTATE PLAYERS ACTIONS

Page 33: Crash Test Your Application at Websummit Dublin

IF YOU DON’T MEASURE IT, IT DIDN’T HAPPEN

Page 34: Crash Test Your Application at Websummit Dublin

AFTER PARTY CLOSING THE GAME

Page 35: Crash Test Your Application at Websummit Dublin

DEBRIEF WHERE THE MAGIC HAPPENS

Page 36: Crash Test Your Application at Websummit Dublin

HOW LONG DOES IT TAKE TO DETECT AN EVENT ?

AND TO RESOLVE AN ISSUE?

Page 37: Crash Test Your Application at Websummit Dublin

NEW HIRE ? GO TO THE SIMULATOR

Page 38: Crash Test Your Application at Websummit Dublin

VALIDATE ASSUMPTIONS PROVE YOUR ARCHITECTURE

KNOWLEDGE OF PROCEDURES

Page 39: Crash Test Your Application at Websummit Dublin

COMMUNICATION PROCEDURES

& CHAIN OF COMMAND

Page 40: Crash Test Your Application at Websummit Dublin

GOOD WEATHER DOESN’T MAKE GOOD SAILORS

Page 41: Crash Test Your Application at Websummit Dublin

TELL ME ABOUT YOUR GAMES!

@danilop [email protected]

Page 42: Crash Test Your Application at Websummit Dublin

Game Days: Crash-Test Your Application Danilo Poccia | Technical Evangelist [email protected] @danilop