How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov
-
Upload
soasta -
Category
Technology
-
view
640 -
download
3
description
Transcript of How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov
![Page 1: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/1.jpg)
1© 2013 SOASTA CONFIDENTIAL - All rights reserved.
How To Avoid Epic Web Failure
Lessons Learned from Healthcare.gov
Webinar
8
![Page 2: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/2.jpg)
2© 2013 SOASTA CONFIDENTIAL - All rights reserved.
What have we learned from recent epic fails?In This Webinar
TODAY’S SOASTA PRESENTERS
Peter Galvin: Brad Johnson:SVP Marketing VP Product Marketing
Agenda: • Poll question• Lessons Learned• Some Best Practices
Questions: Submit in chat box during event
![Page 3: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/3.jpg)
Poll Question
![Page 4: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/4.jpg)
4© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Acceptable Failure?
![Page 5: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/5.jpg)
5© 2013 SOASTA CONFIDENTIAL - All rights reserved.
This October…
![Page 6: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/6.jpg)
6© 2013 SOASTA CONFIDENTIAL - All rights reserved.
This October…
“We didn’t have enough testing for a very complicated project”
US Health and Human Services Secretary, Kathleen Sebelius
![Page 7: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/7.jpg)
7© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Impact of Healthcare Site Failures
• Millions of uninsured citizens• Healthcare program mistrust• President’s approval rating dropped• Congress tied up in legislation• Public cynicism• Press and social media circus• Uncertainty for the future
Brought QUALITY and TESTING to the public forefront!
![Page 8: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/8.jpg)
8© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Industry Best Practices
RECOMMENDATIONS
“Name a single implementation leader”
“Lock down” requirements by April 30
“Streamline decision making”
“End-to-end integrated operations and IT testing”
Top down, Home Health Agencies Missed the Mark
http://www.businessweek.com/news/2013-11-19/obamacare-consultants-warned-of-health-website-failure-in-march
WHAT HAPPENED
“No single leader”
“Shifting requirements”
“Multiple definitions of success
“Insufficient time and scope of end-to-end testing”
http://www.npr.org/blogs/alltechconsidered/2013/11/19/246132770/this-slide-shows-why-healthcare-gov-wouldnt-work-at-launch
In March 2013
![Page 9: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/9.jpg)
9© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Outages Are Serious Business
![Page 10: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/10.jpg)
10© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Outages Are Serious Business
![Page 11: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/11.jpg)
11© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Outages Are Serious Business
![Page 12: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/12.jpg)
12© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Outages Are Serious Business
Source: Venture Beat & Ray Wang at Constellation Research 2012
“Twitter’s down…and it has cost the economy $1 billion already?”
![Page 13: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/13.jpg)
13© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Outages Are Serious Business
Source: Venture Beat & Ray Wang at Constellation Research 2012
OK...reduce Twitter usage assumptions 50%.
Then, only $400,641,025.00 was lost.
“Twitter’s down…and it has cost the economy $1 billion already?”
![Page 14: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/14.jpg)
14© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Last WeekTWO DAYS! (is “too long”)
![Page 15: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/15.jpg)
15© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Extra October Stress for College Applicants 1 million students, 517 colleges, high anxiety
“Mass Panic As Common App Crashes”
![Page 16: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/16.jpg)
16© 2013 SOASTA CONFIDENTIAL - All rights reserved.
But Wait, There’s Moreo Aug. 14: New York Times
• 2 hours - Stock dropped - opened paywall (lost $$) – Twitter storm
o Aug 17: Google
• Less than 5 minutes – lost $500,000 – Internet traffic dropped 40%
o Sept 2: HSBC (UK)
• Internal and external systems – “Weekend of disruption”
o Nov 12: Kayazoonga.com (India)
• Last cricket match of Sachin Tendulkar - 19.7M hits/hour – crashed all day – “Chaos”
o Nov 18: YouTube
• 35 minutes – est. 100,000 users affected
PR Nightmares…
![Page 17: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/17.jpg)
17© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Every Site is SusceptibleEven BatKid’s
![Page 18: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/18.jpg)
18© 2013 SOASTA CONFIDENTIAL - All rights reserved.
SOASTA Helps
![Page 19: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/19.jpg)
19© 2013 SOASTA CONFIDENTIAL - All rights reserved.
London 2012 Results
500 Tests
400,000 concurrent users
431 Million Visitors
4.73 Billion Page Views
Access from 201 Countries
“We began working with SOASTA CloudTest six months prior to the
games.” Paul Bunnell,
Lead Architect, London 2012
![Page 20: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/20.jpg)
20© 2013 SOASTA CONFIDENTIAL - All rights reserved.
SOASTA Helps
Prep for…
![Page 21: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/21.jpg)
21© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Verbalizeit Results “ We were on very
tight timelines…
the SOASTA team
was able to run
multiple tests very
quickly over a two-
day period and get
us going on issues
to immediately
fix.”
Kunal Sarda,
VerbalizeIt
COO and Co-
Founder
Plan based on 6-8 million TV viewers
Tested & tuned for 10 million hits
250 to 30,000 visits/day
7x customer growth
Zero downtime
![Page 22: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/22.jpg)
22© 2013 SOASTA CONFIDENTIAL - All rights reserved.
SOASTA Helps
![Page 23: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/23.jpg)
23© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Dillard’s Results
Tested to 7x Initial load test goals
Reached 9x previous year’s peak
Validated dynamic caching investment
Reduced hardware capacity needs
Validated Akamai to 4x beyond peak
“One of the best investments to our
website this year .” Nancy Jordan,
IT Middleware & Integration
Manager
![Page 24: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/24.jpg)
24© 2013 SOASTA CONFIDENTIAL - All rights reserved.
SOASTA Helps
![Page 25: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/25.jpg)
25© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Hallmark Results“Website performance really
affects your brand image
when you have problems…
The inherent savings to our
brand by using CloudTest is
priceless.”
—Cheryl Davis,
digital technical
operations manager
Hallmark Cards, Inc.
Tested to 120% of expected load
Saved 50% on testing expenses
Reduced staff costs by 66%
Eliminated test software and hw costs
![Page 26: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/26.jpg)
26© 2013 SOASTA CONFIDENTIAL - All rights reserved.
“No amount of testing within reasonable time limits can adequately replicate a live environment of this nature”
About that Healthcare.gov Testing…
![Page 27: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/27.jpg)
27© 2013 SOASTA CONFIDENTIAL - All rights reserved.
“No amount of testing within reasonable time limits can adequately replicate a live environment of this nature”
About that Healthcare.gov Testing…
OBJECTION!
![Page 28: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/28.jpg)
28© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Speed AND QualityThere is no need to compromise
![Page 29: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/29.jpg)
29© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Testing Issues
o 55 Contractors
o Not enough time in schedule to conduct adequate performance testing
o No Integration testing between systems
o No end-to-end testing simulating real life experiences of end users
o Followed waterfall development with parallel/disconnected projects
o Locked at 2000 users at the 1st step
From the HHA press
http://www.washingtonpost.com/politics/house-panel-grills-contractors-on-troubled-health-insurance-web-site/2013/10/24/8f42c748-3ca7-11e3-b7ba-503fb5822c3e_story.html
http://www.cnn.com/2013/10/29/politics/obamacare-warning/
![Page 30: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/30.jpg)
30© 2013 SOASTA CONFIDENTIAL - All rights reserved.
SOASTA Best Practices
o Test Continuously
From ten of thousands of tests
![Page 31: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/31.jpg)
31© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Continuous PerformanceThe path to a performance culture
I JUST MADE A CODE CHANGE
CI system runs load tests against a pre-prod site
…while unit, functional and mobile device tests run in parallel
Daily (or more frequent) updates keep teams “performance focused”
Identify bottlenecks & inform teams, just like unit and functional tests in CI
![Page 32: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/32.jpg)
32© 2013 SOASTA CONFIDENTIAL - All rights reserved.
SOASTA Best Practices
o Test End To End
From ten of thousands of tests
![Page 33: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/33.jpg)
33© 2013 SOASTA CONFIDENTIAL - All rights reserved.
End-To-End Cloud Testing
Customers
SUT/AUT
Web Server
Web Server
App Server
Web Server
Web Server
App Server
App Server
App Server
Load Balancer
Cache
Cache
Database
CDNCredit Card
Web analyti
cs
Other 3rd pty svcs
![Page 34: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/34.jpg)
34© 2013 SOASTA CONFIDENTIAL - All rights reserved.
“Conductor”
Analytics
CloudTest
Database
Main
Perf Tester 1
SUT/AUT
Web Server
Web Server
App Server
Web Server
Web Server
App Server
App Server
App Server
Load Balancer
Cache
Cache
Database
End-To-End Cloud Testing
CDNCredit Card
Web analyti
cs
Other 3rd pty svcs
![Page 35: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/35.jpg)
35© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Analytics
CloudTest
Database
Main
Perf Tester 1
AnalyticsLoad
GeneratorLoad GeneratorLoad
Generator
East Coast (AWS)
SUT/AUT
Web Server
Web Server
App Server
Web Server
Web Server
App Server
App Server
App Server
Load Balancer
Cache
Cache
Database
End-To-End Cloud Testing
CDNCredit Card
Web analyti
cs
Other 3rd pty svcs
![Page 36: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/36.jpg)
36© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Analytics
CloudTest
Database
Main
Perf Tester 1
AnalyticsLoad
GeneratorLoad GeneratorLoad
Generator
East Coast (AWS)
SUT/AUT
Web Server
Web Server
App Server
Web Server
Web Server
App Server
App Server
App Server
Load Balancer
Cache
Cache
Database
End-To-End Cloud Testing
CDNCredit Card
Web analyti
cs
Other 3rd pty svcs
![Page 37: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/37.jpg)
37© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Analytics
CloudTest
Database
Main
Perf Tester 1
SUT/AUT
Web Server
Web Server
App Server
Web Server
Web Server
App Server
App Server
App Server
Load Balancer
Cache
Cache
Database
Data sources: Native (SSH), JMX, PerfMon, CA Introscope,
AppDynamics, New Relic, CloudWatch,….
“Conductor”
AnalyticsLoad
GeneratorLoad GeneratorLoad
Generator
East Coast (AWS)
End-To-End Cloud Testing
CDNCredit Card
Web analyti
cs
Other 3rd pty svcs
![Page 38: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/38.jpg)
38© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Analytics
CloudTest
Database
Main
Perf Tester 1
AnalyticsLoad
GeneratorLoad GeneratorLoad
Generator
East Coast (AWS)
SUT/AUT
Web Server
Web Server
App Server
Web Server
Web Server
App Server
App Server
App Server
Load Balancer
Cache
Cache
Database
AnalyticsLoad
GeneratorLoad GeneratorLoad
Generator
San Francisco (GoGrid)
AnalyticsLoad
GeneratorLoad GeneratorLoad
Generator
Chicago (Rackspace)
AnalyticsLoad
GeneratorLoad GeneratorLoad
Generator
Tokyo (AWS)
AnalyticsLoad
GeneratorLoad Generator
Amsterdam (Azure)
AnalyticsLoad
GeneratorLoad Generator
Virginia (IBM)
SOASTA Global Test
Cloud
End-To-End Cloud Testing
CDNCredit Card
Web analyti
cs
Other 3rd pty svcs
![Page 39: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/39.jpg)
39© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Analytics
CloudTest
Database
Main
Perf Tester 1
AnalyticsLoad
GeneratorLoad GeneratorLoad
Generator
East Coast (AWS)
AnalyticsLoad
GeneratorLoad GeneratorLoad
Generator
San Francisco (GoGrid)
AnalyticsLoad
GeneratorLoad GeneratorLoad
Generator
AnalyticsLoad
GeneratorLoad GeneratorLoad
Generator
Tokyo (AWS)
AnalyticsLoad
GeneratorLoad Generator
Amsterdam (Azure)
AnalyticsLoad
GeneratorLoad Generator
Virginia (IBM)SUT/AUT
Web Server
Web Server
App Server
Web Server
Web Server
App Server
App Server
App Server
Load Balancer
Cache
Cache
Database
SOASTA Global Test
Cloud
Data sources: Native (SSH), JMX, PerfMon, CA Introscope,
AppDynamics, New Relic, CloudWatch,….
“Conductor”
End-To-End Cloud Testing
CDNCredit Card
Web analyti
cs
Other 3rd pty svcs
Chicago (Rackspace)
![Page 40: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/40.jpg)
40© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Analytics
CloudTest
Database
Main
Perf Tester 1
AnalyticsLoad
GeneratorLoad GeneratorLoad
Generator
San Francisco (GoGrid)
AnalyticsLoad
GeneratorLoad GeneratorLoad
Generator
Tokyo (AWS)
AnalyticsLoad
GeneratorLoad Generator
Amsterdam (Azure)
Data sources: Native (SSH), JMX, PerfMon, CA Introscope,
AppDynamics, New Relic, CloudWatch,….
SUT/AUT
Web Server
Web Server
App Server
Web Server
Web Server
App Server
App Server
App Server
Load Balancer
Cache
Cache
Database
AnalyticsLoad
GeneratorLoad Generator
Virginia (IBM)
AnalyticsLoad
GeneratorLoad GeneratorLoad
Generator
SOASTA Global Test
Cloud
Access for all
AnalyticsLoad
GeneratorLoad GeneratorLoad
Generator
East Coast (AWS)
“Conductor”
End-To-End Cloud Testing
CDNCredit Card
Web analyti
cs
Other 3rd pty svcs
Chicago (Rackspace)
![Page 41: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/41.jpg)
41© 2013 SOASTA CONFIDENTIAL - All rights reserved.
SOASTA Best Practices
o Test to Any Scale
From tens of thousands of tests
![Page 42: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/42.jpg)
42© 2013 SOASTA CONFIDENTIAL - All rights reserved.
s
Memory leaks
Scale of Test
Sta
ge /
Team
Dev & Test
Release& Deploy
Network& Ops
CDN file placement
Load Balancer configuration
Network bandwidth
Network configuration
DNS routing
Inadequate server resources
Default configuration settings
Unbalanced web serversAuto-scaling failures
Latency between systems
Slow third-party plug-ins
Garbage collection
Database thread counts
Inefficient database queriesSlow pages
Conflict with other apps
Test Lab
Search technology limits
Method-level tuning
Max sockets exceeded
Firewall max capacity
Global latency variance
Security bottlenecks
Scale is relative – bugs are everywhere
Tuning for full-scale…and well beyond
Frequent Testing from Lab to Production
Staging Production (100% +++)
![Page 43: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/43.jpg)
43© 2013 SOASTA CONFIDENTIAL - All rights reserved.
s
Scale of Test
Sta
ge /
Team
Dev & Test
Release& Deploy
Network& Ops
Test Lab Staging Production (100% +++)
Where do we typically find the issues?
Top 10 Performance Problems
Architecture
Configuration Settings
Load Balancer
Database Performance
Bandwidth
Third Party Services
Culture and Mindset
Application Issues
Shared Environments
Connectivity
![Page 44: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/44.jpg)
44© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Summary
o HHS mistakes have quality at the forefront (again)
o Risks to revenue and reputation are measurable and high profile
o Speed and quality do coexist
o Best practices are well established (follow them)
o There IS time, and you CAN test realistically
o Start now
![Page 45: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/45.jpg)
Thanks
Contact SOASTA:www.soasta.com/cloudtest/
Follow us:
twitter.com/cloudtest
facebook.com/cloudtest
RESOURCES
Case studies: soasta.com/customers
Upcoming webinars: soasta.com/knowledge-center- This Friday, Nov. 22: “Getting Started with CloudTest”- Dec. 11: “Continuous Testing for Optimal Performance”
Need a test, fast? CloudTest On-Demand.- email [email protected] You’ll hear from us by tomorrow
![Page 46: How to Avoid Epic Web Failure... Lessons Learned from Healthcare.gov](https://reader036.fdocuments.us/reader036/viewer/2022062307/55497923b4c90595518b5a2c/html5/thumbnails/46.jpg)
www.SOASTA.com