Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks...
Transcript of Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks...
![Page 1: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/1.jpg)
sqs.com
TransformingtheWorldThroughQuality
![Page 2: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/2.jpg)
Agenda
§ HowDidWeGetHere?§ TheFundamentals§ Approach(BestPractice)§ TheTechnology§ MeasuringSuccess§ Q&A
2©SQSUSAInc.|Dec 2017|
![Page 3: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/3.jpg)
TraditionalApproaches
DigitalDisruption
Lean/AgileConcepts
ContinuousQuality
3©2017TrissentialLLC– AnentityofSQSGroup|
MC/DCMCCMBDDHFWaterfall
IoTMobileSocialCloudBigData
ContinuousImprovementBusinessValueUXSpeed
ShiftLeftEmbeddedQATotalQualityEngineering
DigitalTechnologyTransformation
![Page 4: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/4.jpg)
Pleasecopyaslidewithasuitablepicturefromthefile„TitleSlides_EN.pptx“(changetopresentationmodetodownload)
andpasteithere.Ifnecessary,applythecorrectformattingbyright-clickingandchoosing“Layoutà TitleSlide“.
The Fundamentals
![Page 5: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/5.jpg)
5
TDD
BDDATDD
BART
TestDrivenDevelopment
BehaviorDrivenDevelopmentAcceptance
TestDrivenDevelopment
BusinessAgilitythroughRisk-basedTesting
©SQSUSAInc.|Dec 2017|
GoldenCirclesofAgileQuality
![Page 6: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/6.jpg)
6
-PrioritizeRiskAreas-DefinetheRiskTolerance-FititintoSprints-ReportonRisks
UnderstandingYourRiskisImportant
-EasilyIdentifyWhattoTest-DecideHowMuchtoTest-UnderstandWhentoTest-ActiveMitigation(Anticipate)-CollaborateonResolution
©SQSUSAInc.|Dec 2017|
![Page 7: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/7.jpg)
QualityEssentials
7
§ ProductQuality(ISO25010+ISO16085)o 31QualityAttributesThatRequireaStrategyo MostOrganizationsareFocusedonFunctionalStability(3of31)o OurFocusisonEnablementoftheQualityOrganizationo MostOrganizationsareLinearinTheirTestingApproacho WeAssessRiskinOrdertoDeliverBusinessValueo ShiftLeftisaMind-set
§ QualityinUse(ISO25010):o Effectivenesso Efficiencyo Satisfaction(Usefulness,Trust,Comfort,Pleasure)o FreedomfromRisk(Economic,Safety,Environmental,Competitive)o ContextCoverage(Completeness,Flexibility)o Real/SimulatedUse(Real-WorldE2E)
§ DataQuality(ISO25012):o 15QualityAttributesThatRequireaStrategyo DataatRest,DatainMotion,HighlyAvailable,Confidential,Accurateo DataCreatedinReal-Time(DataasaService– DaaS)o EasilyReplicated,Utilized,andCleanedupo ExponentialTestCoveragewithMinimalAdditionalWork
©SQSUSAInc.|Dec 2017|
![Page 8: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/8.jpg)
Pleasecopyaslidewithasuitablepicturefromthefile„TitleSlides_EN.pptx“(changetopresentationmodetodownload)
andpasteithere.Ifnecessary,applythecorrectformattingbyright-clickingandchoosing“Layoutà TitleSlide“.
Agile Quality Approach
![Page 9: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/9.jpg)
9
Pre-planning
• QAchecksstoriesofNextSprint –FeatureFiles
• QAchecksstoriesofNextSprint -Automation
• QAchecksstoriesofNextSprint -AcceptanceCriteria
GroomingSessions
•WhatdoIneed:•Technology(Sean/Chad)•TestData(BSAs)•E2E(Team)
•Strategy:•How•Highlevelestimate
SprintPlanning
•Story•ExplainStrategy•DetailEstimate•RiskAssessment•Questions
Shift-LeftPlanning
DoingtheworkpriortotheSprintisjustasimportantasdoingtheSprintactivities.Thesepre-SprintactivitieshelpQAachievehighershift-leftvalue.
©SQSUSAInc.|Dec 2017|
![Page 10: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/10.jpg)
10
Pre-Sprint
•RiskRecommendation•GroomingfutureSprintwork
SprintPlanning(Day1)
•RiskAcceptance•TestStrategy•TestPrep•GroomingfutureSprintwork
TestPrep&Run(Day2-4)
•AutomationScripting•TestData•FeatureTesting•Functional/RegressionPrioritization•SmokeTestingExecution(CI)
TestExecution(Day5-7)
•SmokeTesting•AutomatedTesting•FeatureTesting•Functional/RegressionTesting•DefectManagement•QASign-off(Story)•AcceptFeature•StatusReporting
SprintCompletion(Day8-10)
•FeatureTesting•End-to-endTesting•PerformanceTesting•DefectManagement•UAT•Demo•Sign-off(Sprint)•Retrospective
QATimeline
Withourguidance,clientsareabletoalignthetestingeffortwithinthesamesprintasthedevelopmentteam.Thisapproachsupportsspeedandagility,andenablesthepotential“shiftleft”valueofagile/Scrum.
©SQSUSAInc.|Dec 2017|
![Page 11: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/11.jpg)
11
Analyst(Any)
• Story• TestData• Functional/RegressionPrioritization
• FeatureTesting
• Transparency,updatestosprintgoals
Shared
• RiskRecommendation• BacklogMaintenance• RiskAcceptance• TestStrategy• DefinitionofReady• DefinitionofDone• Sizing• DefectManagement• CommitmenttoSprintgoals
• End-to-endTesting• QASign-off(Story)• Demo• Retrospective
Engineer(Any)
• AutomationScripting• SmokeTesting• AutomatedTesting• Functional/RegressionTesting
• PerformanceTesting• Alignmenttoarchitecture
SharedQAResponsibility
©SQSUSAInc.|Dec 2017|
![Page 12: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/12.jpg)
ThePowerofWorkflows
12
WorkflowA
Transaction1b
UI/UX
DataManagement
Integration
Risk
Transaction2b
UI/UX
DataManagement
Integration
Risk
Transaction3b
UI/UX
DataManagement
Integration
Risk
Transaction1a
UI/UX
DataManagement
Integration
Risk
Transaction2a
UI/UX
DataManagement
Integration
Risk
Transaction3a
UI/UX
DataManagement
Integration
Risk
©SQSUSAInc.|Dec 2017|
![Page 13: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/13.jpg)
PairedTesting
Who:§ Analyst– SME§ SDET– Technicalsolutions
What:§ Knowledgetransfer§ Peerreviews§ Testcasedesignsessions
Why:§ Morecompletetechnicalsolutions§ Bettertotalquality§ Collaboration
How:§ Onehouraday,everyday§ Rotatethefocus§ Keepalog
BestPractices:§ RotatepartnerseveryotherSprint§ Communicationshouldbedialogues§ Becustomer-driven§ Thinkoperationally§ Createacommunityofpracticeforum
§ Encourage“natural”synergies
13©SQSUSAInc.|Dec 2017|
![Page 14: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/14.jpg)
Pleasecopyaslidewithasuitablepicturefromthefile„TitleSlides_EN.pptx“(changetopresentationmodetodownload)
andpasteithere.Ifnecessary,applythecorrectformattingbyright-clickingandchoosing“Layoutà TitleSlide“.
Technology
![Page 15: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/15.jpg)
15
§ Vision&Strategy§QualityasaService§ BestPractices§ EnterpriseFrameworks§QualityinUse§ DataasaService§ AnalyticsServices(Metrics)§ Innovation(AI,MBL,BI)§ PredictiveQuality§ DevOps§ ToolsConsolidation
UtilizingIntelligentTestArchitectureUnderstandingNeeds,BuildingStrategies,andPragmaticallyExecuting
CORE COMPONENTS
LIBRARIES
CI\O
rche
stra
tion
WEB
SCM
IDE\
Lang
uage
\Too
ls
PACKAGEMANAGER
FRAMEWORK
CHROME FIREFOXIE SAFARI
EXECUTION
©SQSUSAInc.|Dec 2017|
![Page 16: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/16.jpg)
EnterpriseAutomationFramework
16
CORE CLIENT LIBRARIES EXECUTION
API BDD
OPTIONAL
CORE CLIENT LIBRARIES EXECUTION
DesktopDatabase
APICORE CLIENT LIBRARIES EXECUTIONMOBILE
©SQSUSAInc.|Dec 2017|
![Page 17: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/17.jpg)
Pleasecopyaslidewithasuitablepicturefromthefile„TitleSlides_EN.pptx“(changetopresentationmodetodownload)
andpasteithere.Ifnecessary,applythecorrectformattingbyright-clickingandchoosing“Layoutà TitleSlide“.
Measuring Success
![Page 18: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/18.jpg)
TheQualityMission
1000
1700
020040060080010001200140016001800
Distributionofthe2,700errorswithEED
135 135
675
1080
675
0200400600800100012001400
Distributionofthe2,700errorswithoutEED
Costsfordetecting2,700errors: $314,040
Analysis: 1000x112.20x1= $112,200
Design: 1,700x112.20x4= $762,960
Total $1,189,200
Analysis: 135x112.20x1= $15,147Design: 135x112.20x4= $60,588Implementation: 675x112.20x12= $908,820Acceptance: 1080x112.20x48= $5,816,448Deployment: (675x112.20x90)/4= $1,704,038Total $8,505,041
§ HeavyrelianceonUATisthemostexpensiveandinefficientstrategyfortesting.§ Realcostishiddenwhensupportcostsaresplitfrombuildcostsandtestinglateinlifecycleisseenas“businessasusual”
§ TestingconsistencyisanacceleratorforEEDandautomationisthekeydriverforconsistency18
TypicalPractice BestPractice
©SQSUSAInc|Nov2017|
![Page 19: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/19.jpg)
MeasuringSuccess
19
CostofQualityisnotjustaboutthemoneysaved,itisalsoaboutwhereitissavedandwhatitenabledbythesavings
©SQSUSAInc.|Dec 2017|
![Page 20: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/20.jpg)
MeasuringSuccess
QualitythroughputisjustasimportantasCostofQualitybecauseifyourenterpriseautomationframeworkdoesn’tenableyoutoincreasethroughputthenyouhaven’tbeensuccessful.
20©SQSUSAInc.|Dec 2017|
![Page 21: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/21.jpg)
MeasuringSuccess
Makingsureyourenterpriseautomationframeworkenables“shiftleft”byyourQAteamsisalsoimportanttotrack.Keepinganeyeonwheredefectsarediscoveredisagreatindicatorofshiftleft.
21©SQSUSAInc.|Dec 2017|
![Page 22: Transforming the World Through Quality Trissential... · 2017. 12. 14. · §Enterprise Frameworks §Quality in Use §Data as a Service ... §Innovation (AI, MBL, BI) §Predictive](https://reader034.fdocuments.us/reader034/viewer/2022052018/603203c432799c48623fc5ea/html5/thumbnails/22.jpg)
Thank you for your attention