Post on 12-Nov-2021
Welcome to the Testing Stream
Sponsored by:
Test Automation at Richemont Dierk Hoeft – Isabelle Bour
Birmingham, November 2013
Agenda – Test automation
Context
Objectives
The Solution ⁻ Our project
⁻ Technical solution
⁻ Night scheduling
Benefits
Questions
CONTEXT OF THE PROJECT Context of the project Test Automation
Richemont Organization
The Maisons
Use of SAP at Richemont Strategy Foundations
Favor Integration and Use of SAP Components – Avoid Interfaces and Replication whenever possible
4 Tier Landscape
Central Master Data Management for Articles and other key master data objects
Central Governance
Scope of applications – SAP applications : ERP, Planning and WMS
– Web applications : Usage for B2E, B2B and B2C
– Java applications : POS System
System frequently modified and extended – Regular Bug Fixing -> daily risk
– Maintenance cycle -> every 15 days risk
– Additional Enrichments -> every 6 months risk
– Support Packages -> every year risk
– Yearly Upgrades -> every year risk
Technical Context & Change Management
OBJECTIVES Objectives
Limit the risk of regressions, avoid impact on Operations
Improve reliability of overall Solution
Limit effort linked to manual Testing
Objectives of Test Automation Project
THE SOLUTION The solution, the tools
Our Test Automation Project
2011 - Proof Of Concept
3 machines
2012 - Deployment
5 machines
≈ 70 hours of daily lights-out testing
2013 – Industrialization
10 machines
≈ 140 hours of lights-out testing
2014 – Next steps
+ 20 machines
+ 250 hours
How ?
2 Tools :
SAP Solution Manager for Test Management
Worksoft Certify for Test script
Certify
Test script
- Generation
- Execution
Solution Manager
Test Management Test Plan
Test Package
Tester Assignment
Test Configuration
How ?
Test Management Approach
Test Plan
Test Package
Test Package
Test Package
Project
Template
Project
Test plan n Variants
Central
documentation
Upgrade, Roll out,
Maintenance,
Enhancement
Projects
Session of Tests
IT tests, KU tests
Teams
Business area
Test Configuration
Data set n Manual Test cases
n Automated Test cases
Tester
Test configuration
Test Plan
Test Configuration
Scenario
Process
Flow
Data of
automated test
1 script Steps of a process
Where process
is executed
For example 20 customers
Test Data Container 1
Test Data Container n
1 Automated Test cases
1 System
n Variants
For example
30 materials
What do we test ?
End to End processes
Cross applications
User simulation
Data stored and managed in Solution Manager
Script stored and managed in Certify
HTML UI
SAPGUI
Application Java
HTML
SAPGUI
HTML
Where ?
Pre-Prod
ERP
PreP SAP APO
QA ERP
QA
SAP Portal Q SAP Portal V
Prod ERP
Prod
SAP Portal P
Config P Config. V
Dev ERP
Dev
SAP Portal D
Config. D
When ?
For Regression Tests
Every night
Unattended tests
10 machines
For Projects
On demand
Until success
During the day
Dedicated data / Variants
Autotest
_06
Autotest
_01
Autotest
_02
Central access
to machines
Infrastructure
Autotest Autotest Autotest Autotest Autotest Autotest Autotest
Scheduler
Test automation process
Business Consultant Analysis Status Report Solution Manager & Certify Viewer
Test
Automation
Team
Test Message
Communication
Damaged Message
Correction of Script
Email Notification
Test Plan Owner
Test Package Owner
Tester assigned
Other Teams
Video - Log collectif depuis slm.avi Lights-out Testing 4 PM – 8 AM
BENEFITS Benefits
Test Types and Use of Test Automation (TA)
Potential Saving of at least 2800 MDs / year
Change Type Risk Manual Test Effort per Year
Target TA Coverage in %
Saving in FTE
Bi-Weekly Maintenance
Support Medium 2000 MDs 80 % 7.3
Bi-Annual Release Enrichment High 2400 MDs 30 % 3.3
Annual Upgrade Upgrade Very High 750 MDs 30 % 1
Projects Rollout Medium 2400 MDs 10 % 1.1
Benefits of Test Automation
Risk Mitigation by Permanent Unintended Test Execution – Issues are detected before they are reaching production
– Automation increases reliability
Saving by Reduction of Manual Test Effort
Increased Coverage of Complexity – More Variants are possible
– Scenarios with very high complexity can be covered
Benefits of Test Automation
Speed of Test Execution and Coverage – Important for time critical Projects
– Schedule can be easily adjusted
Improved Quality of Project Delivery – Test Automation allows to efficiently prepare Test Phases
– Resources can focus on Manual testing of complex Flows, Training and Change Management
QUESTIONS, COMMENTS ? Questions ?