Overcoming Test Automation Obstacles
-
Upload
perfecto-mobile -
Category
Mobile
-
view
1.288 -
download
2
Transcript of Overcoming Test Automation Obstacles
05/01/2023 1© 2016, Perfecto Mobile Ltd. All Rights Reserved.
7 key recommendations for building a solid test automation suiteMay 2016
Eran KinsbrunerDirector, Tech. Evangelist
Perfecto
Uzi EilonTechnology Director
Perfecto
Daniel KnottMobile Senior Test Engineer
Xing AG
Webinar Agenda
05/01/2023 2© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Mobile Test Automation Challenges
Strategy for defining the right digital test coverage
Practices For Robust Test Automation
The 7 Keys for Unattended Mobile Test Automation
Live Demo!
Q & A
05/01/2023 3© 2015, Perfecto Mobile Ltd. All Rights Reserved.
I SAIDI WAS FINE.
I LIED.
Poll – Mobile Test Automation Challenges
05/01/2023 4© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Code / Test – Common Challenges
1) Execution of One script across platforms
2) Automating build/deploy and acceptance testing during CI
3) Test results analysis
4) Object id Identification
5) Does it work over time ?
6) Maintenance of scripts and Objects
7) Matching Dev/Testers skill set
DevOps – challenges
Tools
Reports
Flows
Time Stability
False negatives
Collaboration
The Test Coverage Conversation – What To Answer?
Which Devices? Which OS Versions? How Many platforms are Enough? When Should I refresh my test lab? Who is in charge of coverage?
05/01/2023 7© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Mobile Test Coverage Method
Recommended OS – Usage & Quality Rationale
Usage & Quality Issues
Wi-Fi IssuesBattery Drain
Latest REF Android OS
Recommendations Leverage market calendars and stay updated Refresh/Review your test lab once a quarter Beta versions are no longer an option
Chrome, FireFox, iOS Leverage analytics but validate and calibrate using market trends Real user conditions extends your test coverage Assign an owner for digital test coverage but keep the conversation open to all
teams Mix your mobile test lab with the 4 device types
05/01/2023 10© 2015, Perfecto Mobile Ltd. All Rights Reserved.
WHY AUTOMATE?
UI
Integration
Unit Testing
Performance Security
Digital Transformation Requires Changes Around Test Automation
Target Devices
TargetEnv.OS
OS versionsForm factorsCPU & MemoryManufacturersWearablesIOT
NetworksOrientationLocationNotificationsEventsDevice events
Object Identification Is Key For Robust Automation
05/01/2023 13© 2016, Perfecto Mobile Ltd. All Rights Reserved.
• Selenium• Appium• XCTest• UIAutomation• Perfecto
• Abby OCR• Applitools• Perfecto
14
Device/System Level Control is Critical
15
Assure Proper Error Handling
System level control
Application control
Device control
3 Layers Involved In Test Automation Optimization
05/01/2023 16© 2016, Perfecto Mobile Ltd. All Rights Reserved.
App• Info.Plist (iOS)• Manifest.MF (Android)
Test Cases• Define Desired Capabilities
Device• Supports Feature• Doesn’t Support
Facebook App Testing Diversity
05/01/2023 17© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Test Scenario iPhone 6/iPhone 5S iPhone 6S/6S Plus iPad Tablets
Login YES YES YESWrite Post (FB UI) YES YES YESWrite Post (FB Force Touch) NO YES NOUpload Photo/Video(FB UI) YES YES YESUpload Photo/Video(FB Force Touch) NO YES NOTake Photo/Video(FB UI) YES YES YESTake Photo/Video(FB Force Touch) NO YES NO
More Examples: Android Doze & Multi Window
05/01/2023 18© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Android 6 and Above
Android N and Above
Validate Feature Compliance & Test Accordingly
05/01/2023 19© 2016, Perfecto Mobile Ltd. All Rights Reserved.
IOS Developer Library
INFO.PLIST
7 Keys for Successful Unattended Automation and CI
05/01/2023 20© 2015, Perfecto Mobile Ltd. All Rights Reserved.
Start small & Grow Accept that not every test enters CI
Debug & Debug Again across few platforms Make your script reusable
Validate within and between the tests Plan for unexpected events Keep channel between Engineering,
Ops and Biz opened
Zero Effort Automation Demo
More Example
05/01/2023 22© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Smart Monkey Automation
05/01/2023 23© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Smart Monkey Automation
05/01/2023 24© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Webinar Agenda
05/01/2023 25© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Mobile Test Automation Challenges
Strategy for defining the right digital test coverage
Practices For Robust Test Automation
The 7 Keys for Unattended Mobile Test Automation
Live Demo!
Q & A
Thank You