automated acceptance testing phpdorset · CODECEPTION Behaviour-driven testing framework Built on...
41
Transcript of automated acceptance testing phpdorset · CODECEPTION Behaviour-driven testing framework Built on...
AUTOMATED ACCEPTANCE TESTING
PHP Dorset / October 2016
WITH CODECEPTION
IAIN POULSON@polevaultweb
https://www.meetup.com/Bournemouth-WordPress-Group/
@wpbournemouth27th October
Delicious Brains
WP Migrate DB Pro
WP Migrate DB Pro WP Offload S3
WP Migrate DB Pro WP Offload S3
THE PROBLEMReleasing a new version of one of these plugins takes time
WP OFFLOAD S3
Lite free plugin
Premium plugin
AWS plugin dependency
6 addon plugins
20
Manual Acceptance Test Scripts
77
81
181
3 x Developer rounds of testing with bug fixes and retests
WHAT’S THE SOLUTION?
WHAT’S THE SOLUTION?
Hire a tester or testers for the team
WHAT’S THE SOLUTION?
Hire a tester or testers for the team
WHAT’S THE SOLUTION?
Hire a tester or testers for the team
Hire the services of an external Quality Assurance team
WHAT’S THE SOLUTION?
Hire a tester or testers for the team
Hire the services of an external Quality Assurance team
WHAT’S THE SOLUTION?
Hire a tester or testers for the team
Hire the services of an external Quality Assurance team
Hire more developers
WHAT’S THE SOLUTION?
Hire a tester or testers for the team
Hire the services of an external Quality Assurance team
Hire more developers
THE EUREKA MOMENT
THE EUREKA MOMENT
Rock Solid Software Testing Without Hiring an ArmyTrish Khoo
WHY WE CAN’T HAVE NICE THINGS
DO NOT HIRE A QA TEAM
The problem with this is that now you’ve got a team of people who is accountable for quality in your software and they have no power to affect the quality of it directly
HER SOLUTION
AUTOMATION
HER SOLUTION
AUTOMATION
The problem is that usually this is approached in a way that isn’t terribly scalable
HER SOLUTION
IN-HOUSE AUTOMATION
The whole team has to commit to quality
WHAT DOES THAT ACTUALLY MEAN?
THE PLAN
1. One developer works on replacing manual with automated tests 2. All new code should have corresponding tests written 3. Code changes should have tests updated 4. PRs should have suite of all tests run before review
THE RESULT
1. Regression issues are caught much earlier 2. Release testing becomes much shorter, less labour intensive 3. Manual tests can be reduced to a skim test 4. Releases can happen more often
AUTOMATE ALL THE THINGS
CODECEPTIONBehaviour-driven testing framework
Built on top of PHPUnitRuns acceptance, functional, and unit tests
ACCEPTANCE TESTSAcceptance tests can cover standard but complex scenarios from a user’s
perspective. With acceptance tests you can be confident that users, following all defined scenarios, won’t get errors.
http://codeception.com/docs/01-Introduction
A SAMPLE TEST
MODULES
Database Filesystem PhpBrowser Lots more
PHPBROWSERA PHP web scraper, which acts like a browser: it sends a
request, then receives and parses the response
WEBDRIVER
Selenium
PhantomJS
WORDPRESS INTEGRATION
WPBrowser
Extends PhpBrowser and DB Module with WordPress specific assertions
TIP OF THE ICEBERG
Lots of different modules
Continous Integration
BDD support
DOWNSIDES
1. Large overhead in environment setup and converting manual tests 2. Potential for customisation of modules to fit our specific needs 3. Code changes, so the tests will need to be maintained
RESOURCEShttp://businessofsoftware.org/2016/06/rock-solid-software-testing-without-hiring-an-army-trish-
khoo-google-bos2015/
http://codeception.com/
https://github.com/lucatume/wp-browser
https://github.com/polevaultweb/wpos3-acceptance-testing-example
https://deliciousbrains.com/codeception-automate-wordpress-plugin-testing/
ANY QUESTIONS?
