The future of automated testing
-
Upload
gojko-adzic -
Category
Technology
-
view
323 -
download
0
Transcript of The future of automated testing
![Page 1: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/1.jpg)
The future of automated testing
Gojko Adzic@gojkoadzic
http://gojko.net
![Page 2: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/2.jpg)
Change the balance ofexpected vs unexpected
Opportunity #1
![Page 3: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/3.jpg)
github.com/minimaxir/big-list-of-naughty-strings
![Page 4: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/4.jpg)
gojko.github.io/bugmagnet
![Page 5: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/5.jpg)
aws.amazon.com/device-farm
![Page 6: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/6.jpg)
browserstack.com
![Page 7: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/7.jpg)
saucelabs.com
![Page 8: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/8.jpg)
Prediction #1:
cloud device farms + browser farms +
known testing heuristics =
Automated UI mutation testing
![Page 9: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/9.jpg)
mturk.com
![Page 10: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/10.jpg)
usertesting.com
![Page 11: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/11.jpg)
Prediction #2:
Automated crowd-sourcecoordination tools
● Real humans, real devices,● statistically significant, cheap enough● Smoke testing as a service● Automated focus groups
![Page 12: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/12.jpg)
Assisting humans inmaking testing decisions
Opportunity #2
![Page 13: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/13.jpg)
no-mans-sky.com
![Page 14: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/14.jpg)
bbc-news.github.io/wraith
![Page 15: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/15.jpg)
github.com/xebia/VisualReview
![Page 16: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/16.jpg)
domreactor.com
![Page 17: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/17.jpg)
applitools.com
![Page 18: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/18.jpg)
https://github.com/hugs/tapsterbot
![Page 19: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/19.jpg)
Prediction #3:
automated cloud services +probes +
videos/screenshots +approval testing =
Automated selection ofapproval-style UI tests
![Page 20: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/20.jpg)
github.com/jamesshore/quixote
![Page 21: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/21.jpg)
galenframework.com
![Page 22: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/22.jpg)
popapp.in
![Page 23: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/23.jpg)
Prediction #4:
New languages forautomated tests against wireframes or prototypes
![Page 24: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/24.jpg)
Dealing with thingsimpossible to predict
Opportunity #3
![Page 25: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/25.jpg)
hotjar.com
![Page 26: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/26.jpg)
trackjs.com
![Page 27: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/27.jpg)
Prediction #5:
Automated tests forbehaviour changes in
production
● Eg Applitools + hotjar + mturk● On a small part of the user base in production● Integrated into CI
![Page 28: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/28.jpg)
Big Brother, Big Data
Opportunity #4
![Page 29: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/29.jpg)
tensorflow.org
![Page 30: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/30.jpg)
www.dmtk.io
![Page 31: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/31.jpg)
http://news.mit.edu/2016/faster-automatic-bug-repair-code-errors-0129
![Page 32: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/32.jpg)
Prediction #6:
Big-data threat/riskmodelling
● Directing exploratory testing● Combined with mutations/approvals
![Page 33: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/33.jpg)
Prediction #6:
Big-data threat/riskmodelling
● Directing exploratory testing● Combined with mutations/approvals
![Page 34: The future of automated testing](https://reader031.fdocuments.us/reader031/viewer/2022030207/58a7d88b1a28ab8a7e8b5b21/html5/thumbnails/34.jpg)