Escape from the automation hell

COPYRIGHT 2014 @ UNITY TECHNOLOGIES

ESCAPE FROM THE AUTOMATION HELL• By Yan Drugalya


KID DREAMS


WHO I BECAME


HOW OTHERS SEE ME


NOW


AUTOMATION


CHALLENGES• Slow tests• Unstable tests• Hard to run tests locally• Hard to reproduce failure locally


FIRST THERE WERE THE SCOUTS


AFTER ½ YEARS OF SCOUTING


THE HOPE


UNIFIED TEST RUNNER• A Simple command line that changed a lot

test -suite=<runtime|integration…>


TDD IN PERL?


ISSUES• Slow tests• Unstable tests• Hard to run tests locally• Hard to reproduce failure locally


NEXT STEP• Build farm started to use UTR


ISSUES• Slow tests• Unstable tests• Hard to run tests locally• Hard to reproduce failure locally


HOARDER


BuildAgents&Humans Hoarder WS


NICE DISCOVERIES• 16 559 749 tests run in Aug 2015!• Never failed tests• Compare performance regressions• How people use UTR to run tests locally• Automatic discovery of unstable test• ....


FUTURE• Immediately get an overview of the state of our test

automation• Automatically find and assign test failures• Extend the REST API interface to make it easier to

integrate with other tools we use at Unity

Escape from the automation hell

Software

Transcript of Escape from the automation hell