Software Testing on the Web - mschuette.name · Codeception MartinSchütte SowareTestingontheWeb...

So ware Testing on the Web

Martin Schütte

. .So ware Quality

. . . . .Documentation

. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .

Behaviour Testing. .Conclusion

Outline

So ware Quality

Documentation

Unit TestingPHPUnitContinuity

Web Drivers

Behaviour TestingMetaPHP Behat and Ruby CucumberCodeception

Martin Schütte So ware Testing on the Web 2012-10-13 2 / 51

. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Main Questions

How can I know (my) so ware is correct?How does my boss know so ware is correct?How can we discuss what “correct” is, anyway?

We always need:• implicit assumptions,• explicit specifications.


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Walking on water and developing so ware from a specification areeasy if both are frozen.

– Edward V. Berard

Let’s just update PHP…

Let’s just change the DB schema…

Let’s just add feature X…

Is the so ware still correct?


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Maintainability requires Documentation

Consistency of:1. Code2. Comments3. Documentation

When code and comments disagree, both are probably wrong.

– Norm Schryer


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Levels of Documentation..

abstract

.

concrete

.

Libraries, Functions

.

Subsystems

.

External API

.

UI


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


PHPdoc/JavaDoc/Doxygen etc...

/*** Gets single server parameter for specified key.** @param string $key A key of the parameter to get* @param string $default A default value when key is undefined** @return string A value of the parameter*/public function getServerParameter($key, $default = ’’){

return (isset($this->server[$key]))? $this->server[$key] : $default;

}


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Low Level Documentation


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


High Level Documentation


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Levels of Testing..

abstract

.

concrete

.

Unit Tests

.

System Tests

.

AcceptanceTests


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Regression TestingBug Tracker = Documentation


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


PHPUnitclass DTABaseTest extends PHPUnit_Framework_TestCase{

protected function setUp(){

$this->fixture = new DTABase();}

public function testGetNumTooShort(){

$input = ”12345”;$off = 3;$len = 4;$rc = $this->fixture->getNum($input, $off, $len);$this->assertEquals(”45”, $rc);

}// ...

}Martin Schütte So ware Testing on the Web 2012-10-13 12 / 51

. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


PHPUnit~/Payment_DTA> phpunit tests/DTABaseTest.phpPHPUnit 3.6.11 by Sebastian Bergmann.

F....

Time: 0 seconds, Memory: 3.75Mb

There was 1 failure:

1) DTABaseTest::testGetNumTooShortFailed asserting that 45.001 matches expected ’45’.

/usr/home/mschuett/Payment_DTA/tests/DTABaseTest.php:50/usr/local/bin/phpunit:46

FAILURES!Tests: 5, Assertions: 5, Failures: 1.


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Tests are Documentation

~/Payment_DTA> phpunit --testdox tests/DTABaseTest.phpPHPUnit 3.6.11 by Sebastian Bergmann.

DTABase[ ] Get num too short[x] Get num offset too big[x] Get str too short[x] Get str offset too big[x] Get str invalid


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


WordPress Unit Testshttp://unit-tests.trac.wordpress.org/..

vagrant@wp:~/trunk$ phpunitRunning as single site... To run multisite, use -c multisite.xmlNot running ajax tests... To execute these, use --group ajax.PHPUnit 3.6.12 by Sebastian Bergmann.

Configuration read from /home/vagrant/trunk/phpunit.xml

................F....................................SS.....S 61 / 1437 ( 4%)S...SSSSSS.............S..SSS..........SS................S... 122 / 1437 ( 8%).......SS.SSSS...............S.................S............. 183 / 1437 ( 12%)...............................S............S................ 244 / 1437 ( 16%).S........................S.................S.......I........ 305 / 1437 ( 21%).........................SSSS.S..SSS......................... 366 / 1437 ( 25%)............................................................. 427 / 1437 ( 29%)............................................................. 488 / 1437 ( 33%)............................................................. 549 / 1437 ( 38%)............................................................. 610 / 1437 ( 42%)..................................................S.......... 671 / 1437 ( 46%).......SSSSSSSSSSSSSS...........SS........................... 732 / 1437 ( 50%).............SS...............SSSSSSSSSSSSSSSSSS............. 793 / 1437 ( 55%)................SSS...S.SSSSSSS................SSSSSSS....... 854 / 1437 ( 59%).............S..SS....FFF....SSSS.SS......................SSS 915 / 1437 ( 63%)............................................................. 976 / 1437 ( 67%)......S..................................................S..S 1037 / 1437 ( 72%)................SS.S.........................S............... 1098 / 1437 ( 76%)...............S..................S.......................... 1159 / 1437 ( 80%)............................................................. 1220 / 1437 ( 84%).......................F..............................S...... 1281 / 1437 ( 89%)............................................................. 1342 / 1437 ( 93%).............................................SS.

Time: 08:56, Memory: 122.75Mb[...]

FAILURES!Tests: 1390, Assertions: 5640, Failures: 5, Incomplete: 1, Skipped: 117.


http://unit-tests.trac.wordpress.org/

. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


PHPUnit Code Coverage


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Things to build upon Automated Testing

• git bisect run phpunit:find commit that introduces a bug

• Continuous Integration:• frequent check-ins to mainline branch• verified by automated builds and tests

• Continuous Deployment:• automated deployment to production• useful: automated rollback


http://geek-and-poke.com/2012/01/recently-at-the-jenkins-monitor.html

. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Example: Jenkins CI


https://builds.apache.org/job/SpamAssassin-trunk/

. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Example: Travis CI for GitHub


https://travis-ci.org/#!/pear/Payment_DTA/builds/2517746

. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Approaches to Unit Testing

• Exploratory testing (e. g. for 3rd party libs)• Regression testing (for found & fixed bugs)• Spike and Stabilise testing (a er code, before refactoring)• Test Driven Development (TDD): test first, then code


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Program testing can be used to show the presence of bugs,but never to show their absence!

– Edsger Dijkstra,Notes on Structured Programming

Testing by itself does not improve so ware quality.Test results are an indicator of quality, but in and of themselves,they don’t improve it. […]If you want to improve your so ware, don’t test more; developbetter.

– Steve McConnell, Code Complete


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Cost of Testing• Testing (like Documentation) has a cost• o en: productivity improvement > cost• but ROI depends on type of project/so ware


http://notinventedhe.re/on/2011-5-17

. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


HTTP APIclass TumblrAPITest extends PHPUnit_Framework_TestCase{

public function testPostDatetime(){

$url = ”http://staff.tumblr.com/api/read”;$ch = curl_init($url);curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);$xmlsrc = curl_exec($ch);

$xmlobj = new SimpleXMLElement($xmlsrc);$str_date = date_timestamp_get(date_create(

$xmlobj->posts->post[0][’date-gmt’]));$unix_date = intval(

$xmlobj->posts->post[0][’unix-timestamp’]);

$this->assertEquals($str_date, $unix_date);}

}Martin Schütte So ware Testing on the Web 2012-10-13 23 / 51

. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


HTML-Contentclass WpCampTest extends PHPUnit_Framework_TestCase{

public function testSiteTitle(){

$url = ”http://wpcamp.de/”;$ch = curl_init($url);curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);$xmlsrc = curl_exec($ch);

$dom = @DOMDocument::loadHTML($xmlsrc);$title = $dom->getElementsByTagName(’title’)

->item(0)->textContent;

$this->assertContains(’Das WordPress Event’, $title);}

}

.Martin Schütte So ware Testing on the Web 2012-10-13 24 / 51

. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Gouttea simple PHPWeb Scraper

class WpCampTest extends PHPUnit_Framework_TestCase{

public function testSiteTitle(){

$client = new Client();$crawler = $client

->request(’GET’, ’http://wpcamp.de/’);$title = $crawler

->filter(’html head title’)->first()->text();

$this->assertContains(’Das WordPress Event’, $title);}

}


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Seleniuma suite of tools to automate web browsers across platforms

class WpTest extends PHPUnit_Extensions_SeleniumTestCase{

public function setUp(){

$this->setHost(”localhost”);$this->setBrowser(”firefox”);$this->setBrowserUrl(”http://wpcamp.de/”);

}public function testSiteTitle(){

$this->open(”/”);$this->assertText(”//html/head/title”,

”Das WordPress Event *”);}


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Selenium, contd.

public function testSearch(){

$this->open(”/”);$this->type(”id=s”, ”sponsoren”);$this->click(”id=searchsubmit”);$this->waitForPageToLoad(”30000”);

$this->assertText(”css=#content”,”regexp:.*Premium-Sponsor Chocri.*”);

$this->assertText(”css=#content”,”regexp:.*Platin-Sponsor Adobe.*”);

}}


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Behat Minkan acceptance test framework for web applications

class WpCampTest extends PHPUnit_Framework_TestCase{

public function setUp(){

$driver = new \Behat\Mink\Driver\GoutteDriver();$this->session = new \Behat\Mink\Session($driver);

}public function testSiteTitle(){

$this->session->visit(’http://wpcamp.de/’);$title = $this->session->getPage()

->find(’css’, ’html head title’)->getText();$this->assertContains(’Das WordPress Event’, $title);

}


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Behat Mink, contd.public function testSearch(){

$this->session->visit(’http://wpcamp.de/’);$page = $this->session->getPage();$page->find(’css’, ’#s’)->setValue(’Sponsoren’);$page->find(’css’, ’#searchsubmit’)->press();

$text = $this->session->getPage()->find(’css’, ’#content’)->getText();

$this->assertContains(’Premium-Sponsor Chocri’, $text);

$this->assertContains(’Platin-Sponsor Adobe’, $text);

}}


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


The Big Picture

..Mink..

PHPUnit

.

Selenium

.

Sahi

.

Goutte

.

Zombie.js

.

Opera

.

Firefox


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Problems with Web Drivers

Differences in:• web functionality (HTML, CSS, JS, AJAX)⇒ performance

• selectors (ID, CSS, XPath, DOM)• test functionality and integration with test framework

Recommendation: Select two Drivers,1. simple and fast one for unit testing and2. Selenium/Sahi for integration and UX testing.


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Testing in Production = Monitoring

Example: check webshop availability

Possible layers:• ping server• check HTTP status ”200 OK”• check homepage title• login as user• complete order process


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


The next level: Behaviour Tests

Funktionalität: SelbstpräsentationUm etwas über das WPCamp zu erfahrenAls BesucherMöchte ich Infos auf der Website finden

Szenario: Sponsoren suchenAngenommen ich bin auf ”/”Und ich suche nach ”sponsoren”Dann ich sollte ”Premium-Sponsor Chocri” sehenUnd ich sollte ”Platin-Sponsor Adobe” sehen


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Next Level: Behaviour Driven DevelopmentTDD with other syntax?

Is BDD the same as TDD? Yes. If you’re a programmer, and yourentire team is programmers, and all your stakeholders areprogrammers.

– Dan North

We don’t call them “acceptance tests” because you can’t aska business person “Please help me with my acceptance test”.Try “I’d like to talk to you about the scenario where…” instead. Or,“Can you give me an example?” Either of these are good.

– Liz Keogh


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Unit & Behaviour Testing

Unit Tests• unit testing• programmers• programming language• bottom-up• assertXYZ• tests derived from user stories

⇒ development tool

Behaviour Tests• acceptance test scenarios• non-developers• language of business domain• top-down / outside-in• X should do Y• execute user stories

⇒ communication tool


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


One Notation/“Language”: Gherkin

Feature: [one line describing the story]In order to [benefit]As a [role]I want [feature]

Scenario: [A scenario specific goal]Given [Something that needs to have happened or be true]When [Some task I must do]And [Another task]Then [Some way I know I’ve achieved my goal]


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


I18N

# language: de

Funktionalität: [one line describing the story]Um zu erreichen [benefit]Als [role]Möchte ich [feature]

Szenario: [Title]Angenommen [context]Wenn [event]Dann [outcome]Und [another outcome]


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


TDD with other syntax?

Scenario: New lists are emptyGiven a new listThen the list should be empty.

Scenario: Lists with things in them are not empty.Given a new listWhen we add an objectThen the list should not be empty.

.


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Implementation / Translation

A look behind the curtain:• framework is clever but not magical• some translation needed• statements have to become executable code

Mechanism:• plain sentence→method name• quoted words→ arguments• matching with annotated RegExp• methods yield success, exception, or pending exception


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Behat/Mink FeatureContext.phpuse Behat\MinkExtension\Context\MinkContext;

class FeatureContext extends BehatContext{

public function __construct(array $parameters){

$this->useContext(’mink’, new MinkContext());}

}

MinkContext adds web-related methods and their I18N translations,e. g.:

• visit($page)• fillField($field, $value)• pressButton($button)


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Behat Output[mschuett@dagny] ~/wpcamp/code% ./vendor/bin/behatFunktionalität: Selbstpräsentation

Um etwas über das WPCamp zu erfahrenAls BesucherMöchte ich Infos auf der Website finden

Szenario: Sponsoren suchen # features/wpcamp.feature:8Angenommen ich bin auf ”/” # Behat\MinkExtension\Context\MinkContext::visit()Und ich suche nach ”sponsoren”Dann ich sollte ”Premium-Sponsor Chocri” sehen # Behat\MinkExtension\Context\MinkContext::assertPageContainsText()Und ich sollte ”Platin-Sponsor Adobe” sehen # Behat\MinkExtension\Context\MinkContext::assertPageContainsText()

1 scenario (1 undefined)4 steps (1 passed, 2 skipped, 1 undefined)0m1.574s

You can implement step definitions for undefined steps with these snippets:

/*** @Given /^ich suche nach ”([^”]*)”$/*/

public function ichSucheNach($arg1){

throw new PendingException();}


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Edit FeatureContext.phpaddmethod

/*** @Given /^ich suche nach ”([^”]*)”$/*/public function ichSucheNach($arg){

return array(new When(”I fill in \”s\” with \”$arg\””),new When(”I press \”searchsubmit\””),

);}


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Behat Output

[mschuett@dagny] ~/wpcamp/code% ./vendor/bin/behatFunktionalität: Selbstpräsentation

Um etwas über das WPCamp zu erfahrenAls BesucherMöchte ich Infos auf der Website finden

Szenario: Sponsoren suchen # features/wpcamp.feature:8Angenommen ich bin auf ”/” # Behat\MinkExtension\Context\MinkContext::visit()Und ich suche nach ”sponsoren” # FeatureContext::ichSucheNach()Dann ich sollte ”Premium-Sponsor Chocri” sehen # Behat\MinkExtension\Context\MinkContext::assertPageContainsText()Und ich sollte ”Platin-Sponsor Adobe” sehen # Behat\MinkExtension\Context\MinkContext::assertPageContainsText()

1 scenario (1 passed)4 steps (4 passed)0m2.59s


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


The Big Picture (PHP)

..Mink.

Behat

.

PHPUnit

.

Selenium

.

Sahi

.

Goutte

.

Zombie.js

.

Opera

.

Firefox


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Cucumberoriginal Ruby version, nicer syntax

# Example Webrat step definitions

When /I search for ”(.*)”/ do |query|@browser.text_field(:name, ’s’).set(query)@browser.button(:name, ’searchsubmit’).click

end

Then /I should see/ do |text|@browser.text.should =~ /#{text}/m

end


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


The Big Picture (Ruby)

..Cucumber.

Selenium

.

Watir

.

Webrat

.

Celerity

.

Opera

.

Firefox


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Codeception unit testa new full-stack testing PHP framework

$I = new CodeGuy($scenario);$I->wantTo(’perform actions and see results’);

$I->testMethod(’DateTime.getTimestamp’);$date = new DateTime(”2012-10-13T14:45:00+02:00”);$I->executeTestedMethodOn($date);

$I->seeResultIs(’int’);$I->seeResultEquals(1350132300);


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Codeception acceptance test

$I = new WebGuy($scenario);$I->wantTo(’find infos on the website’);

$I->see(’Das WordPress Event’, ’html head title’);

$I->fillField(’s’, ’sponsoren’);$I->click(’searchsubmit’);

$I->see(’Premium-Sponsor Chocri’, ’#content’);$I->see(’Platin-Sponsor Adobe’, ’#content’);


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Codeception Output[mschuett@dagny] ~/wpcamp/code% php codecept.phar run --stepsCodeception PHP Testing Framework v1.1.4Powered by PHPUnit 3.6.10 by Sebastian Bergmann.

Suite unit startedTrying to perform actions and see results (exampleCept.php)Scenario:* I test method ”DateTime.getTimestamp”* I execute tested method on ”DateTime”* I see result is ”int”* I see result equals ”1350132300”

OK

Suite functional started

Suite acceptance startedTrying to find infos on the website (wpcampCept.php)Scenario:* I am on page ”/”* I see ”Das WordPress Event”,”html head title”* I fill field ”s”,”sponsoren”* I click ”searchsubmit”* I see ”Premium-Sponsor Chocri”,”#content”* I see ”Platin-Sponsor Adobe”,”#content”

OK

Time: 4 seconds, Memory: 9.50Mb

OK (2 tests, 5 assertions)


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Problems

• most Web tests require known DB state• behaviour testing is slow

• only run locally• use in-memory DB

• draw the line• features in documentation (what)→ add behaviour test• mere implementation (how)→ only unit tests


. .So ware Quality


. .

. . . . .

. . .

. . .

Unit Testing. .. . . . .. . .

Web Drivers. . .. . . .. . . . . . .. . .


Summary

Value individuals and interactions over processes and tools

– The Agile Manifesto

Links:• PHPUnit• Selenium• Behat & Mink• Cucumber• Codeception

• Sebastian Bergmann (PHPUnit)• Dan North’s blog (BDD)• Liz Keogh’s blog (BDD)• Geek and Poke• Not Invented Here


http://agilemanifesto.org/

http://phpunit.de

http://seleniumhq.org/

http://behat.org/

http://cukes.info/

http://codeception.com/

http://sebastian-bergmann.de/

http://dannorth.net/

http://lizkeogh.com/

http://geekandpoke.typepad.com/

http://notinventedhe.re/

Software Testing on the Web - mschuette.name · Codeception MartinSchütte SowareTestingontheWeb...

Documents

Transcript of Software Testing on the Web - mschuette.name · Codeception MartinSchütte SowareTestingontheWeb...