Progression Testing

Adam Knight Twitter: @adampknight

Blog: www.a-sisyphean-task.com

• htt

ps://

ww

w.fl

ickr

.com

/pho

tos/

open

eye/

5066

0187

79

This is Adam

This is Adam

This is RainStor

This is RainStor

Lack of Progression is Regression

•  Bugs can arise where functionality has not changed •  Customer expectation has changed •  The market has moved on •  We can move backwards by standing still

• imag

e : r

ay w

ewer

ka h

ttp:

//ww

w.fl

ickr

.com

/pho

tos/

picf

ix/4

4092

5766

8

Automation is software development

•  Focus on needs rather than tools •  Iteratively improve to introduce test capabilities •  Incorporate newly added product features •  Adapt to new environments and technologies

• htt

ps://

ww

w.fl

ickr

.com

/pho

tos/

fran

cois

mai

llot/

8333

4229

64/

This is a RainStor Test Pattern

This is a RainStor Test Pattern

Test Harness Requirements Change From Through To

Data Import and Query

Administration Commands

Full Cluster Administration

Single Server Single Process

Multi-server single pack Multi-server parallel Packs

Sequential Packs Iterative Execution Parallel Iterative Execution

No ODBC/JDBC ODBC/JDBC single thread

ODBC/JDBC multi-thread

Text Based Reporting Simple HTML Report Interactive HTML with Summary and Differences

Linux Only Linux, Solaris, AIX, HPUX and (gasp) Windows

Linux Only

Thanks •  Email: adampknight@a-sisyphean-task.com •  Twitter: @adampknight •  Blog: http://www.a-sisyphean-task.com

•  Email: adam.knight@rainstor.com •  WebSite: http://www.rainstor.com

References •  Further Reading •  From smart people •  http://lizkeogh.com/2011/03/04/step-away-from-the-tools/ •  http://testobsessed.com/2011/02/the-atdd-arch/ •  From me •  http://www.a-sisyphean-task.com/2011/03/without-stabilisers-

why-writing-your.html •  http://www.a-sisyphean-task.com/2012/10/moving-backwards-

by-standing-still-how.html