What is Agile Testing? How does Automation Help?

WHAT IS AGILE TESTING? HOW DOES AUTOMATION HELP?

Anand Bagmar

Test Practice Lead

@BagmarAnand about.me/anand.bagmar

ABOUT ME

WHAT DO YOU EXPECT FROM THIS SESSION?

Money / Value

Time

Quality

ORGANIZATION OBJECTIVE

DISTRIBUTION / FRAGMENTATION

What Is Agile?

Source: http://dilbert.com/strip/2007-11-26 Reference: http://martinfowler.com/articles/agileFluency.html

Agile Manifesto

Source: http://agilemanifesto.org/

AGILE MANIFESTO

Individuals and

Interactions Processes

&Tools over


AGILE MANIFESTO

Working Software

Comprehensive Documentation over


AGILE MANIFESTO

Customer Collaboration

Contract Negotiation over


AGILE MANIFESTO

Responding To

Change Following

A Plan over

Agile Testing Manifesto

AGILE TESTING MANIFESTO

Collaborative Ownership

Detached Objectivity over


Targeted Automation

Widespread Anti-regression over


Defect Prevention

Defect Detection over


Exploratory Testing

Predetermined Scripting

over

Principles & Practices of

Agile Testing

OUR PRIMARY OBJECTIVE

Faster Delivery Of Quality Software From Idea To Consumer

Building Quality In

Involving Everyone

Fast Feedback

Tests Are An Asset

Faster Delivery Into Production

Clear View Of Testing

Business Optimize Value

TESTING PRINCIPLES

PRINCIPLE: BUILD QUALITY IN

Preventing Defects

Finding Defects

Preventing Defects

Finding Defects

QA - BA

QA - Dev

QA - UX

QA – DevOps QA - Stakeholder

PRINCIPLE: BUILD QUALITY IN

PRINCIPLE: INVOLVE EVERYONE

Testing ≠ Testers

Quality is a Team Responsibility

PRINCIPLE: FAST FEEDBACK

QUICK RESPONSE

PRINCIPLE – BUSINESS OPTIMIZE VALUE

PEOPLE

TECHNOLOGY PROCESS

Quality is not just in the software but also in the process

We have the potential to wear many hats…

BA DevOp

PM IM

Typical Process in Agile Teams

Story Planning Session

BUSINESS BA

Write Story & Scenarios

BA

Implement Automated Acceptance Tests

TESTER

TESTER DEV

Implement Functionality

Regular BA/QA Demo

DEV DEV

TESTER DEV BA

TESTER DEV BA

Story Testing

Showcase to Business

STARTS HERE

SYSTEM TESTING

START DEVELOPMENT ITERATION

END DEVELOPMENT ITERATION

DEVELOPMENT ENGINE

STORY PLANNING SESSION

BUSINESS BA TESTER

TESTER

BA / QA Signoff on Dev Box


BUSINESS BA


BA


TESTER

TESTER DEV


Regular BA/QA Demo

DEV DEV

TESTER DEV BA

TESTER DEV BA




DEVELOPMENT ENGINE

STORY WRITING

BUSINESS BA TESTER

TESTER

STARTS HERE

SYSTEM TESTING


Story Testing


BUSINESS BA


BA


TESTER

TESTER DEV


Regular BA/QA Demo

DEV DEV

TESTER DEV BA

TESTER DEV BA




DEVELOPMENT ENGINE

AUTOMATE ACCEPTANCE TESTS

BUSINESS BA TESTER

TESTER

STARTS HERE

SYSTEM TESTING


Story Testing


BUSINESS BA


BA


TESTER

TESTER DEV


Regular BA/QA Demo

DEV DEV

TESTER DEV BA

TESTER DEV BA




DEVELOPMENT ENGINE

IMPLEMENT FUNCTIONALITY

BUSINESS BA TESTER

TESTER

STARTS HERE

SYSTEM TESTING


Story Testing


BUSINESS BA


BA


TESTER

TESTER DEV


Regular BA/QA Demo


DEV DEV

TESTER DEV BA

TESTER DEV BA




DEVELOPMENT ENGINE

BA & QA SIGNOFF

BUSINESS BA TESTER

TESTER

STARTS HERE

SYSTEM TESTING

Story Testing


BUSINESS BA


BA


TESTER

TESTER DEV


Regular BA/QA Demo

DEV DEV

TESTER DEV BA

TESTER DEV BA

BUSINESS BA


TESTER



DEVELOPMENT ENGINE

STORY TESTING

TESTER

STARTS HERE

SYSTEM TESTING


Story Testing


BUSINESS BA


BA


TESTER

TESTER DEV


Regular BA/QA Demo


DEV DEV

TESTER DEV BA

TESTER DEV BA

BUSINESS BA


TESTER



DEVELOPMENT ENGINE

SHOWCASE TO BUSINESS

TESTER

STARTS HERE

SYSTEM TESTING

Story Testing

The 3 Lives of A QA in Agile

THE 3 LIVES OF A QA IN AGILE

THE 3 LIVES OF A QA IN AGILE – THE PAST

§  RETROSPECTIVE

§  SUPPORT PRIOR ITERATION

THE 3 LIVES OF A QA IN AGILE – THE PRESENT

§  ITERATION PLANNING MEETING

§  STORY TESTING §  MANUAL

§  EXPLORATORY

§  NFRs

§  …

§  AUTOMATION §  IMPLEMENTATION

§  MAINTENANCE

§  EXECUTION

§  SHOWCASE

THE 3 LIVES OF A QA IN AGILE – THE FUTURE

§  BACKLOG GROOMING

§  PRIORITIZATION

§  STORY ANALYSIS

§  TEST STRATEGY §  EVOLVE

§  PLAN

QA Capabilities & Skills

Are We Building the Correct Product

& ….

If so, are we building it correctly?

QA CAPABILITIES

Continuous Delivery

Coaching Enabling

Sales

Bridging The Communication Gap

Tech Debt

Trainings

Writing Blogs

Raising Risks

Prioritization

Facilitation

Stakeholder Management

Speaking At QA Conferences

QA SKILLS

Domain

Functional Analysis & Testing

Process Improvements

Automation

Testing Mindset

Accessibility Testing

Showcases

UAT

Defect Management

Security Testing

Performance Testing

Usability Testing

Facilitation

Practices, Tips & Tricks

QA

Test Automation

A PRACTICE THAT MAKES TEAMS SUCCESSFUL?

Test Automation

A PRACTICE THAT MAKES TEAMS UNSUCCESSFUL?

What is Test Automation?

Automation -

A Safety Net

Value

IDEAL TEST AUTOMATION PYRAMID

Manual / Exploratory

Technology-facing Tests

Business-facing Tests

Cost

Time

UI

Web Service

View

JavaScript

Integration

Unit

REALITY

ICE-CREAM CONE ANTI PATTERN


UI

Web Service

View

JavaScript

Integration

Unit

Web Service

View

JavaScript

Integration

Unit

Developers Test Pyramid QA Team Test Pyramid

DUAL TEST PYRAMID ANTI-PATTERN


UI

Web Service

CUP-CAKE ANTI-PATTERN

TYPES OF TEST AUTOMATION FRAMEWORKS

Modular

Data-driven

Keyword-driven Model-based

Hybrid

? ? ?

Understand the system(s) / product(s) you need to test!!

REMEMBER …

TEST AUTOMATION FRAMEWORK DESIGN CRITERIA

Maintainable

Scalable

Browser / Device support

Support features of Product-under-test

Easy to Use

Different Environments

Parallel Execution

Tool support

Reports & Metrics

Support the types of testing required

Operating System & Database support

Run locally & remotely

Language / tool restrictions

PRINCIPLES FOR TEST AUTOMATION FRAMEWORK

Design Patterns

Abstraction Layers

Headless executing

Evolve

Code Quality

Take Screenshots

Refactor

Tools & Utilities

Extensible

Run via CI

Logging

Video Recording

Test Data

FRAMEWORK ABSTRACTION LAYERS

Evolve as you Learn

Source: http://dilbert.com/strip/2005-11-16

[email protected]

[email protected]

@BagmarAnand

about.me/anand.bagmar

THANK YOU

What is Agile Testing? How does Automation Help?

Software

Transcript of What is Agile Testing? How does Automation Help?