Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black...

30
Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennell [email protected]. http://blogs.blackmarble.co.uk/blogs/rfennell

Transcript of Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black...

Page 1: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

Supported by

Virtualisation of the Test EnvironmentRichard Fennell

Engineering Director, Black Marble

@RichardFennell [email protected]://blogs.blackmarble.co.uk/blogs/rfennell

Page 2: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

Agenda• The development cycle• Virtualisation with Lab Management• Load Testing with Load Test Agent

Page 3: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

blackmarble.com blogs.blackmarble.co.uk +44 1274 300175

Supported by

LAB MANAGEMENT

Page 4: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

What is our development cycle?Developer writes

code Compile locally Run unit tests locally

Check-in

Central Automated CI Build inc.

running of unit tests

Automated Deploy to Test

Automated Integration tests UAT/Human Test Log Bugs/Change

Requests

Page 5: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

How does Visual Studio 2010 Help?

Page 6: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

Team Foundation Server (TFS)

Lab Management

Test Case management

Build management

Work Item Tracking

Source Control

System Center Management Stack

Operations Manager

Virtual Machine Manager

Virtualization Platform

Hyper-V

Page 7: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

How to Install TFS Lab Management

• Install TFS 2010• Install GDR patch to enable Lab Management

(or Service pack 1)• Install a SCVMM Server• Install SCVMM Admin Console on TFS server• On SCVMM Server configure hosts and shares

Page 8: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.
Page 9: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

How to Install TFS Lab Management

• Install TFS 2010• Install GDR patch to enable Lab Management

(or Service pack 1)• Install a SCVMM Server• Install SCVMM Admin Console on TFS server• On SCVMM Server configure hosts and shares• Tell TFS the SCVMM server address

Page 10: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.
Page 11: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

How to Install TFS Lab Management

• Install TFS 2010• Install GDR patch to enable Lab Management

(or Service pack 1)• Install a SCVMM Server• Install SCVMM Admin Console on TFS server• On SCVMM Server configure hosts and shares• Tell TFS the SCVMM server address• On each TPC configure lab settings

Page 12: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.
Page 13: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

How to Install TFS Lab Management

• Install TFS 2010• Install GDR patch to enable Lab Management (or

Service pack 1)• Install a SCVMM Server• Install SCVMM Admin Console on TFS server• On SCVMM Server configure hosts and shares• Tell TFS the SCVMM server address• On each TPC configure lab settings• And now the work starts……..

Page 14: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

Lab Management Concepts• Environment• VMs• Templates• Snapshots• Controllers and Agents

Page 15: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

Environment

Each VM in Environment

Developer

What controls what?Test

Controller

Build Controller

TFSTeam

Project Collection

Test Agent

Lab Agent

Build Agent

Build Agent

Build Agent

Environment Capability Lab Agent Required?

Test Agent Required?

Build Agent Required?

Testing √ √ X Deployment workflow √ X √Network Isolation √ X X

Page 16: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

Lab Management Concepts• Environment• VMs• Templates• Snapshots• Controllers and Agents• Network Isolation

Page 17: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.
Page 18: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

Lab Management Concepts• Environment• VMs• Templates• Snapshots• Controllers and Agents• Network Isolation• Host and Guest Connections

Page 19: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

Process of End to End Testing

Lab Build Requested

Ordinary Build Performed

Request the Lab

Start Lab Build

Deploy the software

Run automated Tests

Triage Issues

Build Report Stored

Run Manual Tests

Page 20: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

LAB MANAGEMENTDemo

Page 21: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

blackmarble.com blogs.blackmarble.co.uk +44 1274 300175

Supported by

LOAD TESTING

Page 22: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

Load Testing• Microsoft has provided load testing since

Visual Studio 2005• Enables stress testing of application, building

on the test you have already written• Since May 2011, the Load Test Agent has

become free as part of the Load Testing Feature Pack (you do need VS 2010 Ultimate too)

Page 23: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

Load Test Architecture

A Local PC

Visual Studio 2010 Ultimate

Test Controller(Manages Test Agents)

Test Agent(Runs Tests)

Page 24: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

Another PC

Test Controller PC

Load Test ArchitectureA Developers PC

Visual Studio 2010 Ultimate Test Controller(Manages Test Agents)

Test Agent(Runs Tests)

Another PC

Test Agent(Runs Tests)

Another PC

Test Agent(Runs Tests)

Page 25: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

LOAD TESTINGDemo

Page 26: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

Summary• Delivering quality software is not just about

programming• Automated builds bring repeatable quality to a

project• Lab Management can extend this into both

automated and manual testing with a fully integrated solution

• Load testing is now available to all, building on the test you have already written

Page 27: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

Resources• Visual Studio 2010

http://www.microsoft.com/visualstudio/en-us/products/2010-editions

• VHD Test Drive - Visual Studio 2010 Lab Management http://www.microsoft.com/downloads/en/details.aspx?FamilyID=592e874d-8fcd-4665-8e55-7da0d44b0dee&displaylang=en

• Visual Studio Lab Management team bloghttp://blogs.msdn.com/b/lab_management/

• Techdays 2010 UK Video “Putting some Testing into your TFS Build Process”http://video.uk.msn.com/watch/video/putting-some-testing-into-your-tfs-build-process/15bkj6pcv

Page 28: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

QUESTIONS

Page 29: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

Richard FennellEngineering Director, Black Marble Ltd.

[email protected]

http://blogs.blackmarble.co.uk/blogs/rfennell

@RichardFennell

Page 30: Supported by Virtualisation of the Test Environment Richard Fennell Engineering Director, Black Marble @RichardFennellrfennell@blackmarble.co.uk.

search for us on facebook and linked in!

www.twitter.com/blackmarble

+44 845 644 7656

http://blogs.blackmarble.co.uk

www.blackmarble.com