Automated and Manual Testing with Azure Test Plans
Transcript of Automated and Manual Testing with Azure Test Plans
![Page 1: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/1.jpg)
Agile BoardsPlan, track, and discuss work across teams.
https://docs.microsoft.com/en-us/azure/devopshttps://devblogs.microsoft.com/devops/azure-boards-summer-update/
Randy PagelsAzure App Dev SpecialistUS Midwest Region
![Page 2: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/2.jpg)
• What is DevOps?
• How does Microsoft use DevOps?
• Why Does DevOps Matter?
• Agile Terminology
• Agile Boards Walkthrough
• Reports & Widgets based on Analytics
• Resources
Agenda
![Page 3: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/3.jpg)
People. Process. Products.
What is DevOps?
DevOps is the union of people,
process, and products to
enable continuous delivery of
value to your end users.
“
”
Build&
Test
ContinuousDelivery
Deploy
Operate
Monitor &
Learn
Plan &
Track
Develop
![Page 4: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/4.jpg)
How does Microsoft use DevOps?
![Page 5: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/5.jpg)
DevOps at Microsoft
Data: Internal Microsoft engineering system activity, November 2019
442kPull Requests per
month
2.4m Private Git commits per
month
82,000Deployments per day
4.6m Builds per month
155pb Build artifacts managed
8.8kOpen Source Repos
24kEmployees contributing
to open source
28kWork items created/day
500kWork items updated/day
Azure DevOps is the toolchain of choice for Microsoft engineering with over 110,000 active internal users
https://aka.ms/DevOpsAtMicrosoft➔
![Page 6: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/6.jpg)
![Page 7: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/7.jpg)
Azure Networking
One Engineering System with Azure DevOps
![Page 8: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/8.jpg)
Why does DevOps Matter?
![Page 9: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/9.jpg)
Reach and
engage
Accelerate
time-to-market while
reducing costs
Drive
innovation
Business Needs
![Page 10: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/10.jpg)
Shorten cycle times
and deliver value
faster
Improve quality
and availability
Optimize resources
and eliminate waste
Deliver innovation
and great customer
experience through
experimentation
What needs to change to address those needs?
![Page 11: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/11.jpg)
Agile Methodology Terms and Definitions
![Page 12: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/12.jpg)
Azure Boards
Agile or Scrum?
![Page 13: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/13.jpg)
Agile Methodology Terms and DefinitionsScrum Agile Definition
Sprint Iteration Fixed-length period of time
Release Small Release Release to production
Sprint/Release Planning Planning Game Agile planning meetings
Product Owner Customer Business representative to project
User Story User Story Brief explanation of the who, what, and why
Tasks Tasks Items that need to be completed
Retrospective Reflection “Lessons learned” style meeting
Scrum Master Coach Agile project manager
Development Team Team Empowered cross-functional team
Daily Scrum Daily Standup Brief daily status meeting
![Page 14: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/14.jpg)
Agile is the ability to create and respond to change.
What is Agile?
![Page 15: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/15.jpg)
What is Scrum?Scrum Basics
![Page 16: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/16.jpg)
IT/Operations
Project Lead
Quality Analyst
Business Analyst /
Product Owner
Project Manager
Developer
The Enterprise Collaboration Solution
DevelopPlan & Track
Manual Testing
Build/Deploy
![Page 17: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/17.jpg)
IT/Operations
Project Lead
Quality Analyst
Business Analyst /
Product Owner
Project Manager
Developer
The Enterprise Collaboration Solution
Develop
Manual Testing Build/Deploy
Plan & Track
![Page 18: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/18.jpg)
Introducing Azure DevOps
Deliver value to your users faster
using proven agile tools to plan,
track, and discuss work across
your teams.
Build, test, and deploy with CI/CD that
works with any language, platform,
and cloud. Connect to GitHub or any
other Git provider and deploy
continuously.
Get unlimited, cloud-hosted
private Git repos and collaborate
to build better code with pull
requests and advanced file
management.
Test and ship with confidence
using manual and exploratory
testing tools.
Create, host, and share packages with
your team, and add artifacts to your
CI/CD pipelines with a single click.
Azure Boards Azure ReposAzure Pipelines
Azure Test Plans Azure Artifacts
https://azure.com/devops
➔
![Page 19: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/19.jpg)
Mix and match
to create
workflows with
tools from
Microsoft, open
source or your
favorite
3rd party tools
Azure DevOps: Choose what you love
Azure
DevOps lets
developers
choose the
tools and
languages that
are right for
them
Target any cloud, on-prem or both and deploy to the servers you need
Any Language, Any Platform
![Page 20: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/20.jpg)
Microsoft’s DevOps Tooling – enhanced by GitHub
Security
Package Registry
Actions
![Page 21: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/21.jpg)
Track work with Kanban boards, backlogs, team
dashboards, and custom reporting
Azure Boards
https://azure.com/devops➔
Connected from idea to releaseTrack all your ideas at every development stage and keep your team aligned with all code changes linked directly to work items.
Scrum readyUse built-in scrum boards and planning tools to help your teams run sprints, stand-ups, and planning meetings.
Project insightsGain new insights into the health and status of your project with powerful analytics tools and dashboard widgets.
![Page 22: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/22.jpg)
Planning & Tracking with Azure Boards
Azure Boards allow organizations to
identify what is most important for their
customers and objectively measure &
track how they are delivering value to
their customers.
Azure Boards is an interactive planning
& tracking tool which provides
visualization of the flow of work from
concept to completion.
Business and technical teams can
leverage Azure Boards to track all your
ideas at every development stage and
keep your teams aligned with all code
changes linked directly to work items.
![Page 23: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/23.jpg)
Backlogs HubUse your product backlog to quickly plan and
prioritize your work.
Prioritize work itemsDrag and drop items to adjust the order to help keep things in order or priority.
Manage relationships with hierarchy
After you’ve added features or epics to your portfolio backlog, you can map backlog items to them.
Plan sprintsUse the Plan Sprints pane to quickly assign work to an upcoming sprint.
![Page 24: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/24.jpg)
The hierarchy of requirements
![Page 25: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/25.jpg)
Portfolio management
![Page 26: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/26.jpg)
Backlogs Hub
![Page 27: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/27.jpg)
Sprints HubSprints give you the ability to create increments of
work for your team to accomplish together.
TaskboardUse the taskboard in daily Scrum meetings to view progress made to backlog items and tasks.
Capacity PlanningAssign work hours to team members to help you and your team deliver your work on time.
Burndown ChartThroughout your sprint, you can monitor the sprint burndown chart to determine if your team is on track to complete its sprint plan.
![Page 28: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/28.jpg)
Sprints Hub
![Page 29: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/29.jpg)
Boards HubThe pre-configured Kanban board is perfect for
managing the flow of your work.
Highly customizableCustomize columns, swim lanes, cards, conditional formatting, filtering, and even WIP limits.
Extensibility through extensionsAdd specific features and capabilities to your board with free or paid extensions.
Live updatesSee all board changes as they happen.
![Page 30: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/30.jpg)
Boards Hub
![Page 31: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/31.jpg)
Queries HubTailor exactly what you’re tracking with the query
engine.
Cross-projectCreate and save queries to track work across different team projects.
Pin to dashboardQuickly pin queries to dashboards for quick monitoring and status.
Bulk modify work itemsUse bulk modify to quickly modify one or more fields for work items.
![Page 32: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/32.jpg)
Queries Hub
![Page 33: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/33.jpg)
Work Items HubUse work items to find and focus on work you care
about.
Find work items assigned to youTrack work items that you’re following or have viewed or modified recently.
Rich filteringFilter work items on types, assignment, states, area, and tags.
Query and Search work itemsQuery work items within your project or across projects.
![Page 34: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/34.jpg)
Work Items Hub
![Page 35: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/35.jpg)
DashboardsDashboards give a clear view of what’s happening
to track progress and direction.
Real-time informationDashboards provide easy-to-read, easy access, real-time information
Thriving community of widgetsWidgets smartly format data to provide access to easily consumable data. Add widgets to your team dashboards to gain visibility into the status and trends occurring as you develop your software project.
Add dashboards as neededTailor configure the layout that makes sense for your team, and easily monitor progress throughout the lifecycle of your project.
![Page 36: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/36.jpg)
Dashboards
![Page 37: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/37.jpg)
Azure Boards
Better Together!! – Azure DevOps & Microsoft TeamsMicrosoft Teams makes collaborating on projects a
breeze - from idea to completion.
Collaborate, communicate and celebrateTeams is your chat-centered workspace. Azure DevOps teams get instant access to everything they need in a dedicated hub for teamwork, that brings your teams, conversations, content and tools together into one place.
Messaging ExtensionYou can search, find, and discuss specific work items with your colleagues from within Microsoft Teams. The messaging extension will work for both team and individual chat discussions.
DashboardsKeep track of your project by adding your favorite VSTS dashboard directly into Microsoft Teams.
Track and create new work items with Kanban boards right into Microsoft Teams. All your favorite Kanban board features - live refresh, card styling, tag coloring, extensions, and more - are available without leaving your team's channel.
Kanban boards
https://marketplace.visualstudio.com/items?itemName=ms-vsts.vss-services-teams➔
![Page 38: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/38.jpg)
Azure DevOps & Microsoft Teams
![Page 39: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/39.jpg)
Reports & Widgets based on Analytics
![Page 40: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/40.jpg)
Burn Down & Burn Up
![Page 41: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/41.jpg)
Sprint Burndown
![Page 42: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/42.jpg)
Cumulative Flow Diagram
The CFD widget shows the
count of work items (over
time) for each column of a
Kanban board.
This allows you to see
patterns in your team's
development cycle over
time.
![Page 43: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/43.jpg)
Lead time and cycle time widgets
Lead time measures the total time elapsed from the creation of work items to their
completion.
Cycle time measures the time it takes for your team to complete work items once they
begin actively working on them.
![Page 44: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/44.jpg)
Lead time widget
The Cycle time widget will
help you analyze the time it
takes for your team to
complete work items once
they begin actively working
on them.
A lower cycle time is
typically indicative of a
healthier team process.
![Page 45: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/45.jpg)
Cycle time widget
The Lead time widget will
help you analyze the time it
takes to deliver work from
your backlog.
Lead time measures the
total time elapsed from the
creation of work items to
their completion.
![Page 46: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/46.jpg)
Velocity
The Velocity widget will
help you learn how much
work your team can
complete during a sprint.
The widget shows the
team's velocity by Story
Points, work item count, or
any custom field.
![Page 47: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/47.jpg)
Test Results Trend – Build/Release
With the Test Results Trend
(Advanced) widget, you can
track the test quality of
your pipelines over time.
Tracking test quality and
improving test collateral
are essential tasks to
maintaining a healthy
DevOps pipeline.
![Page 48: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/48.jpg)
Features Timeline
![Page 49: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/49.jpg)
Epic Roadmap / Portfolio Plans (Beta)
![Page 50: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/50.jpg)
Dependency Tracker - Consuming
![Page 51: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/51.jpg)
Dependency Tracker – Risk Graph
![Page 52: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/52.jpg)
Tools for Change
![Page 53: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/53.jpg)
Tools to Blend Waterfall Collaboration and Agile DevOps
![Page 54: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/54.jpg)
Report Your ADO Project Data with Power BI
![Page 55: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/55.jpg)
The Project Roadmap Tool
![Page 56: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/56.jpg)
Putting it all together….
![Page 57: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/57.jpg)
Marketplace Resources
![Page 58: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/58.jpg)
Marketplace - Analytics
Analytics brings you and
your team new insights
into the health and status
of your DevOps life cycle.
It helps you make data
driven decisions and
deliver value to your
customers faster.
https://marketplace.visualstudio.com/
![Page 59: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/59.jpg)
Marketplace – Delivery Plans
Delivery Plans is an
organizational tool that
helps users drive cross-
team visibility and
alignment by tracking work
status on an iteration-
based calendar.
Users can tailor their plan
to include any team or
backlog level from across
projects in the account.
https://marketplace.visualstudio.com/
![Page 60: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/60.jpg)
Marketplace – Microsoftt Teams
Software development
teams get instant access
to everything they need
in a dedicated hub for
teamwork, that brings
your teams,
conversations, content
and tools from across
Office 365 and Azure
DevOps together into
one place.
https://marketplace.visualstudio.com/
![Page 61: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/61.jpg)
Marketplace – Application Insights
Monitor and detect
issues in your apps and
services without ever
leaving Azure DevOps!
https://marketplace.visualstudio.com/
![Page 62: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/62.jpg)
Additional Resources
![Page 64: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/64.jpg)
Documentation - Azure DevOps Feature Index
https://Docs.Microsoft.com/en-us/Azure/DevOps/User-Guide/ALM-DevOps-Features➔
![Page 65: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/65.jpg)
Azure DevOps Features Timeline
https://Docs.Microsoft.com/en-us/Azure/DevOps/Release-Notes/➔
![Page 68: Automated and Manual Testing with Azure Test Plans](https://reader031.fdocuments.us/reader031/viewer/2022021308/620782ecd0cdf236041039fa/html5/thumbnails/68.jpg)
© Copyright Microsoft Corporation. All rights reserved.
Thank You