Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of...

29
Lesson 4: Bug Reporting and STLC

Transcript of Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of...

Page 1: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

Lesson 4: Bug Reporting and STLC

Page 2: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

Website

https://letslearnqa.wordpress.com

Home Work, Class Notes

2

Page 3: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

Activity for Every Class: Status Call

● Please come few minutes early.

● Sit with with another one or two students

● Introduce yourself if you do not know them

● Talk to them about what you did since last class, what do we

going to do in this class and if there are any blockers

(regarding this QA course/class)

● Please do this in every class before the class begins at

830am3

Page 4: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

Opening Statement/Questions

● What is a bug (in testing)?

● What happens when a QA

person/tester find a

bug/defect/issue?4

Page 5: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

In Software testing, when the expected and actual behavior is not matching, an incident needs to be raised. An incident may be a Bug. It is a programmer's fault where a programmer intended to implement a certain behavior, but the code fails to correctly conform to this behavior because of incorrect implementation in coding. It is also known as Defect

5

What is Bug?

Page 6: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

Opening Statement/Questions

● Report appropriately

● Someone validates the issue/defect or as

designed

● If fix is needed, it is assigned to developers

● When fixed, we tests to make sure that it is fixed

● Perform regression tests

6

Page 7: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

BUG LIFE CYCLE

7

Page 8: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

Bug Life Cycle

8

Page 9: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

Testing Types

● Alpha testing

● Beta testing

● User Acceptance Testing

● Regression Testing

9

Page 10: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

Testing Types

● Alpha testing - user comes to facility to test

● Beta testing - Software released (controlled) to

the customer

● User Acceptance Testing - Software is tested by

client/user to make sure it meets their needs

10

Page 12: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

12

Steps Expected Behavior Actual Result Pass/Fail

Go to macys.comSystem should display macy's Home Page

System displayed macy's Home Page Pass

Click on Sign In Link on the top right of the home page

System should take user to Secure Sign In page

System took user to Secure Sign In page Pass

Enter valid credentials in the required fields and click on SIGN IN button

System should display account dashboard

System did not display account dashboard Fail

How to write bugs

Page 13: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

--

13

Use a valid credential to log in System should allow the user to log in System allowed the user to log in Pass

Search Basketball Shoes from in Search Box System should display search results System displayed search results Pass

From results, click on one of the products QuickView link to load the QuickView System should display the QuickView popup System displayed the QuickView popup Pass

Add an item from product quickview

System should display modal window with

the product information and allow user to

add the item in the cart

System displayed modal window with the

product information and allowed user to add

the item in the cart Pass

Add the same item or another item

System should display the added item in the

cart System displayed the added item in the cart Pass

Click the bag image System should take user to the Cart page System took user to the Cart page Pass

Click on the name of the products

System should take user to the product

details page. System took user to the product details page. Pass

Click the bag image System should take user to the Cart page System took user to the Cart page Pass

Click on the PROCED TO CHECKOUT button

System should take user to a page where user

can SIGN IN or CHECKOUT AS A GUEST

System took user to CHECKOUT page to enter

address Fail

How to write bugs

Page 14: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

[Feature Name] TitleEnvironmentSteps to reproduceExpected ResultActual ResultVisual Proof (screenshots, videos, text)

14

What to include when writing bugs

Page 15: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

● Environment - Production/QA, All major desktop browsers

● Steps to reproduce○ Go to Old Navy website○ Locate the search box○ Type Men Shoes in search box and

hit enter15

Title: Old Navy Search Results issue

Page 16: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

● Expected Result○ System should display results which

match design documents● Actual Result

○ Category name is wrong○ Shoe size etc. is wrong

● Visual Proof (screenshots, videos, text)16

Title: Old Navy Search Results issue

Page 17: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

17

- Is it really a bug? Consult document/person- Is it reproducible consistently?- Is it browser related? Or, other settings

related? (if you are not connected to internet, nothing will pass)

- Isolate bug - identify exactly what the problem is. Saying "something is wrong" is not helpful

Before you REPORT -

Page 18: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

18

- Check if you are using the latest version- Check if the bug is known

Please check whether the bug you are experiencing is already documented in the issue tracker .

- File each issue separately If you have multiple issues, it is better to file them separately so they can be tracked more easily.

Create a new issue

Before you REPORT -

Page 19: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

Bug Life Cycle

19

Page 20: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

Regression Test

Regression testing is the process of testing changes

to computer programs to make sure that the older

programming still works with the new changes.

Regression testing is a normal part of the program

development process

20

Page 21: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

Regression Test

When do we do regression test?

Is it functional testing?

How often do we perform this test?

How many test cases do a regression test suite has?

21

Page 22: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

Software Testing Life Cycle (STLC)

22

Page 23: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

Preparing for a bug

23

Steps Expected Behavior Actual Result Pass/Fail

Go to macys.comSystem should display macy's Home Page

System displayed macy's Home Page Pass

Click on Sign In Link on the top right of the home page

System should take user to Secure Sign In page

System took user to Secure Sign In page Pass

Enter valid credentials in the required fields and click on SIGN IN button

System should display account dashboard

System did not display account dashboard Fail

Page 24: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

STLC

1. Requirement Analysis − When the BRD is ready and shared with the

stakeholders, the testing team starts high level analysis

2. Test Planning − Test Team plans the strategy and approach.

3. Test Case Designing − Develop the test cases based on scope and criterias.

4. Test Environment Setup − When integrated environment is ready to

validate the product.

5. Test Execution − Real-time validation of product and finding bugs.

6. Test Closure − Once testing is completed, matrix, reports, results are

documented.

24

Page 25: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

Summary of today’s Lesson

25

Page 26: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

Terminology

● Alpha testing

● Beta testing

● Retesting

● Regression Testing

● User Acceptance Testing

● Test Suite

● STLC

● Bug Life Cycle

26

Page 27: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

27

Page 28: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

28

Page 29: Lesson 4: Bug Reporting and STLC€¦ · Lesson 4: Bug Reporting and STLC. Website ... Summary of today’s Lesson 25. Terminology Alpha testing Beta testing Retesting Regression

Homework● It will be posted in a day or two. I will send an email when it is

ready● You will have 2 weeks to submit● You can email me after the first couple of attempts so that you

can make sure that you are doing it right●

29