Day 3 meet shilpa measuring software quality and business impact session 3

33
www.xbosoft.com 1 Webinar March 20 2014 11.00 AM EST You are at the right place, it’s almost time….10 minute countdown

description

How do you get product managers to understand the non-functional metrics are as important as the features of their product? How do you identify who owns which metrics and therefore provide stewardship to the whole process of metrics and business value? Shilpa digs deep in this final session of her 3-part series.

Transcript of Day 3 meet shilpa measuring software quality and business impact session 3

Page 1: Day 3 meet shilpa measuring software quality and business impact session 3

www.xbosoft.com

1

Webinar March 20 2014 11.00 AM EST

You are at the right place, it’s almost time….10 minute

countdown

Page 2: Day 3 meet shilpa measuring software quality and business impact session 3

2

Page 3: Day 3 meet shilpa measuring software quality and business impact session 3

WELCOME

XBOSOFT Software Quality Knowledge Center is proud to partner with and

introduce

Shilpa DadhwalCEO and Founder

SQE Labs, Inc.

Page 4: Day 3 meet shilpa measuring software quality and business impact session 3

On the callShilpa Dadhwal, Philip Lew and Jan Princen

Moderator: Carolyn Choh

Shilpa Dadhwal,Founder and CEO,SQE Labs Inc

Philip LewCEO, XBOSoft

Jan PrincenManaging Director, XBOSoft

Page 5: Day 3 meet shilpa measuring software quality and business impact session 3

Agenda

• Introduction XBOsoft• Software Quality – Quick recap of Day 1 and 2• Software quality models • Advantages and impact of using them• Moving on to Day 3

– Barriers and issues to business of software quality– Implications for Senior Management for setting

guidelines– Implications for Project Management for best practices

• Q and A• Today’s meeting March 20th

https://www3.gotomeeting.com/register/886356774 

Page 6: Day 3 meet shilpa measuring software quality and business impact session 3

• Specialize in: Software Quality Improvement

• Quality Process Improvement & Testing

• American Company• Located in: San Francisco, Amsterdam &

Beijing• Over 100 Software Quality Experts

XBOSoft Introduction

Page 7: Day 3 meet shilpa measuring software quality and business impact session 3

7

“Proven Results”

“Our products are very complex.  We expected a one year ramp up time, but XBO was able to contribute to our release cycles in just 6 months. ." 

- Development Vice President, Hyperion-Oracle

"The results are very encouraging. Thanks a lot for all the effort put into this project. We really appreciate your work."

- Manager, Quality Assurance, Autodesk

"Everything you've done is impressive and we are quite pleased with the quality of the test cases, well done!So keep up the good work."

- QA Director, CA

Page 8: Day 3 meet shilpa measuring software quality and business impact session 3

Welcome to the Session 3 on ‘Measuring Software Quality –

Its Economic Value’

Shilpa DadhwalFounder & DirectorSQE Labs Inc.

Skype ID : shilpa2dEmail ID : [email protected]

Presentated By:

Page 9: Day 3 meet shilpa measuring software quality and business impact session 3

SQE Labs offers an independent Software Testing and Quality

Assurance services and is committed to improving quality by

providing superior QA solutions to customers

About USA Specialist Independent Software Testing Solutions Provider

Team of Software Quality Engineering professionals having strong

Techno-functional knowledge

Provides services in the areas of Outsourced Software Testing,

Software Testing Consultancy and Software Testing Trainings

Having Offices in Texas (US) and Chandigarh (India)

Page 10: Day 3 meet shilpa measuring software quality and business impact session 3

What is Software Quality?

What is its Economic Value?

How to mange Software Quality?

What are its Attributes?

Why do we need to measure it?

How do we measure it?

Issues while measuring it?

Guidelines for measuring it?

A Specialist Independent Software Testing Solution Provider Questions in Mind

Session 1

Session 2

Session 3

Page 11: Day 3 meet shilpa measuring software quality and business impact session 3

1. QUALITY MODELS for defining Software Quality Attributes

2. ADVANTAGES of measuring Software Quality

3. IMPACT of ‘Software Quality’ on Business

4. BARRIERS to achieve ‘High’ Software Quality

5. ISSUES in measuring Software Quality

6. GUIDELINES for measuring Software Quality

7. PRACTICES to be followed

A Specialist Independent Software Testing Solution Provider Agenda

Page 12: Day 3 meet shilpa measuring software quality and business impact session 3

“Quality is never an accident; it is always the result of intelligent effort.”

– John Ruskin

RemarkA Specialist Independent Software Testing Solutions Provider

Page 13: Day 3 meet shilpa measuring software quality and business impact session 3

QuestionsA Specialist Independent Software Testing Solutions Provider

Do you know the most critical Software Quality Attribute for your product/service?

Do you know how to measure the identified Software Quality Attribute?

Are you able to make right decisions, after measuring the critical Software Quality Attribute?

If any of the above answer is ‘No’, then …….

Page 14: Day 3 meet shilpa measuring software quality and business impact session 3

A quality model is a specification of the required characteristics that a software system must exhibit

A quality model that defines quality attributes precisely improves communications between acquirers, architects, and developers.

A quality model that specifies usable and practical metrics can improve the quality of design models.

Effective application of a quality model adds more quality control earlier in the project’s life cycle

Validate the completeness of a requirements definition

Identifies user acceptance criteria for a completed software product

Identifies software requirements

Identifies software design objectives

Identifies software testing objectives

Quality ModelsA Specialist Independent Software Testing Solutions Provider

Page 15: Day 3 meet shilpa measuring software quality and business impact session 3

Several quality models have been developed over the years.

McCall/GE Quality Model• Organizes quality around three uses of software: product revision,

product operations, and product transition Boehm Quality Model

• Shares a common subset with the McCall model and identifies additional quality attributes

ISO/IEC 9126-1:2001 Quality Standard• Identifies six quality characteristics – functionality, reliability,

usability, efficiency, maintainability, and portability. These are further divided into several sub-characteristics

Quality ModelsA Specialist Independent Software Testing Solutions Provider

Page 16: Day 3 meet shilpa measuring software quality and business impact session 3

McCall’s Traingle for Quality

An Independent Software Testing Solution Provider

PRODUCT REVISIONPRODUCT REVISION PRODUCT TRANSITIONPRODUCT TRANSITION

PRODUCT OPERATIONPRODUCT OPERATION

• Maintainability• Flexibility• Testability

• Portability• Reusability• Interoperability

• Correctness

• Usability• Reliability

• Efficiency• Integrity

Ability to change Adaptability to new environments

Basic operational characteristic

Factors (characteristics) describe the external view of the software as viewed by users of the application

Page 17: Day 3 meet shilpa measuring software quality and business impact session 3

McCall’s Traingle for Quality

The model details three types of quality characteristics (major perspectives) in a hierarchy of factors, criteria and metrics:

11 Factors (To specify): They describe the external view of the software, as viewed by the users.

23 quality criteria (To build): They describe the internal view of the software, as seen by the developer.

Metrics (To control): They are defined and used to provide a scale and method for measurement

A Specialist Independent Software Testing Solutions Provider

Page 18: Day 3 meet shilpa measuring software quality and business impact session 3

Factors (characteristics) describe the external view of the software as viewed by users of the application

Boehm Quality Model

A Specialist Independent Software Testing Solutions Provider

Page 19: Day 3 meet shilpa measuring software quality and business impact session 3

The high-level characteristics represent basic high-level requirements of actual use to which evaluation of software quality could be put – the general utility of software

The intermediate level characteristic represents Boehm’s 7 quality factors that together represent the qualities expected from a software system

The primitive characteristics provide the foundation for defining qualities metrics

Boehm Quality Model

A Specialist Independent Software Testing Solutions Provider

Page 20: Day 3 meet shilpa measuring software quality and business impact session 3

ISO 9126 identifies the internal characteristics and external quality characteristics of a software product and contains various characters.

ISO/IEC 9126-1:2001 Quality Standard

A Specialist Independent Software Testing Solutions Provider

Page 21: Day 3 meet shilpa measuring software quality and business impact session 3

Advantages of Measuring Software Quality

High levels of defect removal efficiency

Happier customers

Better team morale

Shorter development schedules

Lower development costs

Lower maintenance costs and

Total cost of ownership (TCO) that will be less than 50% of the same kinds of projects that botch up quality.

A Specialist Independent Software Testing Solutions Provider

Page 22: Day 3 meet shilpa measuring software quality and business impact session 3

Issues in Measuring Software Quality

Cost of Collecting Metrics• Automation is less costly than manual method• CASE tool may not be free

• Development cost of the tool• Extra execution time for collecting metrics

• Interpretation of metrics consumes resources

Validity of the metrics• Does the metric really measure what it should?• What exactly should be measured?

Selection of metrics for measurement• Hundreds are available and with the same cost

A Specialist Independent Software Testing Solutions Provider

Page 23: Day 3 meet shilpa measuring software quality and business impact session 3

Impact of ‘Software Quality’ on Business

Software Quality Income Expense

'High' Software Quality

• More Customers• Repeat Business• Competitive Advantage

• Lower Production Cost through reduced inventory

• Lower Inspection Cost• Lower Working Capital

'Low' Software Quality

• Loss of Business• Penalties for late delivery or

service• Partial or late payments due

to customer dissatisfaction

• Scrap and rework cost• Warranty Cost• Sorting Cosy• Express shipping cost

Profit = Income - Expense

A Specialist Independent Software Testing Solutions Provider

Page 24: Day 3 meet shilpa measuring software quality and business impact session 3

Barriers in Achieving ‘High’ Software Quality

Specifying Quality Requirements• There has been little work in the field of formal specification for non-

functional requirementsModeling Methods Don’t Address Quality Attributes

• Design methodologies are weak in representing nonfunctional requirements

Designing for Quality Attributes• Quality attributes are interdependent and cannot be achieved in

isolationSolution Catalogues and Quality Attributes

• Design patterns can be used to address some quality attributes, but mapping them to a design pattern’s context and problem statements is not easy.

• It may be worthwhile to begin cataloguing patterns with respect to standardized quality attributes

Quality Control is an Afterthought• Putting testing off until the end of the project is effectively a statement

that quality is not important enough to be assessed early

A Specialist Independent Software Testing Solutions Provider

Page 25: Day 3 meet shilpa measuring software quality and business impact session 3

Guidelines

Use common sense and organizational sensitivity when interpreting metrics data

Provide regular feedback to the individuals and teams who have worked to collect measures and metrics.

Don’t use metrics to appraise individuals

Work with practitioners and teams to set clear goals and metrics that will be used to achieve them

Never use metrics to threaten individuals or teams

Metrics data that indicate a problem area should not be considered “negative.” These data are merely an indicator for process improvement

Don’t obsess on a single metric to the exclusion of other important metrics

A Specialist Independent Software Testing Solutions Provider

Page 26: Day 3 meet shilpa measuring software quality and business impact session 3

Practices to improve Software Quality

A Specialist Independent Software Testing Solutions Provider

Sl. No

Practice Impact on Quality

Benefit Relevant Roles

1 Define Quality Attribute to match your needs

• Meet business Requirements

• Achieve a satisfying user experience

Development team is chartered with a definition of quality that fits the given time, resource and budget constraints

• Business Stakeholders

• Development Team

2. Broadcast simple quality metrics

Reduce defects Highly visible quality metrics keeps quality on the top of the mind for the entire team and exposes when the effort falls short

Development Team

3. Fine tune team and individual goals to include quality

• Meet business RequirementsAchieve a satisfying user experienceReduce defects

Team members perform according to their incentives; thus making quality improvement part of their goals reinforces desirable behaviour

Management

Page 27: Day 3 meet shilpa measuring software quality and business impact session 3

Practices to improve Software Quality

A Specialist Independent Software Testing Solutions Provider

Sl. No

Practice Impact on Quality

Benefit Relevant Roles

4. Get requirements right

• Meet business Requirement

• Achieve a satisfying user experience

Less rework means less retesting and fewer cycles, which greatly reduces overall effort

• Managers• Business

Analysts• User Experience

designers• Architects

5. Test smarter to test less

Reduce defects • Focussing testing on the most important and most riskiest areas ensures that the bugs that slip through are likely to be confined to the least important features

• Use Testing tools

• Quality Assurance

• Managers

6. Design applications to lessen bug risks

Reduce defects Simple, cleaner designs results in code that is simpler, cleaner and easier to test and rework- which means that the code will have fewer bugs and those bugs found will be easier to diagnose and repair

• Architects• Developers

Page 28: Day 3 meet shilpa measuring software quality and business impact session 3

Step 1: IDENTIFY the key ‘Software Quality’ attribute(s) for your product/service

Step 2: Identify the METRIC which can be used to measure the identified

‘Software Quality’ attribute(s)

Step 3: Devise PLAN to measure the Metric for each key ‘Software Quality’

attribute

Step 4: IMPLEMENT the plan to measure the metric during the course of the

software development lifecycle

Step 5: MONITOR the Metric and publish the results to all the affected

stakeholders

Step 6: If the results are not within acceptable limits, devise an action plan to

further IMPROVE it and go back to Step 4 till the Software Quality

Attribute measured is acceptable

Next Step…A Specialist Independent Software Testing Solutions Provider

Page 29: Day 3 meet shilpa measuring software quality and business impact session 3

What is Software Quality?

What is its Economic Value?

How to mange Software Quality?

What are its Attributes?

Why do we need to measure it?

How do we measure it?

Issues while measuring it?

Guidelines for measuring it?

A Specialist Independent Software Testing Solution Provider Questions Answered

Session 1

Session 2

Session 3

Page 30: Day 3 meet shilpa measuring software quality and business impact session 3

A Specialist Independent Software Testing Solution Provider Remember…

Commitment to QUALITY always pays off

Page 31: Day 3 meet shilpa measuring software quality and business impact session 3

Thank YouA Specialist Independent Software Testing Solutions Provider

India OfficeSQE Labs Inc.

116/8, Mohali (Chandigarh)India – 160062

www.sqelabs.com

US OfficeSQE Labs LLC,

6533, Preston Rd, Plano,TX - 75024

Contact me : [email protected]

Page 32: Day 3 meet shilpa measuring software quality and business impact session 3

Follow: @XBOSoft

Questions: [email protected] 408-350-0508

Page 33: Day 3 meet shilpa measuring software quality and business impact session 3

Thank You!

See you tomorrowTomorrow’s meeting March 20th

https://www3.gotomeeting.com/register/886356774 

Shilpa Dadhwal,Founder and CEO,SQE Labs Inc

Philip LewCEO, XBOSoft

Jan PrincenManaging Director, XBOSoft