Download - Software Metrics

Transcript
Page 1: Software Metrics

Software MetricsFacultyFacultyFacultyFaculty

Prof.V.NarayanaProf.V.NarayanaProf.V.NarayanaProf.V.NarayanaK.S.Prakasa RaoK.S.Prakasa RaoK.S.Prakasa RaoK.S.Prakasa RaoP.Linga ReddyP.Linga ReddyP.Linga ReddyP.Linga Reddy

Software MetricsFacultyFacultyFacultyFaculty

Prof.V.NarayanaProf.V.NarayanaProf.V.NarayanaProf.V.NarayanaK.S.Prakasa RaoK.S.Prakasa RaoK.S.Prakasa RaoK.S.Prakasa RaoP.Linga ReddyP.Linga ReddyP.Linga ReddyP.Linga Reddy

Page 2: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 2 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Software Metrics - TopicsSoftware Metrics - TopicsWhy measureWhat to measureWhen to measureData collection Metric analysis Simple statistical toolsImprovements Issues

Page 3: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 3 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Why measure ?Why measure ?Software project goals Software project goals

quality of deliverables quality of deliverables timely delivery and timely delivery and costcost

If you do not measure, you do not know If you do not measure, you do not know where you are and do not know what to where you are and do not know what to improve improve

Page 4: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 4 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Why measure ?Why measure ?Need Quantitative DataNeed Quantitative Data

to monitor progressto monitor progressto analyze trendsto analyze trendsto identify areas that need improvementto identify areas that need improvementto initiate improvementsto initiate improvements

Continuous improvementContinuous improvement

Page 5: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 5 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Why measure ?Why measure ?MeasurementMeasurement -- A quantified observation For A quantified observation For egeg., ., effort in person days in completing a task or number effort in person days in completing a task or number of defects reported in testing a moduleof defects reported in testing a module

MetricMetric -- A comparative measure of the performance A comparative measure of the performance of software product or process For e.g.., Effort of software product or process For e.g.., Effort deviation percentage (planned versus actual)deviation percentage (planned versus actual)Defect density = defects per unit size of work Defect density = defects per unit size of work product.product.

Page 6: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 6 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

What to measure ?What to measure ?Project management metricsProject management metrics

Schedule metricsSchedule metricsEffort metricsEffort metricsPhasePhase--wise effort distributionwise effort distribution

Quality metricsQuality metricsDefect metricsDefect metricsCustomer satisfactionCustomer satisfactionMaintenance metricsMaintenance metrics

Page 7: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 7 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

What to measure ? (cont’d)What to measure ? (cont’d)Cost metricsCost metrics

Cost varianceCost varianceCost of QualityCost of Quality

Page 8: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 8 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Schedule metricsSchedule metricsTo monitor the trends in the actual calendar days To monitor the trends in the actual calendar days spent on completion of specific tasks/ activities spent on completion of specific tasks/ activities against planned calendar daysagainst planned calendar daysDevelopment projects Development projects -- phase wise phase wise measurementsmeasurementsSustenance projects Sustenance projects -- work request wise work request wise measurementsmeasurementsUsed for reUsed for re--planning at the project level and as planning at the project level and as input for estimation at the company levelinput for estimation at the company level

Page 9: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 9 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Schedule metrics (cont’d)Schedule metrics (cont’d)

Schedule deviation = (Schedule deviation = ((Actual calendar days (Actual calendar days --Planned calendar days)/Planned calendar days) * Planned calendar days)/Planned calendar days) * 100 100

Page 10: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 10 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Effort metricsEffort metricsTo monitor the trends in the person days spent To monitor the trends in the person days spent on completion of specific tasks/ activities against on completion of specific tasks/ activities against planned person daysplanned person daysDevelopment projects Development projects -- phase wise phase wise measurementsmeasurementsSustenance projects Sustenance projects -- work request wise work request wise measurementsmeasurementsUsed for reUsed for re--planning at the project level and as planning at the project level and as input for estimation at the company levelinput for estimation at the company level

Page 11: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 11 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Effort metrics (cont’d)Effort metrics (cont’d)Effort deviation = (Effort deviation = ((Actual person days (Actual person days --Planned person days)/ Planned person days) * Planned person days)/ Planned person days) * 100100

Page 12: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 12 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Phase-wise effort distributionPhase-wise effort distributionAnalysis of effort spent on each phase for Analysis of effort spent on each phase for different kinds of projectsdifferent kinds of projectsComparison with size of work product at Comparison with size of work product at each phaseeach phaseProvides norms at the company level Provides norms at the company level

for preparation of proposalsfor preparation of proposalsfor project planning for project planning

Page 13: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 13 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Defect metricsDefect metricsTo monitor trends in defects at each To monitor trends in defects at each phase of development as well as during phase of development as well as during acceptance by the customeracceptance by the customerClassification by severity of defect and Classification by severity of defect and origin of defect helps in initiating origin of defect helps in initiating corrective actionscorrective actions

Page 14: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 14 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Defect metrics (cont’d)Defect metrics (cont’d)Defect densityDefect density

No of defects/size of the work productNo of defects/size of the work product

Severity of defectsSeverity of defectsclassification of defects as critical, major & minor classification of defects as critical, major & minor and their distribution at each phaseand their distribution at each phase

Origin of defectsOrigin of defectsclassification of defects based on the origin of classification of defects based on the origin of defects such as requirements, design or codingdefects such as requirements, design or coding

Page 15: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 15 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Defect metrics (cont’d)Defect metrics (cont’d)

Defects seepageDefects seepageDefects reported by customer during Defects reported by customer during acceptance as a percentage of total defects acceptance as a percentage of total defects reported during prereported during pre--delivery system testingdelivery system testing

Page 16: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 16 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Customer satisfactionCustomer satisfactionBased on customer satisfaction survey, analyze Based on customer satisfaction survey, analyze the data and identify areas of strengths and the data and identify areas of strengths and weaknessweaknessIdentify causes that result in customer Identify causes that result in customer dissatisfaction and take corrective actions dissatisfaction and take corrective actions

Page 17: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 17 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Maintenance metricsMaintenance metricsAnalysis of defects reported during warranty Analysis of defects reported during warranty supportsupportMean time taken to resolve problems reported by Mean time taken to resolve problems reported by the customer the customer

Page 18: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 18 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Cost metricsCost metrics

Cost variance = ((Actual cost Cost variance = ((Actual cost -- Planned Planned cost)/Planned cost) * 100cost)/Planned cost) * 100Cost of Quality Cost of Quality

Prevention costPrevention costAppraisal costAppraisal costFailure cost (Internal failures and external failures)Failure cost (Internal failures and external failures)

Page 19: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 19 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

When to measureWhen to measurePeriodic Periodic -- on a time bound basis (daily or on a time bound basis (daily or weekly) weekly) Milestone Milestone -- on completion of a specific on completion of a specific mile stone mile stone

Page 20: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 20 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Data collectionData collectionPlanned start date and close date for Planned start date and close date for each phaseeach phaseActual start date and close date for each Actual start date and close date for each phasephasePlanned effort for each phasePlanned effort for each phaseActual effort for each phaseActual effort for each phaseDefects at each phase of review and Defects at each phase of review and testingtesting

Page 21: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 21 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Data collection (cont’d)Data collection (cont’d)Customer satisfaction survey dataCustomer satisfaction survey dataCustomer feedback and complaints dataCustomer feedback and complaints dataSustenance projects Sustenance projects -- schedule and schedule and effort (planned and actual) for each work effort (planned and actual) for each work requestrequest

Page 22: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 22 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Metric analysis Metric analysis

Schedule varianceSchedule variance = ((Actual calendar days = ((Actual calendar days --Planned calendar days)/ Planned calendar Planned calendar days)/ Planned calendar days)) * 100days)) * 100Effort varianceEffort variance = ((Actual effort in person days = ((Actual effort in person days --Planned effort in person days)/ Planned effort in Planned effort in person days)/ Planned effort in person days)) * 100person days)) * 100Effort distribution metric Effort distribution metric = Percentage of effort = Percentage of effort spent for each phasespent for each phase

Page 23: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 23 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Metric analysis (cont’d)Metric analysis (cont’d)Defect metricsDefect metricsDefect densityDefect density = Number of defects/size of = Number of defects/size of the work productthe work productDefect distributionDefect distribution = Percentage of defects by = Percentage of defects by defect severity and origin of defectsdefect severity and origin of defectsDefects seepage Defects seepage = Defects reported during = Defects reported during acceptance as a percentage of defects acceptance as a percentage of defects reported during internal testingreported during internal testing

Page 24: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 24 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Metric analysis (cont’d)Metric analysis (cont’d)Customer satisfaction surveyCustomer satisfaction survey

Customer satisfaction survey is conducted Customer satisfaction survey is conducted quarterly/milequarterly/mile--stone for large projects and end of stone for large projects and end of project for small projectsproject for small projectsParameters measured Parameters measured -- Quality, Delivery, Service, Quality, Delivery, Service, Communication, Relationship and ValueCommunication, Relationship and Value

Rating for each parameter Rating for each parameter -- 5 Excellent, 4 Fully 5 Excellent, 4 Fully satisfied, 3 Average, 2 Fair and 1 Poor satisfied, 3 Average, 2 Fair and 1 Poor

Page 25: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 25 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Metric analysis (cont’d)Metric analysis (cont’d)Customer satisfaction survey (cont’d)Customer satisfaction survey (cont’d)

Each parameter to have a score of 3 plus and Each parameter to have a score of 3 plus and an overall score of more than 70% an overall score of more than 70% Analyzed for each customer and plotted for Analyzed for each customer and plotted for score of each parameter and total scorescore of each parameter and total score

Page 26: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 26 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Metric analysis (cont’d)Metric analysis (cont’d)

Maintenance MetricsMaintenance Metrics

Analysis of Time taken to respond to customer Analysis of Time taken to respond to customer reported defects reported defects Analysis of type of defects by type and severityAnalysis of type of defects by type and severity

Page 27: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 27 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Metric analysis (cont’d)Metric analysis (cont’d)

Cost MetricsCost Metrics

Cost varianceCost variance = ((Actual cost = ((Actual cost -- Planned cost)/ Planned Planned cost)/ Planned cost)*100cost)*100Cost of QualityCost of Quality

Prevention cost (Planning, training etc.,)Prevention cost (Planning, training etc.,)Appraisal cost (Reviews and testing)Appraisal cost (Reviews and testing)Failure cost (Rework, customer complaints etc.,)Failure cost (Rework, customer complaints etc.,)

Page 28: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 28 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Simple statistical toolsSimple statistical toolsScatter diagramScatter diagramHistogramHistogramPareto AnalysisPareto AnalysisBrainstormingBrainstormingCause and effect diagramsCause and effect diagramsControl chartsControl charts

Page 29: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 29 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Scatter diagramScatter diagramDiscover, confirm or display Discover, confirm or display relationships between two sets of datarelationships between two sets of data

Page 30: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 30 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

HistogramHistogramDisplay the dispersion or spread of dataDisplay the dispersion or spread of data

Page 31: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 31 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

HistogramHistogram

Page 32: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 32 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Pareto AnalysisPareto AnalysisIdentify major factors and distinguish the Identify major factors and distinguish the most important causes from less most important causes from less significant ones.significant ones.

Page 33: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 33 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Pareto Analysis (cont’d) Pareto Analysis (cont’d)

Page 34: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 34 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Brainstorming Brainstorming Generate, clarify and evaluate a sizeable Generate, clarify and evaluate a sizeable list of ideas, problems or issueslist of ideas, problems or issues

Page 35: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 35 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Cause and effect diagramCause and effect diagramSystematically analyze cause and effect Systematically analyze cause and effect relationships and identify potential root relationships and identify potential root causes of a problem.causes of a problem.

Page 36: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 36 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Cause and effect diagram (cont’d)Cause and effect diagram (cont’d)

Page 37: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 37 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Control charts Control charts Every process is subject to variationEvery process is subject to variationVariation is part of natureVariation is part of natureCauses of variationCauses of variation

Natural causesNatural causesAssignable causesAssignable causes

Natural CausesNatural CausesCannot be avoided but can be improvedCannot be avoided but can be improved

Assignable causesAssignable causesCan be avoidedCan be avoided

Page 38: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 38 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Control charts (cont’d) Control charts (cont’d)

Control charts help us in identifying Control charts help us in identifying assignable causes and to eliminate them assignable causes and to eliminate them

Page 39: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 39 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Control charts (cont’d) Control charts (cont’d)

Steps in control chartsSteps in control chartsDefine company baseline for metrics that need to be Define company baseline for metrics that need to be controlledcontrolledWork out the upper and lower control limits Work out the upper and lower control limits Plot the metrics on a periodic or milestone basisPlot the metrics on a periodic or milestone basisIn case metric out control identify the case and initiate In case metric out control identify the case and initiate action to eliminate the causeaction to eliminate the cause

Page 40: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 40 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

ImprovementsImprovementsCorrective actionsCorrective actionsPreventive actionsPreventive actionsEstimation, planning & tracking methodsEstimation, planning & tracking methodsGoal setting Goal setting -- company level and project company level and project level level

Page 41: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 41 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

IssuesIssues

Data collection Data collection -- Manual methods (cumbersome and Manual methods (cumbersome and do not assure authentic data)do not assure authentic data)Automate the data collectionAutomate the data collectionIdentify centralized department (like QA) for analysis Identify centralized department (like QA) for analysis and reportingand reportingShare information among allShare information among allMetrics are for process improvements and not for Metrics are for process improvements and not for evaluation of persons evaluation of persons

Page 42: Software Metrics

© Ideaspace Solutions LimitedAll Rights Reserved

Slide 42 of 43Version:1.0

Date :05/08/2002Where Ideas Drive IT

Issues (cont’d)Issues (cont’d)Keep the metrics process Keep the metrics process

SIMPLE and PRACTICALSIMPLE and PRACTICAL

OpennessOpennessCommunication and preparedness to improveCommunication and preparedness to improveReport metrics in ERC and MRCReport metrics in ERC and MRC

Page 43: Software Metrics

Thank YouThank You