Systematic Review Touseef

8/3/2019 Systematic Review Touseef

http://slidepdf.com/reader/full/systematic-review-touseef 1/27

A Systematic Review on Software Measurement Programs

By

Touseef Tahir, Ali Jafar

Lahore



h Introduction to software measurement programs

and their problems

h

The research Questionsh Systematic Review

h Outcomes Of Systematic Review

h Conclusions and future work



h Measurement programs(understand, assess,control, improve)

h Problems in measurment programs

Expert judgement required.

Lack of guidelines for measurement activities. A clear measument plan

Clear aims and objectives

Guidlines for data collection

Analysis of results

Lack of understanding the importance.

Lack of management involvement.



h RQ_1a: How do Organizations use software

measurement programs?

h RQ_1b: What are the success factors insoftware measurement program?

h RQ_2: What are the models/frameworks,

and tools developed for measurement programs?



h Qualitative step

Systematic Review

RQ1 and RQ2



1. Planning the review

2. Conducting the review

3. Reporting the review



h Review Protocol

h Search Strategy

h Primary Search process

h Study selection criteria

h Exclusion criteria

h Inclusion criteria

h Quality assessment checklist h Data extraction strategy

h Synthesis of extracted data

h Primary study selection



h Review protocol consists of inclusion/

exclusion criteria, search keywords,

databases to be searched, qualityassessment checklist, data synthesis, data

extraction form and research questions.



h Identification of search keywords by analysing thecontext, objectives, relevant area of researchquestions.

h

Searched resources were analysed for furtheridentification of keywords, including the keywordssection of research resources.

h Identification of synonyms, alternatives andhypernyms for each key word.

h Boolean OR was used for synonyms, alternatives,and hypernyms.

h Boolean AND was used to make a search string andmake searching precise



h (metric OR measure OR measurement) AND(program OR plan OR process) AND (successOR important OR successful OR success story

OR good practices OR practices) AND (factorOR feature OR variable) AND (Software ORsoftware application OR software development life cycle OR software development process OR

software system OR software industry) AND(models OR guidelines OR practices) AND(framework OR structure infrastructure) AND(tool OR instrument OR mechanism OR device).



h The articles/papers that talk about goal

based MPs in software industry.

h The articles/papers that talk regarding GoalQuestion Metrics.

h Empirical studies regarding goal based MPs.

h General papers that directly related to thetopic as well as research question.

h The articles should be accessible in full text.



h Study containing irrelevant information to

the research questions.

h Studies in any language except English wereexcluded.

h Study with irrelevant material and without

validation was ex

cluded.



Type Definition

Bias To check the completeness of the results i.e. true results are presented, in

addition pros and cons of an object that was under study.

Internal

Validity

To determine the research and experimental design i.e. to analyse the

chances of errors in the results.

External

Validity

To determine the use of results in practice.

Generalization Do the results are generalizable?

Completeness Does the specific study provide pros as well as cons of understudied

object?



Common information Article Title, Author(s) Name(s), Journal/Conferences,

Proceedings/Conference. Search Keywords, Sources of Research Articles,

Publication Date

Study context Empirical, Academic

Research methodology Action Research, Experiment, Case Study, Survey

subjects Professional, Sampling criteria



Sr.

No

Journal Total Articles Articles on M.P

1 ACM Transactions on Software Engineering Methodology (TOSEM) 62 2

2 IEEE Transactions on Software Engineering (TSE) 61 2

3 IEEE Software 65 5

4 Springer Software Measurement Journals 788 3

5 Springer Annals 14 2

Sr.

No

Conference Proceedings Total Articles Articles on M.P

1 IEEE International Software Metrics Symposium 115 8

2 IEEE International Conference on Software Engineering 45 1

3 ACM International Conference on Software Engineering 21 2

4 IEEE Euro-micro Conference on Software Maintenance and

Reengineering

1 1

5 Digital Avionics Systems Conference 1 1

6 International Conference on Software Process and Product

Measurement (Mensura)

79 0

7 Empirical Software Engineering and measurement (ESEM) 195 0

8 IEEE Euromicro Conference on Software Engineering and Advance

Application (SEAA)

132 0

Total 1579 28



h RQ1 a Analysis

Extract goods from raw data

Classify the best practices Software process estimations, planning, and

improvements

Monitoring and control of organization business

goals

Organizational health

Reusability of measurement data and

experiences



RQ1 b Analysis

Well defined goals, questions and metrics.

The presence of a structure (well definedstructure, flow and connection between themeasurement activities) .

The well-defined tasks, activities for data

collection.

Traceability of the measurement goals within themeasurement program.



Traceability of the measurement goals

with respect to business goals.

Well-Defined way of data collection.

Well-Defined way of data analysis.

Tool support in data collection, storage and

analysis.



Understanding of the objectives of

measurement processes

Measures repository

Re-usability of measurement objects i.e.

goals, questions, metrics, analysis resultsof previous measurement processes

Communication and feedback



h RQ2 Analysis

Models

GQM

,GQIM

,GAM

,QIP,AM

I,M

IS-PyME

framework,MPSP,M2P,EACIF,MIM,M-

CMM,ISO/SPICE 15504.

Tools

PRIMER,Metri-Flame, GQM-PLAN Tool.



Structured definition of goals and question.

Traceability of the goals, question and measures.

Optimum set of measures.

Supporting re-usability of structured (goals, questions) and

measures. It can be easily automated according to the needs of

organization.

Prioritization of goals on the basis cost, frequency and usage of measures against the benefits.

Structure definition (of goals and question), optimization of measures and

prioritization of goals for successful measurement programs.



Decision

Making

Phase

Measures

Selection

Phase 7. Prioritization

Meeting 5a. Attribute

Selection

5b. MeasuresSelection

MeasurementRepository

CMMI, ISO

and Other

Standards

MeasuresSet, Cost

Question

Definition Phase

4a. Structured Question

Definition

4b. Identify Horizontal &

Vertical Dependencies

6a. Attribute MeasureMatrix Creation

6b. ScreeningProcess

Cost

3. Post Meeting

Analysis

1. Organizational

Perspective

Goal Definition

Phase 2a. Structured Goal

Definition Process

2b. Identify Sub-goals andDependencies

MeasurementData

Deciding on the OptimumMeasures Set

Goals Definition

Questions Definition



A Structured Goal BasedMeasurement Framework Enabling Traceability and

Prioritization

By

Touseef Tahir, Cigdem Gencel



MPs are essential for quality improvement

Estimation, monitor, control , predictions and quality

improvement.

Success of MPs depends on well defined phases, procedures and

guidelines.

There is a need of well defined measurement models,

frameworks and tools to define, collect, analyse, store and reuse

software metrics/measures

There is need of sharing more success and failures of MPs.

Most of the models, frameworks and tools are an extension of

GQM but there are no ways defined for sharing of collected

measures, comparison of findings and guidelines for reusability

of collected data within or outside same MPs using

same/different models, frameworks or tools.

Systematic Review Touseef

Documents

Transcript of Systematic Review Touseef