An ISO/IEC 33000-compliant Measurement Framework for Software Process Sustainability Assessment

www.eng.it

An ISO/IEC 33000-compliant Measurement Framework for Software Process Sustainability Assessment

24°International Workshop on Software Measurement (IWSM) and 9th International Conference on Software

Process and Product Measurement (MENSURA)

Rotterdam (Netherlands) - October 6-8, 2014

Giuseppe LamiLamiFabrizio FabbriniFabbrini

Luigi BuglioneBuglione

www.eng.it2 IWSM-MENSURA 2014 – October 6-8, 2014© 2014 Lami, Fabbrini & Buglione

Sustainability Assess Goals of the presentation

1. Discuss the Sustainability issue in general, more focus on the ‘product’ entity2. Introduce the Sustainability from a process-based viewpoint, for its evaluation3. Propose a Sustainability Measurement Framework (SMF) compliant with the ISO/IEC 33000 series


ISTI-CNR At a glance

www.isti.cnr.it

http://www.isti.cnr.it/

http://www.isti.cnr.it/


Engineering At a glance

www.eng.it

http://www.eng.it/

http://www.eng.it/

http://www.eng-it.it/spimq


Agenda

• Introduction– Sustainability: definition & concept– Some basic questions

• Green & Sustainable Software Process— Definitions

• ISO/IEC 33000: A Standard for Software Process Assessment– MF: Measurement Framework– PRM: Process Reference Model– PAM: Process Assessment Model

• A Measurement Framework for Process Sustainability– SL: Sustainability Levels – PA: Process Attributes– PRM Changes

• Conclusions & Future Works• Q&&A

Sustainability Assess


Introduction Sustainability – Definition & Concept

Sustainability (originating from the Latin word sustenere that means: ‘to hold up’) shows the capability of enduring over time.

In the last years sustainability is more and more intended as the responsible use of the heart resources in order to “meet the needs of the present without compromising the ability of future generations to meet their own needs”

Rome, Teatro di Marcello (I century BC)


Introduction Previous works on Sustainability

• Proposed a set of 3 sustainable processes in the SPICE (ISO/IEC 15504) format • Show proposals for measuring sustainability from a Balanced Scorecard viewpoint, improving current existing ISO standards (e.g. ISO/IEC 25010:2011)

• Proposed a set of Metrics to represent a starting point for ‘measuring green projects’• Analysis of the main CSFs for an EAM (Entity-Attribute-Measure) analysis applied

• Ecological Rework, Renew• How to evalute the capability to ‘renew’ processes• Capability to be ‘resilient’ across time• Proposal for introducing a new criterion in PAMs


Introduction ISO/IEC 25010:2011 – Revised view

• Potential new ISO/IEC 25010:2011 1°-level attribute to be added• In the middle between Quality In Use and the Internal-External Quality viewpoints• Sustainability: “the capability of the software product to meet concurrent needs of required functionalities without compromising the ability to meet future needs”


Introduction Some basic questions...

Which is the definition of ‘sustainable’ concretely applied in organizations?

How much are our projects ‘sustainable’?

Which best practices are yet in place? Which standards?

Which impact on ICT products and processes (if any)?


Agenda






Measur. Framework


Green & Sustainable.. Definitions (1)

• Sustainability Goals: measurable objectives expressed in terms of direct and indirect impacts on economy, society, human beings, and environment. • Process Sustainability: the characterization of the ability of a process to meet current or projected sustainability goals.• Software Process: set of interrelated or interacting activities, related to the development, maintenance, and disposal of a software product, which transforms input in output.• Sustainable software process: a software process able to meet its defined sustainability goals, • Process Sustainability Level: the characterization of a process on an ordinal measurement scale of process sustainability. • Process Sustainability Assessment: a disciplined evaluation of an organizational unit’s process against a Process Assessment Model • Sustainable software product: a software product able to meet its defined sustainability goals. From such a definition a sustainable software product can be seen as software, whose direct and indirect impacts on economy, society, human beings, and environment that results from its development, deployment, and usage are aligned with defined goals.


Green & Sustainable.. Definitions (2)

• Sustainable Software Engineering: the art of developing sustainable software adopting a sustainable software engineering process.

• Negative and positive impacts on sustainable development that result and/or are expected to result from the software product over its whole lifecycle are continuously assessed, documented, and used for a further optimization of the software product.

(i.e. a pattern of growth in which resource use aims to meet human needs while preserving the environment so that these needs can be met not only in the present, but also for generations to come)


Agenda








ISO/IEC 33000 MF: Measurement Framework

• Measurement Framework: a scheme to use for assigning a quantitative rating to a quality characteristics of a process• ISO/IEC 33003 Requirements for the definition of a MF

Components of a MF• Levels: points on an ordinal scale (e.g. from 0 to 5)• Process Attributes: measurable characteristics of a process • Rating Scales: set of values/categories to which an attribute is mapped (e.g. Not/Partially/Largely/Fully achieved)


ISO/IEC 33000 PRM: Process Reference model

• Process Reference Model (PRM): model comprising definitions of processes in a life cycle described in terms of process purpose and outcomes, together with an architecture describing the relationships between the processes. [ISO/IEC 33001]

• ISO/IEC 33004 Requirements for the definition of a PRM

Requirements of a PRM A Process Reference Model shall contain:• a declaration of the domain of the process reference model;• a description of the relationship between the process reference model and its intended context of use;• descriptions of the processes within the scope of the process reference model containing purpose, process outcomes necessary and sufficient to achieve the purpose of the process;• description of the relationship between the processes defined within the process reference model.


ISO/IEC 33000 PRM: Process Reference Model

• This a compliant PRM from ISO/IEC 12207:2008 • The ‘sustainability’ proposal aims to strengthen PRMs with processes and a MF compliant with the ISO/IEC 33000 design


ISO/IEC 33000 PAM: Process Assessment Model

• The PAM is a model for assessing the quality characteristic of processes• So far, only process quality characteristics of capability has been addressed• Once a MF specific for sustainability and a compatible PRM will be defined the SPICE PAM can be used with no change


Agenda








MF-Sustainability SL (Sust. Levels) + PA (Product Attributes)

• Added a Process Attribute (PA) at SL1• Performance & Sustainability need to be both present at such level


MF-Sustainability PRM Changes

• Exemplar Process Definition Process Name MeasurementProcess Purpose

The purpose of the Measurement Process is to collect, analyze, and report data relating to the products developed and processes implemented within the organizational unit, to support effective and sustainable management of the processes, and to objectively demonstrate the quality and sustainability of the products.

Process Performance Outcomes

As a result of the performance of the Measurement Process:a) the information needs of technical and management processes are identified; b) an appropriate set of measures, driven by the information needs are identified and/or developed; c) measurement activities are identified and planned; d) the required data are collected, stored, analyzed, and the results interpreted; e) information products are used to support decisions and provide an objective basis for communication; f) the Measurement Process and measures are evaluated; and g) improvements are communicated to the Measurement Process owner.

Process Sustainability Outcomes

As a result of the sustainable implementation of the Measurement Process:a) the information needs for controlling the achievement of sustainability objectives of technical and management processes are identified; b) the information needs for controlling the achievement of sustainability objectives of work products are identified;c) an appropriate set of sustainability measures for processes and work products, driven by the information needs, are identified and/or developed; d) sustainability measurement activities are identified and planned; e) the data required for sustainability measurement are collected, stored, analyzed, and the results interpreted and communicated to affected parties; g) the Sustainability Measurement Process and sustainability measures are evaluated; h) sustainability improvements are communicated to the sustainability Measurement Process owner.


MF-Sustainability MCM Capability Evaluation


Agenda








Conclusions && Future Works

• Measuring Process Sustainability (not only Capability) Measurement is fundamental for approximating the size of entities of

interest Measurement should be desirable also for processes, not only

products/services Sustainability can be a further attribute to consider for evaluating a

process• Measurement Framework (MF)

ISO/IEC 33000 serie allows the definition of a MF for process sustainability

A MF for process sustainability has been presented The presented MF for process sustainability can be applied in

ISO/IEC 33000-compliant process assessments Next Steps

...try & see!

All models are wrong. Some models are useful. (George Box, Mathematician, 1919-2013)


http://en.wikiquote.org/wiki/George_E._P._Box

http://en.wikiquote.org/wiki/George_E._P._Box


Lessons Learned...

UR

L:

ww

w.d

ilber

t.co

m


http://www.dilbert.com/


Q && A

Bedankt voor uw aandachtBedankt voor uw aandacht!!Thanks for your attentionThanks for your attention!!



Our Contact Data

Luigi Buglione

Engineering Ingegneria Informatica/[email protected]

FabrizioFabbrini

ISTI/[email protected]

GiuseppeLami

ISTI/[email protected]

Measur. Framework

http://www.eng.it/

An ISO/IEC 33000-compliant Measurement Framework for Software Process Sustainability Assessment

Software

Transcript of An ISO/IEC 33000-compliant Measurement Framework for Software Process Sustainability Assessment