Measuring BIM Maturity: Comparison between Maturity Systems & Benchmarks

Dr. Noha Saleeb

n.saleeb@mdx.ac.uk

Property

2

Maturity of what ??

Planning

Design

Construction

Operations

Owners

Client Representatives

Lawyers & Insurers

Investors

Bankers

Accountants

Project Managers

Structural & Civil Engineers

MEP & HVAC Services Consultants

Architects

Cost Consultants & Quantity Surveyors

Specialist Consultants

Contractors

Sub - Contractors

Manufacturers & Fabricators

Suppliers

Facilities Managers

Property Managers

Maintenance Contractors

Tenants

Users 1 2 3

© Saleeb, 2014

Postgraduate Course Feedback

1 • Maturity Definitions

2

• Comparison between 2 Maturity Systems

3 • Customised Maturity Systems

Agenda

PART 1

Maturity Definitions

© Saleeb, 2014

Capability vs. Competency

vs. Maturity

• Capability - the ability to perform a task through specific abilities / skills

• Competency / Maturity - degrees of quality / excellence in performing a task

“You can be capable but not competent – competent but not mature”

1 2 3

• Capability - the ability to perform a task through specific abilities / skills

• Competency / Maturity - degrees of quality / excellence in performing a task

“You can be capable but not competent – competent but not mature”

(i) identify BIM-specific maturity benchmark criteria

(ii) identify the detailed procedures to achieve these benchmarks

(iii) develop a suitable scoring system for measuring teams and

organisations against them

1 2 3

Capability vs. Competency

vs. Maturity

BIM Competency

• BIM-Competent Individual

Someone who has adequate BIM skill, knowledge and experience. Not only

generate a data-rich 3D model, but can do it in a timely manner and according to

a high delivery standards, protocols, procedures.

• BIM-Competent Project Team

A group of organizations which – in addition to being individually competent –

have gained the necessary experience to jointly deliver a BIM services/products

through common standards, collaborative systems and optimized workflows.

• BIM-Competent Organization

One that has consistently delivered (not can deliver) high-quality BIM products

and services. It not only harbours the necessary BIM-Competent individuals but

surrounds them with adequate systems, standards and due support.

To what level ??

1 2 3

PART 2

Comparison between Maturity Systems

© Saleeb, 2014

Existing BIM-specific

Maturity Models

1. NBIMS‟ CMM & I-CMM (Capability Maturity Model USA)

2. BIM Maturity Matrix (Australia)

1 2 3

NBIMS Capability Maturity

Model (CMM) chart

Bilal Succar

http://changeagents.blogs.com/

1 2 3

NBIMS

Capability

Maturity Model

(CMM) chart

1 2 3

AIA: Level of Development

PAS1192:2: Level of Definition

(LOdetail + LOinformation)

NBIMS Capability Maturity

Model (CMM) chart

Bilal Succar

http://changeagents.blogs.com/

1 2 3

NBIMS Integrated Capability

Maturity Model (i-CMM)

1 2 3

5 3

5 3

Weighting Change

1 2 3

Visual Chart of i-CMM

1 2 3

Limitations

1. Does not take into account, BIM level

2. Does not consider organisation/team level & size. All the same? How can

we compare results with others who do not fit same criteria?

3. states that “one should obtain a minimum score of 20 in order to consider

true BIM maturity”. THIS CHANGES: In 2010, the minimum score was 50

points and in 2011, the minimum score required for the distinction of

‘Minimum BIM’ is 60 points. The annual increase in points required is

included to allow for future education and BIM improvements industry-wide.

4. each of the 11 Areas of Interest used in NBIMS‟ CMM are weighted. This

weighting scheme is not conceptually fixed but can be preferentially altered

by organisations as they see fit.

5. Mostly technological skills rather than engagement/collaboration culture

6. The Areas of Interest used are not easily understood and may significantly

overlap (Suermann et al., 2008).

1 2 3

Components of BIM Maturity

Matrix

Bilal Succar

http://changeagents.blogs.com/

1 2 3

BIM Capability / Competency /

Maturity Assessment

Bilal Succar

http://changeagents.blogs.com/

1 2 3

Organisational

Scale

Bilal Succar

http://changeagents.blogs.com/

1. Market

2. Defined Market

3. Sub-Market

4. Industry

5. Sector

6. Discipline

7. Speciality

8. Project Team

9. Organisation

10.Organisational Unit

11.Organisational Team

12.Organisational Member

Components of BIM

Competency / Performance

Measurement

Bilal Succar

http://changeagents.blogs.com/

1 2 3

Granularity Level

1. Discovery: A low detail assessment used for basic and semi-formal

discovery of BIM Capability and Maturity

2. Evaluation: A more detailed assessment of BIM Capability and Maturity

3. Certification: A highly-detailed appraisal of those Competency Areas

applicable across disciplines, markets and sectors

4. Auditing: The most comprehensive appraisal

Building Information Modelling Maturity Matrix (chapter) by Bilal Succar, Nov 09 Handbook of Research on Building Information Modeling and

Construction Informatics: Concepts and Technologies

1 2 3

Building Information

Modelling Maturity Matrix

(chapter) by Bilal Succar,

Nov 09 Handbook of

Research on Building

Information Modeling

and Construction

Informatics: Concepts

and Technologies

1 2 3

Components of BIM

Competency / Performance

Measurement

Bilal Succar

http://changeagents.blogs.com/

1 2 3

Capability Stages

BIM Stages are defined by their minimum requirements

Capability Stage 1 – Modelling: deployed an object-based modelling

software tool similar to ArchiCAD, Revit, Tekla or Constructor

Capability Stage 2 – Collaboration: an organisation part of a

multidisciplinary ‘model-based’ collaborative project

Capability Stage 3 – Integration: an organisation uses a network-based

solution (like model servers) to share object-based models with at least two other

disciplines

Building Information Modelling Maturity Matrix (chapter) by Bilal Succar, Nov 09 Handbook of Research on Building Information Modeling and

Construction Informatics: Concepts and Technologies

1 2 3

Components of BIM

Competency / Performance

Measurement

Bilal Succar

http://changeagents.blogs.com/

1 2 3

Maturity

Levels (2)

Building Information Modelling Maturity Matrix (chapter) by Bilal Succar, Nov 09 Handbook of Research on Building Information Modeling and

Construction Informatics: Concepts and Technologies

1 2 3

Maturity

Levels (3)

Building Information Modelling Maturity Matrix (chapter) by Bilal Succar, Nov 09 Handbook of Research on Building Information Modeling and

Construction Informatics: Concepts and Technologies

1 2 3

Maturity

Levels (4)

Building Information Modelling Maturity Matrix (chapter) by Bilal Succar, Nov 09 Handbook of Research on Building Information Modeling and

Construction Informatics: Concepts and Technologies

1 2 3

Visual Report of a

hypothetical BIM

Maturity assessment

Building Information Modelling Maturity Matrix

(chapter) by Bilal Succar, Nov 09 Handbook of

Research on Building Information Modeling and

Construction Informatics: Concepts and

Technologies

12 Organisational hierarchy

3 BIM

Capability

Stages

5 Maturity Levels

1 2 3

Maturity Discovery Score

Building Information Modelling Maturity Matrix (chapter) by Bilal Succar, Nov 09 Handbook of Research on Building Information Modeling and

Construction Informatics: Concepts and Technologies

Granularity Level

Any Limitations ?

1. BIM level

2. Organisation / team level & size

3. Changeable minimum score

4. Weighting

5. Mostly technological skills rather than engagement / collaboration culture

6. Clear descriptions

1 2 3

PART 3

Customised Maturity Systems

© Saleeb, 2014

Organizational

BIM

Assessment

Profile

(PENN State USA)

33

1 2 3

Organizational BIM Assessment Profile

34

1 2 3

+ Infrastructure

Personnel

Organizational

BIM

Assessment

Profile

35

1 2 3

ARUP BIM Maturity Measure

36

1 2 3

ARUP BIM Maturity Measure

37

1 2 3

Virtual Design & Construction Scorecard

Stanford

38

1 2 3

PAS 91:2013

39

• Capability of working with a project

using a “Common Data Environment”

as described in PAS 1192:2:2013

• Documented policy, systems and

procedures to achieve “Level 2 BIM”

maturity as defined in the government’s

BIM Strategy

• Capability of developing and delivering

or working to a BIM Execution Plan

(BEP) as described in PAS 1192:2:2013

• Arrangements for training employees in

BIM related skills and do you assess

their capabilities

1 2 3

Questions

Dr. Noha Saleeb

n.saleeb@mdx.ac.uk