BIM Performance Assessment - changeagents.blogs.com · Revit®, Archicad® and Tekla®. 32 BIM...
Transcript of BIM Performance Assessment - changeagents.blogs.com · Revit®, Archicad® and Tekla®. 32 BIM...
1 BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
BIM Performance Assessmenta n i n t r o d u c t i o n
presented by Bilal Succar | Emirates BIM User Group
hosted by the Canadian University of Dubai | Feb 15, 2016
2
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
I. Introduction
II. Assessment Methods
c. how to Structure an Organisational Assessment
d. focus on the STAGED method
d1. understanding Capability Stages
d3. sample Template and Report
b. what is BIM Performance Assessment
e. focus on the CONTINUOUS method
e1. inventories of Competency Items and Model Uses
e2. sample Competency Assessment tools and charts
e3. sample Project Assessment based on Model Uses
III. Performance Improvement Lifecycle
IV. Summary and Good Bye
d2. understanding Maturity Levels
a. understanding BIM Wash
3
B u i l d i n g I n f o r m a t i o n M o d e l l i n g i s a s e t o f t e c h n o l o g i e s , p r o c e s s e s a n d p o l i c i e s e n a b l i n g
m u l t i p l e s t a k e h o l d e r s t o c o l l a b o r a t i v e l y d e s i g n , c o n s t r u c t a n d o p e r a t e a f a c i l i t y
l e t s ’ s ta r t w i t h a d e f i n i t i o n :
4
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
I. Introduction
5
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
Part I.a
understanding BIM Washand its levelshttp://bit.ly/BIMWash
6
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
0 . no BIM wash
1 . confusion
2 . inexperience
3 . exaggeration
4 . i l lus ion
d i f ferent l eve l s o f BI M Wa s h
7
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
LEVEL 1 confusion
8
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
LEVEL 2 inexperience
9
LEVEL 3 exaggeration
10
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
LEVEL 4 i l lusion
11
enough about
BIM Wash!
let’s focus on BIM performance
12
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
Part I.b
what is BIM performance?
and what are its benefits
13
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
BIM Performance is a generic term referring to a
large number of metrics . It covers the abilities and deliverables
expected from or realised by individuals, organisations, projects
and teams when using BIM tools and workflows
14
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
• Gain a clear picture of staff competency across the organisation or team
• Generate target competency profiles and identify competency gaps
• Identify training and professional development requirements
• Link training requirements to training material
• Match staff competency to roles and projects
• Clarify selection and recruitment criteria for new staff
the benefits of competency assessments
identifying the abilities of individuals (people):
15
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
• Establishing the organisation’s BIM adoption readiness
• Identifying which organisational systems are causing bottleneck and reducing productivity
• Discovering untapped potential that can be used on projects
• Identifying compliance gaps: standards that are not followed and protocols that need to be developed
the benefits of capability/maturity assessments
identifying the abilities of organisational systems allow:
16
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
Part I.c
how to structure an Organisational Assessment?
17
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
ORGANISATIONAL unit
TEAM of individuals
whole ENTERPRISE
the PROJECT itself
single INDIVIDUAL
the SUPPLY CHAIN
the whole MARKET
CAPABILITY MATURITY
CERTAINTY
COMPETENCY
READINESS
COMPATIBILITY COMPLIANCE
COMPETENCY COMPATIBILITY
MATURITY COMPLIANCECAPABILITY
MATURITY
RICHNESS VARIABILITY
whom/what to assess? what is being assessed?
18
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
ORGANISATIONAL unit
TEAM of individuals
whole ENTERPRISE
the PROJECT itself
single INDIVIDUAL
the SUPPLY CHAIN
the whole MARKET
CAPABILITY MATURITY
CERTAINTY
COMPETENCY
READINESS
COMPATIBILITY COMPLIANCE
COMPETENCY COMPATIBILITY
MATURITY COMPLIANCECAPABILITY
MATURITY
RICHNESS VARIABILITY
whom/what to assess? what is being assessed?
19
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
Assessment Pyramid (by Organisational Scale)
How to Structure the assessment:
20
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
Assessment Hierarchy (by Organisational Business Stream)
How to Structure the assessment:
21
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
II. Assessment Methods
22
conducted using static templates requires more elaborate tools
STAGED CONTINUOUS
assessments are conducted against a FIXED target:
either a performance or compliance milestone
assessments are conducted against a MOVING target: a
performance profile that continually evolves
there are two main ways for assessing performance
23
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
Part II.d
focus on the STAGED method
24
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
the STAGED method assesses against fixed targets – either:
STAGED
compliance milestones performance milestonese.g. UK’s BIM Level e.g. BIM Capability Stages
this session’s focus
25
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
the BIM performance milestones of organisations are composed of two complementary sets of metrics:
STAGED
BIM Capability Stages BIM Maturity Levelsnot to be confused with UK’s BIM Levels
26
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
Part II.d1
understanding BIM Capability Stages
27
What are BIM Capability Stages?
BIM Capabil ity Stages refer to the key performance milestones that can be achieved by organizations and teams as they
adopt BIM tools, workflows and protocols
28 BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
p r e BIM
i n t e g r a t e d BIM
It is practically impossible to jump from pre-BIM (the status before BIM implementation) to full BIM capability in one step!
Frank Gehry
A number of intermediary stages separate ‘no BIM’ to ‘full BIM’.
29
1 2 3
object-based
modelling
network-based
integration
model-based
collaborationpre BIM post BIM
30
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
pre BIM
Frank Gehry
hand-drawing 2D cad
BIM StagesPre-BIM Status
Before the implementation of BIM, organizations are still dependent on manual and 2d CAD tools and processes.
Tools similar to AutoCAD® are prolifically used to generate scaled drawings and details.
(Succar, 2009)
31
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
no model interchanges
cad 2D and 3D from models
(Succar, 2009)
object-based
modelling
BIM Stage 1
These tools can generate five types of model based deliverables and are used to generate single-disciplinary models within either design, construction or operation –the three Project Lifecycle Phases.
BIM Stages
BIM capability is acquired through the successful implementation of an ‘object-based software tool’ similar to Revit®, Archicad® and Tekla®.
32
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
modelinterchanges
model-linking or federation
At Stage 2 players acquire the ability to collaborate with other disciplinary players. Collaboration occurs through an interchange (interoperable exchange) of models through ‘proprietary’ formats (e.g. RVT and NWD) and non-proprietary formats (e.g. IFC).
(Succar, 2009)
model-based
collaboration
BIM StagesBIM Stage 2
33
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
images: Autodesk
arc
hit
ect
eng
inee
r
ow
ner
cont
ract
or
model-based
collaboration
At Stage 2 players acquire the ability to collaborate with other disciplinary players. Collaboration occurs through an interchange (interoperable exchange) of models through ‘proprietary’ formats (e.g. RVT and NWD) and non-proprietary formats (e.g. IFC).
However, at Stage 2, collaboration between different disciplines is file-based and one-to-one. This keeps stakeholders isolated in their silos with disjointed supply chain workflows.
BIM StagesBIM Stage 2
34
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
network-based
integration
integrated models(not necessarily a single model)
At this capability stage, data-rich models are created, shared and maintained collaboratively across Project Lifecycle Phases. This integration can be achieved through ‘model servers’ (using proprietary, open or non-proprietary formats), Cloud Computing, or SaaS (Software as a Service).
BIM Stage 3 models are interdisciplinary models allowing complex analyses at early stages of virtual design and construction.
BIM StagesBIM Stage 3
(Succar, 2009)
35
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
component and materials costs
integrated maintenance
systems
operations business logic
geographic information
systems (GIS)
services grid
building management
systems (BMS)
virtually integrated Design, Construction & Operation (viDCO)
BIM Stagespost BIM
36
BIM Stages videohttp://bit.ly/Video-Stages
15 mins | CC available
This model is also available inSpanish | French | Italian | …refer to BIMThinkSpace Ep13
37
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
BIM Capability Stages measure minimumability (availability).
to measure how good this capability is, another metric is applied.
38
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
Part II.d2
understanding BIM Maturity Levels
39
BIM Maturity is the gradual and continual improvement in qual ity, repeatabil ity and predictabil ity within avai lable BIM Capabil ity.
BIM Maturity is expressed as 5 Maturity Levels (or performance improvement milestones ) that organizations,
teams and whole markets aspire to.
40
41
BIM Maturity Index videohttp://bit.ly/Video-Maturity
9 mins | CC available
This model is also available inSpanish | French | Italian | …refer to BIMThinkSpace Ep13
42
combining BIM Readiness, BIM Capability, BIM Maturity into a single
Point of Adoption model
43
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
44
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
45
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
46
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
Point of Adoptionhttp://bit.ly/Video-PoA
16 mins video
47
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
48
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
49
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
50
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
51
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
52
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
53
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
54
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
Point of Adoptionhttp://bit.ly/Video-PoA
16 mins video
55
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
Point of Adoptionhttp://bit.ly/Video-PoA
16 mins video
56
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
Part II.d3
sample Template and Report
57 BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
BIM Maturity Matrix (BIM3)
Download full English version: http://bit.ly/BIM3-English (PDF 578kb) Portuguese: http://bit.ly/BIM3-Portuguese (PDF 711kb)
58 BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
single BUSINESS STREAM multiple STREAMSperformance results based on STAGED assessment
using top-level BIM Capability/Maturity setsaveraged BIM Performance across
business streams for the whole enterprise
BIM Maturity Charts
59
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
Part II.e
focus on the CONTINUOUS method
60
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
CONTINUOUSthe CONTINUOUS method assesses against evolving targets;
it follows three common sense steps:
61
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
the CONTINUOUS method assesses against evolving targets; it follows three common sense steps:
CONTINUOUS
62
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
Part II.e1
inventories of Competency Items and Model Uses
63
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
to establish targets and assess against them, the CONTINUOUS assessment method relies on the availability of:
CONTINUOUS
needed for assessing individuals, organisations and teams
needed for assessing projects and organisations
a Competency Items inventory a Model Uses inventorya large list of abilities a large list of expected project deliverables
64
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
a Model Uses inventory
13096 Facilitate model-based collaboration between a small team of structural engineers on a bridge project
13881 Maintain BIModels generated using standardized protocols
36721 Use models to conduct egress/ingress simulations
40056 Use models to monitor building performance and control its equipment
a Competency Items inventory
6010 Asset Maintenance6030 Asset Tracking6070 Space Management
CONTINUOUS
sample items sample items
refer to full inventory
4010 Accessibility Analysis4060 Constructability Analysis4070 Cost Estimation
7010 Building Automation7030 Performance Monitoring
65
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
these inventories are derived - using a published research framework – by analysing numerous international standards, protocols, job ads, and many other sources
CONTINUOUS
66
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
8 SETS
55 TOPICS
1000s of ITEMS
67
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
Component Development
Library Management
Standardization & Templates
Technical Training
System and Process Testing
Guides and Manuals
1000s of ITEMS
8 SETS
55 TOPICS
68
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
CollaborationFacilitation
Project ManagementTeam Management
Workflow Management
1000s of ITEMS
8 SETS
55 TOPICS
69
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
Leadership
Strategic Planning
Organizational Management
Business Development
Client Management
Partnership and Alliancing
1000s of ITEMS
8 SETS
55 TOPICS
70
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
Part II.e2
sample Competency Assessment tools and charts
71
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
BIMexcellence.com | β2 | Individual Discovery Module
sample inventory-driven online tool
the CONTINUOUS assessment method
72
Competency Indexf i ve levels
73
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
BIMexcellence.comβ2 | Organisational Discovery Module
another sample inventory-driven online tool
the CONTINUOUS assessment method
74
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
Competency Scores: single set of data with Average Score Curve
sample Competency Benchmarkthe CONTINUOUS assessment method
75
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
Competency Profile:the competencies of a single individual against the 55 topics
76
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
Collated Profile: the competencies of several individuals against the 55 topics
77
Competency Distr ibut ionF ILTERED BY LOCATION
B A S I C S K I L L S A D V A N C E D + E X P E R T
78 BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
Competency Matrix Competency Web
sample Competency Chartsthe CONTINUOUS assessment method
distribution of competency topics against competency levels distribution of scores against competency topics
79 BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
Candidate Scores compared to Target Profile100% denotes full al ignment
note: percentages are not absolute scores but reflect degree of alignment
with client’s pre-qualification requirements
sample Competency Comparison Tablethe CONTINUOUS assessment method
80
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
Part II.e3
sample Project Assessment based on Model Uses
81 BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
refer to BIMThinkSpace Ep24
82 BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
83 BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
84
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
Model Uses as a Performance Metric
Clients/Employers can define their BIM project requirements by selecting Model Uses (expected outcomes from using BIM)
from the inventory
Wheel (A) represents all Model Uses selected by the client; each blue shape representing a single Model Use
Each Model Use can be prioritised and assigned their geometric/informationalrequirements as specific to each project
Requirements:
85
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
Model Uses as a Performance Metric
Wheel (B) provides a summary of the team’s competency for each Model Use selected by the client
Abilities
The project team can then be assessed against the selected Model Uses using a variety of metrics – example:
the 5-level Competency Index
86 BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
Comparison:
requirementsa performance TARGET as defined by the client
Model Uses as a Performance Metric
abilities (capability/maturity)a team’ performance PROFILE as established through assessment
VS
Also available in Italian
87
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
III. Performance Improvement Lifecyclebringing it all together though the
SIX repetitive phases that apply to both STAGED and CONTINUOUS assessment methods
88
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
Performance Improvement Wheel
89
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
define vision, assessment hierarchy, metrics and timelineperformed by all parties
SCOPE1
90
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
establish current abilitiesperformed by 2nd party
ASSESS
2
91
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
collate results, analyse findings and generate a detailed reportperformed by 2nd party
ANALYSE
3
92
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
identify gaps, generate targets and action plans
performed by all parties
PLAN
4
93
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
implement, train,
standardise, purchase, develop, and track
by 1st or 3rd party
ACT
5
94
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
measure progress, test abilities, identify changes and achievements
performed by 2nd party
MEASURE 6
95
BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
IV. Summary
96
BIM Performance Assessment
Dr. Bilal SuccarDubai 2016
I. Introduction
II. Assessment Methods
c. how to Structure an Organisational Assessment
d. focus on the STAGED method
d1. understanding Capability Stages
d3. sample Template and Report
b. what is BIM Performance Assessment
e. focus on the CONTINUOUS method
e1. inventories of Competency Items and Model Uses
e2. sample Competency Assessment tools and charts
e3. sample Project Assessment based on Model Uses
III. Performance Improvement Lifecycle
IV. Summary and Good Bye
d2. understanding Maturity Levels
a. understanding BIM Wash
97 BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016
THANK YOU
BIMexcellence.com online assessment platform
BIMThinkSpace.com knowledge-sharing blog
BIMDictionary.com 600+ terms and descriptions
BIMframework.info Research blog