teamwork respect honesty and care - Care Honesty Teamwork ...
Detection of Teamwork Behaviors as Meaningful Exploration ... · Development of Autonomous Vehicle...
22
Detection of Teamwork Behaviors as Meaningful Exploration of Tradespace during Project Design Puay Siang TAN, MIT [email protected] Dec 07, 2018
Transcript of Detection of Teamwork Behaviors as Meaningful Exploration ... · Development of Autonomous Vehicle...
Detection of Teamwork Behaviors as Meaningful Exploration of Tradespace during Project Design Puay Siang TAN, MIT [email protected] Dec 07, 2018
19 April 2
Team of Teams working on Systems of Systems
Measuring Performance for Complex Problem Solving
19 April 3
About the Research
Study of Teamwork Behaviors of Team of Teams by
Quantifying team performance
Visualizing patterns in making project trade-offs
Detecting coherence in decision making
Teamwork Behaviors
4
Management
Project Director
Team 4
Team 2
Team 1
Team 3
Team of Teams
Mesoscale
Inter-functional
groups and teams
19 April
Macroscale
Total Projects and
Portfolios
Microscale
Individuals and
Small Teams
Modelling Approach to Measure Team Performance
5 19 April
Products
Team of Teams
Project Design
Activities
Model complex engineering project as a system
19 April
Capture dependencies between resources, activities and products
Simulate project outcomes to forecast cost and schedule
Development of Autonomous Vehicle
7
120 Minutes Challenge
19 Design Groups
1 Common Baseline
Change Team Size,
Location, Abilities
Add/ Remove
Products
Add / Remove Activities, Change
Complexity and Dependencies
19 April
Photo: www.mit.edu
19 April 8
Tradespace Exploration
Pro
ject
Co
st
Project Duration (days)
Common Starting Point
19 April Credit: © Bryan Moser
Defining Team Performance
9
Tradespace Exploration
Cost
Duration (Days) Utopia Point
Pareto Frontier:
Region of Non-Dominated
Solutions
Non-Dominated Solutions:
Not out-performed by others
in both cost and duration
19 April
Project Outcomes A better performing
Design Group has:
More non-dominated
project outcomes
More project outcomes
on a Pareto Frontier
19 April 10
Methodology to Quantify Team Performance
Common Baseline
Data Analysis
Pareto Frontier 1
1 Identify non-dominated solutions to
draw the 1st Pareto Frontier.
19 April
Pareto Frontier 2 Remove all points on Pareto Frontier 1
to allow Pareto Frontier 2 to emerge. 2 Pareto Frontier 3
Repeat process till all dots are identified
on respective Pareto Frontiers 3
Each Design Group
is denoted by a
different color
Each dot is a project
outcome simulated
by the Design Groups
Total of 529 project
outcomes simulated in 120
mins by 19 Design Groups
Defining Ranking Logic
12
Pareto
Frontier
No of Project Outcomes per Design Groups
A B C D E
1 2 1
2 1
3 2 2
4 3 2
Design
Group
Rank
A 1
B 2 Rule 1:
Design Groups with project outcomes in the earlier Pareto Frontiers are ranked higher
Rule 2:
Within a Pareto Frontier, Design Groups with more project outcomes are ranked higher
Rule 3:
For ties, keep comparing at subsequent Pareto Frontiers (with Rule 1 & 2) till tie breaker occurs.
19 April
Design
Group
Rank
A 1
B 2
C 3
Design
Group
Rank
A 1
B 2
C 3
D 4
E 5
19 April 2016 13 19 April
Visualizing Tradespace Explorations with
Project Design Tree Diagrams
Tree Diagrams
19 April 2016 14
70 72
52 58 59 60 61 62 63 66 65 69
76 78 79
81
83
84
67 48 53 49 57 73 64 71 77 80 82 86 90 91
19 April 2016 19 April
11
Baseline:
Project Model ID 11
A circle represents an iteration simulated to obtain a project outcome
Project models build on from previous models forming
Iteration Streams during tradespace exploration
Chain Like
Branches
19 April 2016 15
11
70 72
67 48
52
53 49 57
58 59 60 61 62 63
73
66 65
64
69
71
76
77
78 79
80
81
82
83
84
86 90 91
19 April 2016 19 April
Color Code Tree Diagrams
Color codes reveal type of changes in each iterations
19 April 2016 16 19 April 2016 19 April 2016 19 April
Meaningful Explorations Top Performing Group
Bottom Performing Group
Insights from Tree Diagrams: Top Performing Group has many iterations
with changes (colored circles) than Bottom Performing Group.
Top Performing Group has many branches but Bottom Performing has none.
Meaningful Iteration Stream
Meaningful Iteration Streams
No Meaningful Iteration Streams
Meaningful Iteration Stream
is an Iteration Stream with more than
five (5) iterations with changes
Investigating Indicators for Team Performance
19 April 2016 17 19 April 2016 19 April 2016 19 April 2016 19 April
Similar Trend for No of Iterations and Iterations with Changes
Rank #1
Rank #19
Total No of Iterations No of Meaningful Iteration Streams No of Iterations Streams
No of Iterations with Changes
19 April 2016 18
No of Iterations of Changes No of Meaningful Iteration Streams
Downward Trend for Bottom 10 Design Groups
19 April 2016 19 April 2016 19 April 2016 19 April 2016 19 April
Investigating Indicators for Team Performance
Detecting Coherence in Decision Making
19 April 2016 19
Chunking the Tree Diagram
19 April 2016 19 April 2016 19 April 2016 19 April 2016 19 April 2016 19 April 2016 19 April
Meaningful Iteration Stream 1
By observing segmented
chunks to see the “blocks of
changes” may further reveal
if the Design Group are
coherent in their decision
making by measuring how
focused they are
• Meaningful Iteration Streams is a better indicator of Team Performance
• Measuring how focused a Design Group is during decision making process can be defined as an Indicator of Coherence
• A Design Group with coherence may signal a better chance of meaningful changes made during tradespace exploration
19 April 2016 20
Conclusions from Experiment
19 April 2016 19 April 2016 19 April 2016 19 April 2016 19 April 2016 19 April
19 April 2016 21
Conduct Similar Experiment in Real-World Industry
Further refinement of the framework in evaluating team performance
Provide real-time feedback on team interactions & performance in organizations
Measurement of Team Learning Effects
Repeat Design Challenge with same participants 2-3 months later
Measure any learning effects arising from Project Design Challenge
19 April 2016 19 April 2016 19 April 2016 19 April 2016 19 April 2016 19 April 2016 19 April 2016 19 April
Future Work
19 April 2016 22
Conference Proceedings
19 April 2016 19 April 2016 19 April 2016 19 April 2016 19 April 2016 19 April 2016 19 April 2016 19 April 2016 19 April
Available @ [email protected]
Tan Puay Siang and Bryan Moser,
Detection of Teamwork Behaviors as Meaningful
Exploration of Tradespace during Project Design,
Complex Systems Design & Management Asia 2018,
Volume 878, p73-87
