Institute for Environmental Studies...
Transcript of Institute for Environmental Studies...
![Page 1: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/1.jpg)
Scenarios in environmental and energy assessment
Frans Berkhout
Institute for Environmental Studies (IVM)
![Page 2: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/2.jpg)
2
Aims of the lecture
• To describe the uses of scenarios
• To give some historical background
• To define three scenario approaches
• To describe two scenario exercises and the lessons learned
![Page 3: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/3.jpg)
3
What is a scenario?
‘…archetypal descriptions of alternative images of the future, created from mental maps or models that reflect different perspectives on...future developments’
Rotmans and van Asselt, 1998
![Page 4: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/4.jpg)
4
What is a futures scenario?
Attracting
and
repelling
forces
Past Present Future
Future
state
2
Driving
forces
Sideswipes
Future
state
1
Future
state
3
Current
state
![Page 5: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/5.jpg)
5
Millenium Ecosystem Assessment scenarios
![Page 6: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/6.jpg)
Today’s weather forecast
6
Source: KNMI, 1 Nov 2009
![Page 7: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/7.jpg)
Oil price forecast
7
Source: Sals.aNewsletter,Feb 2009
![Page 8: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/8.jpg)
8
Aim of scenarios
‘...to illuminate choices of the present in the light of possible futures...’ (Godet, 1996)
i.e. not predictions
![Page 9: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/9.jpg)
9
Why scenarios?
• To conduct analysis in the future
• To conduct integrated analysis
• To illuminate long-term problems
• To develop common understandings of problems
• To explore robust solutions
• To facilitate and plan for change
![Page 10: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/10.jpg)
10
A short history of scenarios
Several intellectual roots:– Strategic planning (1950s, Thinking the Unthinkable,
Kahn) and operations research (1950s-60s)
– ‘Limits to Growth’ modelling (early 1970s, Forrester and Meadows) using computable systems analysis
– Corporate strategic planning (early 1970s, Shell) emphasizing narrative logics
– La Prospective (1980s) suggesting the integration of models and narratives
![Page 11: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/11.jpg)
11
Output from World2 (Meadows et al, 1999)
![Page 12: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/12.jpg)
12
Scenarios today
• Business strategy scenarios: understanding risk
• New conversation scenarios: opening up options
• Groups-in-conflict scenarios: understanding differences
• Public interest scenarios: developing common agendas and action
• Scientific scenarios: assessing long-range biophysical systems perturbed by human action
(Raskin, 2002)
![Page 13: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/13.jpg)
13
Global assessments
Global Scenarios Group (1995, SEI, environment, poverty)
Special Report on Emissions Scenarios (2000, IPCC, climate change)
Global Environment Outlook (2002, UNEP, environment)
Millennium Ecosystem Assessment (2005, MEA, ecosystem services)
![Page 14: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/14.jpg)
14
Futures scenarios: assumptions
• The future is unlike the past, and is shaped by human choice and action
• The future cannot be foreseen, but exploring the future can inform present decisions
• There are multiple possible futures, scenarios map a ‘possibility space’
• Scenario development involves rational analysis and subjective judgement
![Page 15: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/15.jpg)
15
When are scenarios appropriate?
• Discontinuous change is expected within normal planning horizons
• There is a perceived lack of ‘adaptive capacity’
• There is a risk of maladaptation to future conditions
• There are opportunities for positive gains from pursuing ‘robust strategies’
![Page 16: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/16.jpg)
16
Components of scenarios
Models
Indicators/parameters
Storylines
![Page 17: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/17.jpg)
17
Models, scenarios, stories
![Page 18: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/18.jpg)
18
Models to narratives
• Models are appropriate for simulating well-understood systems over short time-periods
• With higher complexity and longer time horizonsthe power of prediction diminishes
![Page 19: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/19.jpg)
19
Special challenges in building scenarios
• Indeterminacy in social and economic theory
• Emergence of novelty and innovation
• Reflexivity and volition
• Contested futures
![Page 20: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/20.jpg)
20
Scenario approaches
• Extrapolatory: quantitative, deterministic
• Normative: qualitative, visionary
• Exploratory: quantitative and qualitative, synthetic
![Page 21: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/21.jpg)
21
Uses of approaches
Extrapolatory
• Routine in planning and strategy
• Relationships and dynamics well-understood
• Assumption of continuity
• Well-defined expertise and methods
![Page 22: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/22.jpg)
22
Uses of approaches
Normative (ie ‘backcasting’)
• Becoming more common in corporate and policy communications
• Ad hoc approaches, no well-defined methods
• Assumption of control
![Page 23: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/23.jpg)
23
Use of approaches
Exploratory
• Not routine
• Relationships and dynamics not well-understood
• Expectation of discontinuity
• Poorly-defined and heterogenous methods
![Page 24: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/24.jpg)
24
Case 1: SRES Scenarios
• Need for emissions parameters for climate models
• Covers all radiatively important gases
• 4 ‘macro-regions’
• 6 modelling teams: AIM, ASF, IMAGE, MARIA, MESSAGE, MiniCAM
![Page 25: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/25.jpg)
25
Process
• Review
• Identify drivers
• Formulate narrative storylines
• Quantify storylines using models
• ‘Open’ review process
![Page 26: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/26.jpg)
26
Ground-rules
• No ‘business as usual’ scenario
• No probabilities ascribed
• No climate policy assumed
• No adaptation assumed
![Page 27: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/27.jpg)
27
Principal dynamics
• Population growth
• GDP growth
• Energy and technological change
• Land-use change
![Page 28: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/28.jpg)
28
The scenario dimensions
ECONOMIC
GLOBAL
ENVIRONMENTAL
REGIONAL
A1 A2
B1 B2
![Page 29: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/29.jpg)
29
Scenario storylines
A1: rapid economic growth, low population growth, rapid adoption of new technologies, convergence of regions, capacity building, increased social interaction, reduced region differences in per capita income
![Page 30: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/30.jpg)
30
Scenario storylines
A2: heterogenous world, self-reliance and local identities preserved, high population growth, regionally-specific economic growth, fragmented economic and technological development
![Page 31: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/31.jpg)
31
Scenario storylines
B1: convergent world with low population growth, transition to service and info economy, resource productivity improvements, clean technology towards global solutions
![Page 32: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/32.jpg)
32
Scenario storylines
B2: Divergent world with emphasis on local solutions to economic, social and environmental sustainability, moderate population growth, intermediate levels of economic growth, less rapid technological change
![Page 33: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/33.jpg)
33
SRES Scenario families
![Page 34: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/34.jpg)
34
SRES Emissions scenarios
![Page 35: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/35.jpg)
35
Global emissions scenarios
![Page 36: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/36.jpg)
36
Climate futures
Low, middle
and high:
temperatures
(compared to
1980-99)
![Page 37: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/37.jpg)
37
Climate scenarios (2007) + burning embers (2001)
![Page 38: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/38.jpg)
38
The pyramid of uncertainty
Source: Schneider, 2003
![Page 39: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/39.jpg)
Scenarios with probabilities
39
Source: DenElzen et al. 2007
![Page 40: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/40.jpg)
Types of uncertainty, probability and scenarios
40
![Page 41: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/41.jpg)
41
Some problems and weaknesses
• Conceptual framework not well specified
• Feedbacks between environmental and social and economic development not considered
• Too much emphasis on conventional drivers (I=PAT formula)
![Page 42: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/42.jpg)
42
Case 2: The UK Foresight ‘Environmental Futures’ framework
![Page 43: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/43.jpg)
43
Drivers and some outcomes
Berkhout and Hertin, 2002
![Page 44: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/44.jpg)
44
Method
• Facilitation of ‘stakeholder’ workshops
• Possibility space elaborated through associations created by the grid
• Principal of ‘symmetry’ in elaboration
• Synthesis and iteration
• Analysis of alternative strategies
• (Evaluation)
![Page 45: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/45.jpg)
45
Uses
• Scenario planning for policy and agencies– qualitative
– open, participative, multidisciplinary
– based on experience of practitioners
– one-off events (often workshops)
– Scenarios as communication tool
• Scenarios in scientific assessment– qualitative and quantitative
– expert-driven, some inclusive procedures
– use data and expert knowledge
– carried out over longer time periods
– scenario as assessment tool
![Page 46: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/46.jpg)
46
Examples
• Scenario planning in policy and agencies– Foresight Crime Prevention Panel
– Natural Environment Research Council
• Scenarios in scientific assessment– ACACIA Project
– National Water Demand Management Centre
– Digital Futures Project
![Page 47: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/47.jpg)
47
Lessons
Scenario exercises can play two roles:
• Expands the range of future outcomes that are considered in strategy/planning (policy learning)
• Engagement with scenario elaboration precipitates self-reflection, preparing the ground for change (organisational learning)
![Page 48: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/48.jpg)
48
Lessons: Getting the process right
• Preparation
• Workshop moderation
• Analysis and reporting– Symmetry
– Balance
– Triangulation
![Page 49: Institute for Environmental Studies (IVM)projects.knmi.nl/klimaat/autumnschool2012/Documents/Frans_Berkh… · Institute for Environmental Studies (IVM) 2 Aims of the lecture ...](https://reader034.fdocuments.us/reader034/viewer/2022050715/5f1e74f127847e71d52b7699/html5/thumbnails/49.jpg)
49
Summary
• Views of the future are ubiquitous
• Scenarios are one way of ordering views about the future
• Scenario approaches have a long history, especially in integrated environmental assessments
• There are different ways of conducting a scenarios exercise – some of them quite simple
• The results of scenarios are often difficult to embed in current decision-making