Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002...
-
Upload
donna-griffith -
Category
Documents
-
view
214 -
download
0
Transcript of Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002...
![Page 1: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/1.jpg)
Reporting Results -Reporting Results -Audiences and UsesAudiences and Uses
Effectiveness Evaluation Workshop
Victoria, November 7, 2002
Tom Niemann, Ministry of Forests
![Page 2: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/2.jpg)
![Page 3: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/3.jpg)
Why report? BC’s forest policy development
Results based code Tenure policy Land use planning
![Page 4: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/4.jpg)
Why report? BC’s forest policy development Market access
information on SFM certification
![Page 5: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/5.jpg)
Why report? BC’s forest policy development Market access Public’s keen interest in SFM
environment jobs recreation
![Page 6: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/6.jpg)
Why report? BC’s forest policy development Market access Public’s keen interest in SFM Federal commitments
Montreal Process C&I CCFM C&I National Forest Strategy
![Page 7: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/7.jpg)
Why report? BC’s forest policy development Market access Public’s keen interest in SFM Federal commitments
One set of indicators? Report once for all?
![Page 8: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/8.jpg)
What Audiences? Policy makers
JMC JSC Cabinet
![Page 9: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/9.jpg)
What Audiences? Policy makers Industry audiences
workers, shareholders buyers, consumers certification auditors
![Page 10: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/10.jpg)
What Audiences? Policy makers Industry audiences Public (BC and international)
individuals (well informed and not) media communities (PAGs, local government) NGOs
![Page 11: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/11.jpg)
What Audiences? Policy makers Industry audiences Public (BC and international) Agencies
Forest Practices Board BC Timber Sales federal
![Page 12: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/12.jpg)
Policy makers Industry audiences Public (BC and international) Agencies
Some indicators can serve several.Different reports!
What Audiences?
![Page 13: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/13.jpg)
Reporting Issues?
Inform? or Persuade?
![Page 14: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/14.jpg)
Reporting Issues?
Inform? Support dialogue on SFM
Balanced, credible Good news and bad news Avoid bias in:
selection of indicators assessment of indicators presentation of results
![Page 15: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/15.jpg)
Reporting Issues?
Inform? or Persuade? Support change in
policy programs for monitoring, research… opinions
Methods and data are IMPECCABLE! Results are JUST SUPER!
May backfire
![Page 16: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/16.jpg)
Reporting Issues?
Inform? or Persuade? Scale
FMU, province, nation, global Values, monitoring methods vary with scale
TSAs, TFLs: 10,000 ha - 14,800,000 ha
“Rolling up” data often does not work Ecosystems cross administrative borders,
so TEAM UP!
![Page 17: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/17.jpg)
Reporting Issues?
Inform? or Persuade? Scale Time period
Trends are more important than state Choice of reporting period can change
apparent trend Forecasts
![Page 18: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/18.jpg)
Time period
time
aspect
![Page 19: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/19.jpg)
Time period
time
aspect
![Page 20: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/20.jpg)
Time period
time
aspect
![Page 21: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/21.jpg)
Time period
time
aspect ?
![Page 22: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/22.jpg)
Reporting Issues?
Inform? or Persuade? Scale Time period Only a few evaluations per year
Values change over time FPC 1995, 2002 CCFM C&I 1995, 2003
Can we assess SFM?
![Page 23: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/23.jpg)
Reporting Issues?
Inform? or Persuade? Scale Time period Only a few evaluations per year Thresholds
scientific, public, political often difficult or unknown What if only 1 of 6 evaluations > threshold?
![Page 24: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/24.jpg)
Reporting Issues?
Inform? or Persuade? Scale Time period Only a few evaluations per year Thresholds Uncertainty and Risk
When do we know policy needs to change? Accountability (“blame”)
![Page 25: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/25.jpg)
Summary
Reporting is not simple Effectiveness evaluations can inform
a variety of reports We have to look for synergies,
a.k.a. cost savings Co-operation will help us make
progress towards SFM…..
![Page 26: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/26.jpg)
Blank slide
![Page 27: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/27.jpg)
Sustainable forest management
Management to maintain and enhance the long-term health of forest ecosystems, while providing ecological, economic, social, and cultural opportunities for the benefit of present and future generations. Canadian Council of Forest Ministers, 1992
![Page 28: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/28.jpg)
Montreal Process criteria
1. Conservation of biological diversity
2. Maintenance of productive capacity of forest ecosystems
3. Maintenance of forest ecosystem health and vitality
4. Conservation and maintenance of soil and water resources
5. Maintenance of forest contribution to global carbon cycles
6. Maintenance and enhancement of long-term multiple socio-economic benefits to meet the needs of societies
7. Legal, institutional and economic framework for forest conservation and sustainable management
![Page 29: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/29.jpg)
Example: MP Indicators1.1 Ecosystem diversity
Extent of area by forest type relative to total forest area Extent of area by forest type and by age class or
successional stage Extent of forest type in protected area categories (IUCN or
other) Extent of area by forest type in protected areas defined by
age class or successsional stage Fragmentation of forest types
1.2 Species diversity (2 indicators)
1.3 Genetic diversity (2 indicators)
![Page 30: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/30.jpg)
Canadian (CCFM) criteria
1. Conservation of biological diversity
2. Maintenance and enhancement of forest ecosystem condition and productivity
3. Conservation of soil and water
4. Forest ecosystem contribution to global ecological cycles
5. Multiple benefits to society
6. Accepting society’s responsibility for sustainable development
![Page 31: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/31.jpg)
Example: CCFM Indicators1.1 Ecosystem diversity
% and extent, in area, of forest types relative to historical condition and to total forest area
% and extent of area by forest type and age class 1.1.3 area, % and representativeness of forest
types in protected areas level of fragmentation and connectedness of
forest ecosystem components.
1.2 Species diversity (3 indicators)
1.3 Genetic diversity (1 indicator)
![Page 32: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/32.jpg)
Canadian (CCFM) C&I documents
Defining SFM (CCFM C&I) - 1995
C&I of SFM, Progress to date - 1997 C&I of SFM, Technical report - 1997
First national report on C&I - 2000(62 of 83 indicators)
![Page 33: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/33.jpg)
Technical Challenges
understanding data sources data standards data quality clear definitions sampling designs trend detection analytical tools efficient processes
consistent reporting accessibility of
information security of proprietary
data qualitative changes
over time archiving information
![Page 34: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/34.jpg)
Administrative Challenges
commitment budget reductions staff workloads
partnerships management cycle
![Page 35: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/35.jpg)
Political Challenges
commitment process scope / jurisdiction potential for impact
![Page 36: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/36.jpg)
Management Cycle
Plan
Set Objectives
ImplementEvaluate
Monitor
Adjust
![Page 37: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/37.jpg)
Management Cycle
Plan
Set Objectives
ImplementEvaluate
Monitor
Adjust
![Page 38: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/38.jpg)
Presentation policy makers, public, agencies
relevant to values/issues credible, comprehensive indicators clear, concise language
people with little time clear design to help find parts of interest
domestic and international Canadian values clear links to international work
![Page 39: Reporting Results - Audiences and Uses Effectiveness Evaluation Workshop Victoria, November 7, 2002 Tom Niemann, Ministry of Forests.](https://reader035.fdocuments.us/reader035/viewer/2022062805/5697c0021a28abf838cc2e1a/html5/thumbnails/39.jpg)
Top-down and bottom-upGeneralities Sustainable
forestmanagement
Goal Vision
Maintainbiodiversity
Principle Wisdom
Ecosystemdiversity
Criterion Knowledge
Old growth Indicator Information
Specifics CarmanahGiant
Observation Data