Developing a values scorecard
description
Transcript of Developing a values scorecard
![Page 1: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/1.jpg)
Developing a values scorecard
J. Stephen Town & Martha Kyrillidou
University of York, UK and ARLwith help from Katie Burn, University of
York
![Page 2: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/2.jpg)
Summary• The limitations of current measurement
for value, and hence for both planning and advocacy
• Understanding value and impact measurement
• The Library future value proposition emerging from scenario planning
• The development of a value scorecard which demonstrates transcendent value
![Page 3: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/3.jpg)
RIN Report on academic library challenges
“ … there is a strong feeling among senior librarians that they have failed effectively to communicate the value of their services [and]…in rigorously demonstrating the value of their activities”
“The focus of performance indicators up to now has tended to be on inputs and outputs … rather than addressing the much harder issues relating to impact and value. … we believe it is essential that more work is done to analyse the relationships between library activities … and learning and research outcomes … .”
![Page 4: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/4.jpg)
Forming strategy
• Rational/Classical– In the West increasingly shorter term– Generally increasingly economic
• Emergent/Scenario– Deals with uncertainty by offering options– May assist organisational vision more effectively– Helpful in public sector
![Page 5: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/5.jpg)
Limited planning horizons?
Dealing with the immediate or medium term
eg UK context:• Student fees increases• Research Excellence Framework 2014• Enhanced services at lower costs due to
economic crisisFrom UCISA-CISG ‘Brave New World’
![Page 6: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/6.jpg)
Scenario Planning in Libraries
• In use since mid ‘90s• US & UK Health Libraries
– “Knowledge Animal” for future Health Librarian• Various academic libraries
– Reading University Library• Academic Library collective
organisations– ARL to 2030– SCONUL to 2050
![Page 7: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/7.jpg)
“Each scenario has a gap where the library can fill itself in ….”
ARL 2030 Scenarios
![Page 8: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/8.jpg)
Effective Library Planning
• Ensure “learning organisation” approaches– Self reliance; ‘masters of our own destiny’– Shared vision and mental models– Systems thinking and coherence
• Combine formal planning with opportunistic (and crisis) driven emergent strategy
• Allocate resources accordingly• Requires effective change management
methods
![Page 9: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/9.jpg)
A QUEST FOR VALUE MEASUREMENT
![Page 10: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/10.jpg)
The distinction between Quality and Value
R. H. Orr. (1973). MEASURING THE GOODNESS OF LIBRARY SERVICES: A GENERAL FRAMEWORK FOR CONSIDERING QUANTITATIVE MEASURES. Journal of Documentation. 29 (3), p318.
![Page 11: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/11.jpg)
Recent work on impact & value• SCONUL/LIRG Impact initiative (2003-
05)• SCONUL VAMP initiative (2005-)• 8th Northumbria paper (2009)• IMLS LibVALUE project (2010-)• ACRL’s ‘Value of academic libraries’
(2010)• 3rd LAC paper (2010) see Library
Quarterly• Neal’s “polemic” and return to “virtues”
(2011)
![Page 12: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/12.jpg)
The Arguments (see Library Quarterly)
• Cross-pressures and failure to prove worth
• Worth is about value (and impact)• The value sought is transcendent• Library assessment has been about
(mainly) quality rather than value• Value is linked to values• Values provide the key and route to
proof of worth
![Page 13: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/13.jpg)
Consequences for the quest
• Measurement moves outside the ‘black box’
• Values are the starting point• Economic value is only one aspect• Institutional values will be helpful, but
some transcendent value may go beyond the institution, as the aim of the academy is itself transcendent
![Page 14: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/14.jpg)
Transcendence: beyond the black box
Abbott, Christine (1994). Performance Measurement in Library and Information Services. London: Aslib, The Association for Information Management. p19.
![Page 15: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/15.jpg)
The Transcendent Library
The transcendent library is one in which the value can be judged beyond immediate needs and demands, through contribution to less concrete aspects of institutional or societal intent
![Page 16: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/16.jpg)
Consequences for measurement
• More related to institutional intent• More about intangible benefits• More about a coherent and holistic
picture• About what leads to valuable
performance rather than quantifying value measures– Operationalising common good/social goals
![Page 17: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/17.jpg)
INSTITUTIONAL SCENARIOS AND CONSEQUENT VALUES
![Page 18: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/18.jpg)
ARL Scenarios 2030• What values are
assumed in the scenarios?
• How does this link to value?
• What is the resulting library value proposition?
![Page 19: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/19.jpg)
Value proposition analysis
• Overarching cultural values• Consequences for value-added in:
– Content– People– Relationships– Relevant services
• An ‘organism/persona’ vision for the future Library?
![Page 20: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/20.jpg)
Scenario 1: Research Entrepreneurs
• Competition and outsourcing
• Information value high
• Personality cult relationships
• Linking stores and discovery
![Page 21: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/21.jpg)
Scenario 2: Reuse and Recycle
• Collaboration• Information value
low• Relationships
across groups• Research
management and professional training
![Page 22: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/22.jpg)
Scenario 3: Disciplines in Charge
• Specialised Universities
• Data stores high value
• Political skills valued• Research information
decoupled & disaggregated
![Page 23: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/23.jpg)
Scenario 4: Global Followers
• End of Western hegemony
• IP looser?• Relations with
East critical• Global communal
library?
![Page 24: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/24.jpg)
SCONUL Library Scenarios 2050
Axes:
• Open or Closed Society/HE Values• Market or State HE provision
![Page 25: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/25.jpg)
Resulting scenarios
• ‘Beehive’: Open/State• ‘Wild West’: Open/Market• ‘Walled Garden’: Closed/Market• Discarded Closed/State
![Page 26: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/26.jpg)
Characterisations
Beehive
Wild West
Walled Garden
Community good; state controlCompetition; consumersInsularity; information protection
![Page 27: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/27.jpg)
Some measurement conclusions …
• Assumptions of elites throughout• Assumptions of competition throughout• Assumptions of quality throughout• Assumptions about values variable• Assumptions about locus variable• Assumptions about work psychology
variable
![Page 28: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/28.jpg)
Some conclusions for value …
• Value likely to be a differentiating factor in preparing for success (change and strategy)
• Change will be rapid and mitigation will be difficult
• Quality will be a constant requirement• Value measurement needs to assume
greater import alongside quality
![Page 29: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/29.jpg)
BUILDING A VALUE SCORECARD
![Page 30: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/30.jpg)
Values and Value measurement
• Value measurement must be linked to values
• Value measures cannot be chosen until the values set is agreed
• Institutional values statements are one current key source for considering value
• These may lack what arises from the scenario analyses
![Page 31: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/31.jpg)
Conclusions
• Traditional value measure tools will only provide a partial answer
• Some economic value tools may only reflect instrumental aspects
• Value requires assessment of more intangible benefits
![Page 32: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/32.jpg)
A possible institutional set (U of York)
• Excellence• Internationalisation• Inclusivity• Sustainability
![Page 33: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/33.jpg)
A potential Library set (U of York)
• Service– Customer focus– Welcoming and stimualting environment for L & R
• Scholarship– Collaboration with academic partners– Committed to supporting L & R in self and others
![Page 34: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/34.jpg)
A potential Library set (U of York)
• Style– Continuous improvement through creativity and
innovation– Openness, honesty and inclusivity in communication
• Respect– Promotion of equality of opportunity– Respect for each other and for individual
contributions
![Page 35: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/35.jpg)
Unmeasured assets?
Petros A. Kostagiolas & Stefanos Asonitis. (2009). Intangible assets for academic libraries. Library Management. 30 (6/7), p425.
![Page 36: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/36.jpg)
Corrall & Sriborisutsakul
Indicators for:• Human• Structural• Relational• Collections and serviceassets linked to institutional objectives
![Page 37: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/37.jpg)
A VALUE SCORECARDAn expression of the full worth of the academic research library
![Page 38: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/38.jpg)
The Value ScorecardDimension 1: Relational Capital
• Competitive position capital– Reputation– Reach
• Relational capital– External relationship development– Internal institutional relationship development
![Page 39: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/39.jpg)
The Value ScorecardDimension 2: Library Capital
• Tangible capital– Collections – Environments– Services
• Intangible capital– Intangible assets formed around the above (meta-
assets)– Organizational capital– Human capital
![Page 40: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/40.jpg)
The Value ScorecardDimension 3: Library Virtue
• Social Capital developed beyond the Library– Contribution to research– Contribution to learning– Contribution to employability– Contribution to professional and vocational intent– Contribution to inclusivity– Contribution to other common goods
![Page 41: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/41.jpg)
The Value ScorecardDimension 4: Library Momentum
• Capital saved or gained by progress– Capital assets developed early– Facilitation of research capital– Facilitation of learning capital– Facilitation of quality– Capital saved by sustainability
![Page 42: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/42.jpg)
Comparison with Balanced Scorecard
• Financial – broadened to capital development of all kinds
• Process – broadened to capital development intent
• Customer – beyond immediate satisfaction
• Learning – fundamental to human capital development but requires focus on intent
![Page 43: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/43.jpg)
Tests 1?
• Transcendent?• Values linked?• Cultural and Behavioural effect?• Coherent and full?
![Page 44: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/44.jpg)
Tests 2?
• Strategic relevance?• Institutional relevance?• Societal relevance?• Necessary and sufficient?• Balanced or choice of imbalance?
![Page 45: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/45.jpg)
Next Steps, Conclusions and Questions
• Population of the framework with existing value measurement methods, and identify what is missing
• Will this extend the limits of our current evidence gathering towards strategic planning and decision-making in terms of the key areas for future investment, and hence capital accumulation?
![Page 47: Developing a values scorecard](https://reader035.fdocuments.us/reader035/viewer/2022081604/568165cb550346895dd8d53c/html5/thumbnails/47.jpg)