Dynamic approaches to value
-
Upload
stephen-town -
Category
Education
-
view
351 -
download
0
Transcript of Dynamic approaches to value
![Page 1: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/1.jpg)
Measurement and assessment in the research library:
Dynamic approaches to value
J. Stephen TownDirector of Information & University Librarian
University of York, UK
LISC75University of Cape Town Friday 28th November 2014
![Page 2: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/2.jpg)
75TH CONGRATULATIONS! … AND INTRODUCTION
Greetings from York
![Page 3: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/3.jpg)
The 600th Anniversary of the York Library
The 1414 Library, York Minster
![Page 4: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/4.jpg)
http://hoaportal.york.ac.uk/hoaportal/yml1414.jsp
![Page 5: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/5.jpg)
The First York Library (8th C)
“per bonam et deuotissimam magistri mei industriam uel etiam mei ipsius qualecumque sudorem”
Alcuin of York
![Page 6: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/6.jpg)
Aelbehrt & Alcuin
[The library was assembled]: “by the good and most devoted industry of my magister and also by some of my own perspiration”
“industria should be translated as ‘by his own good and most devoted plan,’ and sudor is sweat, the perspiration of the copyist’s heavy toil.”
Dr Mary Garrison, University of York
![Page 7: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/7.jpg)
In a dynamic landscape …
• Capturing the value proposition– Achieving, developing and valuing innovation– Transcendent contribution
• A Scorecard framework (the “plan”)• Implementation cases (“the sweat”)• The Research agenda and challenges for
measurement
![Page 8: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/8.jpg)
DYNAMISM, INNOVATION, & MEASUREMENT
The Landscape and the Response
![Page 9: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/9.jpg)
HE Measurement future
“There is no alternative but to play the impact game”
“… looking for more indicators of learning [and research] outcomes”
“there are some great individual stories, but we want to put more ‘quants’ around them”
Madeleine Atkins, CEO, HE Funding Council (England)
![Page 10: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/10.jpg)
The Dynamic Environment (after Shore, E.)
• The end of research library coherence (1880-1980)• Coherence will only be regained “above campus
scale” through partnership• The end of ‘black box’ measurement alone• Innovation required to re-achieve coherence,
through– Digital infrastructure– Sustainable funding– Publication form control
![Page 11: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/11.jpg)
Innovation requirements
Gentle, P.
Strategic & structural change to accommodate innovation, which …
– Bridges silos– Fosters culture & sets tone– Supports disruptive ideas– Sees and hears unfiltered
concepts
Corrall, S./Kanter, R.M.
– Widen search; broaden scope
– Tighten human connections between innovators and others
– Loosen formal controls and silos
– Spectrum from incremental to ‘big bets’
– Even technologists need relational and communication skills
![Page 12: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/12.jpg)
Innovation: Research Library responses
Jantz, R.C.Innovation in ARL libraries
– Collaborative leaders– Flatter structures– ‘Ambidexterity’– More transformational
styles– A more innovative
climate
Deiss, K.J.Political acumen
– Creating services that add value take precedence …
– Create public value– Customer readiness– Effective communication– Relationship
management
![Page 13: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/13.jpg)
One response …
“Information” level management and strategy
“Intelligence” in social and technical solutions
• Impact proof• Innovation delivery• Infrastructure
sustainability• Intimacy with markets
and partners
![Page 14: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/14.jpg)
THE VALUE SCORECARDDimensions and implementation
![Page 15: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/15.jpg)
The Value Scorecard
![Page 16: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/16.jpg)
The distinction between Quality and Value
R. H. Orr. (1973). MEASURING THE GOODNESS OF LIBRARY SERVICES: A GENERAL FRAMEWORK FOR CONSIDERING QUANTITATIVE MEASURES. Journal of Documentation. 29 (3), p318.
![Page 17: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/17.jpg)
![Page 18: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/18.jpg)
![Page 19: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/19.jpg)
The Balanced Scorecard
![Page 20: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/20.jpg)
Value & Balanced Scorecards
![Page 21: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/21.jpg)
Distinctions …
Balanced Scorecard
• Balanced• Simple• Performance• Discrete measures• Single targets• Direct data
Value Scorecard
• Unbalanced to suit context• Complex• Insight & prediction• Connected• Correlation aim• Narrative & advocacy
![Page 22: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/22.jpg)
Initial Template (BS plus VS)
![Page 23: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/23.jpg)
York levels of input
• Service Unit template reporting (Quarterly)• Internal initiatives
– Action plans from surveys, feedback, lean– Strategy projects
• National & collaborative initiatives & services– UK Customer Service Excellence standards ( & RLUK)– LAMP; CCM; Research data; OA Publications– LibQUAL+; TechQUAL; ClimateQUAL
• Corporate data (analytics)– HR institutional data; UoY Staff Survey; benchmarks– Library and other system data
![Page 24: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/24.jpg)
LIBRARY CAPITALDimension II
![Page 25: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/25.jpg)
The Library Capital dimension
Tangible capital
– Collections value data– Services value data– Environments value data– Valuation and link to
values
– Correlation between this, and impact, and transcendent effects
Intangible capital
– Meta-assets value data– Organizational value data– KM & intellectual value data
– Correlation between this, and impact & capital growth
![Page 26: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/26.jpg)
Increasing asset value at meta-level …
![Page 27: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/27.jpg)
Human Capital
Enablers (4 ‘C’s)
– Capacity• Minus confounders
– Absence, turnover
– Capability• Talent: raw & growth• Critical mass
– Climate of Affect• Engagement• Emowerment
– Culture of momentum• Enablement• Programme capability• Maturity
Outcome proofs
– Market fit• Sustainability• Market related impact
– Strategic fit (over time)• Quality & Improvement• New product development
– Contribution to• Productivity• Creativity
– Competitive impact• Service development• Reputational investment
![Page 28: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/28.jpg)
York Information structure
![Page 29: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/29.jpg)
People Strategy: some components
• Corporate data & benchmarking• Structure & organizational change• Talent-Engagement-Enablement• Development portfolios• Management development• Customer Service Excellence standard• Collaborative leadership
![Page 30: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/30.jpg)
People development metrics
![Page 31: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/31.jpg)
People development metrics
![Page 32: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/32.jpg)
ClimateQUAL vs UK and US Mean
Climate for Continual LearningClimate for Customer ServiceClimate for Deep Diversity, Standardization of Procedures
Climate for Deep Diversity, Valuing Diversity
Climate for Racial Diversity
Climate for Gender Diversity
Climate for Diversity of Ranks
Climate for Sexual Orientation Diversity
Co-worker Support for Innovation
Distributive Justice
Procedureal Justice
Interpersonal JusticeInformational JusticeClimate for Psychological SafetyClimate for Teamwork, Benefit of Teams
Climate for Teamwork, Structural Facilitation of Teamwork
Job Satisfaction
Leader-Member Relationship Quality
Authentic Leadership
Organizational Citizenship Behaviors
Organizational Commitment
Organizational Withdrawal
Team Psychological Empowerment
Task Engagement
Interpersonal ConflictTask Conflict
0
5
10
York UK Mean US Mean
![Page 33: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/33.jpg)
Too many approvals are needed for routine decisions in my Department*
*Results adjusted for negative phrasing (ie low score is bad, high score is good)
![Page 34: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/34.jpg)
The pace of change in the University over the past three years has been positive by Tenure and Age
![Page 35: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/35.jpg)
Customer Service Excellence
Award assessed:March 2014
Achieved with two “Compliance plus” scores:Customer Insight Delivery
![Page 36: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/36.jpg)
Assessor comments
“The Directorate values customer engagement highly … to ensure that customers experience and views are included”
“There are particular strengths about learning from best practice and presenting projects externally…”
“The Information Directorate is a highly focused service delivered by staff who are professional, polite and helpful. It is … forward thinking and proactive … actively working to enhance services …”
![Page 37: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/37.jpg)
Capability Maturity Model (see Wilson)
Ad Hoc
Repeatable
Defined
Managed
Continuous
1
2
3
4
5 Continuous Improvement, innovative ideas
Detailed measures, controlled
Integrated Process
Basic processes, repeated success
Initial, ad hoc
![Page 38: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/38.jpg)
RELATIONAL CAPITALDimension IV
![Page 39: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/39.jpg)
Measurement dimensions
Relationship Capital
– = sum of all relationships– “Goodwill” value increase assessment– Relational data (=strength?)– Correlation between this, direction, activity,
impact & capital growth
![Page 40: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/40.jpg)
Relationship Capital - 6 ‘Cs’
Awareness & Fit
• Consciousness– General audit of relational
spaces (7 market model)• Congruence
– Degree of fit of relationship activity to parent institution (gap analysis)
Strength & Process
• Communities– Assessment of strength level
across all relations• CRM data• Strength index
• Communication– Measures of the process of
communication for relationship development
• Communications audit• Down to individual level
![Page 41: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/41.jpg)
Relationship Capital market model
![Page 42: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/42.jpg)
Relationship Capital sub-frame
Return on relationships
• Causality– Specific outcomes of positive
relationships on academic process, innovation, finance, quality & staff development
• Comeback– Specific ensuing returns to
the Library of repeat benefits of relationships
– Transaction costs saved through Trust
![Page 43: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/43.jpg)
Measuring relational strength
Item RatingDoes the ALL regularly attend Board of Studies?
Is there a specific departmental library committee?
Does the ALL regularly attend other departmental meetings (e.g. undergraduate committee)?
Is the ALL on departmental staff mailing lists?
Does the department keep the ALL up-to-date with general developments in the department?
Is the ALL in regular contact with the Library Rep (in person, phone or email)
How is the relationship between the ALL and the Library Rep?
Does the Library Rep regularly attend Library Committee?
Does the department regularly ask for feedback on the library on module feedback?
To what extent is information literacy training embedded in the UG programme?
To what extent is information literacy training embedded in the PGT programme?
Does the ALL deliver PGR training?
![Page 44: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/44.jpg)
Departmental action plans: Data
![Page 45: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/45.jpg)
![Page 46: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/46.jpg)
![Page 47: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/47.jpg)
Engagement narrative
“[The Department] have for a long time had a fairly arm’s length engagement with the Library though I believe that a significant number of students and staff have been regular and frequent users of the Library both for physical and electronic resources.
Over the past few years engagement has increased with more active liaison between the Library and the department both via contact with the Library Representative and via attendance at BoS and Staff-student Consultative Committee.”
![Page 48: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/48.jpg)
MOMENTUMDimension III
![Page 49: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/49.jpg)
Measurement dimensions
Momentum
– “= mass x velocity”– Alignment proof– Progress data– Correlation between capital development through
projects and time– Volume , pace, culture, and meta-assessment of
organizational capability
![Page 50: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/50.jpg)
Information Strategy
![Page 51: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/51.jpg)
Strategy Programmes
![Page 52: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/52.jpg)
Strategic KPIs (“clear departmental KPI toolkit”)
1. Meet need …2. Resource …3. Innovate …4. Engage …5. Align …6. Risk …
… satisfaction measures… financial measures… new services… relational strength… University fit… failure avoidance
![Page 53: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/53.jpg)
Programme momentum
![Page 54: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/54.jpg)
Project momentum
![Page 55: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/55.jpg)
VIRTUEDimension I
![Page 56: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/56.jpg)
York UK NSS result trends
![Page 57: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/57.jpg)
York UK LibQUAL+ result trends
![Page 58: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/58.jpg)
Reference analytics
![Page 59: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/59.jpg)
Impact correlation: LAMP Wireframes
![Page 60: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/60.jpg)
Collecting the narrative …
![Page 61: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/61.jpg)
CONCLUSIONSImplementing the Value Scorecard
![Page 62: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/62.jpg)
The Scorecard score?
• Virtue– Work to do on impact
• Library Capital– Human good progress; other tangible mixed
• Relationships– Progress; CRMs in sight; partnership importance
• Momentum– Good progress on innovation & use in advocacy
Overall need to move to correlations
![Page 63: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/63.jpg)
Research agendas
• Practical applications of value measurement• Innovation and impact evaluation• Big data sets• Visualisation• Dashboard production• Predictivity of intervention proofs
![Page 64: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/64.jpg)
Social capital and value
“There are intelligent [libraries] and stupid [libraries] … intelligent groups gather information better and adapt better to reality… thus we find ‘social intelligence’
Luis Anglada (2007) quoting Marina (2004)
![Page 65: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/65.jpg)
Acknowledgments
• Ian Hall, Ruth Elder, Sarah Thompson, Michelle Blake, Karen Smith, and all data contributing teams at UoY
• The York Manuscripts Conference 2014• RLUK Conference 2014• Wollongong University• Matt Stripe & HR colleagues, Nestle (UK & Ire)
![Page 66: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/66.jpg)
Sources
• Value, Impact and the Transcendent Library. Library Quarterly 81(1). 2011. 111-124.
• The value of libraries in Baker & Evans (eds) Libraries and society. Chandos, 2011. 303-325.
• With Kyrillidou, M. Developing a values scorecard. Performance Measurement & Metrics 14(1) 2013. 7-16.
• The value of people. Performance Measurement & Metrics 15(1) 2014. 67-80.
Forthcoming• Relationship capital. Library Management 2015
![Page 67: Dynamic approaches to value](https://reader030.fdocuments.us/reader030/viewer/2022011722/58f37bde1a28ab763a8b458d/html5/thumbnails/67.jpg)