Connecting Research American Evaluation Association - Anaheim, CA November 2011
description
Transcript of Connecting Research American Evaluation Association - Anaheim, CA November 2011
![Page 1: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/1.jpg)
Connecting Research
American Evaluation Association - Anaheim, CANovember 2011
![Page 2: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/2.jpg)
Agenda•show how a common data
dictionary can address the challenges of tracking impact in the research community•Challenges•Options•CASRAI approach
![Page 3: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/3.jpg)
Challenges
![Page 4: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/4.jpg)
Challenges
•efficiency•multiplicity•clarity
![Page 5: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/5.jpg)
Efficiency challenges
•doing vs measuring•capturing vs remembering
![Page 6: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/6.jpg)
Multiplicity challenges
•multiple participants•multiple disciplines•multiple institutions•multiple funders•...all on multiple projects
![Page 7: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/7.jpg)
Clarity challenges
•terminology•comparability•identifiability•... all across multiple independent
players
![Page 8: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/8.jpg)
Options
![Page 9: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/9.jpg)
Options
•standardize the hosting•standardize the software•standardize the storage format•standardize the data dictionary
![Page 10: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/10.jpg)
CASRAI approach
![Page 11: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/11.jpg)
Modular dictionary
•Terms, definitions, relationships, thesauri
•Core, discipline, jurisdictional layers
•Simple and compound elements
![Page 12: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/12.jpg)
Exchange format•any concept representable as data•any data representable as
documents•any exchange processable•a common ‘currency’ for
information
![Page 13: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/13.jpg)
Evaluation: what•Multiple frameworks of research measurement
can share common source data•The impact of people and projects on:•Capacity (human, physical, integration)•Knowledge & Innovation (quantity & quality)•Society (economic, health, culture ,
environment)
![Page 14: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/14.jpg)
Evaluation: how•Linking inputs to outputs•If it can be recorded it can be
identified•Example: person on project with
funding produced output resulted in impact
![Page 15: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/15.jpg)
© casrai.org
CASRAI Dictionary
1) Elements where meaning* & structures are used by all nations and all disciplines
Nation-specificNation-specific
Core DisciplineCore Discipline
Core CommonCore Common
2) Extensions to above elements that are unique by discipline3) Extensions to above elements that are unique by nation
Common concepts defined, structured and identified
* Including common classifications and constrained list values.
![Page 16: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/16.jpg)
© casrai.org
can be reused to generate...
Any database with...PersonPerson
ID, Contact, ID, Contact, Education, Education,
Employment, Employment, DistinctionsDistinctions
ContributionsContributionsID, Outputs, ID, Outputs,
Outcomes, ImpactsOutcomes, Impacts
ProjectProjectID, Proposal, Team, ID, Proposal, Team, Partners, Funding Partners, Funding
RequestsRequests
OrganizationOrganizationID, Institution, Funder, ID, Institution, Funder,
PartnerPartner
FundingFundingID, Source, Program, ID, Source, Program,
Amount, PeriodAmount, Period
InfrastructureInfrastructureID, Host Org, ID, Host Org,
UtilizationUtilization
AcademicCV
FundingApplication
FinancialReportCompliance
Reports
CommercialImpact Report
Quality of Life
Impact Report
ProgressReport
Proposal
Statementof Intent
Dean’sReport
Funding ResultsPeer Review
ReportPublic
CV
Funding Opportunities
PublicationsList
![Page 17: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/17.jpg)
© casrai.org
Using any softwareCONCEPTS RECORDED:
researchers and organizations in projects produce outputs with impacts
Proposals
CONCEPTS SHARED.
CVs
Reports
![Page 18: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/18.jpg)
Recap•Research = multiplicity•Harmonization = efficiency/clarity•Harmonization = HARD (dictionary less
hard)
•Impact = evidence that can be connected
![Page 19: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/19.jpg)
© casrai.org
Why connect the dots?
Save time
See patterns
Build bridges
Estimated time* spent administering research grants rather than doing the research.
42%
* Source: US-FDP
Identifiers reveal links between research inputs and outputs. Common dictionary enables better evidence for comparing and benchmarking.
Easier for researchers to collaborate across boundaries of discipline, institution, region, nation. Easier for organizations to raise or lower the information draw-bridge throughout the coopetition lifecycle. Position your organization as a champion of harmonization and standards.
![Page 20: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/20.jpg)
© casrai.org
CASRAI StatusAdoption momentum within national and regional funders and universities.
Discussions started with NSF and NIH towards collaboration options.
Endorsement by eruoCRIS and moving towards adoption of CASRAI dictionary within CERIF.
Introductions & first presentation made to the National Science Foundation of China. A commitment to explore options for collaboration.Discussions being planned for participation in Australia. Forum for European-Australian Science & Technology Cooperation (FEAST) acknowledges CASRAI in a recent discussion paper as a key opportunity for interoperability.
![Page 21: Connecting Research American Evaluation Association - Anaheim, CA November 2011](https://reader036.fdocuments.us/reader036/viewer/2022062323/56815cbe550346895dcac1b5/html5/thumbnails/21.jpg)
Connecting Research
Thank-you.