Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent...
Transcript of Guidelines on data reusability for eQuATIC · Higher Education Statistics Agency Hogeschool Gent...
Guidelines on data reusability for eQuATIC
eQuATIC Conference – 08/12/2016Paul Leys – Ghent University
Outline of the presentation
• Digging through the data
• Data reusability
• Data for eQuATIC
Digging through the data Data reusability Data for eQuATIC
Digging through the data Data reusability Data for eQuATIC
• Quantitative analysis: percentage of mobile master graduates
0 10 20 30 40 50 60 70 80 90 100
Political and Social Sciences
Pharmaceutical Sciences
Bioscience Engineering
Psychology and Educational Sciences
Veterinary Medicine
Economics and Business Administration
Engineering and Architecture
Medicine and Health Sciences
Sciences
Law
Arts and Philosophy
Ghent University
Credit mobility
Mobility joint masters
• Quantitative analysis: number of exchange students
0
250
500
750
1000
1250
1500
10-11 11-12 12-13 13-14 14-15 15-16
Incoming students
Outgoing students
Digging through the data Data reusability Data for eQuATIC
• Quantitative analysis: international students
0
20
40
60
80
100
120
140
160
180
Exchange
Degree
Phd
Digging through the data Data reusability Data for eQuATIC
• Participation on agreements student mobility
0
10
20
30
40
50
60
70
80
90
100
% Outgoing
% Incoming
% Total
Digging through the data Data reusability Data for eQuATIC
• Quantitative analysis: exchange balance
0
100
200
300
400
500
600
Outgoing students
Incoming students
Digging through the data Data reusability Data for eQuATIC
Country Average credits/day*Average
study success**Reference group
Denmark 0,17 94% 12
Germany 0,15 78,18% 100
Finland 0,15 70,7% 34
France 0,17 74,11% 81
Italy 0,15 58,82% 174
Lithuania 0,16 87,85% 39
Norway 0,16 73,5% 6
Austria 0,16 65,83% 11
Poland 0,16 77,45% 117
Portugal 0,18 71,14% 50
Spain 0,16 78,91% 354
*30 credits/sem =+/- 0,2 credits/day
**UGent average = 80%Exchange average = 70%
• Qualitative analysis: Study success
Digging through the data Data reusability Data for eQuATIC
• Qualitative analysis: Erasmus Student Survey
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
How satisfied are you with your Erasmus+mobility experience in general?
How satisfied were you with the support provided by your sending institution
Strongly agree Rather agree Neither disagree nor agree
Rather disagree Stronly disagree
Digging through the data Data reusability Data for eQuATIC
• Qualitative analysis: Internal Quality Assessment Survey
Digging through the data Data reusability Data for eQuATIC
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
How satisfied were you with the support provided by yoursending institution?: Support from student
initiatives/organisations
How satisfied were you with the support provided by yoursending institution?: Academic mentoring
How satisfied were you with the support provided by yoursending institution?: Administrative support arrangement
How satisfied were you with the support arrangements provided by your receiving institution
Strongly agree Rather agree Neither disagree nor agree Rather disagree Stronly disagree
Data reusability
• Registering doesn’t imply data is useable
Digging through the data Data reusability Data for eQuATIC
Digging through the data Data reusability Data for eQuATIC
Data reusability
• Registering doesn’t imply data is useable
• Data cleaning often required
• Need for definitions/standards
• Incentive for registration
• Structural modification in data repositories
Digging through the data Data reusability Data for eQuATIC
Standardisation of institutions
AHOVOSArtesis Plantijn Hogeschool AntwerpenArteveldehogeschoolDep O&VErasmus University RotterdamErasmushogeschool BrusselFlanders Knowledge AreaFreie Universität BerlinGerman Rectors' Conference (HRK)Georg-August-Universität GöttingenGhent UniversityHelsinki Metropolia University of Applied SciencesHigher Education Statistics AgencyHogeschool GentHowest University College West FlandersHowest, de hogeschool West-Vlaanderen
Karel de Grote University CollegeMetropolia University of Applied SciencesNational Research University Higher School of EconomicsNHTV Breda University of Applied SciencesOdisee vzwRadboud UniversityRotterdam University of Applied SciencesSP-aThomas MoreUC LeuvenUC Leuven Limburg vzwUC Leuven-LimburgUCLLUniversidade do MinhoUniversiteit AntwerpenUniversiteit Gent
Universiteit HasseltUniversity College (HoGent)University of Central LancashireUniversity of CyprusUniversity of GroningenUniversity of KentUniversity of LiègeUniversity of MinhoUniversity of PrimorskaUppsala UniversityVrije Universiteit BrusselWindesheim University of Applied Sciences
Digging through the data Data reusability Data for eQuATIC
Standardisation of institutions
• Erasmuscode: less or more stable - only Erasmus-countries high availability
• PIC: less stable than Erasmuscode – also non-Erasmus availability?
• Name instiution: not stable at all high availability
Digging through the data Data reusability Data for eQuATIC
eQuATIC
available comparable easy to readdata scores information
Digging through the data Data reusability Data for eQuATIC
Data behind indicators
• Performance of incoming/outgoing students
• Data on student mobility: institution; start & end date; ISCED
• Data on credits: #credits taken; #credits successfully completed
Sources: SIS, mobility software, other(?)
• Support and facilities
• Student satisfaction on support arrangements and facilities
Source: Erasmus+ participant report, own student survey (non-Erasmus)
Digging through the data Data reusability Data for eQuATIC
Data behind indicators
• Academic quality
• Student satisfaction on teaching and learning
Source: Erasmus+ participant report, own student survey (non-Erasmus)
• Rankings
• Ranking in ARWU, THE, QS
Yearly uploaded by super admin
• Course catalogue information
• Student feedback on completeness course catalogue
Source: Erasmus+ participant report, own student survey (non-Erasmus)
Digging through the data Data reusability Data for eQuATIC
Data behind indicators
• Exchange of mobility documents
• Student feedback on signing learning agreement and receiving transcript of records on time
• Availability of grading table in Egracons
Source: Erasmus+ participant report, own student survey (non-Erasmus)
Grading tables yearly updated by superadmin
• Mobility rate
• Data on mobility (student & staff): institution; start & end date; ISCED
Sources: SIS, mobility software, other(?)
Digging through the data Data reusability Data for eQuATIC
Data behind indicators
• Involvement
• Data on institutional agreements: institution, ISCED
Source: SIS, mobility software
• Mobility rate
• Data on mobility (student & staff): institution; start & end date; ISCED
Sources: SIS, mobility software, other(?)
Digging through the data Data reusability Data for eQuATIC
Data behind indicators
• Educational collaboration
• Data on projects funded by Educational budgets (e.g. Erasmus+)
• Data on joint programmes + graduates
Sources: SIS, mobility software, other(?)
• Research collaboration
• Data on projects funded by Research budgets (e.g. Horizon 2020)
• Data on joint-PhD’s
• Data on joint publications
Sources: SIS, mobility software, research database
Digging through the data Data reusability Data for eQuATIC
Data uploads
Digging through the data Data reusability Data for eQuATIC
Field of education
• Optional in all uploads
• Crucial for analysis at ‘faculty/department/programme level’
• ISCED2013 (data dictionary mobility tool)
Digging through the data Data reusability Data for eQuATIC
Data templates
• Reuse existing templates
• Participant report Erasmus+
• Reporting template Erasmus+ (+ credit information)
• Consistency in naming
• All column headers should be present
• Only relevant information
• One upload different for indicators (if all information is available)
Digging through the data Data reusability Data for eQuATIC
Data templates
Digging through the data Data reusability Data for eQuATIC
Data templates
• Field name schould exactly match
• Mandatory if * field is mandatory
• Possible value expected format (not for all columns)
• Data definition explanation
• Indicator indicators that use data upload
Digging through the data Data reusability Data for eQuATIC
Preparing data sets
• What if certain data is lacking?
• Data cleaning required
• Test with limited data set
Digging through the data Data reusability Data for eQuATIC
Standardisation of institutions
• If institution is not in eQuATIC database: “institution not found” notification
• Should be added by ‘super admin’
Data should be linked to correct institution (internal consistency)
Analysis over institutions: need to capture the right institution (externel consistency)
Some indicators based on general data upload
Digging through the data Data reusability Data for eQuATIC
Contact
Paul Leys
Project leader eQuATIC - [email protected]
Digging through the data Data reusability Data for eQuATIC