If less is more, how to keep score
Participation on agreements student mobility
100
90
80
70
60
50
40
% Outgoing
30
% Incoming
20
% Total
10
0
Introduction
Digging through the data
eQuATIC framework
Peer assessment
Introduction
Digging through the data
eQuATIC framework
Peer assessment
Outline of the presentation
• Introduction
• Digging through the data
• eQuATIC framework
• Peer assessment
Introduction
Digging through the data
eQuATIC framework
Peer assessment
• 20% mobility by 2020
• Institution review
-
Ghent University decentralized university
-
How to be in control of quality
-
PCDA-cycle
• Tendency towards strategic partnerships & preferential partners
• Return on investment
 A lot of data available
Introduction
Digging through the data
eQuATIC framework
Peer assessment
• Quantitative analysis: international students
180
160
140
120
100
Exchange
80
Degree
60
Phd
40
20
0
Introduction
Digging through the data
eQuATIC framework
Peer assessment
• Quantitative analysis: exchange balance
600
500
400
300
Outgoing students
Incoming students
200
100
0
Introduction
Digging through the data
eQuATIC framework
Peer assessment
• Qualitative analysis: Study success
Country
Average credits/day*
Average
study success**
Reference group
0,17
0,15
0,15
0,17
0,15
0,16
0,16
0,16
0,16
0,18
0,16
94%
78,18%
70,7%
74,11%
58,82%
87,85%
73,5%
65,83%
77,45%
71,14%
78,91%
12
100
34
81
174
39
6
11
117
50
354
Denmark
Germany
Finland
France
Italy
Lithuania
Norway
Austria
Poland
Portugal
Spain
*30 credits/sem =
+/- 0,2 credits/day
Introduction
Digging through the data
**UGent average = 80%
Exchange average = 70%
eQuATIC framework
Peer assessment
• Qualitative analysis: Internal Quality Assessment Survey
How satisfied were you with the support arrangements provided by your receiving
institution
How satisfied were you with the support provided by your
sending institution?: Administrative support arrangement
How satisfied were you with the support provided by your
sending institution?: Academic mentoring
How satisfied were you with the support provided by your
sending institution?: Support from student
initiatives/organisations
0%
Strongly agree
Introduction
Rather agree
10%
20%
30%
Neither disagree nor agree
Digging through the data
40%
50%
60%
Rather disagree
eQuATIC framework
70%
80%
90% 100%
Stronly disagree
Peer assessment
Introduction
Digging through the data
eQuATIC framework
Peer assessment
The need to develop a tool for quality assessment of international cooperation
• Structurally measuring quality of cooperation
• Making data widely available
• Based on limited number of indicators but maximum information
• With low work load for the staff involved
Introduction
Digging through the data
eQuATIC framework
Peer assessment
Concept
available
data
Introduction
comparable
scores
Digging through the data
easy to read
information
eQuATIC framework
Peer assessment
Quality in international cooperation
Quality of international
cooperation
Quality of the partners involved
Quality of the information
exchange
Introduction
Impact of the cooperation
Digging through the data
eQuATIC framework
Peer assessment
Available data
• Quality of partners
• Quality of information exchange
• Impact of the cooperation
Introduction
Digging through the data
eQuATIC framework
Peer assessment
Indicators
• Performance of incoming/outgoing students
• Data on student mobility: institution; start & end date; ISCED
• Data on credits: #credits taken; #credits successfully completed
 Sources: SIS, mobility software, other(?)
• Support and facilities
• Student satisfaction on support arrangements and facilities
 Source: Erasmus+ participant report, own student survey (non-Erasmus)
Introduction
Digging through the data
eQuATIC framework
Peer assessment
Indicators
• Academic quality
• Student satisfaction on teaching and learning
 Source: Erasmus+ participant report, own student survey (non-Erasmus)
• Rankings
• Ranking in ARWU, THE, QS
 Yearly uploaded by super admin
• Course catalogue information
• Student feedback on completeness course catalogue
 Source: Erasmus+ participant report, own student survey (non-Erasmus)
Introduction
Digging through the data
eQuATIC framework
Peer assessment
Indicators
• Exchange of mobility documents
• Student feedback on signing learning agreement and receiving transcript
of records on time
• Availability of grading table in Egracons
 Source: Erasmus+ participant report, own student survey (non-Erasmus)
 Grading tables yearly updated by superadmin
• Mobility rate
• Data on mobility (student & staff): institution; start & end date; ISCED
 Sources: SIS, mobility software, other(?)
Introduction
Digging through the data
eQuATIC framework
Peer assessment
Indicators
• Involvement
• Data on institutional agreements: institution, ISCED
 Source: SIS, mobility software
• Mobility rate
• Data on mobility (student & staff): institution; start & end date; ISCED
 Sources: SIS, mobility software, other(?)
Introduction
Digging through the data
eQuATIC framework
Peer assessment
Indicators
• Educational collaboration
• Data on projects funded by Educational budgets (e.g. Erasmus+)
• Data on joint programmes + graduates
 Sources: SIS, mobility software, other(?)
• Research collaboration
• Data on projects funded by Research budgets (e.g. Horizon 2020)
• Data on joint-PhD’s
• Data on joint publications
 Sources: SIS, mobility software, research database
Introduction
Digging through the data
eQuATIC framework
Peer assessment
Reports & visualisation
• For broad public
• Extra background
• Easy to read & interpret
Introduction
Digging through the data
eQuATIC framework
Peer assessment
Result
• List of partners
• A score per partner per indicator
• Reports per partner with strengths and/or weaknesses in the cooperation
Introduction
Digging through the data
eQuATIC framework
Peer assessment
Introduction
Digging through the data
eQuATIC framework
Peer assessment
Result
• List of partners
• A score per partner per indicator
• Reports per partner with strengths and/or weaknesses in the cooperation
Introduction
Digging through the data
eQuATIC framework
Peer assessment
Introduction
Digging through the data
eQuATIC framework
Peer assessment
Introduction
Digging through the data
eQuATIC framework
Peer assessment
Goal:
“An online peer assessment tool for
quality in international cooperation”
Introduction
Digging through the data
eQuATIC framework
Peer assessment
Peer assessment
• Based on mutual data input
• Generate reports on quality of international partners
• Reports on your own quality as perceived by your partners
• In order to improve the quality on both sides of the cooperation
• International test users during project phase
• From now on open to all interested institutions
Introduction
Digging through the data
eQuATIC framework
Peer assessment
European project application
• Upscaling use of eQuATIC
• Create support mechanism
• Guidelines on data gathering and reusability
• Research on inter-institutional partnerships and practices
• Peer assessment toolbox
• Self-assessment functionality
• Training Scheme
Introduction
Digging through the data
eQuATIC framework
Peer assessment
Contact
Paul Leys - project leader eQuATIC
Ghent University
[email protected]
+32 9 264 70 32
Introduction
Digging through the data
eQuATIC framework
Peer assessment