_________________________________________________________________________
A new approach to exam management
_________________________________________________________________________
Copenhagen October 2014
© 2014 Ektimo ApS - All Rights Reserved.
Ektimo ApS
Examfolio is an initiative by Ektimo Aps.
Bo Wolff – Martin Nielsen – Andy Beare
Jonas Ranstam (Consultant Statistician)
Based in Copenhagen, Denmark we have 12 years experience
working with online peer review and evaluation software for academic
organizations.
Collaboration with EBOT
3-in-1 Role-based solution
Questions
Exams
Analysis
1. Authoring
2. Approval
3. Selection
4. Administration
5. Monitoring
6. Feedback
7. Question Statistics
8. Exam Consistency
6. Candidate scores
Exam activities are integrated
Questions
Questions
Exams
Analysis
Traditionally, it can be difficult to
improve exams, because processes
often are detached from each other.
Analysis
Exams
With Examfolio, we create a better
synergy between the activities. It
makes your exams better over time.
Questions
AUTHORING
Writing committee sign in
and author questions
Questions can be
evaluated pre and post
exam
Questions
APPROVAL
Work on questions is
organised into clear
cycles of
Reviewing
Revising
Approving
For every exam held,
feedback helps to improve
questions
Questions
SELECTION
Question selection for
exams is efficient with
quick filtering.
Safety features ensure
no question can be
selected twice…
… and exams can be
exported to external
exam centres.
Before the exam
Registration
Candidates register or are
pre-registered from a data
file.
Select from any open
exams
Can select a location (for
invigilated exams)
Receive email alerts
Before the exam
ADMINISTRATION
Administrators have a
comprehensive overview of
All exams
Locations
Candidates
During the exam
Exam delivery
Web-based
Locked down browser
During the exam
Monitor
Candidates are
monitored remotely
during the exam to
ensure exam integrity…
… which enhances
qualification credibility for
non-invigilated exams.
After the exam
Feedback
Candidates can see their
ranking compared with
others in their category.
The scores and results can
be presented immediately
after the exam.
Demographic analysis
Results
Results from exams can be
used to compare candidates
at different institutions or in
different countries…
… allowing organisers to
deploy educational resources
improve overall standards.
Item analysis
Item
Questions are analysed using:
Point Bi-Serial correlation
Discrimination index,
Difficulty index
Distractor efficiencies
Exam analysis
Consistency
KR20 - Consistency
Mean and SD
Question performance
Candidate performance
Exam analysis
Cut off scores
Modified Angoff methods:
Estimating the proportion of borderline candidates that would
answer the question correctly.
M/SD-1
How much Angoff?
75%/5
1. Group committee voting (November 2014)
2. Panel of Judges (April 2015)
Modified Angoff
Angoff strengths:
Defensible and cut off not relative to the candidate group.
IRT Item response theory
Angoff Weaknesses:
(based on calculation of difficulty
parameters)
Difficult for panel to conceptualize a pool of borderline
candidates. Resource ‘hungry’.
Other
Security
Program design:
Limited user access and information presented on a need-toknow basis.
Data:
Program
Encrypted web-traffic
Secured data file output?
Back-up
Data
Cyber-security:
Penetration testing (external audit 2015)
Cyber-Security
Certification
ISO – 27001 Certification:
Best practices in company-wide security
Other
Costs
Questions database and analysis:
€ 2500 per year
Formative and self-paced tests:
€ 15/20 per candidate
Formal invigilated exams:
€ 30 per candidate
Mobile
PHONE/TABLET
Web-pages optimised for
Smart-phone and tablet.
So, why Examfolio?
Easy
COLLABORATION
Complete
OVERVIEW
Continual
IMPROVEMENT
To build and validate your
pool of high quality
questions…
To have an up-to-theminute overview of all your
exam processes…
To continually improve your
questions and exam
processes…
… and quickly create well
balanced exams.
… and reduce
administative costs.
… and get an insight into
educational standards at
departmental, national or
international level.
_________________________________________________________________________
Thank you
Try us for free
@
examfolio.com
_________________________________________________________________________
Ektimo ApS
Gammeltoftsgade 12B, kld.
1355 Copenhagen K
[email protected]