Peer Learning Assessment
System
PeLe
Knut Bjørkli Rolstad([email protected])
Norwegian University of Science and Technology (NTNU)
Contents
• Brief overview of PeLe
• Using PeLe
– Answering a test as «student»
– Preparing a test
– Monitoring a test
– Reviewing a test
• Discussion of methodology
What is PeLe?
• Tools for running multiple-choice tests with
automatic grading
• Emphasizes immediate feedback and student
collaboration («peer learning»)
• PeLe facilitiates learning activities immediately
following a test
PeLe can be used for a wide spectrum
of applications
Tool for automatically
correcting tests and
immediate feedback
Peer learning tool
Doing a test with PeLe
Test done in the
classroom
Test is handed out to
students on paper
Short break while
teacher prepares
review
After the test: review
+ learning activities
PeLe gives a realtime overview
of how students perform
 You create your PeLe user account
• You will use this account both as «student»
(anwering tests) and as «teacher» (creating
tests)
• Fill in the form on this URL to create your
account:
https://goo.gl/P9Y2FG
 You answer a test as «students»
What do students need to answer a
test?
• A mobile device with internet access
• For example:
• Smartphone (iOS, Android)
• iPad eller tablet PC
• laptop
• They use a web browser to answer tests
Accessing the PeLe student page
• Enter the following URL in a web browser:
app.one2act.no
Logging in
Remove this
checkmark if the
test is NOT
anonymous
1. Click Join session
2. Enter the session
code provided by the
instructor
4. You can now answer
the test which has
been given to you on
paper
Answering a test
1. All the questions
on the same page,
and can be answered
in any order
2. Click the checkmarks
to answer
3. Click again to remove
a checkmark. You can
change your mind as
often as you like
Submitting the test
1. A submit icon will
appear once all
questions have been
answered. Click this…
2. … and you get this
overview of your
answers
3. Type the word «yes» 4. The page looks like
into the box at the
this once your test
bottom to confirm
has been submitted
Question 1
Question 2
Question 3
According to a recent
newsstory, the prices
for package delivery
have increased by
100 %.
A lumberjack with a
chainsaw can cut a log
into four pieces in
12 seconds.
A bottle with a cap has
a production cost of
1,50 €. The bottle itself
costs 1 € more than the
cork.
If package delivery
originally cost 5 €,
what is the cost after
the increase ?
A.
B.
C.
D.
E.
6€
7€
8€
10 €
20 €
How many seconds
are needed to cut the
log into five pieces?
A.
B.
C.
D.
E.
F.
1
4,4
15
16
17
18
What is the cost of the
cap?
A.
B.
C.
D.
0,25 €
0,50 €
0,75 €
1€
Where in the process are we now?
Creating the
Setting up the test
multiple-choice test in PeLe
Monitor test
Review test with
learning activities
Designing multiple-choice test items
• Open («constructed response») exercises can
be turned into multiple-choice items
– Use old exam papers, tests etc. to construct
plausible distractors
– Analyze PeLe test items afterwards
• Difficulty level
• «Discrimination index»: does the question clearly
separate high-performing students from lowerperforming ones?
• Did the distractors work as intended?
 Create a multiple-choice test
• Create a multiple-choice test with 4 – four –
questions
• Label the alternatives A, B, C etc.
• You can create the test in any program you like
(e.g. Word)
• We will transfer the test to PeLe afterwards
Where in the process are we now?
Creating the
Setting up the
the test
test
multiple-choice test in PeLe
Monitor test
Review test with
learning activities
Entering the test in PeLe
1. Start PeLe from
the desktop or Start
menu
3. Click here to start setting up
a test from scratch
2. Log in with your credentials
Adding a test (1 of 4)
Enter a title for the
test
Select whether
tests can be
answered
anonymously
Welcoming
message
students see
when they log in
Adding a test (2 of 4)
Number of
questions
Default number
of alternatives
(more can be
added later)
Adding a test (3 av 4)
Lets students select as
many alternatives as they
like
«Bleeding»: negative
scores are deducted from
the total score (makes the
test harder)
Points for correct answer
(Negative) points for
incorrect answer
Points for no answer
Save test to
disk
Adding a test (4 of 4)
Add test
Add
question
Add/remove
alternatives
Remove checkmark
to set customized
scoring rules for a
question
Set correct
alternatives by
selecting
checkmarks
Delete
question
Adding/uploading the test
2. The test will be
added to the list on
the front page – click
My assessments to
access it
1. Click Upload when
the test is ready. This
will produce a session
code (below)
Viewing session codes
Session codes are not
shown by default. Click
here and select Code
to add a column with
this label (selection is
remembed on next
logon)
Starting a test
Session codes are
now shown in
this column
The test is not yet active.
Click on it to access this
menu…
Starting a test (cont.)
Click here to start the test
so that students can begin
answering it
Students can now log in with your
session code to answer your test
Running a test in the classroom
• Before the test, you have printed the test
questions on paper, or prepared an intelligible
presentation for showing on a projector
• You have generated the session code
beforehand, and this can be printed on the
paper to let students log in right away
 Set up your test in PeLe
• Set up the multiple-choice test you previously
made in PeLe
• Write down the session code once it’s been
uploaded – you will give this to the person
sitting next to you later
Where in the process are we now?
Creating the
Setting up the test
multiple-choice test in PeLe
Monitor test
Review test with
learning activities
Monitoring the test
Real-time display of
correct/incorrect
answers on each
question
Individual view of
each students’
performance on
each question
Ending the test
Click here to end
the test (students
can no longer
submit answers)
Students can now take a short break…
• … while you
– Review class performance on each question
(percentages + histograms)
– Identify problem areas
– Prepare review activities
Reviewing a test
1. Select
questions for
review
2. Click here to hide
most of the PeLe
interface
(«presentation
mode»)
Reviewing a test in presenation mode
Click buttons
1, 2 etc. to see
percentages
for question 1,
2 etc.
Showing percentage graphs to
students
Moveable
toolbar
Click Percentage to
access the result graph
for the selected
question
Making scores available to students
Click here to make test
results available to
students, who log on
to their mobile devies
to see their scores
Organizing finished tests
2. Tests can be cloned,
deleted, archived etc.
1. Select a test from the
list
 Complete your neighbor’s test
• Swap tests and session codes with your
neighbour
• Complete each other’s test, and use the
teacher interface to monitor the test as it
progresses
• Close («stop») the test afterwards
Where in the process are we now?
Creating the
Setting up the test
multiple-choice test in PeLe
Monitor test
Review test with
learning activities
Different types of feecback
• Verification («C was correct because…» etc.)
• Elaborative explanation:
– Teacher provides an explanation in full
– Group discussion
«peer
learning»
– Class discussion
• Follow-up assignment
– Measure depth of knowledge by asking a question
similar to one of the test questions
Different learning activities for
different distributions of answers
• Question 1: large percentage of incorrect answers
• Teacher elaboration («this is what we should do»)
• Question 2 + 3: some correct answers (30-70 %)
• Group/class discussion
• Question 4: mostly correct answers
• Teacher verification («Alternative C was correct because…»)
• Follow-up question
Questions or comments?
• Thank you for your attention!