QLA for secondary schools end to end process 2016

What is QLA and where to find
the data?
Key Stage 2 Question Level
Analyses (QLA) for year 7 pupils
Making primary assessment data
available to secondary schools for the
start of year 7
Question level analysis
• In 2016 all Key Stage 2 tests have been
electronically marked
• This includes all versions of tests for
– Reading
– Mathematics
– English grammar punctuation & spelling
• The question level data for these tests is available
to secondary schools through NCA tools
Enabling RAISEonline
• Schools download two files from NCA tools
– A Common Transfer File (CTF) of year 7 pupils (matched
by their UPN)
– The RAISE compatible QLA data file for year 7 pupils
• The RAISEonline school administrator can then
import first the CTF and then the QLA data file into
RAISEonline using data management functionality
• The RAISEonline school administrator may set up
other school users (subject leaders, heads of year,
teachers etc) enabling them to access this
information/analyses
QLA analyses available (English)
• KS2 reading 2016 paper
• KS2 English grammar punctuation & spelling
2016 paper
• KS2 EGPS (spelling section) 2016 paper
English paper analyses
• All papers can be analysed by mark point across a
cohort
• All papers can be analysed by strand and sub-strand
• Pupil lists can be produced for each paper and from
these individual pupil reports can be generated
• These analyses allow teachers to identify strengths
and possible areas for development for cohorts and
individual pupils
QLA analyses available (mathematics)
• KS2 mathematics paper 1 (arithmetic) 2016
paper
• KS2 mathematics paper 2 (reasoning) 2016
paper
• KS2 mathematics paper 3 (reasoning) 2016
paper
Mathematics paper analyses
• All papers can be analysed by mark point across a
cohort
• All papers can also be analysed by strands and substrands
• Pupil lists can be produced for each paper and from
these individual pupil reports can be generated
• These analyses allow teachers to identify strengths
and possible areas for development for cohorts and
individual pupils
How to get the data from NCA
tools
Sourcing the two files for use with
RAISEonline
Login to the NCA
tools home page
Click on ‘pupil
results’
Click on ‘Search for
pupils’
The school year 7 UPN list
should be copied into the
search box
Note that you can only search
for up to a limit of 300 UPNs at
one time (if you have more than
300 pupils we suggest doing
two separate downloads of the
CTF and QLA data)
When you have added
your UPN’s click on
search
When the search is
completed, records
found and not found
are displayed
Here are the download
formats available. You
will download a CTF
file first.
This is an example of a
common transfer file (CTF)
which contains sensitive
information. This will be
used to populate RAISE with
your current year 7 pupils.
This will need to be saved to
a safe, secure location ready
for uploading to RAISEonline
Note that common
transfer files are always in
.xml format
Now download the ‘RAISE
online upload
spreadsheet’ which
contains all the question
level data for the matched
pupils (as above)
This is an example of the RAISE upload
file (.xls) which contains every question
response for every pupil for all the tests
they have taken at KS2
This will need to be saved to a safe,
secure location ready for uploading to
RAISEonline
How to import the QLA
data into RAISEonline
Import two files, the CTF first (to populate the
year 7 pupils) and the question level analyses file
second (to attach their KS2 year 6 QLA data)
Login to RAISEonline as the school administrator, which gives you access to
data management functionality
The data management screen
Click to import the
CTF first
Uploading the CTF
Select 2015/2016 and
QLA
Pupils will be loaded into the
academic year 2015/16 as year
6 pupils (as they were at the
time of the test)
Browse to the location of
your CTF (which has a
.xml file extension) and
then click ‘upload file’
Large CTFs may take some
time to upload. This
message will change to
show when the process is
completed
When the upload has
finished click ‘view
report’ for any errors
This CTF file upload has been successful.
The next stage is to run confirm updates.
This processes the data.
Return to the data
management home page
where you will be prompted
to click confirm updates
The confirm updates process
will run and may take a few
minutes to complete. Refresh
the screen periodically, once
complete the message will close
Uploading the
RAISEonline question
level data file
Under import data click on
‘Question level analysis’
Browse to the location where
you have saved the ‘RAISEonline
upload spreadsheet’ and click
upload file
The RAISEonline upload
spreadsheet will take a
few moments to load.
Once this is complete
your data will be available
for analyses
Reports and analyses
Helping to identify areas of strength
and areas for further development
How to use the question level analyses
• The ‘landing’ page for QLA presents a cohort
summary by assessment strand for each test
paper
– Differences between the school and national
figures for each strand are displayed
• These summaries can be grouped by gender
• The ‘landing’ page contains links to further
analyses by assessment sub-strand, test paper
mark point and individual pupil analysis
Selecting this option
will open a new
summary ‘landing’
page
A new ‘landing’ screen which summarises the performance of the cohort by strands
for each paper. This displays English papers first (reading, EGPS, spelling then a
combined mathematics followed by papers 1,2,3)
Clicking on the paper
names takes users to
further analysis for
that paper
Graphics have been
updated with
nationals now
displayed as a line
Page 2 displays the strands within the test alongside the marks available, correct
response of the cohort, correct response nationally and the difference between the
two. Also displayed is the percentage attempted in the school and the difference
between this and the national for each of the strands
Clicking on the breakdown options
allows you to look at sub-strand as
well as strand
Pupil lists and individual reports
• Pupil reports are accessed through the
‘related’ analyses drop down menus.
• Accessing a test paper pupil list report will
show the performance of pupils in each
assessment strand relative to national figures
– Pupil lists can be filtered for different groups
• Clicking on an assessment strand within a
pupil list will generate a test paper report for
the selected individual pupil
Related analysis allows you to navigate to other
reports (eg QLA pupil list or QLA markpoint). Clicking
on pupil list takes you to the following report
This report lists the pupils alongside the percentage
correct response for the test and for each strand. The
national data is listed at the top. Clicking on a strand
for a pupil will take you to the individual pupil report
Smith
Jones
Pearce
Hamilton
Andrew
Rob
Jenny
Naomi
Andrew Smith
Andrew Smith
Pupil data is displayed
against the national
data for each strand.
This data is then
displayed under the
graph in tabular format.
Users can choose a bar
chart or a radar chart by
selecting ‘graph type’
Users can select a different subject or
a different paper
Mark point analyses
• Test paper mark point and pupil reports are
accessed through the ‘related’ analyses drop
down menus.
• Accessing the test paper mark point report shows
the performance of the cohort in each question
relative to the national figures
– Mark point reports can be filtered for different groups
– Clicking on a question/item number within the report
will reveal the actual test question
Clicking on QLA markpoint will take you to the
following report
Clicking on the next page takes you to a breakdown
within a table
The percentage correct response of the cohort is displayed for each question/item
alongside the national data with a difference between the two. These can be sorted,
in the example here we will sort by the difference from national
The data is now sorted by the ‘difference from the national’. In this example question
9b has the biggest difference to the national, clicking on it reveals the question