12/7/2016
November 28 – December 2, 2016
Welcome to the Hawai’i
Test Administration Training
State and District Testing
Spring 2017
The ACT
Authorized Test Dates
•
•
•
•
February 28, 2017 – Initial Standard Time (paper)
March 14, 2017 – Makeup Standard Time (paper)
Feb 28 – March 14, 2017 – Online Test Window
Feb 28 – March 14, 2017 – Accommodations Test
Window (paper)
2
Resources
• ACT-Hawaii Webpage:
www.act.org/stateanddistrict/hawaii
• Customer Service:
– Standard Time Test Administration:
800.553.6244 x2800
– Accommodations Administration:
800.553.6244 x1788
3
1
12/7/2016
PearsonAccess Next (PANext)
The ACT
PANext
• Online Test Administration System
– Manage School Participation
– Manage Student Information
• Enrollment counts – Paper materials
• Assign Test Sessions – Online Testing
– Tracking Shipments
5
PANext
6
2
12/7/2016
Accommodations
The ACT
Types of Accommodations
• ACT-approved
• Non-college reportable
• Local test arrangements
8
ACT-approved Accommodations
• College reportable
• Paper testing
– Extended time or additional breaks
– Alternate formats or response modes
• Online testing
– Extended time or additional breaks
– Text-to-Speech
• Require professional diagnosis and current IEP, 504 or
official accommodations plan
Examinees receiving services solely for limited English proficiency do not
qualify for ACT-approved accommodations
9
3
12/7/2016
Non-college reportable
• Scores only used for state assessment purposes
• Paper testing only
– Extended time or additional breaks
– Alternate formats or response modes
• For students whose request for ACT-approved
accommodations cannot be approved
• No prior ACT approval needed.
Examinees receiving services solely for limited English proficiency.
10
Test Accessibility and Accommodations (TAA) System
• Submitting requests for ACT-approved
accommodations
• Checking the status of requests
• Reviewing decision notifications
• Requesting reconsideration of requests
not previously approved
• Viewing examinee information for planning
purposes
11
Accommodations Resources
http://www.act.org/stateanddistrict/hawaii
• Accommodations on the ACT
• Test Accessibility and Accommodations
(TAA) User Guide
• Training Videos:
– Requesting TC Trusted Agent Access
– Requesting TAC Access to TAA
– Request Accommodations for New Examinee
12
4
12/7/2016
Test Facility Requirements
The ACT - paper
Type and Size of Room
• 15-30 examinees to each
room
• Max: 100 examinees per
room
14
Room Setup and Seating Arrangements
15
5
12/7/2016
Proper Use of Table
16
Testing Facilities
• Abide by the Americans with
Disabilities Act (ADA)
• Test-related bulletin boards
are covered
17
Test Room Items
• 2 reliable timepieces
• A phone
• Proper lighting, temperature, and
ventilation
• Free from distractions
18
6
12/7/2016
Testing Staff Requirements
The ACT
Potential Conflicts of Interest
If a relative will be testing at a school in your state, you can’t:
Examinee scores will be cancelled if a relative:
Serve as TC or Back‐up TC
Served as TC/back‐up TC at a school in the state
Have access to secure materials
Served as a RS or proctor for his/her room
Had access to test materials
20
Selecting Testing Staff
• Persons ineligible to serve as staff:
– High school students, volunteers, and lowerdivision undergraduate students
– Anyone taking the ACT within 12 months
– If one is involved in ACT test preparation
21
7
12/7/2016
School Test Coordinators
Prepare
site for
testing
Organize
accommodations
Register
examinees
Administer
tests
22
Test Coordinators
Select and
train testing
staff
Prepare
test rooms,
resources,
and
materials
Administer
a pre-test
session
Complete
necessary
forms
Return
materials to
ACT
23
Room Supervisor
Attend
training
Administer
tests for one
test room
Be in charge
of test
materials
Complete
necessary
forms
24
8
12/7/2016
Proctors
25
Proctors
Attend training
Admit
examinees and
distribute test
materials
Help administer
the test
Be attentive and
report
irregularities
26
Roving Proctor
• For schools using multiple rooms, floors, or
buildings:
– Help check in and monitor examinees
– Assist testing staff
27
9
12/7/2016
Training Staff
• Mandatory training
session before
test day
28
Test Security Requirements
The ACT
Authorized Access
• Only the TC and select
support staff should
access test materials
before test day.
30
10
12/7/2016
Receipt and Check-In of Test Booklets
• Within 24 hours of receipt, the TC must
open and verify the test materials
31
Security of Test Materials
• Test booklets cannot be photocopied
• Test booklet seals cannot be broken except by
the examinee
• Advance access to test content will cancel
scores
32
In the Event of a Security Breach
• Call ACT immediately at 800.553.6244,
ext. 2800 if there is a security breach
• Do not let examinees leave if a test
booklet goes missing
33
11
12/7/2016
Storage before Testing
34
Secure Storage
• If a safe or vault is unavailable, a locked
file cabinet or closet in a locked room can
be used
35
Completing Non-Test Portions
The ACT
12
12/7/2016
Non-Test Portions
• Must be completed before test day
• Session will last around an hour
37
Barcode Labels
• Apply labels to the
back, lower right
corner of the answer
documents
38
Completing Examinee Information
• Required Information to complete:
– Blocks A, B, D, N, O, P, R
• Scores will not be reported without these
complete
39
13
12/7/2016
High School Code
• If testing site is correct school, leave blank
• Find the high school code for examinees’ “home”
high school
– Use www.actstudent.org/regist/lookuphs
40
Test Day Activities
The ACT
Sample Test Day Schedule
7:30 a.m. Arrival of testing staff
7:45 a.m. Briefing session & distribution of test materials
8:00 a.m. Arrival, identification, and seating of examinees
8:15 a.m. 1) Begin reading verbal instructions
2) Distribute test materials
3) Administer 5 tests
4) Collect/verify test materials
1:10 p.m. Dismiss examinees
42
14
12/7/2016
Distributing Materials
• TC must personally
hand over
materials to the
room supervisors
on test day
• Never leave test
booklets
unattended
43
Admitting Examinees to the Test Room
• Verify identification, note on the roster:
– Photo ID
– ACT Student Identification Letter with Photo
– Staff Recognition
44
Seating Examinees
• Don’t allow examinees to choose their
seats
• You may seat examinees alphabetically, or
random order
• Separate groups that arrive together
45
15
12/7/2016
Administering the Tests
The ACT
Distributing Test Materials to Examinees
• Keep track of the serial
numbers to complete the
Seating Diagram
47
Sequence of Tests
• Tests must be administered in exact order
The ACT with Writing
Test 1
45 minutes
Test 2
60 minutes
Break
15 minutes
Test 3
35 minutes
Test 4
35 minutes
Break
5 minutes
Writing Test
40 minutes
48
16
12/7/2016
Timing the Tests
49
Attentiveness During Testing
• Any non-test administration related activity is not
allowed
• Testing staff must walk around
50
Break after Test 2
• Begin the break immediately after Test 2
• Submit an IR for breaks longer than 15 minutes
• Monitor students both in the room & in hallway
51
17
12/7/2016
Break before the Writing Test
• Examinees have 5 minutes to relax or
sharpen pencils, etc.
• Examinees must stay in the test room
52
Examinees Who Leave During a Test and Return
• Collect test materials until they are
readmitted
• Examinees are unable to make up missed
time
53
Group Irregularities
Groups Irregularities
Interrupting a Test
Disturbances and Distractions
Emergency Evacuation
Rescheduled Examination
Missing or Stolen Test Materials
Mistiming
Power Failure
54
18
12/7/2016
Individual Irregularities
Individual Irregularities
Examinees Who Leave Early
Test Item Challenges
Defective Test Materials
Duplicating Test Materials
Failure to Follow Directions in Marking Responses
Examinees Who Become Ill
Irrational Behavior
Prohibited Behavior at the Test Site
Dismissal for Prohibited Behavior
55
Prohibited Behavior
• Examinees are to be dismissed if they:
– Misuse materials or calculator
– Cheat or attempt to
– Take test content or attempt to
– Don’t follow testing rules
– Use inappropriate behavior
– Cause a distraction
56
Prohibited Behavior
• Prohibited behavior does not need to be
observed if you are certain it occurred
• Dismiss examinees and inform them their
answer documents will not be scored
57
19
12/7/2016
Completing an IR for Examinee Dismissal
The IR Should Include:
Time of the incident
Examinee’s name(s)
Examinee’s test room and seating location(s)
Details of the observed incident
Statements you and examinee(s) made
Name of staff who observed irregularity
58
Voiding Answer Documents
• Only if:
– The examinee exhibited
prohibited behavior and
was informed scores
would be void
– An examinee was
scheduled for makeup
testing
59
Reasons for Scores to be Cancelled
Reasons for Scores to be Cancelled
Rooms not set up correctly
Tests completed out of testing
window
Conflict of Interest with staff
Misuse of Timing Codes
Advanced access to test content
Using wrong test materials
Tests not given in correct order
Different timing codes in same room
Mistiming of test
Irrational or prohibited behavior
Test materials are
duplicated/attempt
60
20
12/7/2016
After the Test
The ACT
Test Coordinator Procedures
• Immediately after testing, the TC must:
Verify
materials
Check
documentation
Set aside
and/or
order
makeup
materials
Pack
materials
for return
Ship
materials
back to
ACT
62
Makeup Testing
The ACT
21
12/7/2016
Setting Aside Materials for Makeup Testing
• Original answer
documents: complete any
non-test portions before
makeup testing
• New answer documents:
transfer non-test
information to the new
document
64
Materials ACT Sends to You for Makeup Testing
65
Collecting, Packing, and Returning
Materials
The ACT
22
12/7/2016
Site Header and Test Booklet Form Number
• TC ensures correct test booklet and form
numbers are on the answer documents
• TC puts answer documents under the site
header to pack and return to ACT
67
Collecting RS Documents before Dismissal
Document
Action
Test Booklets
There are no answer documents inside and the test
booklets are arranged in sequential serial number order
Answer Documents
Each answer document has the correct required
identifying information on the front and back pages
Copy for
Records
Test Room Report
Is completed and signed and initialed by the TC and RS
and all test booklets are accounted for
X
Roster
All examinees scheduled to test are listed and if they
tested or not, with any ACT Student ID Letters attached
X
Seating Diagram
All items in the top half are complete and test booklet
serial numbers are recorded in the squares
X
Timing Report
Each test has the start, 5 minutes remaining, and stop
time recorded
X
Irregularity Report
Is signed with explanation and voided/replaced materials
are attached
X
68
Sorting the Answer Documents
If the answer document:
Then
Is ready to be scored
Return it in the green envelope
Was voided and attached to an IR
Return it in the red envelope
Is unused with no markings or barcode Securely destroy it
labels
Has only a barcode label on it
Securely destroy after 6 months
Has non-test portions completed, but
not test items
Securely destroy after 6 months
69
23
12/7/2016
Packing the Red Envelope
70
Packing the Polymailer
71
Packing the Cartons
72
24
12/7/2016
Storage and Pickup
• Return the polymailer and cartons to secure
storage after materials are packed
• On the date scheduled for pickup, place the
polymailer and cartons in the monitored pickup
location
73
Online Testing Overview
The ACT – Online Testing
The Online Process
Before Test Day
Who
Activity
Creates user account in PearsonAccessnext
Test
Coord
Assigns examinees to test sessions
Prints student authorization tickets
Tech
Coord
Examinee
Rerun computer system checks a week before
testing
Pre-cache test content two days before testing
Completes pretest information online
75
25
12/7/2016
The Online Process
On Test Day
Who
Activity
Distributes materials to each RS
TC
Tech
Coord
Assists staff with questions/issues; contact ACT
Assists with any system issues
Prepare computers for testing
RS
Start test sessions in PearsonAccessnext
Admit examinees to rooms
76
The Online Process
During Testing
Who
Activity
Reads verbal instructions
Distributes materials to examinees
Monitors test sessions
RS
Handles and documents irregularities
Ensures that all examinees submit their tests
Closes Test sessions in PearsonAccessnext
77
Differences with Online Testing
• Pretest and responses submitted via the online method
• Available to standard time examinees on eleven test
dates
• Missed scheduled test sessions can test one of the other
dates
• Available to examinees testing with eligible ACTapproved accommodations during a two week window
78
26
12/7/2016
TestNav
• TestNav™: the test delivery engine used by
examinees to take the tests at
https://tn.actonline.act.org
79
Login Security
• Keep your staff login details confidential, don’t
share them
• Keep all student authorization tickets secure
until test day when providing them to examinees
80
Seal Codes
• Seal codes are:
– A combination of letters and numbers
examinees must enter to begin each test
section
– Unique to each test session
81
27
12/7/2016
Test Facilities
The ACT – Online Testing
Determining Testing Capacity
• To determine if your test site has enough
computers to test all the examinees:
[Number of devices]
x [Number of days in the test window]
= Examinee capacity
83
Technical Requirements
• Your school must download the ProctorCache software
– Almost 97% of issues that arose during online testing
were at schools that had not proctor cached
• Updated technical requirements can be found at:
http://www.act.org/content/act/en/products-andservices/state-and-district-solutions/act-onlinetesting.html
84
28
12/7/2016
Technical Requirements
• ACT will switch administration from paper to online if
requirements are unmet
• Administrative monitoring in each room
• Test Content Security
– The ACT must be given using a “locked down” testing application
which disables use of other applications during testing
85
Computer Requirements
• Computers must meet system
requirements and pass site readiness
checkpoints
• The school must maintain administrator
rights to any laptops
Photo from William Hook
86
Seating Arrangements
If the room has:
Then workstations:
No dividers between
workstations
•
•
•
Face the same direction, not the wall or each other
Are distanced 3 feet apart side-to-side and 5 feet front-toback
Are set up so examinees cannot see screens in front of them
Dividers between
workstations
•
•
Do not need to face the same direction
May face the wall/each other if adequate privacy exists
A U-Shaped seating
configuration
•
Must face the wall and not each other
87
29
12/7/2016
Staffing
The ACT – Online Testing
Technical Coordinator Responsibilities
Ensuring computers
and infrastructure
meet online testing
requirements
Helping staff set up
for test day
Troubleshooting
technical issues
examinees may
have with testing
89
Room Supervisor Responsibilities
Identifying and
admitting
examinees to
rooms
Managing test day
materials and
documentation
Completing test
day activities in
PearsonAccessnext
Helping and
monitoring
examinee progress
90
30
12/7/2016
PearsonAccessnext
The ACT – Online Testing
User Accounts
• ACT created a TC account in PearsonAccessnext during
the establishment process
92
Test Sessions
• Assign examinees to test
sessions no later than two
weeks before the first day of
the testing window
93
31
12/7/2016
Student Authorization Tickets
• Printout containing the examinee’s individually assigned
username and password
• TC must print one ticket for each
examinee prior to test day
94
Preparing for Test Day
The ACT – Online Testing
Security of Test Materials
• Secure materials include
– Pretest Instructions for Online Testing
– Student authorizations tickets
– Used scratch paper
• Materials must be locked when not in use with
authorized access
96
32
12/7/2016
Preparing Examinees
The ACT – Online Testing
Pretest Instructions for Online Testing
• Each examinee will get a personal set of
instructions with a unique claim code
• Examinees have until 4 days after the test
window to complete their pretest information
98
How to Complete the Pretest Information
• Holding an in-school session
• Asking examinees to complete pretest
information on their own time
99
33
12/7/2016
Accommodations
The ACT – Online Testing
ACT-Approved Accommodations for Online Testing
• ACT-approved accommodations for online testing:
– Additional or stop-the-clock breaks with standard time
– Extended time to complete each test
– Testing over multiple days
• For other test formats or a reader, examinees must test
via paper
101
ACT-Approved Accommodations Testing Window
• Tests must be administered only during the
accommodations window or they will not be
scored
• The requirement to begin no later than 9:00 am
does not apply to accommodations testing
102
34
12/7/2016
Scratch Paper
• What to use for scratch paper if the examinee is
testing:
– In a single sitting
• Their student authorization ticket and, as needed,
ACT blue scratch paper
– Over multiple days/sittings
• ACT blue scratch paper only
• Must use a fresh sheet each day
103
Student Authorization Tickets
• For examinees testing over multiple days
The student
authorization ticket
must be reused
each day
Collect the ticket
each day and keep
it secure until
handing it back for
the next test
Tickets cannot be
used as scratch
paper since they
are reused
104
Differences with Timing the Tests
• Standard time test sessions: computer
times the test
• ACT-approved accommodations test
session: RS times the tests for all timing
codes
105
35
12/7/2016
Post-Test Activities
• In addition to materials for standard time online testing,
insert the following documents into the red envelope:
– The TAA PIN Report
– Completed Test Room Report
106
Test Day Activities
The ACT – Online Testing
Admitting Examinees to the Test Room
108
36
12/7/2016
Using Scratch Paper
• Examinees can use their student authorization ticket
and blue scratch paper
• All used and unused scratch paper must be
collected and returned to the TC
109
Administering the Online Tests
The ACT – Online Testing
Test Room Start Time
• Verbal Instructions must start no later than
9 a.m. in all rooms
• Rooms starting later than 9 a.m. must
complete an IR
111
37
12/7/2016
Administering the Tests
Start test
session in
PANext
Retrieve
Seal
Codes
Monitor
examinee
progress
Close the
test
session
Return test
materials
to the TC
112
Irregularities
The ACT – Online Testing
Irregularities
• The Irregularity Report (IR) is the online form for
documenting irregularities through
PearsonAccessnext
114
38
12/7/2016
Emergencies
Log out of
TestNav
Log out of
PANext
Make note of
time
Authorization
tickets &
scratch paper
Lock test
room
115
Handling Examinees Who Leave and Don’t Return
Log out of
TestNav
Mark test
complete in
PANext
Determine
makeup testing
eligibility
116
Examinees Who Leave and Come Back
If an examinee becomes ill or asks to go to the bathroom and returns
after the next test has already started:
Make
note of
time
Collect
test
materials
Stay
signed in
and
running
Provide
new seal
code
Continue
testing w/
remaining
time
117
39
12/7/2016
How to Handle Prohibited Behavior
Inform
examinee of
behavior,
dismissal,
and score
cancellation
Log out of
TestNav
and collect
test
materials
Mark the
test
complete in
PANext
Dismiss
examinee
Submit an
IR
118
Post-test Activities
The ACT – Online Testing
Collect Materials from Room Supervisors
• Collect from each RS:
Completed
Roster and
Seating Diagram
Student
authorization
tickets
Used and
unused scratch
paper
Administration
manual
120
40
12/7/2016
Scheduling Examinees for Makeup Testing
• In PearsonAccessnext, you may:
– Create a new test session and move examinees
from their original session to this makeup session
– Or move examinees to an existing test session
121
Packing the Red Envelope
• Insert the following documents in the red envelope:
Completed Seating
Diagrams
Unused Student
Authorization
Tickets
Unused scratch
paper
State and District
Testing Staff Lists
Unused red
envelopes
Marked rosters
ACT Student
Identification
Letters
Examinee’s clipped
student
authorization ticket
with scratch paper
122
Packing and Mailing the Polymailer
• Place the red envelope in the polymailer
• Seal the polymailer and return to secure storage until the
scheduled pickup date
• On the pickup date, place the polymailer in a secure
location for the carrier to pick them up
123
41
12/7/2016
Reporting
The ACT
Reporting Schedule
Document
Recipient Timeline
Description
Student Report
Student
3-8 weeks
Paper report
Student Online Scores
Student
1 week after S.R.
Online account
H.S. Checklist Report
School
3-8 weeks
List of Examinees
H.S Report
School
3-8 weeks
List of C.R. Scores
Student Score Labels
School
3-8 weeks
Record Labels
Student College Report
College
3-8 weeks
C.R. Scores
NCR Accomm. Score
Notification Letter
School
June 8, 2017
NCR Scores
Profile Report – H.S.
District
June 8, 2017
Averages per H.S.
Profile Report - District
District
June 8, 2017
Averages for District
Student Level Data File District
District
June 8, 2017
All scores for all
examinees
125
Resources
• ACT-Hawaii Webpage:
www.act.org/stateanddistrict/hawaii
• Customer Service:
– Standard Time Test Administration:
800.553.6244 x2800
– Accommodations Administration:
800.553.6244 x1788
126
42
12/7/2016
Questions?
43