2016–17 CAASPP
Pretest Administration System
Workshop
January–February 2017
Presented by
Educational Testing Service
Agenda
MorningSession
Topic
8:30–8:45a.m.
Welcome
8:45–9a.m.
OverviewoftheCaliforniaAssessmentofStudentPerformanceandProgress(CAASPP)
System,What’sNewfor2016–17,andSmarterBalancedSummaJveAssessments
9–9:20a.m.
SmarterBalancedInterimAssessmentsandDigitalLibrary
9:20–9:30a.m.
CaliforniaScienceTest(CAST)andCaliforniaAlternateAssessment(CAA)forScience—Pilot
Tests
9:30–9:45a.m.
AccessibilitySupports
9:45–10a.m.
PracJceTestsandTrainingTests
10–10:15a.m.
Break
10:15–10:30a.m.
RolesandResponsibiliJes,andTechnologyUpdate
10:30–10:45a.m.
UsingtheTestOperaJonsManagementSystem(TOMS)
10:45–11a.m.
TestAdministraJon
11–11:15a.m.
TestSecurity
11:15–11:30a.m.
Reports
11:30a.m.–noon
QuesJons
2016–17 CAASPP Pretest Administration Workshop
2
CAASPP System
!  Smarter Balanced Summative Assessments for
English language arts/literacy (ELA) and
mathematics
!  California Alternate Assessments (CAAs) for ELA
and mathematics
!  California Science Test (CAST)—to be piloted in
2016–17
!  CAA for Science—to be piloted in 2016–17 and
2017–18
!  Standards-based Tests in Spanish
2016–17 CAASPP Pretest Administration Workshop
3
Importance of Informing Parents
and Guardians About Testing
Pursuant to California Code of Regulations, Title 5,
Section 852:
! Each year local educational agencies (LEAs) are
required to notify parents or guardians of their pupil’s
participation in the CAASPP tests.
! In addition, LEAs are required to inform parents/
guardians of their right to exempt their child from taking
the CAASPP tests.
•  Parents/Guardians must annually submit a written
request specifying the tests to be exempted.
2016–17 CAASPP Pretest Administration Workshop
4
What’s New for 2016–17
2016–17 CAASPP Pretest Administration Workshop
5
What’s New for 2016–17
!  New Pilot Assessments
•  CAST (California Science Test)
•  CAA for Science
!  Testing Window
•  All assessments can be administered when 66 percent
of the instructional year has been completed, including
grade eleven.
•  Smarter Balanced ELA and mathematics testing will be
available on January 9, 2017.
•  CAST and CAA testing will be available on March 20,
2017.
!  New and Revised Interim Assessment Blocks (IABs)
•  29 new and 24 revised
2016–17 CAASPP Pretest Administration Workshop
6
What’s New for 2016–17
!  Classroom activities have been eliminated for both
summative and interim assessments.
!  The California Student Statewide Identifier (SSID)
number no longer includes the prefix “CA-.”
!  There are two new non-embedded accessibility
resources:
•  Simplified Test Directions (designated support)
•  100s Number Table (accommodation)
2016–17 CAASPP Pretest Administration Workshop
7
What’s New for 2016–17:
Assessments Color-Coding
Assessments
SmarterBalancedInterim
ColorAssignment
Green
SmarterBalancedSumma=ve
Red
SmarterBalancedPrac=ceTests
Pink
SmarterBalancedTrainingTests
CAAsforELA,mathema=cs,and
science
CAAPrac=ceTests
Purple
CAATrainingTests
Indigo
Blue
Teal
CASTSumma=ve(i.e.,pilottests)
Brown
CASTTrainingTests
Orange
2016–17 CAASPP Pretest Administration Workshop
8
What’s New for 2016–17:
Selection of Tests
2016–17 CAASPP Pretest Administration Workshop
9
What’s New for 2016–17:
Test Delivery System
!  Expandable Items
!  Video Playback Controls
!  Enhanced Contrast
!  Larger Zoom Levels for students with visual
impairments
!  Item Badges
!  Item Security and Information Bar
!  More information about test delivery system
enhancements:
http://www.cde.ca.gov/ta/tg/ai/infomeeting.asp
2016–17 CAASPP Pretest Administration Workshop
10
What’s New for 2016–17:
Desmos Calculator
(This slide contains animations. Please view in presenter mode.)
Desmos
Scientific
Standard
Calculator
Desmos
Graphing
Calculator
Benefits
of theCalculator
Desmos
Previous
Standard
Calculator
Previous Scientific
Graphing Calculator
Calculator
Calculator
! Students’ familiarity with online calculator
! Accessible to a broader range of students
! More reliable
! Improved response times
! Sleeker design
! Training resources for the Desmos Calculator available
at https://www.desmos.com/
2016–17 CAASPP Pretest Administration Workshop
11
What’s New for 2016–17:
Changes to the CAASPP Portal
2016–17 CAASPP Pretest Administration Workshop
12
What’s New for 2016–17:
Changes to the CAASPP Portal
2016–17 CAASPP Pretest Administration Workshop
13
What’s New for 2016–17:
Changes to the CAASPP Portal
(This slide contains animations. Please view in presenter mode.)
2016–17 CAASPP Pretest Administration Workshop
14
What’s New for 2016–17:
Changes to the CAASPP Portal
(This slide contains animations. Please view in presenter mode.)
2016–17 CAASPP Pretest Administration Workshop
15
What’s New for 2016–17:
Changes to the CAASPP Portal
(This slide contains animations. Please view in presenter mode.)
2016–17 CAASPP Pretest Administration Workshop
16
Smarter Balanced Summative
Assessments
2016–17 CAASPP Pretest Administration Workshop
17
Smarter Balanced
Assessment System
2016–17 CAASPP Pretest Administration Workshop
18
Smarter Balanced Summative
Assessments
!  All students in grades three through eight and
grade eleven take the Smarter Balanced
Summative Assessments with the following
exceptions:
•  Students with the most significant cognitive
disabilities and whose individualized education
program (IEP) team designates the use of the
alternate assessment
•  English learners who have been enrolled in a
school in the United States for fewer than 12
months for ELA (optional exemption)
2016–17 CAASPP Pretest Administration Workshop
19
Computer Adaptive Test (CAT)
! CAT adjusts the level of difficulty to the
student’s abilities.
! Student is not scored on the basis of the
number of correct answers (i.e., percent
correct).
! Student is scored on both the number of
correct answers and the difficulty of the
questions completed.
2016–17 CAASPP Pretest Administration Workshop
20
Performance Task (PT)
!  The PT is designed to provide students with an
opportunity to demonstrate higher-order
thinking skills to explore and analyze a
complex, real-world scenario.
!  The PT is required. Students will not receive a
score if the CAT and PT are not completed.
2016–17 CAASPP Pretest Administration Workshop
21
Early Assessment Program (EAP)
!  Used to demonstrate college readiness at the California State
University (CSU) and some California community colleges
•  Grade eleven students must authorize the release of their
test results for each assessment (ELA and mathematics).
•  Students will receive a question at the end of the computer
adaptive portion of each test authorizing the release of
test results.
•  Students who do not authorize the release of their results
may need to provide a copy of the CAASPP score report
to the campus.
2016–17 CAASPP Pretest Administration Workshop
22
Benefits of the EAP
!  Students who release their CAASPP test
scores for EAP purposes and receive a score
of Standard Exceeded for ELA and/or
mathematics will not have to:
•  Participate in the CSU Early Start Program
•  Take the CSU Placement Exam for the
content area(s) where the score received
was Standard Exceeded
•  Take the community college assessment for
placement
2016–17 CAASPP Pretest Administration Workshop
23
Smarter Balanced Interim
Assessments
2016–17 CAASPP Pretest Administration Workshop
24
Security Considerations for
Interim Assessment Materials
!  In California, the Smarter Balanced Interim
Assessments are available only to educators in
California LEAs. (Nonpublic school educators
who provide direct instruction to California public
school students may also have access.)
!  The interim assessments are not for public use,
display, or distribution. Any use, display, or
distribution of the interim assessments that
results in access to individuals beyond LEA staff
is considered a security breach.
2016–17 CAASPP Pretest Administration Workshop
25
Overview of the Smarter
Balanced Interim Assessments
Two types of interim assessments:
!  Interim Comprehensive Assessments (ICAs)
•  ELA, mathematics, and PTs for each content area
•  Look and feel like the summative assessments
•  Between 34 and 49 questions per computer-based
fixed form
!  Interim Assessment Blocks (IABs)
•  Shorter and more focused on specific concepts
•  Designed to allow flexibility with pacing plans
•  Up to 18 questions per IAB
2016–17 CAASPP Pretest Administration Workshop
26
Benefits of Using
the Interim Assessments
!  Build teacher and student comfort with the
process of online testing
!  Evaluate progress and plan adjustments to
increase student learning
!  Experience content and questions reflective of
the summative assessments
!  Provide an excellent opportunity to try out
accessibility supports and actual test questions
with students
2016–17 CAASPP Pretest Administration Workshop
27
Using Interim
Assessment Results
Interim assessment results may help:
!  Improve teaching and student mastery of the knowledge
and skills measured by the assessment of the Common
Core State Standards (CCSS) (when combined with other
information)
!  Identify specific areas of strength and weakness
!  Check end-of-unit learning
!  Make decisions about areas of curricular enhancements
!  Make decisions around professional development needs
2016–17 CAASPP Pretest Administration Workshop
28
The Interim Assessment
Manner of Administration Setting
! The setting is used to identify which interim
assessment results are appropriate for
comparison across time and students.
! The accuracy of this setting is important.
! This setting should be set before
administering an interim assessment.
! Nonstandardized and Standardized/
Benchmark are the two setting options.
2016–17 CAASPP Pretest Administration Workshop
29
The Interim Assessment
Manner of Administration Setting
!  In the Interim Assessment (IA)
Reporting System, results with
the
icon are from a
Standardized/Benchmark
administration.
!  For further details, see the tip
sheet or the Interim Assessment
User Guide on the CAASPP
Portal.
2016–17 CAASPP Pretest Administration Workshop
30
Interim Assessment
Administration Resources
2016–17 CAASPP Pretest Administration Workshop
31
Interim Assessment Resources
!  Available on the CDE’s Smarter
Balanced Interim Assessments Web
page at
http://www.cde.ca.gov/ta/tg/sa/
sbacinterimassess.asp
•  Chart listing IABs available by
grade
•  IAB Blueprints
•  Number of questions that require
hand scoring
•  IA Video Series
!  Available on the CAASPP Portal at
http://www.caaspp.org/
•  Interim Assessment User Guide
2016–17 CAASPP Pretest Administration Workshop
32
Hand Scoring
Training Materials
!  Available on the TOMS Help
Page at
https://caaspp.ets.org/mt/
helpInterimTraining.htm
•  Hand scoring demonstration
videos, hand scoring
workshop videos, slide
presentations, and PDFs of
materials used
•  Hand scoring training guides
and exemplars
2016–17 CAASPP Pretest Administration Workshop
33
Digital Library
2016–17 CAASPP Pretest Administration Workshop
34
Digital Library Registration
!  LEA CAASPP coordinators are responsible for providing
access to LEA and nonpublic school staff who provide
services to their students.
•  Create and manage users and manage LEAs on the
Administration and Registration Tools (ART) Web site
at https://art.smarterbalanced.org.
•  Adding Users to the Digital Library video available at
http://www.caaspp.org/training/caaspp/index.html.
!  NEW! Self-registration interface for the Digital Library—
LEA staff will be able to request and receive a Digital
Library account or reset their password.
2016–17 CAASPP Pretest Administration Workshop
35
Digital Library Registration
!  Digital Library Self-Registration Page
2016–17 CAASPP Pretest Administration Workshop
36
Resources to Promote Educator
Use of the Digital Library
!  Digital Library Resource Collections
http://www.cde.ca.gov/ta/tg/sa/
collectionresources.asp
•  Professional Learning Series
o Collection of resources for
professional development
o Topics include: assessment
literacy, the formative
assessment process, and
supporting student
accessibility needs
2016–17 CAASPP Pretest Administration Workshop
37
Resources to Promote Educator
Use of the Digital Library
•  Instructional Learning Series
o Provides resources with
content assessed by specific
IABs
o Supplements core curriculum
•  Smarter Balanced—Digital
Library Connections
o Provides Digital Library
resources based on student
performance on the IABs
2016–17 CAASPP Pretest Administration Workshop
38
Resources to Promote Educator
Use of the Digital Library
!  Formative Assessment in
Action Video Series
•  Short videos that
feature California
educators modeling
formative assessment
practices in their
classrooms
http://www.cde.ca.gov/ta/tg/
sa/fainaction.asp
2016–17 CAASPP Pretest Administration Workshop
39
Resources to Promote Educator
Use of the Digital Library
!  In the Digital Library:
•  Video–Understanding the Formative Assessment Process video
!  On the CDE Digital Library Web page
•  PDF–The Formative Assessment Process
•  CAASPP Institute Training Materials—Section 4 on Formative
Assessment and the Smarter Balanced Digital Library
•  Spotlight Webinars by Smarter Balanced
•  Narrated presentations
•  FAQs
•  Videos–Formative Assessment in Action
!  On the CDE CAASPP in Action Web page
•  CAASPP in Action Report Series
2016–17 CAASPP Pretest Administration Workshop
40
Strategies to Encourage Educator
Use of the Digital Library
!  Dedicate time during staff meetings and/or professional
development time to explore the Digital Library and
CDE resources to support engagement.
!  Use the Professional Learning Series, the Instructional
Learning Series, and the Smarter Balanced Making
Connections resource lists.
!  Spend time working with site coordinators, LEA staff,
and teachers to familiarize them with the Digital Library.
!  Implement formative assessment processes and
practices for grade-level teams and school sites.
2016–17 CAASPP Pretest Administration Workshop
41
California Alternate
Assessments (CAAs) for ELA
and Mathematics
2016–17 CAASPP Pretest Administration Workshop
42
CAAs for ELA and Mathematics
!  Students are assessed through alternate achievement
standards linked to the California standards.
•  The CAAs are aligned to the core content
connectors.
•  They are administered one-on-one.
•  Practice tests for each grade and content area will
be available in January 2017.
•  CAAs will be available on March 20, 2017.
•  Testing ends the last day of the selected testing
window.
2016–17 CAASPP Pretest Administration Workshop
43
For More on the CAAs
Today’s afternoon workshop will provide indepth coverage, including:
! How to prepare for the CAAs, including the
CAA for Science
! Step-by-step instructions on how to administer
the CAAs to students
! What resources are available for the CAAs
2016–17 CAASPP Pretest Administration Workshop
44
California Science Pilot
Assessments
2016–17 CAASPP Pretest Administration Workshop
45
California Science Pilot
Milestones
January/February
November 8–10, 2016
• CAST 2018 Field Test Item
Writing Workshop
2017
2018
2020
• Training tests for
CAST and training
samples for CAA for
Science become
available
• CAST Field Test
• CAA for Science
Pilot Year 2
• CAA for Science
Operational
Administration
November 14–16, 2016
March 20, 2017
2019
• CAA for Science 2017 Pilot
Embedded Performance
Task Review Meeting
• Piloting of CAST
and CAA for
Science begins
• CAST
Operational
Administration
• CAA for Science
Field Test
2016–17 CAASPP Pretest Administration Workshop
46
CAST and CAA for Science Pilot:
Student Participation
!  All students in grades five and eight
!  A sampling of high school grades
State-level
highschoolsample
•  All high schools will participate.
Grade
12
•  Each high school will be assigned a
Grade
11
single grade, either grade 10, 11, or 12.
Grade
10
•  All students who are enrolled in that
grade are required to participate.
•  The assigned grade will be the same for the CAST pilot test
and the CAA for Science pilot test.
•  Grade assignments are available at
http://www.caaspp.org/administration/about/science/scienceassignments.html.
2016–17 CAASPP Pretest Administration Workshop
47
CAST Pilot Components
CAST2016–17Pilot
Component
Purpose
Date
Available
ConfiguraJon
TrainingTest
Providesstudents,teachers,
parents/guardians,andstakeholders January/
• 
withanopportunitytoengagewith February2017
CANGSS–aligneditems
Includesarangeofitemtypesand
content
FixedOnlineTest
Form
• 
Collectspar=cipa=onstatusof
students;anopportunitytotryout
March20,2017
newlydevelopeditemtypesandtest
• 
systemfunc=onality
• 
Includesafixedonlineformthathas
severaldiscreteitemsandonePTper
grade
Approximatelyonehourtocomplete
Availableinthetestdeliverysystem
• 
• 
March20,2017
• 
• 
AmericanSignLanguage
Text-to-Speech
Braille(i.e.,embosserandrefreshable)
PrintonDemand
Accessibility
Supports
Evaluatefunc=onalityofsome
accessibilityfeatures
StudentSurvey
•  3–5ques=ons
•  Approximately7minutestocomplete
Collectsinforma=onaboutstudents’
March20,2017
experienceswiththeassessment
•  Availableinthetestdeliverysystem
directlyfollowingthetestques=ons
TestAdministrator Collectsfeedbackonthepilot
Pretest Administration Workshop
administra=onandassessment
Survey 2016–17 CAASPP
•  10–12ques=ons
March20,2017 •  Approximately15minutestocomplete
48
•  Availableviaanonlinesurveyplaaorm
CAST Pilot Administration
!  Administered online only through the test
delivery system using the same secure
browser as the other CAASPP tests
!  Includes an online fixed test form that has
several discrete items, one PT per grade, and
a student survey
!  Takes approximately one hour to complete,
which includes completion of the PT
2016–17 CAASPP Pretest Administration Workshop
49
CAA for Science Components
CAAforScience
2016–17Pilot
Component
TrainingSample
Purpose
DateAvailable
Providesstudents,teachers,
parents/guardians,and
stakeholderswithanopportunity
January/
toengagewithitemsalignedto
February2017
thecorecontentconnectorsthat
arebridgestotheCANGSS
performanceexpecta=ons
Introducesteachersandstudents
Embedded
totheembeddedperformance March20,2017
PerformanceTask task
StudentSurvey
Collectspar=cipa=onstatusfor
accountabilitypurposesand
March20,2017
informa=onaboutstudents’
experienceswiththeassessment
TestExaminer
Collectsfeedbackonthepilot
March20,2017
Pretest Administration Workshop
administra=onandassessment
Survey 2016–17 CAASPP
ConfiguraJon
• 
Includesasampleembeddedperformance
task(embeddedPT)
• 
SimilartotheCAADirec&onsfor
Administra&on
AvailablefordownloadinTOMS
• 
•  2–3ques=ons
•  Approximately5minutestocomplete
•  Availableinthetestdeliverysystem
•  10–12ques=ons
•  Approximately15minutestocomplete50
•  Availableviaanonlinesurveyplaaorm
CAA for Science Pilot
Administration
!  The pilot is based on student performance on an
embedded performance task (embedded PT), one
per grade.
!  The embedded PT will be administered by the test
examiner, which may be the student’s primary
teacher.
!  Student responses are scored according to statedefined criteria and protocols.
•  Scores are not provided or reported for the pilot
test.
2016–17 CAASPP Pretest Administration Workshop
51
CAA for Science:
Benefits of Embedded PTs
!  Allow teachers to collect student work samples
throughout the school year
!  Provide an opportunity for students to demonstrate
performance in “real time”
!  Offer the least restrictive environment for teachers/
students to select/produce evidence
!  Support the improvement of teaching and learning
!  Promote the delivery of challenging, yet
developmentally appropriate, academic content to
students
2016–17 CAASPP Pretest Administration Workshop
52
CAST and CAA for Science
Pilot Results
!  Only participation rates will be reported, not
scores
!  Student Score Reports will include:
•  Purpose of the assessment
•  Timeline for implementation
2016–17 CAASPP Pretest Administration Workshop
53
Opportunities for Teacher
Involvement
!  Item writing
!  Item review
!  Form review
!  Scoring
!  Data review
!  Range-finding
To get involved, complete the CAASPP Content Reviewer
Application at http://caaspp.org/reviewers.html.
2016–17 CAASPP Pretest Administration Workshop
54
Accessibility Supports
2016–17 CAASPP Pretest Administration Workshop
55
Accessibility Supports
!  Universal Tools:
•  Available to all; based on student preference and
selection (e.g., strikethrough, highlighter)
!  Designated Supports:
•  Available to all; need to be indicated by an educator
or parent/guardian (e.g., color contrast, glossary,
magnification)
!  Accommodations:
•  Based on IEP or Section 504 plan (e.g., American
Sign Language, scribe)
2016–17 CAASPP Pretest Administration Workshop
56
Accessibility Supports
!  The online assessments include embedded
and non-embedded accessibility supports:
•  Embedded: part of the computer
administration (e.g., digital notepad,
calculator)
•  Non-embedded: provided outside of the
computer administration (e.g., scratch
paper, noise buffers)
2016–17 CAASPP Pretest Administration Workshop
57
Accessibility Supports
Graphic organizers available at
http://www.cde.ca.gov/ta/tg/ca/accesssupportitems.asp#ela
2016–17 CAASPP Pretest Administration Workshop
58
CAST Pilot Accessibility
Supports
!  Student eligibility for accommodations is identified in the student’s
IEP and/or Section 504 plan.
•  Student eligibility for the designated support available is
determined by the student’s instructor or parent/guardian.
!  The test delivery system will automatically register the student for
the accessibility test form when one or more of the test settings
are specified for the student.
!  Although all of the accessibility resources are not available for the
pilot, it is our goal to expand these for the field test and the
operational assessment.
2016–17 CAASPP Pretest Administration Workshop
59
CAST Pilot Accessibility
Supports
Students with the following test settings will take the
accessibility pilot form:
AccessibilitySupport
Type
AmericanSignLanguage(ASL)
EmbeddedAccommoda=on
Text-to-Speech
EmbeddedDesignatedSupport
Braille
EmbeddedAccommoda=on
PrintonDemand
EmbeddedAccommoda=on
2016–17 CAASPP Pretest Administration Workshop
60
CAST Unlisted Resources
!  Request unlisted resources by filling out the Web
form in the [Unlisted Resources] tab section in
TOMS.
•  The online request form has been enhanced for
easier completion.
•  The new response options and comment boxes
allow the CDE to ask for specific information
about the requested support.
•  The CDE’s response will indicate if the support
is already available on Matrix One.
2016–17 CAASPP Pretest Administration Workshop
61
Accessibility Supports
Resources
!  Smarter Balanced Usability, Accessibility, and Accommodations
Guidelines
http://www.smarterbalanced.org/wordpress/wp-content/uploads/
2014/08/SmarterBalanced_Guidelines.pdf
!  Smarter Balanced Usability, Accessibility, and Accommodations
Implementation Guide
http://www.smarterbalanced.org/wp-content/uploads/2015/09/
Usability-Accessibility-and-Accommodations-ImplementationGuide.pdf
!  Guidelines: Frequently Asked Questions
http://www.smarterbalanced.org/wp-content/uploads/2015/09/
Usability-Accessibility-Accommodations-Guidelines_FAQ.pdf
2016–17 CAASPP Pretest Administration Workshop
62
Accessibility Supports
Resources
!  CAASPP Accessibility and Accommodations
Webcast
http://www.caaspp.org/training/caaspp/index.html
!  Matrix One
http://www.cde.ca.gov/ta/tg/ai/caasppmatrix1.asp
!  Universal Tools, Designated Supports, and
Accommodations Short Demonstration Videos
http://www.caaspp.org/training/caaspp/uaag.html
2016–17 CAASPP Pretest Administration Workshop
63
Practice Tests
and Training Tests
2016–17 CAASPP Pretest Administration Workshop
64
Practice and Training Tests
!  Smarter Balanced Practice Tests
!  Smarter Balanced Training Tests
!  New CAAs for ELA and Mathematics Practice
Tests
!  New updated CAAs for ELA and Mathematics
Training Tests
!  CAST Training Test available January/February
!  CAA for Science Training Sample available
January/February
2016–17 CAASPP Pretest Administration Workshop
65
Limitations of the
Practice and Training Tests
Practice tests and training tests:
!  Assess some of the standards included in the
operational tests
!  Help familiarize students and teachers with the
online testing system
!  Are not scored (answer keys and scoring
rubrics may be available)
2016–17 CAASPP Pretest Administration Workshop
66
Smarter Balanced
Practice Tests vs. Training Tests
Training Tests
Purpose
Grade Levels
Number and Types of
Questions
Universal Tools, Designated
Supports, and
Accommodations
Practice Tests
Provide students, teachers, parents/guardians,
and stakeholders with an opportunity to quickly
become familiar with the software and interface
features
Provide students, teachers, parents/guardians,
and stakeholders with a grade-specific testing
experience similar in structure and format to the
summative assessments
Grade bands:
•  Grades 3–5
•  Grades 6–8
•  High school
Each grade:
•  Grades 3–8
•  Grade 11
Approximately 15 questions per grade band (6 in
ELA and 8–9 in mathematics); PTs are not
available
Approximately 30 questions in ELA and 30
questions in mathematics per grade level;
includes 1 ELA PT and 1 mathematics PT per
grade level
All
All
Not scored
2016–17
ScoringCAASPP Pretest Administration Workshop
Not scored; however, answer keys and scoring
67
rubrics are available
CAAs for ELA and Mathematics
Practice Tests vs. Training Tests
Training Tests
Purpose
Directions for
Administration
Provide students, teachers, parents/guardians,
and stakeholders with an opportunity to quickly
become familiar with the test delivery system,
question types, and interactions provided in the
Directions for Administration (DFAs)
Provide students, teachers, parents/guardians,
and stakeholders with a grade-specific testing
experience similar in structure and format to the
CAAs
DFAs can be downloaded from
http://www.caaspp.org/
DFAs available by grade can be downloaded from
http://www.caaspp.org/
One test each for ELA and mathematics
One test each for ELA and mathematics for each
grade 3–8 and grade 11
15 questions for ELA
13 questions for mathematics
Approximately 11–22 questions for each content
area
All that are available for the CAAs
All that are available for the CAAs
Grade Levels
Number and Types of
Questions
Universal Tools,
Designated Supports,
and Accommodations
Practice Tests
Not scored
2016–17 CAASPP Pretest Administration Workshop
Scoring
Will be provided
68
Science Pilot Assessment
Training Tests
Training Test for the CAST
Purpose
Grade Levels
Training Sample for the CAA for Science
Provides students, teachers, parents/guardians,
and stakeholders with an opportunity to become
familiar with the different types of questions
aligned to the CA NGSS performance
expectations
Provides students, teachers, parents/guardians,
and stakeholders with an opportunity to become
familiar with the embedded PT aligned to the CA
NGSS core content connectors, which are bridges
to the CA NGSS performance expectations
Includes questions from grades 5 or 8 or high
school
Grade 5
Approximately 5–10 questions for each grade
Approximately 2–5 questions
All that are available for the CAAs
Teachers may provide the same supports offered
to students during classroom instruction
Number and Types of
Questions
Universal Tools,
Designated Supports,
and Accommodations
Not scored; however, scoring rubrics are available
Scoring
2016–17 CAASPP Pretest Administration Workshop
Not scored; however, scoring rubrics are available
69
Accessing the Practice
and Training Tests
There are two ways to access the practice and training
tests:
1.  Through http://www.caaspp.org/ on a Web browser
2.  Through the secure browser, which simulates the
testing environment
a.  Test administrator or test examiner creates a
test session.
b.  Using the secure browser to create a practice
or training test session allows the students to
complete a test over multiple sessions.
2016–17 CAASPP Pretest Administration Workshop
70
Accessing the Practice
and Training Tests
2016–17 CAASPP Pretest Administration Workshop
71
Practice and Training Tests
Resources
Test Administrator and Test Examiner Resources
for the Online Practice and Training Tests:
http://www.caaspp.org/ta-resources/practicetraining.html
2016–17 CAASPP Pretest Administration Workshop
72
Roles and Responsibilities
2016–17 CAASPP Pretest Administration Workshop
73
Roles and Responsibilities
Available User Roles in TOMS:
LEACAASPPCoordinator
TestSiteCoordinator
TestAdministrator
TestExaminer
TestAdministrator&Test
Examiner
InterimAssessment
AdministratorOnly
Educator–District
Educator–
Test Site
View-only roles
Educator
– Roster
2016–17 CAASPP Pretest Administration Workshop
74
User Role Guidance
!  TOMS Pre-Administration Guide for CAASPP Testing
http://www.caaspp.org/administration/instructions/
!  User Roles and Definitions in TOMS
http://www.caaspp.org/administration/toms/toms-users.html
!  Instructions for Adding Users
http://www.caaspp.org/administration/toms/toms-upload-users.html
!  2016–17 User Role Guidance
http://www.caaspp.org/administration/toms/
!  Videos: TOMS Adding Users One by One and TOMS Adding Users by
Batch File Upload
http://www.caaspp.org/training/caaspp/
!  Template for Batch Upload of Users
http://www.caaspp.org/administration/toms/
2016–17 CAASPP Pretest Administration Workshop
75
Technology Update
2016–17 CAASPP Pretest Administration Workshop
76
Technology Update:
Operating Systems
Desktop Operating Systems
! Windows XP is no longer supported.
! LEAs must update their Windows operating
systems to a current and supported version for
2016–17 interim and summative testing.
! Windows XP users will receive an access
denied message if the secure browser is
launched.
2016–17 CAASPP Pretest Administration Workshop
77
Technology Update:
Secure Browser
Secure Browser
! Students must use the secure browser to take any
CAASPP online test, including the interim assessments,
summative assessments, science pilot, and the CAAs.
! Auto-update of the secure browser is not available for
2016–17.
! LEAs must update their secure browser to version 9.x.
Note: Test administrator computers may
use any standard, supported Web browser.
2016–17 CAASPP Pretest Administration Workshop
78
Technology Update
Prior to test administration, LEA CAASPP coordinators with
technology coordinators should:
R  Check for a stable high-speed Internet connection (wired or wireless).
R  Check that testing devices are working.
R  Ensure that secure browsers are properly installed a minimum of two weeks
prior to testing.
R  Make sure the necessary hardware is available and working (e.g., headphones,
external keyboards, printers).
R  Configure filters, firewalls, and proxy servers.
R  Ensure that any auto updates are turned off. Updates during testing have the
potential to kick students out of testing.
R  Ensure you are using the latest mobile secure browser.
2016–17 CAASPP Pretest Administration Workshop
79
Technology Update
2016–17 CAASPP Pretest Administration Workshop
80
Technology Resources
!  CAASPP Secure Browsers
http://ca.browsers.airast.org/
!  Bandwidth Checker
http://www.caaspp.org/about/bandwidth-checker.html
!  Technical Specifications and Configuration Guide for
CAASPP Online Testing
http://www.caaspp.org/administration/instructions/
!  Preparing Technology for 2016–17 CAASPP Testing
Webcast
http://www.caaspp.org/training/caaspp/
2016–17 CAASPP Pretest Administration Workshop
81
Using the Test Operations
Management System (TOMS)
2016–17 CAASPP Pretest Administration Workshop
82
Tasks to Complete in TOMS
for the 2016–17 Administration
R Add and manage all users.
R Set up test administration window.
R Review student data.
•  Demographic data from the California Longitudinal Pupil
Achievement Data System (CALPADS)
R Assign students to non-default tests—the CAAs and
Standards-based Tests in Spanish for Reading/Language
Arts (STS for RLA).
R Assign online test settings to students.
R Enter condition codes for Parent/Guardian Exemption
(PGE) and Not Tested Medical Emergency (NTE).
2016–17 CAASPP Pretest Administration Workshop
83
TOMS Student Profile
Demographics
Alldemographic
dataarereadonly.
2016–17 CAASPP Pretest Administration Workshop
84
TOMS Student Profile
Demographics
!  Data are read-only; corrections must be made
in CALPADS.
!  Students’ grade levels must be correct in TOMS
before the first date of the testing window.
•  The grade level is frozen on the day the
student logs onto his or her first test.
•  Any grade level changes require an incident
report to be submitted in the Security and
Test Administration Incident Reporting
System (STAIRS) and a reset appeal.
2016–17 CAASPP Pretest Administration Workshop
85
Importance of CALPADS
CALPADS is the sole source for student demographic,
enrollment grade, and program participation data.
Demographic Data in CALPADS
SSID
Primary language, Limited English Proficient
status, entry/exit dates, U.S. school
enrollment data, migrant status
Student name, gender, date of birth
Ethnicity, race
LEA and school names and countydistrict-school (CDS) code
Education program code (Special Education,
Section 504 status), primary disability code
Grade
Parent/guardian education, education
program participation
2016–17 CAASPP Pretest Administration Workshop
86
Importance of CALPADS
! Grade level is frozen on the day the student
logs onto his or her first test.
! LEAs cannot update student demographic data
in TOMS.
! LEAs must keep data in CALPADS up-to-date.
•  Processing time from CALPADS to TOMS is
24–48 hours.
! Student accessibility supports are uploaded
and maintained in TOMS, not in CALPADS.
2016–17 CAASPP Pretest Administration Workshop
87
TOMS Student Profile
Demographics
!  CALPADS Education Program designation for Special Education
(IEP) or Section 504 plan
•  These data are read-only; they must be modified in CALPADS.
•  Reminder: Embedded and non-embedded accommodations are
available only to students who have an Education Program code
of “101” for a Section 504 plan or “144” for a Special Education
indicator with a valid primary disability type in CALPADS.
2016–17 CAASPP Pretest Administration Workshop
88
TOMS Student Profile:
Test Mode
! Test assignments have been simplified for 2016–17.
There are only two options for test assignments:
• General
Assessments
• California
Alternate
Assessments
2016–17 CAASPP Pretest Administration Workshop
89
TOMS Student Profile:
Test Mode
!  Test assignment
•  The system will default to the General Assessments
assignment.
•  Students who are eligible for the CAAs must be
assigned in TOMS.
•  Reminder: Students can only be assigned to the
CAAs in TOMS with an Education Program code of
“144” for Special Education and with a valid primary
disability type in CALPADS.
!  LEAs should verify student test assignments a
minimum of 24 hours prior to student testing.
2016–17 CAASPP Pretest Administration Workshop
90
Condition Codes
!  Only two codes can be uploaded directly to TOMS:
•  Parent/Guardian Exemption (PGE)
•  Not Tested Medical Emergency (NTE)
!  Batch upload of condition codes is available.
!  The best practice is to enter condition codes prior to
testing.
!  The deadline to enter condition codes is the last day of
the selected test administration window.
!  Only one condition code can be applied per content
area per student.
2016–17 CAASPP Pretest Administration Workshop
91
Indicating Parent/Guardian
Exemptions
!  Set the PGE condition code in TOMS prior to
testing.
!  Set in the [Score Status] tab of the student’s
profile in TOMS.
2016–17 CAASPP Pretest Administration Workshop
92
Student Profile in TOMS:
Test Settings
!  LEA CAASPP coordinators and CAASPP test site
coordinators are authorized to set accessibility supports for
students in TOMS using the following methods:
•  One-by-one through the student profile
•  Template upload
•  CAASPP Individual Student Assessment Accessibility Profile
(ISAAP) Tool file upload
!  Test settings must be configured at least 24 hours prior to
testing.
•  Allow up to 24 hours from the time you configure student test
settings in TOMS to the time the changes appear in the Test
Administrator Interface and Student Testing Site.
2016–17 CAASPP Pretest Administration Workshop
93
Student Profile in TOMS:
Test Settings
2016–17 CAASPP Pretest Administration Workshop
94
Student Online Test Settings:
Batch File Upload
2016–17 CAASPP Pretest Administration Workshop
95
Test Administration
2016–17 CAASPP Pretest Administration Workshop
96
Systems and Processes for
Online Administration
1
CALPADS
•  Manage student
demographic data
2
TOMS
•  Setuptestadministra=on
windows
•  Verifystudentdemographic
data
•  Configureonlinetest
sedngs(designated
supportsand
accommoda=ons)
2016–17 CAASPP Pretest Administration Workshop
3
TestAdministrator
Interface&Student
TesJngSite
•  Administeronline
SmarterBalanced
assessments
•  AdministertheCAAs
•  AdministertheCAST
97
Smarter Balanced
Estimated Testing Times
Content Area
ELA
Mathematics
Both
CAT questions
PT
Total
Grades
hrs:mins
hrs:mins
hrs:mins
3–5
1:30
2:00
3:30
6–8
1:30
2:00
3:30
11
2:00
2:00
4:00
3–5
1:30
1:00
2:30
6–8
2:00
1:00
3:00
11
2:00
1:30
3:30
3–5
3:00
3:00
6:00
6–8
3:30
3:00
6:30
11
4:00
3:30
7:30
2016–17 CAASPP Pretest Administration Workshop
98
Scheduling Testing Time
!  Estimates do not account for the time needed to start
computers, load secure browsers, and log on students.
!  To help estimate the number of days and associated network
bandwidth required, see the Smarter Balanced Technology
Readiness Calculator at
http://www3.cde.ca.gov/sbactechcalc/.
•  Enter the number of students testing, number of computers
available, computer hours available per day, and Internet
connection speed.
!  Review and account for test expiration rules when
scheduling testing time.
2016–17 CAASPP Pretest Administration Workshop
99
Scheduling Testing Time
!  Recommendation: Schedule the CAT before the PT.
•  ELA PTs have two parts and can be completed over two
days.
•  Mathematics PTs have one part and can be completed in
one day.
!  Recommendation: PTs should not be administered on the
same day as the CAT.
CAT
2016–17 CAASPP Pretest Administration Workshop
PerformanceTask
100
Establishing Appropriate
Testing Conditions
!  Testing in classroom-sized groups is preferable:
•  Reduces test fear and anxiety
•  Facilitates monitoring and control for test
administrators
!  Room should have good lighting and ventilation,
and be free of noise and interruptions.
!  Remove or cover displayed information that
students could use to answer questions.
2016–17 CAASPP Pretest Administration Workshop
101
Establishing Appropriate
Testing Conditions
!  Make appropriate seating arrangements prior to
test administration.
•  Students should be seated so that they cannot
view the answers of others.
!  Establish procedures to maintain a quiet testing
environment.
•  Some students may finish more quickly than
others.
2016–17 CAASPP Pretest Administration Workshop
102
Establishing Appropriate
Testing Conditions
!  Cell phones and other electronic devices must be
turned off and put away during testing.
!  Post an “Unauthorized Electronic Devices May
Not Be Used at Any Time During the Testing
Session” sign so that it is clearly visible to all
students.
!  Place a “TESTING—DO NOT DISTURB” sign on
the door.
2016–17 CAASPP Pretest Administration Workshop
103
Demonstration
2016–17 CAASPP Pretest Administration Workshop
104
Test Rules for General
Assessments
Students:
! Must answer all test questions on a page (i.e., screen) before
moving on to the next page
! May not return to a test segment once it has been completed
and submitted
! Must answer all test questions before the test can be
submitted
! May not return to a test once it has been submitted
Test administrators:
! Must follow the “SAY” script exactly each time a test session
is administered
2016–17 CAASPP Pretest Administration Workshop
105
Pausing Tests
!  Test administrators may pause an individual
student’s test in the Students in Your Test Session
table.
•  This will not impact other students’ tests (for
Smarter Balanced and the CAST).
•  Not applicable for the CAAs because the CAAs are
administered one-on-one.
2016–17 CAASPP Pretest Administration Workshop
106
General Pause Rules
!  If there is a technical issue (e.g., power outage
or network failure), students will be logged off,
and the tests will be paused automatically.
!  If a test is paused, the student must log on
again to resume testing.
!  Highlighted text is preserved during test
sessions.
!  Student comments entered on a notepad are
preserved.
2016–17 CAASPP Pretest Administration Workshop
107
Smarter Balanced
CAT Pause Rules
! If the CAT is paused for more than 20 minutes,
the student is:
•  Required to log back on to the student interface
•  Presented with the page containing the question last
worked on (if the page contains at least one
unanswered question) or
•  Presented with the next page (if all questions on the
previous page were answered)
•  Not permitted to review or change any previously
answered questions (except questions on a page that
contains at least one unanswered question)
2016–17 CAASPP Pretest Administration Workshop
108
Smarter Balanced
CAT Pause Rules
!  If paused for fewer than 20 minutes, the student
is:
•  Presented with the question or passage he or she
was working on when the test was paused
•  Permitted to answer previously shown questions
within a segment
2016–17 CAASPP Pretest Administration Workshop
109
Smarter Balanced
PT Pause Rules
! ELA PTs are divided into two segments.
•  After a student completes the first segment, he
or she cannot return to it.
! There are no pause rules for PTs.
•  Even if a PT is paused for more than 20
minutes, the student can return to the current
segment and continue.
2016–17 CAASPP Pretest Administration Workshop
110
CAST Pause Rules
! If paused for more than 20 minutes, the student
is:
•  Required to log back on to the student interface
•  Presented with the page containing the question last
worked on (if the page contains at least one
unanswered question) or
•  Presented with the next page (if all questions on the
previous page were answered)
•  Not permitted to review or change any previously
answered questions (except questions on a page that
contains at least one unanswered question)
2016–17 CAASPP Pretest Administration Workshop
111
CAST Pause Rules
!  If paused for fewer than 20 minutes, the student
is:
•  Presented with the question he or she was working on
when the test was paused
•  Permitted to answer previously shown questions
2016–17 CAASPP Pretest Administration Workshop
112
Test Timeout
Due to Inactivity
!  Students are automatically logged off of the test after
30 minutes of inactivity.
•  “Activity” means selecting an answer or using a
navigation option in the test (e.g., selecting [Next] or
[Back], using the Questions drop-down list).
•  Note: Moving the mouse or selecting an empty space on
the screen is not considered activity.
•  Before the system logs off, a warning message is
displayed.
2016–17 CAASPP Pretest Administration Workshop
113
Test Expiration Rules
! The CAT remains active until:
• Student completes and submits the test,
• Selected test administration window ends, or
• 45 calendar days after the student has begun the CAT.
! The PT remains active for 10 calendar days after the
student has started it.
! An expired PT may be reopened by submitting an
appeal.
! The test expires at the end of the selected test
administration window.
2016–17 CAASPP Pretest Administration Workshop
114
Test Security
2016–17 CAASPP Pretest Administration Workshop
115
Test Security and Appeals
!  STAIRS requires LEA CAASPP coordinators and
CAASPP test site coordinators to submit an online
form to report an incident.
•  Any incidents related to the CAST also will be
submitted through STAIRS.
•  If an appeal is required, an e-mail will be sent
instructing the coordinator to file an appeal in
TOMS.
2016–17 CAASPP Pretest Administration Workshop
116
Test Security
There are three types of test security
incidents:
1.  Impropriety
2.  Irregularity
3.  Breach
2016–17 CAASPP Pretest Administration Workshop
117
Test Impropriety
!  An unusual circumstance that has a low impact on the
individual or group of students tested and low risk of
affecting student performance, test security, or test
validity
!  Correctable and containable at the local level
!  Must be reported to the LEA CAASPP coordinator or
the CAASPP test site coordinator
•  The coordinator must report it in STAIRS within 24 hours.
•  If needed, the coordinator will be instructed to submit an
appeal in TOMS.
2016–17 CAASPP Pretest Administration Workshop
118
Test Irregularity
!  An unusual circumstance that impacts the individual or
group of students tested and may affect student
performance, test security, or test validity
!  Correctable and containable at the local level
!  Must be reported to the LEA CAASPP coordinator or the
CAASPP test site coordinator
•  The coordinator must report it in STAIRS within 24 hours.
•  If needed, the coordinator will be instructed to submit an
appeal in TOMS.
2016–17 CAASPP Pretest Administration Workshop
119
Test Breach
!  An event that threatens test validity (e.g., release of
secure materials)
•  Example: Student or test administrator takes a
photograph and posts it to social media
!  External implications for the Consortium and other
statewide assessments
!  Must be reported to the LEA CAASPP coordinator
or the CAASPP test site coordinator who must
report the breach using the STAIRS form within 24
hours of the incident
2016–17 CAASPP Pretest Administration Workshop
120
Item Security and
Information Bar
Added bar code can be decoded and tracked if someone
takes a picture of the screen and posts it to social media
2016–17 CAASPP Pretest Administration Workshop
121
Test Security Incident
Types and Examples
Type of Security Incident
Example
Test Impropriety
Students talking during testing
Test Irregularity
Students cheating or providing answers to one
another
Test Irregularity
Student accessing or using electronic
equipment (e.g., cell phone)
Test Breach
Test administrator or CAASPP test site
coordinator modifying student responses or
records at any time
Test Breach
Test administrator allowing students to take
home test questions, passages, prompts, or
scratch paper
2016–17 CAASPP Pretest Administration Workshop
122
Reports
2016–17 CAASPP Pretest Administration Workshop
123
Completion Status Reports
!  Allow for the monitoring of testing progress for
students who participate in any CAASPP online
assessment, including the summative, interim, and
alternate assessments
!  Help ensure all students eligible for testing begin,
complete, and submit their tests
Note: Once testing is underway, users should check
the Completion Status system on a daily basis.
2016–17 CAASPP Pretest Administration Workshop
124
Completion Status Reports
Completion Status reports are accessible via the
CAASPP Portal for the summative and interim
assessments using your TOMS logon.
2016–17 CAASPP Pretest Administration Workshop
125
Completion Status Reports
Resources
!  Using Completion Status Reports to Plan and
Manage Testing video
http://www.caaspp.org/training/caaspp/index.html
2016–17 CAASPP Pretest Administration Workshop
126
LEA User List Report
!  First Name
!  Last Name
!  CDS Code
2016–17 CAASPP Pretest Administration Workshop
!  E-mail Address
!  Telephone Number
!  Role in Organization
127
School-Level Student
Demographics Report
2016–17 CAASPP Pretest Administration Workshop
128
LEA-Level Student
Demographics Report
2016–17 CAASPP Pretest Administration Workshop
129
LEA Coordinator Report
2016–17 CAASPP Pretest Administration Workshop
130
School-Level Student Test
Assignment Report
2016–17 CAASPP Pretest Administration Workshop
131
LEA-Level Student Test
Assignment Report
2016–17 CAASPP Pretest Administration Workshop
132
School-Level Student Test
Settings Report
2016–17 CAASPP Pretest Administration Workshop
133
Unlisted Resources Report
2016–17 CAASPP Pretest Administration Workshop
134
Student Results Report—Student
Score Data Extract
2016–17 CAASPP Pretest Administration Workshop
135
Questions
2016–17 CAASPP Pretest Administration Workshop
136
Help Desk Support
The California Technical Assistance Center
(CalTAC) is there to support all LEA CAASPP
coordinators!
Monday–Friday from 7 a.m.–5 p.m. PT
Summative Assessments: 800-955-2954
Digital Library and Interim Assessments: 855-631-1510
E-mail: [email protected]
CAASPP Portal: http://www.caaspp.org/
2016–17 CAASPP Pretest Administration Workshop
137