Educator`s Guide

E D UC AT O RS ’ D I RE C TI ON S F OR A DM IN IS T RA TI O N
TABLE OF CONTENTS
Overview of the Educators’ Guide ................................................................................................. 4
Structure of the guide .................................................................................................................. 4
Intention of the Guide ................................................................................................................. 4
Introduction & Overview ................................................................................................................ 5
Background on Alternate Assessment ........................................................................................ 5
Participation ................................................................................................................................ 5
Assessment Design ......................................................................................................................... 7
Design Overview ........................................................................................................................ 7
Development Efforts ................................................................................................................... 7
Content Assessed ........................................................................................................................ 8
WA-AIM Terminology ............................................................................................................... 9
Scope of the WA-AIM Alternate Assessment .......................................................................... 10
Assessment Delivery..................................................................................................................... 11
Engrade online platform ........................................................................................................... 11
Support Using Engrade ............................................................................................................. 11
Access Point Frameworks ............................................................................................................. 12
Performance Task Requirements .................................................................................................. 14
Steps for Administering the WA-Access to Instruction & Measurement..................................... 16
Overview ................................................................................................................................... 16
Preparing to Administer the WA-AIM ......................................................................................... 17
Step One: Confirm Students to be Assessed ............................................................................. 17
Step Two: Familarize Yourself with the Engrade Online Assessment Platform ...................... 18
Step three: Review the Access Point Frameworks ................................................................... 19
Step Four: Review the Performance Task Documents for Each Content Area ........................ 20
Administering the WA-AIM ......................................................................................................... 22
Step Five: Determine the appropriate access Point level for each standard ............................. 22
Step Six: Review the Performance Task for the Selected Access Point ................................... 23
Step Seven: Administer Baseline Performance Task................................................................ 25
8.
Observer Attestation ................................................................................................... 29
9.
Seventy-Five Percent Rule ......................................................................................... 29
Step Eight: Provide Instruction ................................................................................................. 30
Step Nine: Administer Final Performance Task ....................................................................... 31
Submitting the WA-AIM for Scoring ....................................................................................... 33
Scoring and Reporting .................................................................................................................. 34
Scoring ...................................................................................................................................... 34
Reporting................................................................................................................................... 34
Appendix A ................................................................................................................................... 35
IEP Team Decision Making Guidelines Regarding Student Participation in Statewide
Assessments .............................................................................................................................. 35
Appendix B ................................................................................................................................... 39
Engagement Rubric: Criteria for use ........................................................................................ 39
Engagement Rubric ................................................................................................................... 40
Appendix C ................................................................................................................................... 41
Observer Role and REsponsibilities ......................................................................................... 41
Appendix D ................................................................................................................................... 42
WA-AIM Access Point Framework & Performance Task Development Committees ............ 42
Appendix C ................................................................................................................................... 43
Ways of Communicating Matrix .............................................................................................. 43
OSPI Contacts & Support ............................................................................................................. 44
WA-AIM Information & Support ............................................................................................. 44
OSPI Division of Assessment and Student Information ........................................................... 44
3
OVERVIEW OF THE EDUCATORS’ GUIDE
STRUCTURE OF THE GUIDE
The Educators’ Guide to Administering the WA-Access to Instruction & Measurement (WAAIM) alternate assessment begins with a background on alternate assessments and the ways
students with significant cognitive challenges participate in state assessment programs. The
Educator’s Guide then moves to provide detailed descriptions of the two main components of the
assessment, the Access Point Frameworks and the performance task requirements and is then
followed by step-by-step directions for administration. The Educators’ Guide touches on the
online assessment platform (Engrade) that will be used to administer, deliver, and submit the
WA-AIM lays out resources for educators administering the assessment. Appendices provide
supporting materials, additional details, and supplementary resources. The engagement rubric
for students with the most significant cognitive challenges (students who fit the criteria of being
at or near the awareness level) as well as the directions for implementing the engagement rubric
are also in the appendices.
INTENTION OF THE GUIDE
The intention of the Educator’s Guide is to provide a working document that encompasses all
aspects of the WA-Access to Instruction & Measurement (WA-AIM) alternate assessment. The
Educators’ Guide will need to be supplemented with additional training and resources in order
for educators administering the WA-AIM assessment to be fully prepared to correctly administer
the assessment to yield valid results of their students’ knowledge and skills. The Educators’
Guide is intended to provide an overview of the steps for administration as well as further
information on the structure of the assessment and details on Engrade, the online assessment
delivery platform.
4
INTRODUCTION & OVERVIEW
BACKGROUND ON ALTERNATE ASSESSMENT
The Individuals with Disabilities Act (IDEA) Amendments of 1997 and 2004, as well as the
Elementary and Secondary Education Act (ESEA) also known as No Child Left Behind (NCLB),
require that all students with disabilities, even those with the most significant cognitive
challenges, participate in state and district assessment programs.
In particular, NCLB legislation ensures, “…that all children have a fair, equal, and significant
opportunity to obtain a high- quality education and reach, at a minimum, proficiency on
challenging State academic achievement standards and state academic assessments.” (2001)
The Individuals with Disabilities Education Act (IDEA) dictates that states develop alternate
assessments that:
• Are aligned with the states’ academic content standards. (SECTION 602 (3) of IDEA
97)
•
•
•
•
•
Improve the results for students with disabilities through improved teaching and learning.
Raise expectations for students with disabilities.
Increase access to the general curriculum.
Provide parents information about their child’s achievement.
All students are to be assessed based on grade--‐level content standards. (2003)
These pieces of legislation have complemented each other in their insistence that alternate
assessments for students with significant cognitive challenges:
• Are academic in nature.
• Are aligned with the same challenging state standards as for all other students.
• Promote access to and demonstrate performance in the general education curriculum.
• Reflect professional judgment of the highest achievement standards possible.
• Provide meaningful access to their assigned grade-level content in the areas of reading,
writing, mathematics, and science.
PARTICIPATION
School districts are required to include all students in state assessments, including students with
the most significant cognitive challenges. States are charged with developing alternate
assessments aligned to alternate achievement standards so that students with significant cognitive
challenges may meaningfully participate in the academic assessment program.
For the purposes of assessing with the alternate assessment, students with “significant cognitive
challenges” are those who:
require intensive or extensive levels of direct support that is not of a temporary or
transient nature. Students with significant cognitive challenges also require specially
5
designed instruction to acquire, maintain or generalize skills in multiple settings in order
to successfully transfer skills to natural settings including the home, school,
workplace, and community. In addition, these students score at least two (2) standard
deviations below the mean on standardized, norm-referenced assessments for adaptive
behavior and intellectual functioning. (OSPI, 2010)
Figure 1: Guidelines for Participating in the Alternate Assessment Graphic. See Appendix A
for the complete document.
The alternate assessment is designed for a small percentage (1%) of the total school population
for whom traditional assessments, even with accommodations, are not an appropriate means to
measure student progress. Each student’s IEP team will determine the most appropriate
assessment. Guidance for IEP teams has been developed, Guidelines for Participating in the
Alternate Assessment: Guidance for IEP Teams and can be found in Appendix A as well as on
the OSPI website.
6
ASSESSMENT DESIGN
DESIGN OVERVIEW
The WA-Access to Instruction & Measurement (WA-AIM) is a Performance Task type
assessment aligned to the Common Core State Standards (CCSS) in English language arts and
mathematics and the Washington Essential Academic Learning Requirements (EALRs) in
science. At grades three through eight and eleven, one standard from each of the five
mathematics domains and one standard from five of the English language arts strands has been
developed into an Access Point Framework. One standard from five of the science EALRs has
also been developed into an Access Point Framework.
The Access Point Frameworks provide the backbone for the WA-Access to Instruction &
Measurement (WA-AIM). Access Point Frameworks with three levels of complexity were
developed to provide students a continuum of entry points along which to show their knowledge
and skills aligned to the Common Core State Standards and Washington Science EALRs.
Performance tasks will be used to assess the knowledge and skills called out in the Access Point
Frameworks. Performance task requirements and examples for administration are presented for
every Access Point.
The WA-Access to Instruction & Measurement is designed to be a baseline/final assessment with
a minimum of six weeks of instruction between the baseline and final administration. The WAAIM will be delivered and submitted for scoring via an online delivery platform.
DEVELOPMENT EFFORTS
The WA-Access to Instruction & Measurement was a joint development effort between the
Office of Superintendent of Public Instruction (OSPI), Washington educators, and Measured
Progress test development experts. Washington educators participated in the development of
both the Access Point Frameworks as well as the Performance Task Requirements.
The Access Point Frameworks were developed first, articulating knowledge and skills aligned to
the Common Core State Standards and Essential Elements1. The Access Points went through
multiple iterations of review during their development including review by educator committees2
comprised of both expert general educators and special educators as well as LEA administrators
and OSPI staff. The review committees carefully considered issues of academic intent,
accessibility, and bias and sensitivity.
The work of the review committees guided test developers in the initial drafting of the
Performance Task requirements, which were then brought to educator committees. The
1
Dynamic Learning Maps Consortium (2013). Dynamic Learning Maps Essential Elements for Mathematics.
Lawrence, KS: University of Kansas.
2
Please see Appendix B for a list of the participating educators.
7
committee edits and considerations were taken into the last phase of development and are
represented in the final assessment documents.
CONTENT ASSESSED
The WA-Access to Instruction & Measurement (WA-AIM) is the alternate assessment for grades
three-eight and eleven. The WA-AIM assesses mathematics, English language arts, and science.
Mathematics
• All grades
English language arts
• All grades
Science
• Fifth, Eighth, & high school
Figure 1: Content and Grades Assessed
In mathematics, one standard for each of the five domains of mathematics is assessed at each
grade.
THIRD GRADE MATH
Geometry
Measurement & Data
Numbers Operations Fractions
Operations and Algebraic Thinking
Numbers and Operations in Base Ten
Figure 2: Third grade math standards
In the Common Core State Standards, English language arts is encompassing of reading
(literature and informational), writing, and speaking & listening. In English language arts, one
standard for each strand is assessed at each grade.
THIRD GRADE ELA
Reading Literature: Key Ideas & Details
Reading Informational: Craft & Structure
Reading Foundational Skills: Phonics & Word Recognition
Writing: Text Types & Purposes
Speaking & Listening: Comprehension & Collaboration
Figure 3: Third grade English language arts standards
8
For each content area and at each grade, the standards to be assessed have been developed into
Access Point Frameworks. (The Access Point Frameworks are discussed in detail in the next
section.) At each grade level, there is one Access Point Framework for each of the five domains
in math and each of five strands in English language arts. There is one Access Point Framework
for five science Essential Academic Learning Requirements (EALRs) at grades five, eight and
eleven. Students are assessed on all five of the standards at each content area at each grade.
Educators will determine the appropriate complexity level of the standard, but the standards to be
assessed are predetermined. The map of standards selected for assessment are presented in
Appendix C of this document. Mathematics is presented first with each domain developed into
an Access Point Framework, and therefore assessed, indicated. The mathematics blueprints are
followed by English language arts. The science blueprints are presented last and only show
grades five, eight, and high school as those are the only assessed grades.
WA-AIM TERMINOLOGY
Figure 4: WA-AIM Terminology
9
SCOPE OF THE WA-AIM ALTERNATE ASSESSMENT
At each grade, all students are assessed on the same standards for mathematics, English language
arts, and science. The standards have been preselected; they are the standards that are developed
into access point frameworks. There is one standard from each of the five domains of math and
one standard for five strands of English language arts, which is inclusive of reading, writing, and
speaking and listening. In grades 5, 8, and 11, students are assessed on five science EALRs.
Students will be assessed with a performance task for each of the five math domains and with a
performance task for each of five English language arts strands that have been developed into
Access Point Frameworks at each grade.
Figure 5: Example home screen displaying a student’s assessment
Engrade is the online assessment system used to deliver the WA-AIM. Each student has a home
screen in Engrade that displays all of the standards in her/his assessment. Engrade is discussed
in detail in the following section.
10
ASSESSMENT DELIVERY
ENGRADE ONLINE PLATFORM
The WA-Access to Instruction &
Measurement (WA-AIM) will be
delivered and submitted electronically
using an online educational platform,
Engrade. Engrade has been custom
built for OSPI to deliver the WA-AIM
assessment. Educators will use
Engrade throughout the assessment
processes.
Each educator will have a unique account. District Assessment Coordinators are working with
building based administrators or coordinators who will then send teachers their logon credentials.
Districts and schools have already been pre-populated with students, so teachers will only need
to add her students to be assessed to her class. Throughout the assessment window, educators
can also add or delete students to the assessment platform as needed. Engrade will enable
educators to track not only the progress of a single student, but that of all of their students
simultaneously.
SUPPORT USING ENGRADE
Engrade has developed a Users’ Guide that will provide instructions for accessing the platform
and using Engrade to administer the WA-AIM assessment. Engrade will also be supported with
a helpdesk as well as an online module to familiarize educators with the system. These resources
are posted on the WA-AIM website under the “Administration Platform” tab.
Figure 6: Engrade Users’ Guide/Procedures Manual and
customer support information are posted to the WA-AIM
website.
11
ACCESS POINT FRAMEWORKS
The Access Point Frameworks are expended frameworks that provide students with significant
cognitive challenges multiple entry points to the grade level Common Core State Standards. The
Access Point Frameworks are built on three levels of complexity giving students the opportunity
to apply, understand, and identify key knowledge and skills aligned to the content standards.
The mathematics and English language arts Access Point Frameworks follow the same design:
the Common Core State Standard is presented on the left, with the associated Essential Element3
directly to the right. The Access Point Framework follows. The Access Points on each
framework move from More complex on the right (closer to the CCSS), to Intermediate
complexity, to Less complex. The layout of the Access Point Frameworks presents the spectrum
of instruction for students, working from the grade level standard on the left to the less complex
Access Point on the right.
Figure 7: Anatomy of an Access Point Framework graphic. This graphic appears in the front of all the Access Point
Framework documents.
3
Dynamic Learning Maps Consortium (2013). Dynamic Learning Maps Essential Elements for Mathematics.
Lawrence, KS: University of Kansas.
Dynamic Learning Maps Consortium (2013). Dynamic Learning Maps Essential Elements for English language arts.
Lawrence, KS: University of Kansas.
12
The Access Point Framework documents are organized by content area and then by grade. At
the start of each new grade, a map of the standards expanded into Access Point Frameworks is
presented.
Figure 8: Map of sixth grade mathematics Common Core State Standards developed into Access Point Frameworks
13
PERFORMANCE TASK REQUIREMENTS
Student performance on the skills and knowledge detailed in the Access Point Frameworks will
be measured through teacher administered performance tasks. Performance Tasks Requirements
and Examples have been developed for each Access Point within all of the frameworks at every
grade and for every content area.
Each Access Point in
the framework has
an associated
performance task
with specific
requirements.
The performance
task requirements
reflect the Access
Point’s level of
complexity and
provides examples
on how to measure
the knowledge and
skills called out in
the Access Point.
Figure 9: Relationship of Access Point Frameworks to performance tasks
All of the performance tasks are structured identically with sections for: requirements,
adaptations, examples and restrictions. The requirements section details what requirements are
necessary in order to accurately measure the Access Point. Standard Requirements include five
unique items for each performance task and any necessary features specific to the task (e.g.,
objects must have straight and curvy lines, text must be informational). The adaptations detail
ways in which the performance task may be adapted to meet the needs of different students.
Adaptations can include using manipulatives, a tablet, or pictorial representations. The
restrictions section details any materials or procedures that are restricted as they would violate
the construct being measured (i.e., yield an invalid measure). In mathematics, a restriction might
be that the teacher may not count for the student, in English language arts, a restriction might be
that a multiple-choice item may not be used.
14
CCSS Domain
& Strand
Access Point
Requirements
Adaptations
Restrictions
Figure 9: Performance Task with highlighted components
The first Performance tasks will be administered as a baseline that determines the appropriate
Access Point Level for assessment. The final Performance Task will be the same task
determined as appropriate at the baseline and will measure the student’s knowledge and skills in
each content area after instruction. There must be minimum of six weeks of instruction between
administering a baseline and administering the final performance tasks.
15
STEPS FOR ADMINISTERING THE
WA-ACCESS TO INSTRUCTION & MEASUREMENT
OVERVIEW
The steps for administering the WA-AIM alternate assessment are broken down into two
sections: preparing to administer the WA-AIM alternate assessment and administering the WAAIM alternate assessment.
PREPARING TO ADMINISTER THE WA-AIM
1. Confirm the students to be assessed
2. Familiarize yourself with the Engrade assessment platform
3. Review the Access Point Frameworks
4. Review the performance task requirements documents
ADMINISTERING THE WA-AIM
5. Determine the Access Point level for each standard
6. Review the performance task for the selected Access Point
7. Administer baseline performance task to determine correct A.P. level
8. Provide instruction
9. Administer final performance task
Preparing for the WA-AIM begins by familiarizing yourself with the assessment platform, the
Access Point Frameworks and the performance tasks. The Access Point Frameworks provide
instructional and planning guidance and the performance tasks provide a way to measure a
student’s knowledge and skills called out in the Access Point Frameworks. Administering the
assessment to the student is when you will use the performance tasks to measure a student’s
knowledge and skills and record that performance in Engrade, the online system.
16
PREPARING TO ADMINISTER THE WA-AIM
STEP ONE: CONFIRM STUDENTS TO BE ASSESSED
1. Confirm that the student is to be assessed with the WA-Access to Instruction &
Measurement has the alternate assessment documented in her/his IEP.
a. The student’s IEP team will determine if the student will be assessed with the
general assessment, Smarter Balanced, or the alternate assessment, the WAAccess to Instruction & Measurement. If the student is to be assessed with the
alternate assessment, WA-AIM, it should be documented in her/his IEP.
2. The participation criteria for the alternate assessment has not changed. IEP teams will
use the OSPI provided guidance (2010)4 to aid in the decision making process. The
participation criteria are in Appendix A as well as posted to the WA-AIM website under
the “Resources” tab.
4
The participation criteria has not changed. The IEP Team Decision Making Guidelines have been updated to
reflect the CCSS assessment system as well as reorganized, but the criteria for participation remains the same as
previous years.
17
STEP TWO: FAMILARIZE YOURSELF WITH THE ENGRADE
ONLINE ASSESSMENT PLATFORM
Engrade is the online assessment platform educators will use to
administer the WA-Access to Instruction & Measurement. A link
to the Engrade portal is posted to the WA-AIM webpage as well
as the Engrade Users’ guide, a training module for using the Engrade system and the Engrade
support desk contact information.
1. Each educator will have a unique account.
a. District Assessment Coordinators work with building based administrators who
send teachers their logon credentials. Districts and schools have already been prepopulated with students, so teachers will only need to add the students to be
assessed to her class.
2. Review the Engrade Users’ Guide/Procedures Manual and/or view the Engrade Users’
online module.
3. There is a test account available for educators to familiarize themselves with the system
prior to operational administration. The link to the test site is on the WA-AIM
website/administration platform. The test account will remain live during the
administration window.
4. The Engrade system will be live for the operational administration at the beginning of
November, 2014.
Figure 9: Support for using the Engrade platform is provided by CTB via email or phone. This information
is located on the WA-AIM administration platform page.
18
STEP THREE: REVIEW THE ACCESS POINT FRAMEWORKS
The next step is to review the Access Point Frameworks. The Frameworks are organized by
content area: Math, English Language Arts and science. The documents are posted to the WAAIM website. The Access Point Frameworks are designed as learning progressions and are
aligned to the Common Core State Standards and Essential Element. The framework documents
can be used for instructional and planning guidance.
1. The Access Point Frameworks are located on the OSPI WA-Access to Instruction &
Measurement website.
Figure 11: Location of Access Point Frameworks on OSPI WA-AIM webpages
2. The Access Point Frameworks are organized by content area and are inclusive of grades
three through eight and eleven.
3. Review the Access Point documents for each content area, paying close attention to the
grade at which each student is assessed. *Remember, the CCSS and Essential Elements,
and therefore the Access Points, are unique at each grade.
19
STEP FOUR: REVIEW THE PERFORMANCE TASK DOCUMENTS
FOR EACH CONTENT AREA
The performance tasks are organized by grade. Each grade consists of English language arts and
mathematics and at grades 5, 8, and eleven, science. The documents are organized in the same
fashion: the Access Points for each standard are presented followed by the associated
performance tasks. The performance tasks are arranged in the order of more complex,
intermediate complexity, and less complex. English language arts comes first, followed by math
and, where applicable, science.
Figure 12: Example of performance task document layout: sixth grade math: ratio and proportional relationships
Universal to all the performance tasks:

is the requirement for five unique items. On the Engrade performance screen there is a
place for five item responses. “Unique” means that a student is asked five different or
unique questions (i.e., the student cannot be asked the same question multiple times).

is the number of response options is determined by the complexity level. The more
complex (M) and intermediate (I) levels will have three answer options for each item in
a multiple choice question. The less complex (L) level will have two answer options
for each item in a multiple choice question.
20
1. Go to the WA-AIM webpage and select the performance task requirements document for
the student’s enrolled grade.
2. Read through the grade level document to familiarize yourself with the way the
performance tasks correspond with the Access Points at each level in the content areas.
21
ADMINISTERING THE WA-AIM
STEP FIVE: DETERMINE THE APPROPRIATE ACCESS POINT
LEVEL FOR EACH STANDARD
For each standard assessed, educators will use professional judgment to determine the
appropriate level of Access Point, More (M), Intermediate (I), or Less (L) on which to assess the
student.
1. Consider the Access Point Framework for each standard separately.
2. Begin with the Intermediate Access Point.
a. What does the student know about the concept?
b. What skills associated with the Access Point can the student perform?
Start at the Intermediate level.
3. Use the Access Point documents in conjunction with the Performance Task documents to
determine the appropriately challenging level for the student to be assessed.
o The expectation is not that the student can demonstrate full mastery of the access point.
o If the student has mastered the knowledge and skills detailed in the Access Point then
then it is not complex enough and the student should move up a level.
o A student may be performing at different Access Point levels on different standards
within a content area.
22
STEP SIX: REVIEW THE PERFORMANCE TASK FOR THE
SELECTED ACCESS POINT
Every performance task has the same components: requirements, examples, adaptations and
restrictions and is structured identically. The provided examples must be used to frame out the
performance task. Educators will make adaptations to the example in order for the five items to
be accessible to each unique learner.
assessed
Access Point
Requirements
Examples
Adaptations
Restrictions
Figure 13: Diagram of a performance task: Sixth grade ratio and proportions
23
1. The vast majority of the performance tasks have at least two example set ups to choose
from.

The provided examples must be used to frame out the performance task.
2. Review the teacher directions.

There are sample directions to a student.

In parentheses there are directions to teacher.
3. Review the adaptations section.

What materials are needed to make the task accessible to the student?

How will the remaining four items follow the example?
4. Review the restrictions section.

Are there any restrictions to the performance task (e.g., do not count the numbers
for the student)?
24
STEP SEVEN: ADMINISTER BASELINE PERFORMANCE TASK
Engrade facilitates the administration and is the platform that will hold all student information.
When administering the performance tasks, it will be helpful to have the performance task
documents with the examples accessible as well as the Engrade system on which to enter the
data. Educators will work between the source documents and the Engrade system to administer
the assessment to each student.


The Performance Task documents directly
correlate with the Engrade performance
screen.
When the Access Point level is selected in
Engrade, the requirements and
restrictions are populated on the screen.
Figure 14: Relationship of Performance Task documents and Engrade performance screen
25
The vast majority of the performance tasks have two guiding examples for administering the
task. Both examples provide a valid measure of the Access Point; educators need to determine
which example will be the most appropriate for each student.
1. Determine which example to use.
Figure 15: Fifth Grade Math: Geometry (I): Performance Task Document and performance scoring screen in
Engrade
26
2. Review the Teacher Directions section. In example one from Fifth grade Geometry,
Intermediate level, the teacher is showing the student a shape and asking the student to
select from a field the shape with the same number of sides.
3. Decide the materials needed to make the task accessible to the student that will yield five
scorable items. This might include the text to be read, sentence starters, and/or
manipulatives.
4. Using the prompts in the teacher direction section, administer the first item to the student.
Figure 16: This setup shows the
Performance Task document for
5th grade Geometry: Intermediate
in relation to the performance
scoring screen in Engrade for this
task.
Teacher Directions are a
summary of the directions
used for the selected
example.
Item type: the student is
selecting the correct shape
from a field. These are multiple choice items. Therefore the item type is selected response.
27
Adaptations: The adaptations are notes on what used to complete a task (e.g., manipulatives, text,
etc.). In this example the adaptations listed are flash cards with shapes.
5.
Using the first item as a guide, administer the next four items.
a. In a selected response performance task, additional items are created by changing
either the stem of an item (the question) or by changing the answer options.
Changing the stem: using the same answer options as the first example (flash cards with
the shapes: parallelogram, hexagon and triangle) present the student with a new
question: Here is a picture of a right triangle; which of these shapes has the same
number of sides?
Changing the answer options: using the same stem/question (flash card with a picture of
a square), present the student with new answer options (flash cards with a picture of a
triangle, pentagon, and diamond. Here is a picture of a square; which of these shapes
has the same number of sides?
6. Each item is scored with a 0 or 1 value. If the student got the answer correct, a 1 is
entered. If the student did not make a correct response, a 0 is entered.
7. In the teacher notes section the teacher documents the student’s either correct or incorrect
response.
Figure 17: Detail: Engrade performance scoring screen: example task: Fifth grade math,
Geometry (I)
28
8. OBSERVER ATTESTATION: The Observer Attestation is designed to strengthen the
procedural validity of the assessment and is integral to administration of each
performance task. (See Appendix C)
An educational professional (administrator, paraprofessional, educator, or service
provider) who is not the test administrator must observe the student performing the task
and verify that the student independently generated the answers documented in the
performance scoring section. The observer will enter her/his name and role on the
performance scoring screen for each performance task.
Figure 18: Observer attestation section of Engrade performance scoring screen
a. The observer may record the data in Engrade as the student is being assessed to be
confirmed by the educator. Alternately the observer may review the data the
teacher administering the assessment entered prior to entering her/his name and
attesting to the student’s performance on each assessed task.
9. SEVENTY-FIVE PERCENT RULE: At the baseline, if the student is scores above
75% on an individual performance task (4/5 or 5/5 items correctly), then the student
needs to be assessed at a higher Access Point.
a. If a student has already mastered a skill, then s/he needs to be moved to the next
Access Point level. The baseline performance task serves to place the student at
the most appropriate level for the assessment. If a student does not have any
knowledge or associated skills for the access point, that is absolutely fine. The
educator will make a professional judgment of the most appropriate place to begin
the assessment at the baseline based on knowledge of student performance.
29
STEP EIGHT: PROVIDE INSTRUCTION
The WA-AIM is designed to work with the knowledge and skills being taught during the course
of the year. Examine existing unit and lesson plans to determine at which points throughout the
year the various standards and Access Points can be addressed in your current mathematics,
English language arts, and science lessons.
1. There must be a minimum of six weeks of instruction between the administration of the
baseline and final performance task.
2. Standards may be administered on an individual basis if it is most appropriate based on
instructional practice. E.g., if lessons or IEP progress reporting fall at a particular time
during the assessment window, it would be completely appropriate to align administering
performance tasks with these events to use the data for multiple, meaningful purposes.
3. The assessment window runs November 1st, 2014 through April 10th, 2015.
30
STEP NINE: ADMINISTER FINAL PERFORMANCE TASK
The student is assessed at the same Access Point level with the same performance task
requirements from the baseline at the final assessment. “Items must be unique” means that you
will not ask the student the exact same question each time within a performance task. You may
use the same questions at both the baseline and final. Alternately, you might use one of the other
examples for the performance task or change the question. In English language arts, you might
change the text with the same set of questions. The individual items on baseline and final
performance tasks are not compared with one another, just the items within each task (i.e., there
must be five unique items within the baseline and within the final).
.
You will notice that the setup of
the performance scoring
screen is identical.
The Access Point Level is
identical, so are the
requirements.
The item type is identical,
although it does not have to be.
Figure 19: This visual is of a baseline and final performance task for a demonstration student.
31
Once a student’s assessment data has been entered into the performance scoring screen and the
data saved, you will be returned to the student’s home assessment screen. You will be able to
see an overview of the student’s entire assessment. For each completed performance task, a
green check mark appears, thereby indicating that the student has completed the assessment.
d
Figure 20: Engrade home screen showing standard with green checkmarks indicating that both the baseline and final
assessments have been completed
32
SUBMITTING THE WA-AIM FOR SCORING
The student’s home assessment screen shows a green checkmark for each completed
performance task. Once a student’s assessment is complete, and there is a green checkmark at
both the baseline and final measure for each standard, the assessment activities are over. There
is no further action required of the teacher.
Figure 21: Engrade home screen showing completed assessment. Each standard has a green checkmark at both
baseline and final indicating that the assessment is complete.
After the assessment window closes on April 10th, 2015, the assessments will be automatically
locked and uploaded via the Engrade platform for scoring.
33
SCORING AND REPORTING
SCORING
During the administration of the WA-Access to Instruction & Measurement (WA-AIM)
educators determine the most appropriately challenging Access Point and administer the
associated Performance Task. There are five items at the baseline and five items at the final
assessment. Educators score each item is scored with a 0/1 value based on a student’s response.
The scores on the items for each of the final performance tasks are the ones that will be used to
calculate proficiency. For each content area, a student will have five standards, each with five
scorable items, for a total of 25 problems.
The assessment window closes on April 10th, 2015 at which time the WA-AIM assessments will
be submitted via Engrade to be scored and the data captured for reporting. The Office of
Superintendent of Public Instruction (OSPI) works with professional scorers and uses rigorous
methods to ensure that the scoring process yields valid and reliable results.
The process of determining what constitutes a passing scoring for the purposes of federal and
state accountability is called, “standard setting.” The standard setting process for the WA-AIM
will take place during July of 2015. The standard setting panels will consist of both special
educators and general educators, school psychologists, and community members representing
educational communities across the state of Washington. The standard setting panels will review
the assessment data and work with standard setting experts to make judgments as to where to set
the cut scores to determine proficiency. The standard setting panels’ recommendations will be
brought to the State Board for approval in August.
REPORTING
In the beginning of September, districts and schools will receive score reports detailing student
performance on the 2014-2015 WA-Access to Instruction & Measurement (WA-AIM). Copies
of Individual Student Reports (ISRs) will be provided to schools to send home to families that
explain student scores on the assessment.
34
APPENDIX A
IEP TEAM DECISION MAKING GUIDELINES REGARDING STUDENT
PARTICIPATION IN STATEWIDE ASSESSMENTS
The Individualized Education Program (IEP) team makes many important decisions
regarding the program and services available for students eligible for special education and
related services. One of those important decisions involves a determination of how a
student will participate in (1) the general student assessment system in grades 3-8 plus
once in high school, with or without allowable accommodations, or (2) if the student will
participate in the Alternate Assessment. Essential to an appropriate decision by the IEP
team regarding a student’s participation at any level of the statewide assessment system is
a fundamental belief in the integrity of the overall IEP process.
IEP teams should begin this decision-making process with the proposition that all students,
including all students eligible for special education, can learn grade level content and should
participate in the general assessment system to the maximum extent possible. However, there
are times in which the IEP team can decide that the alternate assessment is necessary and
appropriate for a relatively small segment (approximately 1%) of the total tested population, or
roughly 10% of the total number of special education eligible students being tested.
For example, if the total tested population in a school district is 4,000, then 40 students would
represent 1% of the total tested population. Similarly, if 400 students eligible for special
education were tested in the same school district, then 40 would represent 10% of the students
eligible for special education that were tested.
General Criteria
The decision about how an eligible student participates in the statewide assessment is an IEP
team decision, and not an administrative decision. The IEP team should use the following
criteria for determining the extent to which a student can participate in the general
assessment, with or without accommodations, or if the student should participate in the
alternate assessment system (WAC 392172A-03090 through 03110).
1) The student must be eligible for special education and must have an individualized
education program (IEP) in effect at the time of the decision.
35
2) IEP team decisions regarding a student’s participation in the statewide assessment must
be based on both current and historical evaluation and instructional data relevant to the
student.
3) IEP team decisions should be based on the student’s present levels of educational
performance, need for specially designed instruction, annual goals, learner
characteristics and access to the general education curriculum.
4) IEP Team decisions regarding a student’s participation in statewide assessments must be
made at a scheduled IEP team meeting that precedes administration of the statewide
assessment.
Alternate Assessment
The alternate assessment is a statewide testing option in lieu of the regular assessment. It is an
option only for students with significant cognitive challenges. The term “significantly
cognitively challenged” does not represent a new or separate category of disability. It is a
designation applied to a small number of students (generally 10% or less) eligible for special
education and related services participating in the statewide testing program.
For purposes students who are significantly cognitively challenged means those students who
require intensive or extensive levels of direct support that is not of a temporary or transient
nature. Students with significant cognitive challenges also require specially designed
instruction to acquire, maintain or generalize skills in multiple settings in order to successfully
transfer skills to natural settings including the home, school, workplace, and community. In
addition, these students score at least two (2) standard deviations below the mean on
standardized, norm-referenced assessments for adaptive behavior and intellectual functioning.
For a student to be considered as having a significant cognitive challenge and therefore,
appropriate for consideration as a candidate for the alternate assessment, ALL of the following
statements should be carefully considered by the student’s IEP team:
 The student’s demonstrated cognitive functioning and adaptive behavior in school, work,
home and community environments are significantly below chronological age
expectations, even with program modifications, adaptations and accommodations.
36
 The student requires extensive direct instruction and/or extensive supports in multiple
settings to acquire, maintain and generalize academic and functional skills necessary for
application in school, work, home and community environments.
 The student demonstrates complex cognitive disabilities and poor adaptive skill levels
determined to be significantly (at least two standard deviations) below chronological age
expectations by the student’s most recent individualized eligibility determination which
prevents the student from meaningful participation in the standard academic core
curriculum or achievement of the appropriate grade level expectations.
 The student’s inability to complete the standard academic curriculum at grade level is not
primarily the result of: (a) poor attendance, excessive or extended absences, (b) lack of
access to quality instruction, (c) social, cultural, linguistic, or economic differences, (d)
below average reading or achievement levels, € expectations of poor performance, (f) the
anticipated impact of the student’s performance on the school/district performance scores,
and (g) the student’s disability category, educational placement, type of instruction, and/or
amount of time receiving special education services.
When an IEP team determines that the student should take an alternate assessment, the team
must document why the student cannot participate in the regular assessment, and why the
alternate assessment is appropriate for the student. Please note that an IEP team could
document and justify that the alternate assessment could be an appropriate statewide
assessment for an individual not necessarily meeting all of parameters of the state definition of
significantly cognitively challenged on a case by case basis.
37
38
APPENDIX B
ENGAGEMENT RUBRIC: CRITERIA FOR USE
For a student’s whose level of cognitive development would be considered awareness and is
unable to participate even minimally in the performance tasks at the lower complexity level for
any standard within a content area, the IEP team may consider using an Engagement rubric to
measure a student’s engagement and attention to academic activities and provide information to
schools and families on the student’s progress in pre-academic activities.
For a student who meets the below criteria, the IEP team may decide that in lieu of participating
in the performance task aspect of the alternate assessment, a student’s engagement with the
mathematical, literacy, or science activities taking place in the classroom may be measured and
reported on. Because using the Engagement rubric replaces the performance task assessment, a
student will be placed in performance level one.
The student must meet some or all of the criteria below for the IEP team to consider using the
Engagement rubric for a content area of the alternate assessment:
 The student communicates primarily through cries, facial expressions, change in muscle
tone but no clear use of objects/textures, regularized gestures, picture signs, etc.
 The student alerts to sensory input from another person (auditory, visual, touch,
movement, etc.) but requires actual physical assistance to follow simple directions; or the
student’s response to sensory stimuli (e.g., sound/voice; sight/gesture; touch; movement;
smell) is unclear.
 Parents and teachers must interpret child’s state from behaviors such as sounds, body
movements, and facial expressions.
If after thorough review of the alternate assessment at the student’s enrolled grade, the
Engagement rubric, and the above criteria, the IEP team decides that measuring a student’s
engagement and attention to academic activities is most appropriate, the following steps must be
taken:
1) Obtain signatures from: classroom teacher administering the assessment, building based
administrator, and special education director.
2) Contact OSPI office of alternate assessment: [email protected]: subject line: WA-AIM
Engagement Rubric and request the rubric and supporting directions.
3) Scan or fax the signature page to OSPI’s assessment office: 360.725.0424
4) Directions for administration, scoring, and submission will be sent via email for use
during the assessment window.
39
ENGAGEMENT RUBRIC
40
APPENDIX C
OBSERVER ROLE AND RESPONSIBILITIES
The administration of every performance task must be accompanied by an attestation of an
outside observer. The role of the observer is to observe the teacher administering the
performance task to a student being assessed with the WA-AIM.
Who can be an observer?

The observe must be an educational professional who is not the teacher administering the
test.

The observer must be an employee of the district and can be another teacher,
paraprofessional, related service provider (e.g., speech language pathologist), or
administrator (e.g., principal or special education director).
What is the role and the duties of the observer?

The observer must be familiar with the performance task the student is being assessed
with.

The observer watches a teacher administer a performance task to the student being
assessed.

The observer then reviews the performance data entered into the Engrade online system
to ensure the accuracy of the documentation of student responses.

If the observer believes the data on the performance screen accurately captures the
student’s performance, then the observer will enter her/his name and indicate her/his
role, thereby attesting that the assessment data presented is accurate.
Attestation:
41
APPENDIX D
WA-AIM ACCESS POINT FRAMEWORK & PERFORMANCE
TASK DEVELOPMENT COMMITTEES
Jodell Allinger, Ed.D……………….
Diane Berry, M.A. …………………
Glenda Blankenship, M.A., NBCT...
Lori Carossino……………………...
Tanya Cochran, M.A……………….
Dawn Cope, M.Ed …………………
Cathy Corrado, M.A………………..
Mary Crosby, NBCT……………….
Rick Culbertson, M.A. …………….
Lucy EveryHope, M.A. ……………
Rebecca Fry, M.A., NBCT…………
Ann Gateley, M.Ed. ……………….
Lynn Gill, M.Ed. …………..………
Lynne Glasspool, M.Ed. …..……….
Paula Green, M.A. NBCT………….
Stacey Gruenich, M.Ed., NBCT……
Shellie Harris, M.A. ……………….
Shari Hartwig, M.A. ……………….
Katy Henry, M.A. ………………….
David L. Hoph, M.A. ……………...
Julie Knoedler, M.Ed. ……………..
Theodore (Ted) Mack, NBCT ……..
Yolanda G. McClanahan …………..
Rena Mincks, Ph.D., NBCT ……….
Courtney Myers, M.A. …………….
Chris Neese-Blackman, Ed.D. …….
Sarah Nickel, M.A., NBCT ………..
Colt Nickel, M.A. ………………….
Alisha Nimmo ……………………..
Emma Noble, M.Ed. ……………….
Kim Perisho, M.A.T., NBCT ……...
Cheryl Picolet, M.A. ………………
Karl Reddy, M.A. ………………….
Sapna Sethi, M.A. …………………
Susan Smith, NBCT ……………….
Debra Strawhun, CCC-SLP, NBCT..
Amy Vaughn, M.A. ………………..
Jennifer Veliz, M.A. ……………….
Megan Walker, M.A. ………………
Jane Wilson, M.Ed. ………………
Longview School District
Wapato School District
Federal Way Public Schools
Elma School District
Goldendale School District
Office of Superintendent of Public Instruction
Center for Childhood Deafness and Hearing Loss
Everett School District
Anacortes School District
Lynden School District
Bellevue School District
Seattle Public Schools
Bethel School District
Lake Chelan School District
Sunnyside School District
Kent School District
Seattle Public Schools
Mead School District
Spokane School District
Toledo School District
Evergreen-Clark School District
Moses Lake School District
Evergreen School District
Pullman School District
Evergreen Public Schools
Walla Wall School District
Pasco School District
Pasco School District
Camas School District
Spokane School District
Mukilteo School District
Bellingham School District
Washington School for the Deaf
Tacoma School District
Ferndale School District
Bremerton School District
Office of Superintendent of Public Instruction
Chief Leschi Schools
Federal Way Public Schools
Vancouver School District
42
APPENDIX C
WAYS OF COMMUNICATING MATRIX
Ways of Communicating Matrix from Washington Sensory Disabilities Services:
http://www.wsdonline.org
43
OSPI CONTACTS & SUPPORT
WA-AIM INFORMATION & SUPPORT
OSPI WA-Access to Instruction & Measurement website:
http://k12.wa.us/assessment/WA-AIM/default.aspx
For questions regarding administration of the WA-AIM: [email protected]
For support using Engrade: [email protected]
OSPI DIVISION OF ASSESSMENT AND
STUDENT INFORMATION
Robin Munson, Ph.D.
Assistant Superintendent of Assessment & Student Information
Michael Middleton
Director of Select Assessments
Lesley Siegel, Ph.D.
Alternate Assessment Coordinator
Kimberly DeRousie
State Test Coordinator
Collette Mason
Project Specialist
44