Assessment Update Webinar
SY 16-17 UPDATE #9
MAY 16, 2017
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
1
Today’s Topics
Operations
Content
Technology
TIDE Appeals
Interim vs. Summative
Managing Test Windows in TIDE
Testing Schedule
HS Science field test
Understanding Smarter Balanced Scores
Higher Education Placement
Smarter Ready
Ready WA
Sample Items
Interim Answer Keys
ChromeVox
Chrome 58
Text to Speech – iOS IPads
Secure browser update
Data
End of year close-out
Start-up timelines
NAEP
2018 NAEP and International Assessments Update
Select Assessments
Other
COE
ELPA21
Graduation Alternatives
WA-AIM
Where to find historical webinars / where to
register for upcoming ones.
Contact Information
2
Operations Update
3
TIDE Appeals
TIDE Appeals Update:
The AIR Appeals Support Team is processing appeals within 24 hours
Over 1,000 appeals submitted due to TAs inappropriately administering a Summative
instead of an Interim
•
Verify whether you have students who were given the incorrect assessment
When incidents occur during testing, should TAs instruct students to continue testing?
DCs or DAs report incidents to [email protected] and [email protected]
4
Managing Test Windows in TIDE
DCs or DAs can now set summative test windows in TIDE, and can adjust as necessary.
◦ For entire district, or
◦ Individually by school
Once the schedules are set in TIDE, the change will automatically be reflected in the Test Delivery
System (TDS)
Summative tests will only be available during the windows set in TIDE.
◦ This will eliminate TA access until there is an approved schedule, and
◦ Help to avoid summative being administered when interim is intended.
A ‘Make-up’ window can also be set to accommodate students who were unable to be assessed
during the initial schedule.
Full instructions are in the updated TIDE User Guide
2017-18 State Testing Schedule
Administration
Assessment
Grades
Subjects
Testing Window
Fall 2017
Smarter Balanced
Off-Grade Level Graduation
Alternatives
11 & 12
11 & 12
ELA, Math
ELA, Math, Science
Online: 10/23 – 11/17
Paper/Pencil: 10/30 –
11/17
Winter 2018
WA-AIM
End-of-Course (EOC)
Smarter Balanced
ELA, Math
Algebra, Integrated I, Geometry, Integrated II
Science
ELA, Math
Online: 9/11- 11/17
Paper/Pencil: 1/2 - 2/2
Spring 2018
12
12
Class of 2017 and beyond
3-8
10, 11, 12
ELA, Math
Online: 3-5 – 6/8
Paper/Pencil: 5/4 – 5/25
5&8
Science
Online: 4/16 – 6/8
Paper/Pencil: 4/16 – 5/18
11
Science
Online: TBD
Paper/Pencil: TBD
Algebra, Integrated I, Geometry, Integrated II
Science
ELA, Math, Science
Paper/Pencil: 5/7 – 6/8
Off-Grade Level
12
Class of 2017 and beyond
10 – 12
ELPA21 Spring Annual
ELPA21 Spring Alternate
K – 12
K – 12
Writing, Reading, Listening, Speaking
Writing, Reading, Listening, Speaking
Online: TBD
Online: TBD
Paper/Pencil: TBD
Science
EOC
Online: 3/5 – 6/8
Paper/Pencil: 3/5 – 5/18
Online: 3/5 – 6/8
Paper/Pencil: 3/5- 5/18
Data Update
7
Data Cleanup Spring 2017
Non-TIDE Test Exemption Tasks Due by 6/10
1) Medical Exemption: Report directly to Kimberly DeRousie in Assessment Operations
◦ [email protected] fax: 360-586-2728
2) WA-AIM Late Enrollment: Report directly to Toni Wheeler in Special Populations Assessments
◦ [email protected] fax: 360-725-0424
Both of these will be incorporated into accountability extract view in WAMS
8
Data Cleanup Spring 2017
Kiddos with 2 records in TIDE? Do this in this order:
1) Work with your CEDARS admin and OSPI Customer support to resolve the ssid split/merge
◦ Resolve to single, correct SSID is step 1
2) If any assessments have been administered under a ‘bad’ SSID, have the user contact the
WCAP helpdesk managed by AIR to migrate the test
◦ AIR has significant problems doing this after the test admin closes
3) Assessment Analysts can manually delete the record in TIDE with a bad record
◦ Good idea to let us know that steps 1 and 2 are done.
REMEMBER: the mere fact that a student has a record in TIDE does not inherently mean the
student MUST be assessed on SBA.
9
Data Cleanup Spring 2017
The fact that the student is enrolled as reflected in CEDARS or is not enrolled but completes a
test drives who is in or out of accountability metrics.
Review CEDARS data for accuracy
◦ WAMS page to be provided for high level review by assessment staff on 5/22 – static file, not a final
version
◦ This is an “If we pulled a record for every student as of today, this is what it your data would look like
without the tests merged in”
◦ What to look for: students in correct grade level, program flags mostly to completely accurate, only
students enrolled during the test window are included, BUT
10
Data Cleanup Spring 2017
Cleanup of any end of year data that needs to be reflected in assessment/accountability
reporting in CEDARS must wrap in time for (tentative) 6/22 FINAL data extract.
◦ This date may move out further into July based on a meeting later this week, so please make sure the
messaging with CEDARS staff is “Not to freak you out, if you’ve been doing everything right all year
there’s nothing to worry about, but OSPI is planning on pulling the enrollment extract for accountability
on 6/22.”
11
School Year Rollover (preview)
OSPI CEDARS Customer Support invited to the June Monthly Assessment Webinar. Please invite
your CEDARS administrator so we can all be on the same page. Deep Dive next month.
TIDE will go live on 8/14/17
◦ Users will ‘reactivate’ existing accounts rather than requiring all accounts to be ‘recreated’ top down.
◦ New users or users in districts that get new email addresses need accounts created
CEDARS: goes live on 8/15/17
◦ Nightly data handoff will go live within a few days of this go-live
◦ STRONGLY recommend against using SSID Issuance (Screen Entry or Bulk Upload) to try to create a
‘baseline’ at start of year unless absolutely necessary
Planning to open “Sandbox School District” more broadly for training purposes next year
12
Content Update
13
High School Science Field Test
Over 121 sites, with over 35,000 students, pre-registered to participate.
Test window opened on Monday, May 1.
Participation as of Monday, May 15: 1,764 students
Continue testing through Thursday, June 15.
Your students can participate even if your site did not pre-register!
14
High School Science Field Test
Test Coordinators/Test Administrators  User Guides and Manuals
15
Understanding Smarter Balanced
Assessment Scores
Training presentation in the Test Coordinators > Modules folder
Video is about 30 minutes long
Slides with script, and FAQ document also available
16
Understanding Smarter Balanced
Assessment Scores
Purpose: to answer some basic questions about Smarter Balanced scores
Audience: test coordinators, principals, data/instructional coaches, teachers,
parents
Please direct questions and comments about this presentation to:
Kara Todd, Content Coordinator for Test Development
[email protected]
17
Higher Education Placement Agreements
Colleges and universities in Washington use high school Smarter Balanced test
scores to place students in college-level courses.
Bridge to College page:
http://www.k12.wa.us/CurriculumInstruct/BridgetoCollege/
The Washington Student Achievement Council website:
http://www.wsac.wa.gov/college-readiness
18
New Resources:
Ready WA and Smarter Balanced Ready Update
19
New Resource: Smarter Balanced Ready
Smarter Balanced Ready is designed for district staff and educators to provide examples of
successful implementation practices, lessons learned, and suggestions for improving instruction
and student learning.
Interactive webpage
is organized by Big
Ideas and includes a
downloadable
Resources section
20
New Resource: Ready WA
Ready WA is a coalition that supports college- and career-ready learning standards and assessments.
This website is designed for students, parents, the community, and educators.
Resources include:
•
•
•
•
•
Infographics and fact sheets
Communication toolkits
Teacher voices network (CORElaborate), Tweets, Blog
Reproducible handouts and posters
Quick links, FAQs, videos, and more…
21
Sample Items Website Update
From the April webinar:
• Smarter Balanced Sample Item Website
• http://www.smarterbalanced.org/assessments/sample-questions/
May update:
• Metadata has been cleaned up to enhance the search feature to sort items by
claim and to identify the assessment targets and standards for the items.
• The items themselves have not changed.
22
Interim Answer Keys
• Smarter Balanced is developing IAB and ICA answer keys
• Answers for machine-scored items
• Abbreviated rubrics for handscored items
• Will include answer keys for new interim blocks currently in development
• Exact number, content, grade level, etc. of these new interims is still in development
• Additional information about the answer keys and new interims available
around the start of the 2017–18 school year
23
COE Update
24
Collection of Evidence (COE)
Spring Submission
• Upcoming COE Submission Window: May 17 - June 7
• COEs will be scored June 12 - August 18, 2017
• Scores for all content areas will be posted to WAMS on September 1, 2017
• Eligibility to Submit
• Open to all (11th and 12th grade) students who meet the eligibility requirements.
• Please check each student’s eligibility at least five business days prior to submission. If you believe a
student is eligible but is not showing as such, please contact [email protected] immediately (please
include student SSID in email).
• Note: An eligibility code of “A” indicates the student is ineligible to submit because he/she has already
met standard on another assessment.
25
Collection of Evidence (COE)
Website Updates
As we approach the 2017-18 school year, OSPI wants to ensure the Collection of
Evidence website remains a helpful and accurate resource for COE professionals
across the state.
Updates to the COE website will be posted by September 1, 2017.
26
ELPA21 Update
27
ELPA21 Screener
Screener:
• The ELPA21 screener will be launched in August. Once it is operational, use of the WELPA
placement test will end for all students except those needing a Braille version of the
screener. ELPA21 will not have a Braille version until the 2018-19 school year.
• The ELPA21 screener is fully online. There is no hand written booklet for Kindergarten and 1st
grade. Paper-pencil testing options will be available for students who have or are likely to
have paper-pencil accommodations on their IEP and 504 plans.
• Additional information about the ELPA21 screener will be coming as it is available.
28
ELPA21 Score Reports
Scores Reports:
District level scores were released to districts on May 15.
- The data should not be published, but…
- The data can be used for planning purposes.
On May 19 data will be released to WAMS which will be representative of the information that will post
to Report Card and LEP application through EDS.
- Changes to scores are not anticipated, but OSPI wishes to verify scores through CEDARS before possible publishing to websites
or communication to families.
- Dates for Report Card and the LEP application are TBD
Paper ISRs will arrive toward the end of May/early June
NOTE: Students participating in testing window 2 are not included in this data
29
Graduation Alternatives Update
30
Graduation Alternatives - Audit Flags
• Audit Flag Notifications – Emailed to impacted districts on May 3, 2017
• An audit flag occurs when the score information entered into a student’s form is NOT supported by
the documentation (i.e. official ACT score report) uploaded to the Graduation Alternatives application.
• Audits are only conducted on forms approved within the application (not forms pending signature).
• District responses and/or supporting documents are due to OSPI by 5 p.m. on May 24, 2017.
31
Graduation Alternatives End-of-Year Reminders
Students using Graduation Alternatives to meet assessment requirements
MUST have them submitted and approved in the Graduation Alternatives
Application PRIOR to being exited from school (as indicated in CEDARS).
• This is particularly important for students receiving special education services
• According to WAC 392-172A-02000(2) “A student who is determined eligible for special
education services shall remain eligible until… the student has graduated from high
school.” Should this student return to school to complete any unmet graduation
requirement(s), he/she will have been exited from special education services, and will not
have access to any CIA assessment options.
• LDAs must be approved in the Graduation Alternatives application prior to granting a
student his/her diploma. Paper LDA forms are NO LONGER used/accepted.
32
Graduation Alternatives End-of-Year Reminders
Feedback for the Graduation Alternatives Application
We recognize that as the users of the application, you may have recommended updates, user
preferences or thoughts on additional functions for the application. We welcome your thoughts
and feedback!
Please submit feedback or suggestions via our Graduation Alternatives Update Survey, located
on our Graduation Alternatives Application webpage.
33
WA-AIM Update
34
WA-AIM Update
Spring 2017 Report Dates
• May 25 – Score File in WAMS
• May 30 – Online ISRs in eDirect (user directions coming soon)
• June 6 – Paper ISRs in District
35
WA-AIM NGSS Science
• Will be applicable for the 2017-2018 administration
• 5 standards at Elementary, Middle School and High School
• Each Performance Task will have a complete set of five items
• Access Point Framework will be posted by end of May
• Performance Tasks will be posted later this summer
36
Technology Update
37
Technology Update: TTS and Chromevox
Chromevox is not to be used during testing at all, due to the potential security risks involved
Text-to-speech (TTS) is available as both an embedded and non-embedded designated
support/accommodation, that must be set up in TIDE, and includes a feature that allows students to
pause and then resume TTS in the middle of a passage. The pause feature does not work on mobile
devices such as iPads and Chromebooks. Consequently, it is recommended that schools with students
who require TTS as a non-embedded designated support/accommodation should consider using
desktop or laptop computers running Windows or Mac OS.
If students who require TTS must test on Chromebook devices, though, follow the steps in the latest
Technical Specifications Manual for Online Testing, and ensure that Chromevox is disabled. Students
needing embedded TTS will still be able to utilize that feature through the Test Delivery System, if the
students are properly set for TTS in TIDE, despite Chromevox being disabled.
38
Technology Update: Chrome OS 58
• AIR is scheduled to offer official support for Chrome 58, by the morning of 5/19/2017, except
for ELPA21. There is a known issue with the recorder tool when using Chrome OS 58, therefore
Chrome OS 58 is not supported for ELPA21 testing. Schools and districts using the Chrome
operating system should continue to administer ELPA21 tests on Chrome OS 56 using patch
number 56.0.2924.110
• AIR recommends that all schools that administer ELPA21 tests on Chromebooks take a training
test on the model of Chromebook they are using and verify that ELPA21 Speaking records
correctly before administering the test to students.
39
Technology Update: iOS and TTS
• iOS software has a built-in text-to-speech (TTS) function, that can be disabled with a profile
setting, when in standard Single App Mode (SSAM). However, the profile setting does not block
the built-in TTS if the iPad is in autonomous Single App Mode (ASAM). This may result in
students having unauthorized access to TTS during live test sessions.
40
Technology Update: Speech-to-Text
• Students who need Speech-to-text software as an accommodation should not test on mobile
devices. The mobile secure browsers on mobile devices (Chromebooks, iOS, Android) are not
built to support permissive mode, which is a required setting for Speech-to-Text software
• Speech to Text is best provided using Dragon software on a Windows or Mac device
41
NAEP Update
42
2018 NAEP and International
Assessments Update
May 2017 Update: Selected WA schools will participate in 2018 NAEP, TIMSS, and ICILS
• The National Assessment of Educational Progress (NAEP) is the largest nationally representative assessment of what students in the United States know and can do in various
subject areas
•
•
•
Tablet-, computer-, and paper-based assessments administered to some students in each school
•
55 districts and 105 schools will be chosen to participate in a NAEP administration for grade 4, 8, and 12
The Trends in International Mathematics and Science Study (TIMSS) provides reliable and timely data on the mathematics and science achievement of U.S. fourth- and eighthgrade students compared to that of students in other countries and jurisdictions
•
Tablet-based assessment administered to no more than two classrooms
•
One elementary school and one middle school will be selected to participate. These schools will be from separate districts
The International Computer and Information Literacy Study (ICILS) is an international comparative grade 8 assessment that uses an innovative, computer-based assessment to
evaluate students’ computer and information literacy
•
Computer-based assessment administered to no more than 30 randomly selected students per school
•
Six separate districts will be selected. No more than six schools statewide will participate – one from each district
•
Districts will be notified late May/early June of their NAEP/TIMSS/ICILS participation
•
The NAEP administration will occur during Winter 2018, TIMSS and ICILS administrations will occur between March and May 2018.
43
Previous webinar information
1. Go to the WCAP Portal: http://wa.portal.airast.org
2. Select the Test Coordinators card
3. Select Test Coordinator Resources
4. Select the Modules folder
5. Scroll down to the Assessment Update Webinars Overview section…
44
Previous webinar information
Top of the section:
Bottom of the section:
45
WCAP USER SUPPORT
Questions regarding information in the Test Administration Manuals
• Test Administrators and School Test Coordinators, contact your District Test Coordinator.
• District Test Coordinators contact the OSPI Assessment Operations Team at: [email protected].
Policy or Test Administration Questions
• Test Administrators and School Test Coordinators, refer to the Test Administration Manual. If additional
support is needed, contact your District Test Coordinator.
• District Test Coordinators contact the OSPI Assessment Operations Team at: [email protected].
46
WCAP Contacts for Technology,
System, or Program Issues
• Test Administrators, School Test Coordinators, and District Test Coordinators contact
the WCAP Help Desk (TAs and School Test Coordinators must also alert the District
Test and Technology Coordinators of issues).
• The WCAP Help Desk is open Monday–Friday from 6:00 a.m. to 6:00 p.m. PT (except
holidays or as otherwise indicated on the Washington Comprehensive Assessment
Program Portal).
• Washington Comprehensive Assessment Program Help Desk
Toll-Free Phone Support: 1-844-560-7366
Email Support: [email protected]
47
WCAP Contacts
AIR Help Desk for Technical, Network, and password issues
• AIR Help Desk: [email protected] 1-844-560-7366
OSPI Assessment Analysts for student data issues
• OSPI Assessment Analysts: [email protected] 360-725-6109
OSPI Assessment Operations for assessment policy and test materials
• Assessment Operations [email protected] (360) 725-6348 or (800) 725-4311,
press option 3
Smarter Balanced has updated its website. Check out the revamped and more user
friendly site at http://www.smarterbalanced.org/.
48
Thank you!
49