Assessment Updates
January 12th, 2016
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Computer‐Based Testing Updates
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
2
Computer‐Based Testing The following Spring 2016 assessments are computer‐
based:
• Grades 8–10/Retake FSA ELA Writing
• Grades 4–10 FSA ELA Reading
• Grade 4 Reading on computer for the first time
• Grades 5–8 FSA Mathematics
• FSA EOC Assessments (Algebra 1, Geometry, Algebra 2)
• NGSSS EOC Assessments (Algebra 1 Retake, Biology 1, Civics, U.S. History)
• FCAT 2.0 Reading Retake
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
3
Computer‐Based Testing
New Student Interface shell for 2015–16
• Universally accessible • De‐emphasize navigation components by using lighter colors
• Item tools menu • All tools now consolidated in a single location under a menu button in the top right corner of the item.
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
4
Computer‐Based Testing
Item Response Recovery
• For FSA ELA Writing, students may restore previously‐saved versions of their writing responses (during the same sitting)
• Responses save every two minutes
• Tool is also available on open response items for ELA Reading and Mathematics assessments
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
5
Computer‐Based Testing
FSA Session Transitions
• Beginning with the Winter FSA EOCs, the process for moving from Session 1 to Session 2 includes the following changes:
• Students no longer have the option to click “Next” on the Session Review screen.
• Students will select “End Session” (to pause their tests) and test administrators will take no further action (other than to stop the session).
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
6
Computer‐Based Testing
Listening Items
• Grades 4–10 ELA Reading
• Listening items may appear in either or both sessions of the ELA Reading tests
• Schools must provide headphones/earbuds, or students may use their own
• Headphones/earbuds should be plugged in and system settings checked (e.g., volume not muted) PRIOR to launching the secure browser
• American Sign Language (ASL) Videos will be available for eligible students taking CBT or PBT accommodated ELA Reading tests
• PBT accommodated students will have access to listening items (audio) on a computer through a secure site
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
7
Computer‐Based Testing
• FDOE’s IT team is involved in overseeing all technology‐related processes and changes for AIR and Pearson.
• All system changes and improvements proposed by the contractor must be reviewed and approved by FDOE IT staff.
• FDOE will closely monitor testing to ensure that all systems work as expected, and to troubleshoot any issues that arise.
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
8
Additional Fall/Winter Updates
• FSA ELA Test Item Specifications—Slight revisions made to format and other minor details
• ELA Test Design Summary and Blueprint—Remove Grade 11; update Writing administration time to 120 minutes; update Technology‐Enhanced Item Descriptions for 2015–16; update language regarding the weighting of the ELA writing component; provide additional language regarding cognitive complexity
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
9
FSA ELA Writing Scoring Samplers
• Now available on the FSA Portal
• Grade 4—Opinion; Grade 5—Informative; Grade 6—Informative; Grade 7—Argumentation; Grade 8—Informative; Grade 9—
Argumentation; Grade 10—Informative
• Examples of student responses that represent various score‐point combinations
• Not intended to provide a full spectrum of examples
• Do not necessarily represent highest or lowest examples of score points
• Passage sets are permissioned pieces and will be available via a hyperlink. (Printing is available via the URL.)
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
10
New FSA CBT Practice Tests
• Now available on the FSA Portal • FSA practice tests available for each grade; replaces the Training Tests
• Online FSA Reading practice tests divided into two sessions to allow Test Administrators practice with logging students in and out of sessions
• SESSION LENGTH AND CONTENT ARE NOT REPRESENTATIVE OF THE OPERATIONAL ASSESSMENTS! • CBT students required to participate in a practice test prior to testing
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
11
More FSA ELA Writing Practice Tests • Grade 4—Informative • Grade 5—Opinion
• Grade 6—Informative
• Grade 7—Argumentation • Grade 8—Informative
• Grade 9—Argumentation
• Grade 10—Informative www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
12
Accommodations • For students with IEP or 504 plan that specifies this accommodation, Text‐to‐Speech (TTS) functionality will be available for all computer‐based FSA ELA Reading and Writing components.
• Passages/text sets are not read to students.
• Items and options are read to students.
• Prompt wording is read to students.
• American Sign Language (ASL) videos provided for listening items on the CBT and PBT ELA Reading tests (SPRING 2016)
• Students with PBT accommodations have access to the listening items via a secure interface.
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
13
FSA ELA Writing Condition Codes
• Totally blank – no valid ELA score because student did not attempt to take the Writing portion of the ELA assessment • If “0” reported = attempt to respond, but response earned condition code resulting in zero points out of 10 points possible • Entire response written in a language other than English = 0
• Totally illegible, incomprehensible, insufficient, or copied from the sources with no original writing = 0
• Totally off topic = conventions domain is still scored, resulting in 0, 1, or 2 points www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
14
FSA Writing Reminders to Students
• Read prompt first! • Read the passage set carefully, taking notes
• Think about the purpose, audience, and task.
• Reread the prompt.
• Plan the response.
• Draft a response, read your draft, then revise and edit as needed. www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
15
Handheld Calculators
• FDOE provided an approved list of calculator models for the 2015–16 FSA assessments • The list can be found in the following document on the FSA Portal: Calculator and Reference Sheet Policies for Florida Standards Assessments (FSA) Mathematics Assessments (shown on next slide as well)
• FDOE will review/approve additional models for the list once annually; however, districts may provide calculators if mathematics specialists in the district determine that they meet the published specifications (provided on later slides)
• Handheld calculators are OPTIONAL
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
16
Updated Calculator Policy
The following handheld scientific calculators are FDOE‐approved calculators for the 2015–16 school year.
• Texas Instruments TI‐30Xa
• Casio fx‐260 solar
• Casio fx‐82 solar
• Sharp EL‐510R
• Sharp EL‐510RN
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Updated Calculator Policy
• Schools may use calculators that are not on the approved list if district mathematics specialists determine they meet the required specifications. • Students are not allowed to share calculators. Not every test item in the calculator section will require the use of a calculator.
• See the calculator and reference sheet policy on the portal.
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Handheld Calculators
• Calculators are allowed for certain grades and subjects, and for only certain FSA sessions: • Grades 7 and 8 Mathematics – SESSIONS 2 and 3 ONLY
• FSA EOCs – SESSION 2 ONLY
• NGSSS EOCs (Algebra 1 Retake, Biology 1) – 4‐function handheld
• Tests for students who have access to a calculator during non‐calculator sessions OR who have access to a calculator with prohibited functionalities must be invalidated
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
19
Handheld Calculators
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Handheld Calculators – Prohibited Functionality
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
FSA Calculator Summary
Assessment
Calculator Permitted
Grades 3 and 4 Mathematics
PBT‐ None
Grades 5 and 6 Mathematics
CBT ‐ None
Grades 7 and 8 Algebra 1
Algebra 2
Geometry
Computer based scientific calculator or hand‐held
scientific calculator
PBT: Paper Based Test
CBT: Computer Based Test www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Practice Using the Online Calculator
The online scientific calculator for grades 7 and 8, and FSA EOCs can be found at:
http://fsassessments.org/resources/
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Accessing Resources in the FSA Portal Sign up
Click here for….
Updated !
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Accessing Resources in the FSA Portal
Resources include: Equation editor item tutorial; FSA Mathematics policies and materials; FSA scientific calculator www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Questions About These Assessment Topics?
Vince Verges
Assistant Deputy Commissioner, Accountability, Research, and Measurement
[email protected]
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
26
Florida Standards Alternate Assessment
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Florida Standards Alternate Assessment
• IEP determines if:
• The student has a significant cognitive disability
• Even with appropriate and allowable instructional accommodations, assistive technology, or accessible instructional materials, the student requires modifications to grade level general state content standards
• The student requires direct instruction in academic areas of English language arts, mathematics, social studies, and science based on access points in order to acquire, generalize, and transfer skills across settings
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
2016 FSAA
• FSAA‐Performance Task
• 99% of students meeting the criteria for needing instruction in Access Courses and being assessed on alternate achievement standards will participate in the performance task assessment
• FSAA‐Datafolio Trial Administration
• designed to provide a second option for assessing students with the most significant cognitive disabilities for whom no formal mode of communication has been established. www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Performance Task: Milestone Timeline
Blueprints and Alignment Study Summer 2014
Items Developed Winter‐
Summer 2015
Item Review Committee
June 2015
and
July 2015
Construct Test Forms and Production
Summer‐Fall 2015
Administer Test
Spring 2016 • New assessment blueprints developed for Mathematics, ELA, and HS Biology
• New blueprints for ELA and Mathematics are aligned to the Florida Standards Access Points
• New blueprint for Biology based on NGSSS
• Alignment study determined which items currently in bank are aligned to new blueprints
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Content Areas & Grades Assessed
Grade
Level
ELA
Mathematics
3
X
X
4
X
X
5
X
X
6
X
X
7
X
X
8
X
X
9
X
10
X
Science
EOC
Algebra 1
EOC
Geometry
EOC
Biology
X
X
X
X
X
HS
• Civics EOC, US History EOC, and Algebra 2 portfolio introduced in 16‐17 • Operational field test for Writing in 2015‐16
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Performance Task Overview
•
Accessibility for all students: • Universal Design concepts
• Tactile/Braille materials – contracted and non‐contracted
• Gradual transition to Unified English Braille
• Tactile materials for non‐braille readers
• American Sign Language videos in 16‐17
•
Administration Modes
• Paper administration in 2016 • Transition to optional online computer based administration 2017
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Performance Task Design Overview
2016 Operational Field Test Design
•
Goals of 2016 Operational Field Test
• Test the item tiers and complexity assumptions
• Establish the psychometric scale for future assessment
•
Administration procedures will change
• Each content will be separated into 2 or 3 sessions
• Each session will follow different administration procedures
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
FSAA‐Datafolio Trial Administration
• FSAA—Datafolio Trial Administration
• 120 participating teachers
• 160 participating students
• Participating teachers will provide feedback throughout the process on:
• Training Materials, Samples and the Resource Guide (RG)
• Blueprints & Activity Choices
• Participation Guidelines
• Levels of Assistance
• Scoring
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Important Dates ‐ Resources
Resources
Accommodated Materials Ordering Window
• Tactile Graphic Materials
September 21 – November 2, 2015
• Uncontracted Braille/Tactile Graphic
Materials
• Contracted Braille/Tactile Graphic Materials
• One-Sided Response Booklet Ordering
Train the Trainer Resources available on the
Measured Progress FTP Site
Administration manuals (TAMs) arrive in
districts
November 2, 1015 – April 3, 2015
Website (URL): https://transfer.measuredprogress.org November 18-19, 2015
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Important Dates ‐ Resources
Resources
Administration Training Modules and Support
December 1, 2015
Documents posted to the FSAA Training Website
FSAA Online System’s Assessment Registration
December 2 – 30, 2015
Print-based Practice Materials arrive in districts
December 3 & 4, 2015
Practice materials/tutorial available in the FSAA
Online System
Mid- to late December 2015
Distribution of Object Exchange List and List of
Cards and/or Strips and Teacher-Gathered
Materials
No later than January 15, 2016
FSAA Online System training for AACs\Teachers
January 20, 2016\February 1, 2016
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
FSAA Important Dates – Elementary and Middle
Elementary and Middle School (Grades 3-8)
Materials in Districts
February 19 – 24, 2016
Student Testing Window
February 29 – April 15, 2016
Student Responses Entered into
Online System
No later than 11:59 PM EST on April 15, 2016
Return of Test Materials to Piedra
Data Services
No later than May 13, 2016
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
FSAA Important Dates – High School
High School ELA (Grades 9 & 10) , Algebra 1, Geometry, and Biology 1
Materials in Districts
March 15 – 17, 2016 or March 21 – 23, 2016
Student Testing Window
Upon receipt of materials through April 29, 2016
Student Responses Entered into
Online System
No later than 11:59 PM EST on April 29, 2016
Return of Test Materials to Piedra
Data Services
No later than May 13, 2016
Student Reports in districts
Week of June 6, 2015
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Standard Setting and Reporting
• Standard setting will be conducted after the 2015‐
16 administration.
• Reports will be in schools the week of June 6
• Until standard setting is conducted and cut scores determined, student reports will include student raw score and percentile ranking per content area
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
FSAA Contact Information
Angela Nathaniel
[email protected]
(850)245‐0972
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Assessing Communication and Comprehension in English State‐to‐State for English Language Learners 2.0 (ACCESS for ELLs 2.0)
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
ACCESS for ELLs 2.0 Assessments
• Based on the WIDA English Language Development Standards and are used to measure students’ progress in learning English. Three components: • Kindergarten ACCESS for ELLs, paper‐based assessment for Kindergarten
• ACCESS for ELLs 2.0 Paper, paper‐based assessment for Grades 1–
12
• Alternate ACCESS for ELLs, paper‐based assessment for students in Grades 1–12 who have significant cognitive disabilities
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Important Resources
Florida’s WIDA webpage: https://www.wida.us/membership/states/Florida.aspx
• Florida‐specific information regarding the administration of the ACCESS for ELLs 2.0.
WIDA Secure Portal: www.wida.us/login.aspx
• Online training modules and certification to district and school personnel for the ACCESS for ELLs 2.0. WIDA Assessment Management System (WIDA AMS): www.wida‐ams.us
• Administrative portal is to order test materials, edit student demographic information and accommodations, and download the Spring 2016 ACCESS for ELLs 2.0 Score Reports. www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Students to be Tested
All students enrolled in the district (grades K‐12) and classified ELL, with a code of “LY” on the 1st day of the test administration window, must be administered the ACCESS for ELLs 2.0. Students with disabilities participate in the statewide assessment program by taking one of the following:
• ACCESS for ELLs 2.0 without accommodations,
• ACCESS for ELLs 2.0 with accommodations, or
• Alternate ACCESS for ELLs
Important: All determinations regarding participation and accommodations in the statewide assessment program must be documented in the student’s IEP or Section 504 Plan, and the student’s ELL Plan. www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
2015 – 2016 ACCESS for ELLs 2.0 Schedule
Event
Date
Delivery of 2016 Administration Materials
January 15, 2016
2016 ACCESS for ELLs 2.0 Test Administration Window
February 8, 2016 – March 25, 2016
Return of Materials February 9, 2016 – April 1, 2016
Pre‐Reporting Data Validation Window
April 20, 2016 – April 26, 2016
Delivery of 2016 ACCESS for ELLs 2.0 Score Reports
May 20, 2016
Post‐Reporting Data Validation Window
May 23, 2016 – June 3, 2016
Final Data Available to State
June 13, 2016
Bridge Study (conducted by Center for Applied Linguistics)
June 14, 2016 – September 30, 2016
Standard Setting
October 2016
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Test Overview
• Kindergarten ACCESS for ELLs is an individually administered, adaptive assessment designed to take an average of 45 minutes per student.
• The Test Administrator scores all sections, including the Writing test, on site. • ACCESS for ELLs 2.0 Paper is available in three tiered forms within a grade‐level cluster. Tier refers to the form of the test administered that roughly correspondences to a student’s position along the second language continuum: Tier A (Beginning); Tier B (Intermediate); or Tier C (Advanced). • Grade‐Level Clusters: 1, 2, 3, 4–5, 6–8, 9–12
• The Speaking section is individually administered and scored by the Test Administrator.
• The Listening, Reading, and Writing sections can be group‐administered. • Alternate ACCESS for ELLs is an individually administered, semi‐adaptive assessment.
• Grade‐Level Clusters: 1–2, 3–5, 6–8, 9–12
• The Test Administrator scores all sections.
.
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Training and Certification Requirements for Test Administrators via WIDA Secure Portal
WIDA requires that all Test Administrators score 80% or higher on the appropriate quiz to become a certified Test Administrator. For some educators, one or more quizzes are required.
• Kindergarten ACCESS for ELLs: Kindergarten Training Module and take the Kindergarten quiz
• ACCESS for ELLs 2.0 Paper: Speaking Assessment Scoring Module and take the appropriate quiz
• There are five Speaking Assessment Scoring Modules that cover the grade‐level clusters (Grade 1, 2–3, 4–5, 6–8, 9–12), which takes approximately 90 minutes to complete all modules. These modules provide sample student responses for Test Administrators to practice scoring.
• The Speaking Quiz is provided in two grade‐level clusters (Grades 1–5 or 6–12).
• Note: If a Test Administrator is not administering the Speaking section, the Speaking quiz is not required. • Alternate ACCESS for ELLs: Alternate ACCESS for ELLs Training Module and take the Alternate ACCESS for ELLs quiz
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
2016 ACCESS for ELLs 2.0 Regional Training Sessions
Location
Assessment(s)
Date
Tallahassee
Kindergarten ACCESS for ELLs
ACCESS for ELLs 2.0 Paper
December 14, 2015
Gainesville
Kindergarten ACCESS for ELLs
ACCESS for ELLs 2.0 Paper
December 15, 2015
Kissimmee
Kindergarten ACCESS for ELLs
ACCESS for ELLs 2.0 Paper
December 17, 2015
Kissimmee
Alternate ACCESS for ELLs
December 18, 2015
Boca Raton
Kindergarten ACCESS for ELLs
ACCESS for ELLs 2.0 Paper
January 11, 2016
Boca Raton
Alternate ACCESS for ELLs
January 12, 2016
Online Training
Kindergarten ACCESS for ELLs ACCESS for ELLs 2.0 Paper
Alternate ACCESS for ELLs
October 5, 2015 – March 25, 2016
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
2016 ACCESS for ELLs 2.0 Score Reports
• Individual Student Report (ISR): Scores are reported as Proficiency Levels and as Scale Scores of four individual language domains and combined domains.
• Note: For Alternate ACCESS for ELLs, the ISR is referred to as the Parent/Guardian Report.
• Student Roster Report: Lists individual scale scores along with their corresponding ELP levels for each grade according to grade‐level clusters.
• Teacher Report: Provided for Alternate ACCESS for ELLs.
• School Frequency Report: Shows the distribution of ELLs according to their language proficiency levels for each language domain and combination of domains in a stated grade of a specified school. • District Frequency Report: Shows the distribution of ELLs according to their language proficiency levels for each language domain and combination of domains in a stated grade of a specified district. Important: Districts are scheduled to receive one hardcopy of each score report on May 20, 2016, but additional reports can be printed via WIDA AMS.
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.
Contact Information
Florida Department of Education Office of Assessment
Sabrina Read, WIDA Florida ACCESS Test Trainer
• Telephone Number: 850‐245‐0843
• Email: [email protected]
www.FLDOE.org
© 2015, Florida Department of Education. All Rights Reserved.