Accountability Scorecards
Top to Bottom Ranking
February 2016
Changes for 2014-15
• Proficiency targets were reset using M-STEP and
MI-Access
• ELA replaced separate Reading and Writing
content areas
• Student Growth Percentiles were computed to
measure growth (not for ELA)
• Safe Harbor and multi-year averages were not
calculated
• ACT and WorkKeys were not included in high
school Scorecards or ranking range calculations
Scorecards…
Color-Coded Scorecards
• Colors are given to schools and districts for each
“scorecard component” and an overall color.
• Overall status color is determined using a point-based
system from the number of target areas the
school/district has met and the school ranking.
Decreasing # points received and increasing # targets not met…
6. The Proficiency tab displays each content area and the associated points earned for proficiency in each applicable
student group.
7. The Participation tab displays each content area and whether or not each applicable student group met the 95%
assessment participation rate requirement.
8. The Additional Scorecard Components tab displays the points and details for the compliance, educator evaluations, and
graduation or attendance rates components of the scorecard.
9. The Scorecard History tab display current and prior scorecard summary information back to the 2012-13 school year if
available.
10.Clicking on the View Details link under each content area heading will display detailed student group information for
the associated content area.
11.Clicking on the Appeal button (only active during the scorecard appeal window) allows you to submit an appeal for your
scorecard data.
12.Clicking on the Download Student Information button will allow you to download the individual student enrollment and
proficiency information used in calculating your draft scorecard results.
Proficiency Targets
Targets are based on 2014-15 proficiency rates:
• (85 – current percent proficient) / 9 = annual
increment
• Increments do not reset
• Proficiency targets are set using PLs 3 & 4 only
(not Provisional or Growth Proficient)
• Provisional and/or Growth Proficient will help
you meet targets
“Accountable Proficient”
versus Proficient
Students considered proficient are…
For ‘True Proficiency’ purposes:
• Performance Level 1 or 2
vs.
For ‘Accountable Proficiency’ purposes:
• Students must attain a performance level of 3 or 4 –OR–
• Students must attain a scale score that is within two standard
errors of the proficient cut score (provisionally proficient).
–OR–
• Students must demonstrate growth at a rate that will allow
them to reach proficiency in three years (growth proficient).
Full Academic Year (FAY)
• Students that were present in the building for the last:
• 3 count days (Fall, Spring and End-of-year collection)
• Only FAY students can count toward a school or district’s
proficiency rates for accountability purposes
• Limits the impact of student transiency on accountability
• Ensures that only students that have been educated by
the school/district count for proficiency
Participation Target
• Two options for school/district color status for this target
area.
95% Assessed Met
95% Assessed Not Met
Attendance Rates
3 Possible colors to receive for this target area:
• If a school meets the attendance target, it will receive a
green cell (2 points) for attendance rate.
• If a school meets the attendance improvement target, it
will receive a yellow cell (1 point).
• If it misses the attendance target, they will receive a red
cell (0 points).
Audit:
*A school/district receiving a red indicator for attendance
cannot have an overall color ranking better than yellow.
Graduation Rates
3 Possible colors to receive for this target area:
• If a school/subgroup has a graduation rate of at least
80%, it will receive a green cell (2 points).
• If it makes the graduation rate improvement target, it will
receive a yellow cell (1 point).
• If it misses both the rate and the improvement target,
they will receive a red cell (0 points).
Audit:
* A school/district’s overall status color is automatically yellow if
it is red for the “All Students” group for this target.
Compliance Factors
Component
Target
Educator Effectiveness Label Reporting in REP
100%
Teacher-Student Data Link Inclusion
95%
School Improvement Plan Completion
Y/N
EdYes! Report Completion
Y/N
Attendance Rate
90%
Educator Evaluations
• Educator Evaluations are based on State law. All of Michigan’s
educators will be evaluated using measures of student growth and
the results of these evaluations will be reported into MDE’s data
systems.
• Educator Evaluations will be reported as “In Good Standing” or “Not
in Good Standing” based on compliance with State law.
• Two components make up the Educator Evaluations section
• Effectiveness Labels Completion rate (100% target)
• TSDL Student Inclusion rate (95% target)
• 2 Possible colors to receive for this target:
• Those in good standing will receive a green cell.
• Those not in good standing will receive a red cell.
Compliance Factors
• Compliance Factors are based on State law. All schools are required
by State law to have a School Improvement Plan (SIP), and to
complete School Performance Indicator (SPR) reports.
• If a school completes all of its required reports it will receive a green
cell for the Compliance Factors. If a school does not complete its
required reports, it will receive a red cell for Compliance Factors.
• 2 Possible colors to receive for this target:
• Those with completed reports receive a green cell.
• Those with incomplete reports receive a red cell.
School and District
Scorecard Subgroups
• All Students
• Two or more races
• Bottom 30%
• Hispanic of any races
• American Indian or Alaska Native • Economically Disadvantaged
• Black or African American
• English Language Learners
• Asian
• Students with Disabilities
• Native Hawaiian or Pacific
Islander
• Shared Education Entity (SEE)
(district-level only)
• White
Pre-Audit Scorecard Color
• Pre-audit scorecard color based on percentage of points
earned through proficiency and compliance
• Point System Color Scale:
•
•
•
•
•
85% or Greater Points
70 to 84%
60 to 69%
50 to 59%
Less Than 50%
Additional Audits
Scorecard Component
Audit Check
Top to Bottom
Is school labeled a Priority school?
Participation
Does school/district have at least two red cells
for “all students” ?
Participation
Does school/district have more than two red
cells for any subgroup?
Participation
Does school/district have one red cell for “all
students” and at least two red cells for any
subgroup?
Participation
Does school/district have two red cells for any
subgroup?
Participation
Does school/district have one red cell for “all
students” and one red cell for any subgroup?
Participation
Does school/district have one red cell for “all
students”?
Participation
Does school/district have one red cell for any
subgroup?
Audit Outcome
Additional Audits (continued)
Scorecard Component
Audit Check
Proficiency
Does school/district have one red cell in any
subgroup except the Bottom 30% subgroup?
Proficiency
Does school/district have one red cell in any
Bottom 30% subgroup?
Graduation
Does school/district have one red cell for “all
students” group?
Attendance
Does school/district have a red cell?
Educator
Evaluations
Does school/district have a red cell?
Compliance Factors
Does school/district have a red cell?
Audit Outcome
Point Values by Color for Each Target Area
Target Area
(where applicable)
Target Met
Target Met Through Safe
Harbor or Improvement
Participation
Green- 2 pts.
Not applicable
Proficiency of All Students
Green- 2 pts.
Yellow- 1pt
Red- 0 pts.
Proficiency of Bottom 30%
Green- 2 pts.
Green- 2pts
Red- 0 pts.
Target Not Met
Red- 0 pts.
(See additional audits, next slide)
Red- 0 pts.
Proficiency of Subgroups
Graduation Rate
Green- 2 pts.
Yellow- 1pt
Green- 2 pts.
Yellow- 1pt
“All students” group and each subgroup
(where applicable)
“All students” group and each
subgroup (where applicable)
School/district overall color cannot be
better than yellow if it has at least one
red cell subgroup (except Bottom 30)
Red- 0 pts.
School/district overall color cannot be
better than yellow if it is red for the
“All Students” group
Red- 0 pts.
Attendance Rates
Green- 2 pts.
Yellow- 1pt
Red- 0 pts.
Green
Educator Evaluations
Not applicable
Up to 5% possible of available points
Green
Compliance Factors
Up to 5% possible of available points
(schools/districts w/o reporting requirements
will receive green and 0 pts)
(School/district overall color cannot
be better than yellow)
(School/district overall color
cannot be better than yellow)
Red- 0 pts.
Not applicable
(School/district overall color cannot
be better than yellow)
Top to Bottom
New for 2014-15
• Priority and Focus will not be named again until 2016-17
• Reward will not be named again until 2015-16
• Achievement Gap removed from TTB and formally made
a separate ranking
• Component weighting will change to 50% Achievement
and 50% improvement
• Content areas weighting will change to be weighted by
number of FAY students assessed
• Improvement will use Student Growth Percentiles (SGPs)
in place of Performance Level Change (PLC) and slopes
Stayed the Same…
• Only FAY students are included
• Use of Achievement, Improvement, and
Graduation components
• Achievement
• Graduation
• Still uses best of 4-, 5-, or 6-year cohort
• Still counts for 10% of overall ranking
Draft School Rankings
Components of TTB
• Each component applies to each subject for a
school:
• Achievement (aggregated student z-scores)
• Improvement [aggregated Student Growth
Percentiles (SGPs)]
• Graduation rate (grad rate and trend of grad
rate)
• Achievement gap will no longer be part of TTB
ranking but will be a separate ranking to
determine Focus Schools
Achievement Gap Ranking Overview
• Statewide percentile ranking of most schools
• Includes content areas of ELA and Math
• Uses only Full Academic Year (FAY) students
• Uses two-year averaging for increased stability
• Used to determine Focus labels
• New labels will not be given until 2016-17
• Schools with gaps larger than the bottom 10%
of Title I schools
Questions?
• Kelly Trout
• 517-244-1261
• [email protected]