Cherokee EVAAS Presentation 2.12.13

EVAAS
Proactive and Teacher Reports:
Assessing Students’ Academic
Needs and Using Teacher Reports to
Improve Student Progress
Cherokee County Schools
February 12, 2013
RESOURCES on
WikiCentral
Pre-Assessment
Poll: I am very familiar with the Education Va...
Poll: I know how to login to the EVAAS website...
Poll: I know how to navigate the EVAAS website...
Poll: I understand EVAAS report names.
Poll: I know how to use the EVAAS website to g...
Poll: I know how to access EVAAS reports for i...
Poll: I am able to analyze the metrics in EVAA...
Poll: I know how to collect evidence from EVAA...
Poll: I know how to collect evidence from EVAA...
Poll: I know how to interpret the following re...
Poll: I am able to communicate the findings of...
Poll: I am able to use data analysis to initia...
EVAAS Reflective
Report Review and
Scavenger Hunt
Student Pattern
Report
To Navigate to Student Pattern Report:
Go to Reports Other Reports
Pattern Report
Student
Student Pattern Report
Key points to remember:
•The report shows growth for the lowest, middle, and highest achieving students within the
chosen group.
•The report can be used to explore the progress of students with similar educational
opportunities.
•Like all diagnostic reports, this report is for diagnostic purposes only.
•A minimum of 15 students is needed to create a Student Pattern Report.
Student Pattern Report
Student Pattern Report
Key
Questions
Student Pattern Report – Key Questions
Different experience?
Different strategies?
Different needs?
Number of hours?
Student Pattern Report – Key Questions
Different experience?
Different strategies?
Different needs?
Number of hours?
YES!
Rerun the report
with new criteria.
Student Pattern Report – Next Steps
All 31
Students in
the Program
16 Students
who attended
for 40+ hours
Less Informed Conclusion: We
need to change the selection
criteria for this program.
More Informed Conclusion: We need to adjust the recommended
hours for participants.
Custom Student Report
To Navigate to Custom Student Report:
Go to Custom Reports Custom Student Report
Custom Student Report HANDOUT
Academic At-Risk Reports
To Navigate to Academic At Risk Reports:
Go to Reports Other Reports Academic At Risk Report
Academic At-Risk Reports
3 Categories
AYP at Risk- at risk for not meeting the academic
indicators for AYP
Graduation at Risk-reports for students at risk for
not making a Level III on EOC subjects required
for graduation
Other at Risk-reports for students at risk for not
making Level III on other EOC subjects
Academic at Risk Reports
Be Proactive
Use these reports to determine local policy for
providing targeted intervention and support to
students who are at risk for not meeting future
academic milestones.
30
Making Data Driven Decisions
What Are Projections?
What Are Projections Anyway?
Given a specific set
of circumstances…
…what’s the most
likely outcome?
What Are Projections Anyway?
Given this student’s testing
history, across subjects…
…what is the student likely
to score on an upcoming
test, assuming the student
has the average schooling
experience?
EVAAS Projections
What are they based on?
• Expectations based on what we know
» About this student and other students who have
already taken this test
» Prior test scores (EOC/EOG), across subjects
» Their scores on the test we’re projecting to
What’s the Value of the Projections?
Projections are NOT about
predicting the future.
They ARE
about assessing
students’ academic
needs TODAY.
Assessing Students’ Needs
• What are this student’s chances for success?
• What goals should we have for this student this
year?
• What goals should we have for this student in
future years?
What can I do to help this student get there?
Using Projections to Take Action
• Identify students
• Assess the level of risk
• Plan schedules
• Identify high-achievers
• Assess the opportunities
• Inform
Making Data Driven Decisions
Data Mining
REFLECTION + PROJECTION =
TODAY
Student Projection Report
Student Projection Report
Student Project Report
Thinking of the State Distribution by
QUINTILES
QUINTILE 5
QUINTILE 4
QUINTILE 3
QUINTILE 2
QUINTILE 1
Note the Student’s Projected
QUINTILE
QUINTILE 2
Reflecting on Past Effectiveness to Plan
for Differentiating Student Instruction
Past Effectiveness
Entering Achievement
Reflecting on Past Effectiveness to Plan for
Differentiating Student Instruction
QUINTILE 2
Past Effectiveness
Entering Achievement
ACADEMIC PREPAREDNESS
REPORT
Go to Reports
To Navigate to Academic
Preparedness Reports:
Other Reports Academic Preparedness
Report
Academic Preparedness Report
50
Teacher Value-Added
Report
Why should you care about your
EVAAS Teacher Value Added Report?
• Beginning with your 2013 report, it becomes
part of your evaluation.
– Standard 6 – Teachers contribute to the academic success of
their students. (Measurable Progress)
– Standard 4 – Teachers facilitate learning for their students
• Teachers plan instruction appropriate for their students
– Use data for short and long range planning
– Standard 5 – Teachers reflect on their practice.
• Teachers analyze student learning.
Why should you care about your
EVAAS Teacher Value Added Report?
You care about your
students.
Achievement vs. Progress
Student Progress – How far have I come?
• Highly dependent on what happens as a
result of schooling rather than on
demographic factors.
Achievement vs. Progress
• Focus on progress
• Educators can influence this
• Minimum expectation = one year of
academic gain
Understanding Value Added
• Projection report looks at past testing information
and projects how a student will perform.
– Student’s own past performance
– Performance of students who have taken the test
previously
• Students must have three prior test scores for
something to be included in the teacher’s
predictive report.
• Whole cohort of students analyzed.
EVAAS can tell you WHAT happened. It’s
up to YOU to determine WHY it happened
and what you want to do about it.
Local
Knowledge
& Expertise
EVAAS
Improve
the
Education
Program
Info about Teacher Reports
• State Growth Standard/State Average =
0.0
• Standard Error = a measure of
uncertainty
– Usually, the more data you have, the smaller
the standard error.
• Index = Teacher Estimate divided by
Standard Error
Effectiveness Categories
Effectiveness Level Determination
• Exceeds Expected Growth:
– Teachers whose students are making
substantially more progress than the state
average
– Index is 2 or greater
Effectiveness Level Determination
• Meets Expected Growth:
– Teachers whose students are making the same
amount of progress as the state average
– Index is equal to or greater than -2 but less than
2
Effectiveness Level Determination
• Does Not Meet Expected Growth:
– Teachers whose students are making
substantially less progress than the state
average
– Index is less than -2
Evaluation Composite
Index: Teacher
Estimate Divided by
Standard Error
Courses included in
calculation
Statewide distribution
of teacher status.
Understanding Teacher Value-Added
Reports
• Teacher Estimate: How much progress did this
teacher’s students make compared to other
students across the state?
• Index: Teacher estimate divided by the standard
error. Index is the basis by which teachers are
assigned to effectiveness levels.
EVAAS Teacher Value Added Report
EVAAS Teacher Value Added Report
Supplemental Information Table
Student Teacher Linkages
EVAAS Student Report
Teacher Diagnostic
Report
Making Generalizations
Making Generalizations
• What generalizations
can we make?
• What do we not
know?
• How do we find out?
EVAAS Teacher Diagnostic
Report
School Composites
Using Teacher Reports to Improve
Student Progress
1. Identify highly effective teachers
2. Identify teachers who need support
3. Identify strengths and areas for improvement
of individual teachers
4. Identify school-wide strengths and
weaknesses to inform and provide
professional development opportunities
5. Facilitate powerful, crucial conversations
between teachers and administrators
6. Impact scheduling decisions
*See “Using Teacher Data”
Role Play Activity
PLC
Predictions
and
Possibilities
Teacher
Dashboard
Resources
Questions?
83
Exit Tickets and Feedback
As you reflect on today’s session, use two sticky
notes to capture your thoughts on these topics:
1. Greatest Take Away
2. Now, I Need…
http://go.ncsu.edu/ncdpi-resa_survey