2015 NCAAHPERD-SM
ASW What We Learned in Year One
Today’s ppt is available on the Professional Development page of Healthful
Living Wiki at http://hlnces.ncdpi.wikispaces.net/Professional+Development
Wireless password
Analysis of Student Work
What We Learned in
Year One
NCDPI ASW Team
Arts Education
Christie Lynch Ebert
Slater Mapp
AP/IB
Sneha Shah-Coltrane
Coordinator
Jen DeNeal
Healthful Living
World Languages
Burt Jenkins
Ann Marie Gunter
Analysis of Student Work
Beginning in 2014-2015, ASW became
the Standard 6 measure for teachers in
Advanced Placement, Arts Education,
Healthful Living, International
Baccalaureate, and World Languages.
Contribute
to Academic
Success
Growth is based on student work
submitted by teachers and rated by
content experts in a “blind review”
process.
6
Analysis of Student Work
ASW Timeline from 2014 - 2015
http://ncasw.ncdpi.wikispaces.net/14-15Implementation
Time
Task Completed
April 1 – May 20,
2015
ASW Reviewer Application Window
• Applications were reviewed on an ongoing basis with
st
th
priority deadlines of May 1 and May 20
• Reviewer applicants selected moved on to training
Late May – Early
July
ASW Reviewer Training Completed
• Certification Module Passed
• Over 600 ASW Reviewers
June 19, 2015
ASW Evidence Collections Uploaded
• Upload Window OPEN until 5:00 p.m. (extended)
• Over 6,300 Evidence Collections with 3 Timelapse
Artifacts each
Overall ASW Numbers
• 69 LEA’s + multiple charters
• 6,415 Teachers Submitted Evidence
Collections
– Made up of 19,245 Timelapse Artifacts
• 12,830 Evidence Collections Reviewed
(minimum of 2 reviews per collection)
• 97% reviewed
ASW Timeline from 2014 - 2015
http://ncasw.ncdpi.wikispaces.net/14-15Implementation
Time
Task Completed
July
ASW Review
August
ASW Review Ratings and Feedback Comments processed
by NCDPI
September October
SAS completes Value-Added Analysis for Standard 6 ratings
from EOGs, EOCs, NC Final Exams, & K-3 Checkpoints.
Early to midNovember
All teachers receive Standard 6 ratings from 2014 – 2015
November 12,
2015
Webinar on ASW Results from 2014 – 2015
• 3:30 – 5:00 p.m. as GoToWebinar
• Will be recorded and posted approximately 1 week later
ASW Numbers for Healthful Living
• 2,344 Healthful Living Teachers Submitted
Evidence Collections
(over 1/3 of all submissions)
• Made up of 7,032 Timelapse Artifacts
• 4,688 Evidence Collections to be
reviewed
(minimum of 2 reviews per collection)
Healthful Living Reviewers
• 110 reviewers
• Top reviewer rated over 100 collections
• 98.7% reviewed
So When Am I Getting My Rating?
ASW Timeline from 2014 - 2015
http://ncasw.ncdpi.wikispaces.net/14-15Implementation
Time
Task Completed
July
ASW Review
August
ASW Review Ratings and Feedback Comments processed
by NCDPI
September October
SAS completes Value-Added Analysis for Standard 6 ratings
from EOGs, EOCs, NC Final Exams, & K-3 Checkpoints.
Early to midNovember
All teachers receive Standard 6 ratings from 2014 – 2015
November 12,
2015
Webinar on ASW Results from 2014 – 2015
• 3:30 – 5:00 p.m. as GoToWebinar
• Will be recorded and posted approximately 1 week later
Results for 2014-15 Healthful Living
ASW
• Results in late October early to mid
November with other EOC/EOG tests.
ASW Timeline from 2014 - 2015
http://ncasw.ncdpi.wikispaces.net/14-15Implementation
Time
Task Completed
July
ASW Review
August
ASW Review Ratings and Feedback Comments processed
by NCDPI
September October
SAS completes Value-Added Analysis for Standard 6 ratings
from EOGs, EOCs, NC Final Exams, & K-3 Checkpoints.
Early to midNovember
All teachers receive Standard 6 ratings from 2014 – 2015
November 12,
2015
Webinar on ASW Results from 2014 – 2015
• 3:30 – 5:00 p.m. as GoToWebinar
• Will be recorded and posted approximately 1 week later
Waiver Policy
• Waiver Policy is to go before the Board
November 4th and/or 5th.
ASW Wiki
http://ncasw.ncdpi.wikispaces.net/home
Reviewers Feedback
Comments
• Feedback
Comments
available to
download on the
ASW wiki
http://ncasw.ncdpi.wikispaces.net/Reviewer+Resources
Interpreting Results for 2014-15
Healthful Living ASW
• Each Timelapse Artifact is
rated:
– Exceeds Expected Growth
– Meets Expected Growth
– Does Not Meet Expected
Growth
• Reviewer may provide
feedback comments on each
artifact.
TA 3
TA 1
TA 4
TA 2
TA 5
ASW Quality Rubric
For 2015-16,
an evidence
collection will
be made up of
5 Timelapse
Artifacts.
X X X X X XX
X
X
X
X
X
X
X
XX XX
X
XX
X
XXX XXX
Interpreting Results for 2014-15
Healthful Living ASW
• Evidence Collection is rated
– Exceeds Expected Growth
– Meets Expected Growth
– Does Not Meet Expected
Growth
based on the timelapse artiacts
• Reviewer may provide
feedback comments for the
entire collection.
Evidence Collection Rating Form
•
D = Does Not Meet Expected Growth
•
M = Meets Expected Growth
•
E = Exceeds Expected Growth
Transfer your rating for each TA from the quality rubric to the table below:
TA 1
D
TA 2
M
TA 3
E
TA 4
D
TA 5
M
Use this table to determine the overall rating for the evidence collection
Does Not Meet
DDDDD
DDDDE
DDDDM
DDDEE
DDDME
DDDMM
Meets
MMMMM
MMMME
DMMMM
MMMEE
DDMMM
DMMME
DDMME
DDMEE
DMMEE
1
Exceeds
EEEEE
MEEEE
MMEEE
DEEEE
DMEEE
DDEEE
1
Overall Rating for the entire Evidence Collection
Does Not Meet Expected Growth Meets Expected Growth
Exceeds Expected Growth
Effectiveness Status
3 Years of Combined Data for Standard 6
Standard
6
2014-15
Standard
6
2015-16
Standard
6
2016-17
An educator receives an
Effectiveness Status
when he or she has 3
years of data for
Standard 6.
Effectiveness Status
NC Educator Evaluation System
1 2 3 4 5
Demonstrate
Leadership
Establish
Environment
Know
Content
5 Rating Categories
Not Demonstrated
Developing
Proficient
Accomplished
Distinguished
Facilitate
Learning
Reflect on
Practice
Contribute
to
Academic
Success
6
3 Rating Categories
Effectiveness Status
LEAs/Charter Schools who took part in ASW in 2014
Best 2 out of 3 years of data
Ms. NC’s 3 years of
growth data:
Standard
Standard
Standard
Year 1
2014-2015
Year 2
2015-2016
Year 3
2016-2017
Does Not Meet
Expected Growth
Meets
Expected Growth
Meets
Expected Growth
6
6
6
2014-15 Does Not Meet
(Year 1)
2015-16 Meets (Year 2)
+ 2016-17 Meets (Year 3)
Ms. NC’s Standard 6
rating for 2014-2017
Contribute
Meets
Expected Growth
to Academic
Success
Effectiveness Status
LEAs/Charter Schools who waived out of ASW in 2014
Best 2 out of 3 years of data
Mrs. NC’s 3 years of
growth data:
Standard
Standard
Standard
Year 1
2014-2015
Year 2
2015-2016
Year 3
2016-2017
Meets
Expected Growth
Does Not Meet
Expected Growth
Meets
Expected Growth
6
6
6
2014-15 Meets (Year 1)
School Wide Data
2015-16 Does Not Meet
(Year 2)
+ 2016-17 Meets (Year 3)
Mrs. NC’s Standard 6
Contribute
rating
for 2014-2017
to Academic
Meets
Expected Growth
Success
Effectiveness Status
Charter Schools that are part of ASW for the
first time in 2015
Mr. NC’s 3 years of
growth data:
Standard
6
Standard
6
Standard
6
Year 1
2015-2016
Year 2
2016-2017
Year 3
2017-2018
Meets
Expected Growth
Meets
Expected Growth
Meets
Expected Growth
2015-16 Meets (Year 1)
2016-17 Meets (Year 2)
+ 2017-18 Meets (Year 3)
Mr. NC’s Standard 6
rating for 2015-2018
Meets Expected Growth
Contribute
to Academic
Success
Effectiveness Status for 2016 - 2017
In Need of
Improvement
Effective
Highly
Effective
Any rating
lower than
proficient
Proficient
or Higher
on Standards
1-5
Accomplished
or Higher
on Standards
1-5
Does Not
Meet
Expected
Growth
Meets or
Exceeds
Expected
Growth
Exceeds
Expected
Growth
Standards
1
Establish Environment
2
Know Content
3
Facilitate Learning
4
Reflect on Practice
5
Contribute to Academic
Success (3 yrs. of data) 6
Demonstrate Leadership
Effectiveness Status
for 2016 - 2017
2016 - 2017
Developing
Proficient
Standard 1
Demonstrate
leadership
X
Standard 2 Establish
Environment
X
Standard 3
Know Content
X
X
Standard 4
Facilitate Learning
Standard 5 Reflect
on Practice
Standard 6
Three year growth
data
Effective
Accomplished
Distinguished
X
Best 2 out of 3 years of growth data for 2014 – 2017
Meets Expected Growth
ASW Wiki
http://ncasw.ncdpi.wikispaces.net/Teacher+Resources
New Resources for 2015-16
The Standard 6
ASW Procedures
Manual provides
step by step
instructions in the
compilation of an
Evidence
Collection.
http://ncasw.ncdpi.wikispaces.net/Teacher+Resources
New Resources for 2015-16
The ASW Timelapse
Artifact Template has
been developed to
assist teachers in Health
and Physical Education
to plan and implement a
single Timelapse Artifact
from beginning to end.
http://ncasw.ncdpi.wikispaces.net/Teacher+Resources
ASW Process: A Quick Guide
ASW Timeline for 2015 - 2016
http://ncasw.ncdpi.wikispaces.net/15-16Implementation
Teachers
are
responsible
for the
items within
the red
boxes.
ASW Process: A Quick Guide
Teaching Context
Validate Class Schedule for
ASW Courses
• Screen shot
ASW Process: A Quick Guide
Class Selection
The online platform selects
the classes from which the
Student Work Samples will
be collected.
Class Selection
The teacher reviews the 5
classes selected for ASW
Process.
ASW Process: A Quick Guide