fidelity of implementation - Kentucky Center for Instructional Discipline

KENTUCKY CENTER FOR
INSTRUCTIONAL DISCIPLINE
Sustaining PBIS
SCHOOL-WIDE POSITIVE BEHAVIORAL INTERVENTIONS
AND SUPPORTS:
ADDRESSING THE BEHAVIOR OF ALL STUDENTS
33 Fountain Place, Frankfort KY 40601
Phone/Fax: 502.223.9932 - www.kycid.org
Participant Expectations
 Be Responsible
 Return promptly from breaks
 Be an active participant
 Use the law of two feet
 Be Respectful
 Maintain cell phone etiquette
 Listen attentively to others
 Limit sidebars and stay on topic
 Be Kind
 Enter discussions with an open mind
 Respond appropriately to others’ ideas
Sustainability
 Definition: Durable, long-term implementation of
a practice at a level of fidelity that continues to
provide valued outcomes (Han & Weiss, 2005)
 In other words: The point at which a practice
ceases to be a project or initiative and becomes
institutionalized (Rogers, 2003)
Barriers Preventing Sustainability
Antecedent
Ongoing
Challenge
• Changes in
Context
• Lack of
contextual fit
• New
challenges
exist
• Competing
initiatives
Behavior
Fidelity of
Implementation
• Changes in
Capacity
• Loss of
funding
• Attrition of key
personnel
Consequence
Student
Outcomes
• Changes in
Consequences
• Diminished
effectiveness
due to poor
fidelity
• Outcomes no
longer
perceived as
important
Memo
To: School Administrators
From: District Administrators
In keeping with the new state initiative, this fall we will be
implementing an exciting new district initiative of SNI in place of
LYI. All in-service days previously scheduled for LYI will be
rescheduled as staff development for SNI. The $500 release time
and materials for LYI will be discontinued and provided instead
for SNI. By the way, you will need to create local SNI teams that
meet weekly. The former members of your LYI team would be
perfect for this new team. Your new SNI binders will be coming
next week. Have a great year!
Factors to Enhance Sustainability
 Promote PRIORITY
 Ensure EFFECTIVENESS
 Increase EFFICIENCY
 Use data for CONTINUOUS
REGENERATION
Priority
 Definition: The relative visibility and
importance of a practice in comparison to
other practices (McIntosh, Horner, & Sugai,
2009)
 How to achieve?
 Maximize visibility by using data and
describing the effects of abandoning support for
the practice
 Get into written policy
 Braid initiatives
Effectiveness
 Definition: The extent to which
implementation results in desired outcomes
(McIntosh, Horner, & Sugai, 2009)
 How to achieve?
 Focus on fidelity of implementation
 Implement PBIS in all settings
 Implement all tiers of support
 Involve family
 Share data showing how fidelity is related to
effects
Efficiency
 Definition: Describes the relationship
between effectiveness and the effort
required to produce effects (McIntosh,
Horner, & Sugai, 2009)
 How to achieve?
 Get it down on paper: lesson plans, scheduled,
agenda
 Focus on efficient team meetings
Continuous Regeneration
 Definition: The process of (a) collecting data
to monitor fidelity, outcomes, and context,
(b) adapting over time while keeping critical
features intact, and (c) ongoing investment
in building local capacity (Han & Weiss,
2005)
 How to achieve?
 Adjust practices for a changing environment
 Stay connected with a community of PBIS
practice
Most Important Features for
Sustainability
 Teaching behavior expectations, having a
reward system, and monitoring must occur
if implementation fidelity and sustainability
are to be achieved
 Administrative support, communication,
and data-based decision-making were found
to be the most important characteristics for
long-term sustainability
Doolittle, 2006
Most Important Features for
Sustainability
1.
2.
3.
4.
5.
School administrators actively support PBIS
School administrators describe PBIS as a top
priority for the school
A school administrator regularly attends and
participates in PBIS team meetings
The PBIS school team is well organized and
operates efficiently
The school administrators ensure that the PBIS
team has regularly scheduled time to meet
McIntosh, Predy, Upreti, Hume, & Matthews, 2011
Analyzing Your PBIS Initiative
 Evaluate
 Fidelity
data
 Outcome data
 Previous Action Plan
 Look for celebrations and areas of
improvement
Analyzing Your PBIS Initiative
 Evaluate
 Fidelity
data
 Outcome data
 Previous Action Plan
 Look for celebrations and areas of
improvement
Fidelity Data
 When a practice or program is implemented
as intended by the researchers or
developers, this is referred to as fidelity of
implementation
 Schools measure fidelity through use of:
 Team
Implementation Checklist
 Benchmarks of Quality
 Self-Assessment Survey
Outcome Data
1. Identify data sources (ODRs, OSS, ISS,
SWIS Big 5, triangle data, etc.)
2. Describe the data (WHAT)
3. Interpret the data (WHY)
Outcome Data
1. Compare your average referrals per day per
month to other schools of your level and
size
2. Ask: “Is there a problem?”
3. Looks for trends and patterns
4. Examine your triangle data
Team Time
Consider your
Benchmarks of Quality
and Self-Assessment
Survey scores. What
strengths and
weaknesses are evident
in the areas of: (1)
teaching expectations,
(2) monitoring and
communicating, and (3)
having a school-wide
rewards system?
Team Time
Now analyze your data
using the provided
worksheets. Look for
trends and patterns,
then interpret the data
based on your
discussion.
From this data, what do
you perceive are areas
to work on next year?
Team Time
 Develop an Action Plan
for the upcoming
school year with broad
annual goals and shortterm objectives to meet
the annual goals.
 Set your meeting
schedule for the
upcoming school year.
 Finalize your team
roster and roles.
KYCID Contacts
 Mike Waford, Director
 [email protected]
 Judy Boggs, Assc. Director
 [email protected]
 Lea Brown, West
 [email protected]
 Kelly Davis, West
 [email protected]
 Janeah Gullett, East
 [email protected]
 Karen Bush, North
 [email protected]
 Tamara Kendrick, Training
 [email protected]
Assistant
www.kycid.org