Oakhill Boys Ranch
Outcomes Report
2013-2014
Oakhill Boys Ranch
Outcomes Report 2013-2014
Table of Contents
INTRODUCTION .....................................................................................................1
I.
NUMBER OF CLIENTS (n=60) ......................................................................3
II.
CULTURAL/ETHNIC ORIGIN (N=60) .........................................................3
III. CHILD WELFARE STATUS (N=60) .............................................................3
IV. OTHER STATUS (N=13) ................................................................................4
V.
AGE AT INTAKE (N=32) ...............................................................................4
VI. AGE AT DISCHARGE (N=28) .......................................................................4
VII. LENGTH OF STAY (N=28).............................................................................4
VIII. EDUCATION (N=60) ......................................................................................4
IX. DSM DIAGNOSIS (N=48) ..............................................................................6
X.
FASD (N=48)....................................................................................................7
XI. PLACEMENT PRIOR TO INTAKE 2013-14 (N=32) ....................................7
XII. PLACEMENT AT DISCHARGE 2013-14 (N=28) .........................................7
XIII. PLACEMENTS TOWARDS PERMANENCE ...............................................8
XIV. CHILREN’S GLOBAL ASSESSMENT SCALE (CGAS) SCORES (N=18) 8
XV. BEHAVIORAL OUTCOMES (N=23).............................................................9
XVI. PROGRAM OBJECTIVES ............................................................................10
XVII.
OTHER INITIATIVES ............................................................................13
XVIII.
CASE WORKER FEEDBACK (N=4) ....................................................21
Oakhill Boys Ranch
Outcomes Report 2013-2014
INTRODUCTION
The following report is a collection of information gathered for the period of April 1, 2013
to March 31, 2014. The information provides a general overview in client demographics
and service outcomes that are both quantitative and qualitative. Most of the data has
not been empirically tested (other than the standardized test) and therefore statistical
significance varies throughout.
Over the fiscal period we have experienced slight changes in our client population and
significant service outcomes.
1. Summary of Changes in Client Demographics
 A slight decrease in age at intake from 12 years and 8 months to 12 years and 4
months.
 A decrease in age at discharge; from 14 years and 3 months to 13 years and 5
months, a difference of 10 months
 Overall behavioral scores at intake remain very high in the 99.3 percentile in the
home setting and 99.4% in the school setting when compared to the general
population.
2. Summary of General Service Outcomes
 Statistically significant improvement in some domains of Organizational Social
Context surveys.
Improvement noted in nearly all areas measuring
organizational culture, climate and morale of the organization.
 Significantly positive scores on the CARE surveys conducted by Cornell
University in Staff knowledge and beliefs, Current practice and Youth perception.
 Cornell University ranked Oakhill as one of their top performers in respect to the
implementation of the CARE program.
 Seventy-nine (79%) of the young people discharged from Oakhill Boys Ranch
were planned discharges and were placed in similar or less intensive placements
in the community or family.
 Fifty four percent (54%) of all discharges were placed in a family setting.
 Young people attended at Oak Hill School and community schools on a
consistent and regular basis with a 33% improvement from their previous school.
 Academic performance in reading scores of 2.16 grade levels in a one year
period.
 Provincial achievement tests scores for the five participating grade nine students
are above the provincial norm.
 Significant positive change in child functioning as indicated by CGAS scores.
 Significant behavioral change as indicated on SAC scores.
1
Oakhill Boys Ranch
Outcomes Report 2013-2014
 Positive results in Case Worker Feedback although the number of responses was
limited.
The Ranch will continue its pursuit for excellence in achieving strong outcomes for
young people and their families in the upcoming year. In addition to maintaining strong
outcomes in the areas reported above, Oakhill Boys Ranch will put a strong emphasis
on the following areas for the upcoming year:
 The continued focus on the implementation and sustainability of CARE resulting
in:
o Strengthening the CARE principles and congruence of practice in the
school setting and the home setting, and
o Continue to develop attachment and trauma practices in Cavell Lodge.
 Continue to Review and further of our clinical supports; specifically assessment
activities for new admissions along with a stronger emphasis on congruence with
CARE.
 Strengthening of our special components such as: Equine program, Animal
Assisted Therapy Program, High and Low Ropes Course and our Aboriginal
services.
The specific data collections regarding each of the variables and achievements are
further detailed in the body of the report.
2
Oakhill Boys Ranch
Outcomes Report 2013-2014
I. NUMBER OF CLIENTS (n=60)
Number of Clients Served: 60
(3 less than the previous year)
Number of Clients Admitted: 32

All admissions were identified as requiring specialized treatment services
(physically aggressive /dual diagnosis)
(This decreased by 1 from the previous year)
Number of Clients Discharged: 28
 22 were consistent with treatment planning.
 6 were discharged for emergent circumstances (required secure services
or ran away).
(This decreased by 8 from the previous year)
II. CULTURAL/ETHNIC ORIGIN (N=60)
Aboriginal: 29 (48%)
Caucasian: 28 (47%)
Other: 3 (5%)
(No significant change from previous year)
III. CHILD WELFARE STATUS (N=60)
Custody Agreement (CA): 35 (58%)
Permanent Guardian Status (PGO): 17 (28%)
Temporary Guardian Status (TGO): 8 (13%)
(No significant change).
3
Oakhill Boys Ranch
Outcomes Report 2013-2014
IV. OTHER STATUS (N=13)
Family Support for Children with Disabilities (FSCD) = 5
Outcome Based Service Delivery (OBSD) = 7
V. AGE AT INTAKE (N=32)
The mean age at intake is 12 years and 4 months. This is a slight decrease in age by 4
months from the previous year. The range of age at intake is 9 years and 6 months to
15 years.
VI. AGE AT DISCHARGE (N=28)
The mean age at discharge is 13 years and 5 months, a decrease of 10 months from
the previous year. The range of age at discharge is 10 years and 2 months to 16 years
and 8 months.
VII. LENGTH OF STAY (N=28)
The mean length of stay is 367 days (12 months). This is a 79 day increase from the
year prior. The range of length of stay is 33 days to 1229 days.
Post Placement
Family Care
Substitute Family Care
Group Home
Residential Treatment
EYOC/RCMP
Hospital
Runaway
# of Children
12
3
5
4
2
1
1
% of Children
43%
11%
18%
14%
7%
3%
3%
Length of Stay
346 days
334 days
470 days
196 days
51 days
1229 days
136 days
Over the last five years, the data indicates the longer the length of stay (334 days or
more) the better post placement outcomes. We have also seen longer length of stays
when young people require more intensive post placement supports. This is primarily
based on the increased complexity of client population and the availability of specialized
placements.
VIII. EDUCATION (N=60)
Oak Hill School recognizes that many of the young people in the care of Oak Hill Boys
Ranch have experienced many difficulties in school and often require additional
academic and behavioral supports to reconnect and remain encouraged about their
4
Oakhill Boys Ranch
Outcomes Report 2013-2014
educational potential. Those young people who have reached the potential to be able to
be successful in community school attend schools in our local community.
School Attended
Oak Hill School
Sturgeon Composite
Gibbons Junior High
Gibbons Fresh Start
Number of Young People (n=60)
56
2
1
1
Attendance at Oak Hill School is regular for all the young people attending there. The
young people attend school everyday regardless of behavior. Only when there are
severe behavioral situations they may receive a maximum of a 2-day suspension.
Absences at Oak Hill School generally are due to young people being absent from the
ranch. Examples of absences are full day appointments, sick days, family visits,
suspensions and young people who have runaway.
Student prior to admission to Oakhill demonstrated a combined absence and late
attendance at a rate of 45%. When attending Oak Hill School the combined absence
and late attendance rate is significantly reduced to 12%.
Academic performance
Oak Hill School measures part of academic performance based on standardized testing
in reading. In the upcoming year the school with also measure performance in math
utilizing the Stanford diagnostic for math. Below is a summary of the reading scores
from June 2013.
Test
Sept 2012
June/Oct 2013
Difference
Renaissance Reading, Star Reading Test (n=16)
Group High
Group Low
Mean
11.5
2.2
5.0
12.6
2.6
6.5
+1.1
+0.4
+1.5
NOTE: Group high, Group Low and Mean scores are grade level based on student performance per testing period.
Only those tested in the spring 2012 are included in the fall 2013
In the 2013-14 school year there has been a strong focus on literacy. Efforts have
included: 1 on 1 support - Fountas & Pinnell, Accelerated Reading - Star Reading Test,
Global Strategies - Frayer Model, Word Walls, Alphabet, Decoding and Evening
Reading Initiative at Ranch.
The RESULT = 2.16 Grade Level Improvement on the Star reading test.
5
Oakhill Boys Ranch
Outcomes Report 2013-2014
Provincial Achievement Tests (June 2013)
Five (5) grade nine students participated in the provincial achievement test. There
performance is summarized below.
Oak Hill School – Provincial Achievement Tests Scores (n=5)
Science
Oak Hill School
Provincial
Math
LA (B)
81.0
63.0
73.8
66.2
63.2
64.7
Overall School Average: 72.95
Social
74
66.6
The five (5) students who participated in the PAT(s) scored extremely well when
compared to the provincial average.
Behavioral Scores for School Setting
Behavioral measures are completed in the school setting by the educational staff with
the Short Form Assessment checklist developed by the University of Tennessee. The
summary of these results are as follows:
Initial SAC Completed (n=20)
Internalized Externalized
Overall
Behavioral
Behavioral
Behavioral
Score
Score
Score
M= 18.9
M=30.15
M=49.05
98.6%
99.2%
99.4%
Clinical
Clinical
Clinical
Last SAC Completed or March 2014(n=20)
Internalized Externalized
Overall
Behavioral
Behavioral
Behavioral
Score
Score
Score
M=11.07
M=19.03
M=30.10
91.9%
93.3%
91.9%
Clinical
Clinical
Clinical
The young people placed at Oak Hill School learn to experience positive academic and
behavioral growth.
IX. DSM DIAGNOSIS (N=48)
The young people placed in the care of Oak Hill Boys Ranch typically are diagnosed by
the DSM IV/V before intake and often have multiple diagnoses.
Diagnosis
ADHD
Oppositional Defiance Disorder
Number of Children
(n=48)
39
31
6
% of Children
81%
65%
Oakhill Boys Ranch
Outcomes Report 2013-2014
Reactive Attachment Disorder
Conduct Disorder
Learning/cognitive
Disability/Disorder
FASD
Post Traumatic Stress Disorder
Other (n=10)
16
15
33%
31%
13
13
6
10
31%
27%
13%
21%
X. FASD (N=48)
In a sample of 48 (n=48), 13 (31%) of the young people were diagnosed with FASD or
there was a strong clinical opinion noted. This is 5% decrease with the year prior.
XI. PLACEMENT PRIOR TO INTAKE 2013-14 (N=32)
Type of Placement
Family Care
Group Care
Substitute Family Care
Residential Treatment
Secure Treatment
EYOC
# of Children
13
10
5
2
1
1
% of children
40%
31%
16%
6%
3%
3%
XII. PLACEMENT AT DISCHARGE 2013-14 (N=28)
There were 25 (74%) planned discharges and 9 (26%) unplanned discharges. Planned
discharges only include situations where the permanency plan or concurrent plan is
followed as specified in the child’s Service Plan. Unplanned discharges include crisis or
emergent discharges. Below is a sample table of placements following discharge.
Post Placement
Less restrictive/Intrusive
# of
Children
20
% of
Children
71%
Equally restrictive/intrusive
4
14%
More restrictive/intrusive
3
11%
Runaway
1
3%
7
Oakhill Boys Ranch
Outcomes Report 2013-2014
Planned/Unplanned
Planned
Unplanned
Number
22
6
Percentage
79%
21%
In respect to the 22 planned discharges, 20 (91%) of the young people were placed in a
less intrusive setting. 15 (68%) of the planned discharges were placed in family based
care and 5 (23%) went to community based group care.
XIII. PLACEMENTS TOWARDS PERMANENCE
Generally speaking, it is fair to state that young people who are admitted to Oakhill Boys
Ranch should return to placements that are minimally of the same intensity as prior to
admission. Oakhill Boys Ranch has provided services to young people and returned
fifty four percent (54%) back to family based care and eighteen percent (18%) back to
community group care. Fourteen percent (14%) were discharged to residential treatment
setting and 6 (21%) did not successfully complete Oakhill Boys Ranch program due to
unplanned discharged. Oakhill performs extremely well when we view placement needs
at admission and then again at discharge.
XIV. CHILREN’S GLOBAL ASSESSMENT SCALE (CGAS) SCORES (N=18)
The CGAS is a clinical measure for client functioning and is based on two or more
scores over the period from initial score to last score taken. There were 18 useable
scores. The data is consistent with the last two years, with overall improvements from
moderate degree of functioning to variable degree of functioning. The greatest positive
increase being 33 to 66 and the highest negative change was from 60 to 45.
INITIAL CGAS SCORE
M= 47
LAST CGAS SCORE OR MARCH 2011
M = 56
RANGE
Low Score: 31
High Score: 70
.CGAS: Score Interpretation
70-61 Some difficulty in a single area but generally functioning well (e.g., sporadic or isolated antisocial acts, such as
occasionally playing hooky or petty theft; consistent minor difficulties with school work; mood changes of brief
duration; fears and anxieties which do not lead to gross avoidance behaviour; self-doubts); has some meaningful
interpersonal relationships; most people who do not know the child well would not consider him/her deviant but those
who do know him/her well might express concern.
60-51 Variable functioning with sporadic difficulties or symptoms in several but not all social areas; disturbance would
be apparent to those who encounter the child in a dysfunctional setting or time but not to those who see the child in
other settings.
50-41 Moderate degree of interference in functioning in most social areas or severe impairment of functioning in one
area, such as might result from, for example, suicidal preoccupations and ruminations, school refusal and other forms
8
Oakhill Boys Ranch
Outcomes Report 2013-2014
of anxiety, obsessive rituals, major conversion symptoms, frequent anxiety attacks, poor to inappropriate social skills,
frequent episodes of aggressive or other antisocial behaviour with some preservation of meaningful social
relationships.
40-31 Major impairment of functioning in several areas and unable to function in one of these areas i.e., disturbed at
home, at school, with peers, or in society at large, e.g., persistent aggression without clear instigation; markedly
withdrawn and isolated behaviour due to either mood or thought disturbance, suicidal attempts with clear lethal intent;
such children are likely to require special schooling and/or hospitalization or withdrawal from school (but this is not a
sufficient criterion for inclusion in this category)
The CGAS score is also a good measure of the overall level of functioning of the
population of young people served by the Ranch.
XV. BEHAVIORAL OUTCOMES (N=23)
The following behavioral outcomes are measured by Short-form Assessment Check List
(SAC) designed and developed by the University of Tennessee, Children’s Mental
Health Services Research Centre (2004).
Initial SAC Completed (n=29)
Internalized
Behavioral
Score
M= 17.62
98.4%
Clinical
Externalized
Behavioral
Score
M=30.45
99.4%
Clinical
Last SAC Completed or March 2014
(n=29)
Internalized Externalized
Overall
Behavioral
Behavioral
Behavioral
Score
Score
Score
M=15.34
M=20.90
M=36.24
95.5 %
95.5%
98.2%
Clinical
Clinical
Clinical
Overall
Behavioral
Score
M=47.72
99.3%
Clinical
NOTE: Young people are functioning below the percentile as compared to the general population of males between ages of 12 to 18
years.
The significance of the above scores clearly demonstrates that Oakhill continues to work
with young people who score very high on these behavior scales. Compared to last
year’s population, behavioral scores are slightly higher, indicating that the population is
more complex.
Even with a more complex population, Oakhill demonstrates improvements over time on
the Short Form Assessment checklist.
9
Oakhill Boys Ranch
Outcomes Report 2013-2014
XVI. PROGRAM OBJECTIVES
The therapeutic services offered by Oakhill Boys Ranch provide a process and a vehicle
to meet very specific service objective and outcomes. Oakhill Boys Ranch has achieved
significant success in meeting the needs of young people with intense problem
situations and successfully transitioning them to less intrusive placement resources
(71% in 2013-14) of the time. Fifteen (54%) of all discharges and 68% of planned
discharges were placed in family settings. We attribute these successes to our
approach, the scope and depth of services and to our ability to provide continuity of care
that supports children and families through their most intensive situations. The
objectives and outcomes identified below are designed under this premise.
Goal
1. Care and Safety
Young people will remain
safe.
Outcome
Performance
Measures
Target
Young people are protected from
harm and abuse.
Review of Critical 100%
Incident reports and
analysis of any harm
and abuse.
Progress: In the period of April 1, 2013 to March 31, 2014 there were zero incidents from mistreatment or
maltreatment.
An incident occurred where one young person sexually assaulted another young person.
investigation determined that a lack of supervision was unsubstantiated.
Young people will have a
stable placement
Young people will remain at Oak
Hill Boys Ranch until their
treatment goals are met.
Young people remain
healthy.
The young person is normally well.
The young person’s weight is in
the normal range for his height.
Preventative health measures are
being taken. (medical, dental &
optical)
The young person does not put
their health at risk.
The
Discharge data
100%
analysis of planned
and unplanned
discharges
Progress: An analysis of discharge data (n=28) show a 22 (79%) young people discharged from Oak
Hill Boys Ranch were planned discharges where the young people had achieved their treatment
objectives. There were 6 (21%) discharges from the program due to emergent situations.
Review of health care
data forms.
100%
Progress: All (100%) young people who attended Oakhill Boys Ranch remain in a normal and
healthy range for physical health and preventative medical appointments were scheduled and
attended. Some young people suffer from acute and chronic medical conditions were also supported
in a manner where their needs were met and monitored.
Young people will receive Living environment will be
Self reports.
100%
a strong provision of basic attractive and comfortable.
care services.
Food will be enjoyable and follow
Menu report.
10
Oakhill Boys Ranch
Outcomes Report 2013-2014
Goal
Outcome
the Canada Health Guide
Young people will maintain
appropriate hygiene.
Young people will receive
appropriate living supports.
Performance
Measures
Target
Self care records.
Client and Case
worker satisfaction
survey.
Progress: Client satisfaction surveys were not completed as the young people have over participated
in surveys. There was a minimal return on caseworker surveys N=4. All CW survey stated they
were satisfied with the basic care. Menu planning is appropriate and facilities meet licensing &
health care standards.
2. Treatment and Programming
Young people will receive Young people will show an
Short form
100%
emotional supports and improvement in emotional health.
assessment.
nurturance.
Psychological reports
Self reports
Progress: Short form assessment scores indicate a significant improvement of internalized,
externalized and overall scores in both the home setting (29) and the school setting (20). In the
eighteen young people sampled the mean improvement on the clinical measure (CGAS) was 9 points.
Young
people
will Externalized behavioral scores will Short Form
100%
demonstrate
appropriate be in the normal range.
assessment Measures
pro social behavior that is Internalized behavioral scores will
acceptable to community be in the normal range
norms.
Progress: In a Sample of 29, improvement on the internalized, externalized and overall behavioral
scores and demonstrated improvements in the young people’s behavior in the home setting.
Twenty (20) showed an improvement in the internalized, externalized and overall behavioral in the
school setting.
Eighteen (18) demonstrated improvement a mean improvement in functioning as indicated on the
Children’s Global Assessment Scale (CGAS).
Young people who resided at Oakhill Boys Ranch and completed the program were involved in a
formal community activity. Activities included: no hit hockey league in Edmonton, work at Prairie
Gardens, 4H Beef Club in Bon Accord and on Ranch, as well as other youth events in Edmonton,
Bon Accord, and Gibbons.
Young people will have Young people will participate in
Self reports
100%
access and support to recreational activities.
Care records
participate in recreational
activities.
Progress: All the young people (100%) participated in recreation activities. In addition to the
recreation mentioned above, the young people have been involved in almost daily recreation on
ranch which has included: football, soccer, basketball, baseball, ice, hockey, community floor
hockey, volleyball, badminton, floor hockey etc. The young people also participate in many outdoor
adventure activities including: camping, canoeing, hiking, fishing, equine programming, nordic
skiing, alpine skiing, swimming, skateboarding and biking.
Young people will have The young person identifies with
Self reports
100%
access and participate in and is proud of his ethnic, cultural
cultural activities.
or racial background
Service plan
Progress: Oakhill has increased our weekly onsite Aboriginal Programming through an elder to
twice weekly and has increased the services of an Aboriginal Liaison Worker from half time to full
11
Oakhill Boys Ranch
Outcomes Report 2013-2014
Goal
Outcome
Performance
Measures
Target
time. Oakhill continues the development of an Aboriginal Interpretive area. Oakhill also offers a
Christian youth group named Lighthouse.
Young people will achieve Young people will attend school
Short Form
100%
success behaviorally in daily.
Assessment measures
school.
Young people will demonstrate
Attendance Records
behavioral improvements in
Self Reports
school.
Progress: In a sample of 20 young people they achieved significant improvements on internalized,
externalized and overall behavior scores.
Young people will achieve The young person’s educational
School reports.
100%
educationally in school.
performance matches his ability.
Adequate attention is being given
Individual Program
to planning the young persons
Plans in place for
100%
education.
every child
Progress: Educational reading test indicate a tracking of 2.16 grade levels improvement in literacy.
Provincial Achievement tests score for five students are above the provincial average.
Services
will
achieve Young people will have an
Intake reports
100%
identified permanency plan. identified permanency plan at
intake.
Young people will be discharged
Discharge Data
to a permanent placement or
planned placement.
Progress: Of the twenty eight young people (n=28) discharged from Oakhill Boys Ranch 22 (79%)
were discharged to planned placements.
Young people will increase
self esteem, demonstrate
self direction and hope.
The young person has a good level Short Assessment
100%
of self esteem.
Measures
The young person has knowledge
Service Plan Measures
of his current situation and
Psychological reports
preferred future.
Progress: Youth perception survey completed by Cornell University demonstrates the young
person’s perception above the norm when compared to other CARE agencies.
3. Discharge
Young People will be
positively reunited with
their families.
Young people with return to live
with their families.
Discharge data
50%
3 month follow up
Progress: This year, 43% of the young people were discharged to family or kin. When we combine
family and substitute family care 54% of the children discharged moved to a family setting.
Young people will be Young people will be placed in
Discharge data
positively prepared and substitute family care.
placed in foster/adoptive
3 month follow up
care.
Progress: Three (11%) young people were discharged to substitute family care.
40%
Young people develop
competencies for
10%
Young people will be prepared for
and placed for independent living.
12
Service Plans
Discharge data
Oakhill Boys Ranch
Outcomes Report 2013-2014
Goal
Outcome
Performance
Measures
Target
independent living.
3 month follow up
Progress: 18% young people were discharged to community based group care. No young people
were discharged directly to SIL.
Young people will be Young people will achieve in
Discharge data
100%
enrolled, attend and be school.
successful behaviorally in a
3 month follow up
community school.
Progress: Transitional planning was in place for three months following discharge.
Young people will actively Young people will have at least
Service plans
100%
participate in community one community activity or
initiatives.
community organization at
Discharge.
Progress: No measures implemented
XVII. OTHER INITIATIVES
1. CHILDREN AND RESIDENTIAL EXPERIENCES (CARE)
Early in 2009 Oakhill Boys Ranch had been exploring a Service Delivery model
developed by Cornell University’s Residential Child Care Project. In January 2010, Oak
Hill Boys Ranch made a commitment to the implementation of Children and Residential
Experiences (CARE): Creating Conditions for Change practice model. This was initially,
a two year committed relationship with Cornell University. This year we have agreed to
extend this commitment to a three-year term.
This residential care practice model will enable Oakhill Boys Ranch to organize and
deliver quality care of children according to evidence informed principles based on the
“best interest of the child”. The project has a process and outcome based evaluation
component to measure the effectiveness of the model on reported critical incidents,
staff’s intention to use CARE principles in their work, and aspects of facility climate and
culture.
Background
The CARE practice model is founded on six research and standards-informed principles
designed to guide residential child care staff’s practice and interactions with children in
order to create the conditions for change in children’s lives. The research-informed
principles support care and treatment that is:
1. Developmentally focused,
2. Family involved,
13
Oakhill Boys Ranch
Outcomes Report 2013-2014
3.
4.
5.
6.
Relationship based,
Competency centered,
Trauma informed, and
Ecologically oriented.
These best practices principles are grounded in theory, in evidence-based practices, in
practice wisdom, and in child care standards. The principles were established after a
comprehensive literature review, surveys of experienced child care workers and
supervisors, and standards review.
Project Activities:
This process began in January 2010 with the formation of a CARE work group
responsible for the coordination and monitoring of CARE activities. Cornell personnel
scheduled quarterly visits to provide support and technical assistance with the
implementation of CARE. The first years activities included: completing assessments,
training the leadership and direct service staff, and aligning organizational systems with
the CARE principles.
Project Outcomes:
Oakhill has been working with Cornell in tracking our progress throughout the
implementation of CARE. The measures have 2 focuses; the first is the organizational
social context which measures organizational culture and climate and is completed
every 3 years. The second measure is specific dimension for the CARE program.
Organizational Social Context:
The organizational Social Context is a survey that measures the general health of the
organization through measuring the culture and climate of the organization. This survey
is normed against 1200 units of human and health service organizations in North
America.
The pre-test was taken in 2010 and the post-test was taken in 2013. It was expected to
see results in the climate; however cultural shifts typically take place between three and
five years. Below are the measures and the results.
14
Oakhill Boys Ranch
Outcomes Report 2013-2014
15
Oakhill Boys Ranch
Outcomes Report 2013-2014
16
Oakhill Boys Ranch
Outcomes Report 2013-2014
Oakhill Boys Ranch was pleased with the results of these surveys. First the measures
are going in the correct direction and secondly the organization is performing above the
norms.
Culture: There is a statistically significant improvement with the proficiency of the
organization, whereas no change with the rigidity or resistance.
Climate: There is statically significant positive change in all three dimensions
(engagement, functionality and Stress).
Morale:
results.
The general morale of the organization has improved from the initial test
CARE Surveys:
Pre surveys were taken with all staff specifically in the areas of Knowledge and Beliefs
(KB) as well as the Current Practice (CP) in relation to the CARE program. We also
completed Youth Perception Surveys with the young people receiving services. The
domains survey included: a) Listening and Understanding, b) demonstrating Investment,
c) Inclusion, d) flexibility, e) building competence and f) rules and consequences.
1. Knowledge and Beliefs Survey: An increase in staff knowledge of CARE
principles as measured through knowledge based testing. (pre, post, 1 year and
3 years and 4 years). The organization scored very well demonstrating
improvements in all six domains. We have seen a significant spike in the fourth
year. In addition when compared to other CARE agencies Oak Hill scored better
than the norm in all areas measured.
17
Oakhill Boys Ranch
Outcomes Report 2013-2014
KBS Knowledge Scores
Your Agency vs. All Others
13
12
11
10.5
Average Number Correct (out of 13)
10.1
10
9.4
9.0
9
8.4
8.2
8.1
7.8
8
6.9
7
6
5
4
3
2
1
4-Years Later
3 Years Later
1-Year Later
Post-Training*
Pre-Training
Other Agencies (N=1783, N=1258, N=364, N=220)
Your Agency (N=57, N=56, N=31, N=15, N=60, N=27, N=40)
*Note: The Post-Training Knowledge Score for Your Agency is an average of 2010, 2011, 2012 and 2013.
CARE KBS Report for Oak Hill Boys Ranch 05/01/2014
Strong Disagree -----------Unsure----------- Strong Agree
Average Beliefs Scores In Each Content Area
5
4.4
4.2
4.5 4.5
4.4
4.5
4.3
4
4.2
3.7
4.2
3.8
4.2
3.8
4.2
4.1
4.0
3.9
3.7
3.8
4.1
4.0
3.7
3.6
3.7
3.4
3.3
3.7
4.3
4.2
4.1
4.0
3.9
Lower average =
less emphasis on
rules &
consequences
4.1
3.7
3.3
3
2.7
2.5
2.5
2.3
2.0
2
2.1
1.9
1
Listen/Understand
Investment
Inclusion
Flexibility
Pre-Training (N=57)
Post-Training 2010/11 (N=56)
1-Year Later (N=31)
3-Years Later (N=60)
Post-Training 2013 (N=27)
4-Years Later (N=42)
CARE KBS Report for Oak Hill Boys Ranch 05/01/2014
18
Builds Competence
Rules & Consequences
(reverse-coded)
Post-Training 2012 (N=15)
Oakhill Boys Ranch
Outcomes Report 2013-2014
2. Current Practice Survey: The intention of staff to use the CARE principles in their
practice. (Measured through current practice and post training intention surveys,
1 year follow up surveys, 3 year follow up, 4 year follow-up, observation, and
supervision). The result demonstrated improvement in most areas noted above
and again when compared to other CARE agencies Oakhill scored better than
the norm when compared to other CARE agencies in all measures.
19
Oakhill Boys Ranch
Outcomes Report 2013-2014
3. Youth Perceptions Survey: Youth perception measures were taken in the same
areas at 6 months, 1 year, 3 years and 4 years. The results for all three surveys
were similar and were above the norm (3) in all areas.
The focus on this change process is to create a real cultural change that will assimilate
program staff and their practice, not simply accommodating the language and new
protocols for practice. Oakhill is pleased with the progress and excited about further
implementation of the CARE program. We estimate we are about 80% through the
implementation and will be looking at organizational practices for sustainability of the
CARE program in the upcoming years. The CARE program will be soon established
under promising practices in the California Clearing House for evidence-based practice.
This is the highest achievement for any Residential based program.
20
Oakhill Boys Ranch
Outcomes Report 2013-2014
XVIII. CASE WORKER FEEDBACK (N=4)
Y= Yes,
N = No
N/A = Not Applicable.
Child Safety
I am satisfied that the children I place with Oak Hill Boys Ranch will be treated with
care and remain free from child maltreatment.
I am satisfied that Oak Hill Boys Ranch will attend to any emergent medical needs
in an appropriate and timely manner.
I am satisfied that Oak Hill Boys Ranch will ensure children’s basic care needs are
met in a manner that supports their healthy development. (Living environment, food,
clothing, self care, etc)
All Above was completed in a very timely manner
Y
N
N/A
4
0
0
4
0
0
4
0
0
Y
N
N/A
4
0
0
4
0
0
4
0
0
3
1
0
3
1
0
Y
N
N/A
4
0
0
4
0
0
4
0
0
4
0
0
4
0
0
Child Wellbeing
I am satisfied with the therapeutic environment provided to children by Oak Hill Boys
Ranch.
I am satisfied that Oak Hill Boys Ranch is providing the support and interventions
that promote continued development of the children’s behavioural functioning
I am satisfied that Oak Hill Boys Ranch is providing the support and interventions
that promote continued development of the children’s emotional health.
I am satisfied that Oak Hill Boys Ranch provides supports and interventions that
facilitate regular attendance at school.
I am satisfied that Oak Hill Boys Ranch provides access to educational support and
interventions that facilitate academic growth.
Supportive Comments:
 Oak Hills has surpassed all expectations.
Permanence and Continuity
I am satisfied that Oak Hill Boys Ranch provides support and interventions that
promote continuity of care.
I am satisfied that Oak Hill Boys Ranch is provides supports and interventions
consistent with the child(rens) permanency plan.
I am satisfied that Oak Hill Boys Ranch prepares children to be placed in a less
intensive placement in a realistic time frame.
I am satisfied that Oak Hill Boy s Ranch provides supports and interventions that
prevent unplanned discharges. (such as AWOL).
I am satisfied that Oak Hill Boys Ranch provides follow up services that support post
placement stability.
Supportive Comments:
 The staff are incredible and support family reunification.
21
Oakhill Boys Ranch
Outcomes Report 2013-2014
Family and Community Support
I am satisfied that Oak Hill Boys Ranch provides family support and family
intervention services that serve to optimize family relationships.
I am satisfied that Oak Hill Boys Ranch provides access and opportunity for children
to be involved in structured community activities.
I am satisfied that Oak Hill Boys Ranch provides support and interventions that
meets children’s cultural needs.
I am satisfied that Oak Hill Boys Ranch adequately prepares children to live in a
family and or community setting.
Supportive Comments:
 Oak Hill is a miracle worker
Y
N
N/A
4
0
0
4
0
0
4
0
0
4
0
0
Programming:
Please rate the following services as:
Excellent
Therapeutic Living
Therapy Services
Family Services
Oak Hill School
Recreational Services
Adventure Based Activities
Aboriginal Programming
Equine Programming
Good
Fair
Excellent
3
3
3
3
3
3
4
3
Poor
Good
1
1
1
0
1
1
0
0
N/A
Fair
0
0
0
1
0
0
0
0
Poor
0
0
0
0
0
0
0
0
N/A
0
0
0
0
0
1
0
1
General Feedback, Comments and Recommendations:
Supportive Comments:
 Oak hill has wonderful communication between CW and have made a huge impact on my clients
life.
 The child I have placed there has so much positive feedback about being there.
22