Understanding Your YOS Data
Part I:
Compliance Report: Baseline
Score Report: Baseline & Follow-Up
June 2010
1
Purpose of this call:
To review format of YOS compliance and
score reports in order to:
• understand how to interpret the #s
• and begin thinking about how to use the
data in your grant applications and case
for support
3 types of AIM reports for YOS data:
Compliance Report
Reports the number and percentages of YOS
surveys completed (against those that were
due in a given timeframe)
Score Report
Reports the number of baseline and follow-up
YOS surveys completed within a given
timeframe – as well as the average scores for
each outcome category
Outcomes Impact
Report
Reports the percentages of youth showing
improvement by outcome categories;
demonstrates statistical significance; and
reports the percentage of youth showing
improvement overall by # of outcome areas
3
Sequencing of YOS
functionality in AIM
March 2010
May 2010
Sept 2010
YOS
Compliance
Report
YOS Follow-up
Surveys & YOS
Score Report
YOS
Outcomes
Report
(for baseline)
Sept-Oct
2010
YOS
Compliance
Report
(add Follow-up)
YOS Compliance Report: Baseline
• Helps agency management understand how
many baseline surveys were completed
overall
• Total pool = age-eligible children in new
matches (9 years and older)
• “Completed” vs. “Blank”
• Completed = done, declined, or unable to
comprehend
5
Example of 100% Compliance
•
•
•
•
•
•
•
new = new matches made within specified time period
age eligible = how many of the new matches had Littles over the age of 9
completed = of the age-eligible number, number of baselines completed,
this includes surveys completed, declined, or unable to comprehend
declined = survey skipped: either parent/youth declined to participate
comprehend = survey skipped: youth unable to comprehend questions
compliance = percentage of surveys completed (of age-eligible children)
blank = surveys not completed: reasons unknown
6
Compliance (Baseline):
Why is it so critical?
• you need to account for your 12 month match
attrition (opposite of retention)
• And account for the challenges you may face in
getting youth to complete the follow-up
surveys
• Thus, your available “pool” of completed
surveys for the data needed to report
outcomes BECOMES MUCH SMALLER!
7
Compliance (Baseline):
Who needs to know and how often?
• Who might you need to share this
data with?
• How often might you need/want to
pull this report?
8
Sequencing of YOS
functionality in AIM
March 2010
May 2010
Sept 2010
YOS
Compliance
Report
YOS Follow-up
Surveys & YOS
Score Report
YOS
Outcomes
Report
(for baseline)
Sept-Oct
2010
YOS
Compliance
Report
(add Follow-up)
YOS Score Report:
Baseline & Follow-up
• Provides agency management with the
average scores of youth completing the
surveys, by outcome categories
• Total pool = age-eligible children in new
matches (9 years and older)
10
•
3 outcome categories have additional sub-categories: educational expectations, grades,
and risk attitudes
Baseline and Follow-up columns
• This score report provides info on the 2 different sets of surveys
• These do not represent the same children
Number of Children Answering Questions
• Youth can skip certain questions on the YOS.
• This explains why the numbers in each of these columns may
change.
Average Score by Outcome Category
• This number represents the average score for all the youth
answering those questions
What might strike you about this data?
How might you use this data?
Number of Children Completing Baseline and Follow-up (paired surveys)
• Paired surveys = children who completed both a baseline and a
follow-up survey
Average Scores for Paired Surveys by Outcome Area
• These numbers represent the average scores for all the youth
answering both baseline and follow-up surveys
What does this data tell you?
How might you use this data?
YOS Score Report:
Why is it important?
• Shows you how your trending in terms of
achieving outcomes
• Highlights areas of progress with your
Littles (and areas still needing progress)
19
YOS Score Report:
Who needs to know and how often?
• Who might you need to share this
data with?
• How often might you need/want to
pull this report?
20
Coming soon: the Outcomes Report
• Represents the final step in our outcomes
journey
• The outcome report will summarize what
percentage of youth improved (or stayed
the same) by outcome categories
• It will also provide data on statistically
significant change between
baseline/follow-up
21
A Peek at the OUTCOMES report…
• Provides percentages of youth
improving/staying the same by category
• Shows statistically significant change by
categories
• Provides % of children achieving positive
outcomes by # of categories
Sequencing of YOS
functionality in AIM
March 2010
May 2010
Sept 2010
YOS
Compliance
Report
YOS Follow-up
Surveys & YOS
Score Report
YOS
Outcomes
Report
(for baseline)
Sept-Oct
2010
YOS
Compliance
Report
(add Follow-up)