CHILD AND FAMILY SERVICES
REVIEWS (CFSRs)
Sustaining the Momentum: The Next Round of Reviews
JooYeun Chang, Associate Commissioner
Children’s Bureau
1
Overview of CFSR Rd 3 Announcement

Technical Bulletin #7 kicks off next round of monitoring of the 50 States, District of
Columbia and Puerto Rico.

Reviews will be conducted over Federal fiscal years 2015 – 2018. Statewide
assessments transmitted officially this fall and onsite reviews in spring of 2015.

CB will be making some changes in how we conduct monitoring to be responsive to
comments on ways to improve the reviews from states and other stakeholders. Key
areas of change are:
•
•
•

1. Statewide Assessment and Integration with the Child and Family Services Plan
2. Onsite Reviews – Stakeholder Interviews and Case Reviews
3. Statewide Data Indicators and National Standards
These changes in the monitoring process are all being made within the parameters of
our existing regulatory framework for the CFSR’s.
2
CFSR Rd 3 Context– Key Criticisms and Suggestions
Common criticisms and suggestions for improvement from States, Courts, Indian
tribes and other stakeholders in response to 2011 solicitation for input:
Criticism





Federal review is too
episodic and States are
partners in process but don’t
always own results.
CFSR experience is
resource-intensive and in
addition to other federal
monitoring efforts.
CFSR outcomes/systemic
factor scope may be dated.
CFSR national standards
are not self-explanatory and
data measures/approaches
have method problems.
States are challenged by
federal fiscal penalties.
Suggestion for Improvement
•
•
•
•
•
Institutionalize continuous quality improvement in State
systems to constantly evaluate and adjust for better chance
at long-term sustainability of improvements. Use State
CQI/quality assurance systems for federal review.
Integrate the CFSR with existing ACF protocols for
monitoring, planning and reporting on child welfare
programs, such as the title IV-B child and family services
plan process; and,
Incorporate new title IV-B and IV-E plan requirements into
federal monitoring efforts, such as some of those in
Fostering Connections;
Eliminate composite measures, have national standards
take into context variety in State policies and child welfare
population, do not rest outcome compliance decisions on 65
cases or systemic factor compliance on a few stakeholder
interviews.
Continue to ensure accountability to a high level of
performance but encourage positive performance rather
than just penalizing poor performance
CFSR Rd 3 Context - CB Work in Interim Period
 Measures/Statewide Data Indicators
•
Engaged experts to assist with measurement issues and inform our thinking
on data that lends itself to substantial conformity decisions
 Continuous Quality Improvement
•
•
•

CB Information Memorandum August 2012 provides States with guidance on
CQI system functioning
CB staff engaged with states to assess and consult on improving CQI system
functioning – ongoing work of CB
CQI Academy for state staff
State Child and Family Services Plan/Annual Progress and Services
Report
•
•
March 2014 CFSP program instruction begins integration with CFSR by
focusing on evaluating data related to systemic factors and outcomes
Reinforces continued engagement with States on CQI system functioning
CFSR Rd 3 - Core Review Goals and Elements
that Remain

Overall goal of CFSRs:
•
•
•

1) determine state conformity with
certain child welfare requirements;
2) determine the experience of children
and families who have contact with
child welfare system; and,
3) support states to enhance their
capacity to provide better outcomes
and systems for children and families
Assessment of states based on
the same 7 outcomes and 7
systemic factors using national
standards and measures of
expected performance

A statewide assessment followed
by an onsite review

States found to be “not in
compliance” will continue to have
the opportunity to improve their
programs before facing the
possibility of financial penalties.

The penalty structure itself is
regulated
5
CFSR Rd 3 – Changed Elements of Review
6
Statewide Assessment and Integration with the
Child and Family Services Plan
 Fully integrate the CFSP and the APSRs with the CFSR statewide
assessment process to reduce states’ burden and align federal
planning and monitoring efforts.
 States will be able to refer to their CFSP/APSR and update
information only as needed.
 CB will also focus the statewide assessment instrument on the
particular assessment questions needed for substantial conformity
decisions and other regulatory requirements
7
Onsite Review – Stakeholder Interviews
 Stakeholder interviews reserved for systemic factors where
conformity not clear from statewide assessment (or CFSP/APSR)
 CB will vary the extent or scope of stakeholder interviews conducted
during the onsite review based on the level to which the state
demonstrates it’s functioning on each of the systemic factors in
statewide assessment
 Possible for CB not to require additional stakeholder interviews for a
systemic factor. One exception is with service array due to
regulations requiring stakeholder input.
 Where statewide assessment data is insufficient to determine
substantial conformity, the joint federal-state team will determine
which stakeholder interviews are necessary to gather additional
information during the onsite review.
8
Onsite Review – Case Reviews

States meeting CB criteria encouraged to conduct their own case reviews
using a revised federal CFSR onsite review instrument and submit the
results to CB as part of conformity determination on outcomes.

CB criteria detailed in Technical Bulletin 7 involve:
•
•
•
using specified sampling methods,
ensuring accurate and consistent case review process,
using federal instrument, rating guidance and instructions

CB will discuss and review state policies, procedures and other materials as
needed to make a determination of whether a state's case review process
can be used. If approved, state must provide information so CB can
participate in state’s case review process.

Alternative will be a more traditional week-long case review conducted
jointly by the state and CB.
9
Statewide Data Indicators and National Standards
 A refined set of CFSR statewide data indicators associated with the
first safety outcome and the first permanency outcome.
 No longer using composites for permanency indicators
 Changes in methodologies.
 More details to come in Federal Register notice.
10
State Case Reviews – Letter of Intent Requested
State Tentatively
Scheduled
Review Year
FFY 2015
FFY 2016
Letter of Intent
Due to CB
Regions
CB Decision
Notification to
States
No later than
November 14,
September 1,
2014
2014
By September 1,
2014, but no
October 1, 2015
later than July
15, 2015
FFY 2017
No later than
July 15, 2016
October 1, 2016
FFY 2018
No later than
July 15, 2017
October 1, 2017

CB seeks a letter of intent from all
states so that we can anticipate the
review type

The state’s letter of intent will guide
CB engagement, planning and
scheduling of review with the state/

CB will work from existing &
documented knowledge of state
CQI functioning and build on that via
discussion and exchange of
information

CB wants states to be successful in
meeting state case review criteria!
11
Additional Communication and Guidance


Through April, CB Regional Offices will partner with central office to host
additional conference calls on a regional basis to address TB#7 and
address state questions
CB intends to issue by May:
•
•
•
•


Federal Register Notice on statewide data indicators for public comment. Will
host briefing to explain
Statewide assessment instrument inclusive of systemic factors
Onsite review instrument
Procedures manual
In May and June, CB staff will have in person 2-day briefings with states in
five locations - Seattle, Atlanta, Chicago, Dallas and Boston
CB will issue details further out on the horizon regarding:
•
•
•
•
Data profiles
Program improvement plans and measurement
Automation to collect case review information
State specific training for CFSR participants
12
Questions?
Resources online:
• https://www.cfsrportal.org/
• http://www.acf.hhs.gov/programs/cb/monitoring/child-familyservices-reviews/
Direct Additional Questions to your CB Regional Office
1