ROMA Next Generation and the CSBG Annual Report - Overview
June 30, 2017
ROMA Next Generation and the CSBG Annual Report - Overview
1
Presenters
• Seth Hassett, Director, Division of Community
Assistance, OCS
• Denise Harlow, Chief Executive Officer, CAP
• Jarle Crocker, Director, Training and Technical
Assistance, CAP
• Barbara Mooney, ANCRT
• Katy Kujawski, Research Director, NASCSP
• Lauren Cook, CSBG Deputy Director, NASCSP
ROMA Next Generation and the CSBG Annual Report - Overview
2
Agenda
• ROMA Next Generation
• CSBG Annual Report:
– Where are we now?
– Review of Modules:
• Module 2: Expenditures, Capacity and Resources
• Module 3: Community Level
• Module 4: Individual/Family Level
• Tools and Resources
– Preparing for Data Collection and Reporting
ROMA Next Generation and the CSBG Annual Report - Overview
3
Introduction
• Milestones and Accomplishments
– Successful Submission of Module 1 Annual Report
– Available “baseline” administrative information
– ACSI Round 2 entity survey underway
• Adaptive Challenges
– Data systems
– Interpretation of results
– Continuous improvement focus
– National measures and reporting
ROMA Next Generation and the CSBG Annual Report - Overview
4
Building on the ROMA
Foundation
ROMA NEXT
GENERATION
ROMA Next Generation and the CSBG Annual Report - Overview
5
ROMA Next Generation:
• Improves CSBG Performance Management.
• Improves CSBG Performance Measurement.
• Demonstrates Continuous Quality Improvement
across a complex system.
• Demonstrates a commitment to Outcomes.
• Strengthens local solutions for families and
communities.
• Builds agency capacity for the long term.
ROMA Next Generation and the CSBG Annual Report - Overview
6
ROMA Next Generation
• The adoption of a National Community Action Theory
of Change.
– Support of creation of Local Theories of Change
• Renewal of the CSBG network understanding of the
necessity of working toward community change as
well as individual and family outcomes.
• Focus on improved collection and analysis of data.
– New Annual Report with OMB clearance
– Increased use of data at every point of the full ROMA
Cycle.
• Increased integration of the phases of the ROMA
Cycle.
ROMA Next Generation and the CSBG Annual Report - Overview
7
Community Action
Theory of Change
The foundation of ROMA NG is the
National Community Action Theory
of Change.
ROMA Next Generation and the CSBG Annual Report - Overview
8
What is the Community Action
Theory of Change?
• The National Community Action TOC is the
articulation of the underlying beliefs and
assumptions that guide a service delivery strategy.
• It identifies the “why” and the “how” of the activities
undertaken and it identifies the “what” of change
and improvement produced.
• This national statement can be adapted for specific
local needs and approaches by local CAAs.
ROMA Next Generation and the CSBG Annual Report - Overview
9
Why We Need It
• In 2011 Community Action leaders committed to
making reforms to CSBG that would improve
results for individuals with low-incomes and
communities.
• Articulates core principles for CAA Network.
• Identifies CAA Network national goals.
• Demonstrates CAA Networks unique approach.
• Makes a complicated system easier to
understand.
ROMA Next Generation and the CSBG Annual Report - Overview
10
How Was it Developed?
• By reflecting critical elements of the current
CSBG Act.
• Incorporating the CAA history, vision and
values.
• Considering fresh and innovative thinking
about the future of our work.
• Since 2012 NASCSP has solicited feedback
from the Network at meetings and via
comment periods to develop the final TOC.
ROMA Next Generation and the CSBG Annual Report - Overview
11
ROMA Next Generation and the CSBG Annual Report - Overview
12
NATIONAL THEORY OF CHANGE
ROMA Next Generation and the CSBG Annual Report - Overview
13
A Local Theory of Change
• The national TOC is the framework for
the network, but each agency will
identify its own TOC that will be a
reflection of the results of the CAAs
needs assessment, strategic planning
and Community Action Plan.
ROMA Next Generation and the CSBG Annual Report - Overview
14
New Tool Available at
www.nascsp.org
ROMA Next Generation and the CSBG Annual Report - Overview
15
CSBG Performance Management
Framework
Securing CSBG efficiency and
effectiveness at the local, state and
federal levels.
ROMA Next Generation and the CSBG Annual Report - Overview
16
Performance Management Framework
• Local Organizational Standards
• State and Federal Accountability Measures
• Results Oriented Management and
Accountability system
• ROMA Next Generation
• CSBG Annual Report, which includes an
updated and refined set of CSBG outcome
measures.
ROMA Next Generation and the CSBG Annual Report - Overview
17
ROMA NG: The CSBG Annual
Report
ROMA Next Generation and the CSBG Annual Report - Overview
18
Where are we now?
• CSBG Annual report received a 3-year
clearance from the Office of
Management and Budget (OMB) on
January 12, 2017.
• This starts the phase-in of the CSBG
Annual Report and the phase-out of the
CSBG IS Survey.
ROMA Next Generation and the CSBG Annual Report - Overview
19
Finally, Clearance! Now, moving forward…
January
12, 2017
• CSBG Annual
Report is
cleared by
OMB
February
2017
March
2017
April 2017
June 2017
• Module 1 is
• Module 1 is
• States
• Round one of
tested in
available in
complete first
Module 1 and
OLDC by State
OLDC
submission of
the CSBG IS
beta testers
Module 1 in
data review is
• Module 1
OLDC
completed.
• T/TA
Instruction
Webinars
Manual
• States submit • DATA Task
available on
CSBG IS
Force holds
• States
NASCSP
Access
first in person
prepare to
website
Database to
meeting.
complete
NASCSP
Module 1
• Convened the
• Draft
DATA Task
instruction
Force
manual is in
process.
ROMA Next Generation and the CSBG Annual Report - Overview
20
Reporting Timelines: October 1 – September 30
Federal Fiscal Year
(FFY)
State Reporting Period
October 1 –
September 30
Data Submission for
States:
Data Submission for
local CSBG Eligible
Entities:
Due March 31, 2017:
FFY 2016:
October 1, 2015September 30, 2016
State Reporting Period:
October 1, 2015September 30, 2016
CSBG IS Survey is submitted
to NASCSP. Module 1 is
completed based on the
2016 Federal Fiscal Year and
submitted through the OnLine Data Collection system
(OLDC).
CSBG IS Survey
Due March 31, 2018:
FFY 2017:
October 1, 2016September 30, 2017
State Reporting Period:
October 1, 2016September 30, 2017
FFY 2018:
October 1, 2017September 30, 2018
State Reporting Period:
October 1, 2017September 30, 2018
(In Progress)
CSBG IS Survey is submitted
to NASCSP. Module 1 is
completed based on the
2017 Federal Fiscal Year and
submitted through OLDC.
Due March 31, 2019:
CSBG Annual Report
(Modules 1-4) is submitted
through OLDC.
ROMA Next Generation and the CSBG Annual Report - Overview
CSBG IS Survey
CSBG Annual Report
(replaces CSBG IS
Survey)
21
How do we get there?
Assessment and Planning
Communication & Coordination
Training and Technical Assistance
ROMA Next Generation and the CSBG Annual Report - Overview
22
Local
Agencies:
Local Experts
Neighbor CAAs
DATA Task Force
States:
State CSBG Offices
State Associations
RPICs
DATA Task Force
NATIONAL:
Federal Partners
NASCSP
CAP
ANCRT
CAPLAW
OCS Specialists
DATA Task Force
ROMA Next Generation and the CSBG Annual Report - Overview
23
The DATA Task Force
ROMA Next Generation and the CSBG Annual Report - Overview
24
CSBG DATA (Data, Analysis, and Technical
Assistance) Task Force
Convened by NASCSP to assist OCS and NASCSP in
understanding and addressing the CSBG Network’s
– Data needs, including collection and storage;
– Use of data for analysis; and
– Continual improvement of results.
• DATA Task Force is a consultative body focused on:
– The transition from the CSBG IS Survey to the CSBG Annual
Report; and
– Ongoing assistance in the implementation of the CSBG
Annual Report.
– Create a data oriented culture.
ROMA Next Generation and the CSBG Annual Report - Overview
25
DATA Task Force Members by HHS Region
10
1
8
2
5
7
9
6
3
4
State Office
State Association
Local CAA
ROMA Next Generation and the CSBG Annual Report - Overview
26
DATA Task Force Guidance
• Feedback
– Instructions for Modules 2, 3 & 4
• Data Analysis
– What analysis of IS data currently takes place at the
local level? At the state level?
– How is that data used?
– What would be the ideal?
• Communication
– What are the critical messages about the AR that
need to be conveyed to the network?
ROMA Next Generation and the CSBG Annual Report - Overview
27
ROMA NG: The CSBG Annual
Report and the CSBG IS Report
ROMA Next Generation and the CSBG Annual Report - Overview
28
Improving Performance Management
• Under the IS reporting system we found some things
missing:
Which have been added to the new Annual Report
Reporting of services and strategies
Data on state and federal accountability measures
Data on Organizational Standards
Additional Community Level outcomes (new NPIs)
Ability to show progress on community work over time
Additional infrastructure for multi level data analysis
OMB clearance for 3 years (as of January 2017)
ROMA Next Generation and the CSBG Annual Report - Overview
29
CSBG Annual Report
Module 1
• State Administration
Module 2
• CSBG Eligible Entity Expenditures,
Capacity, and Resources
Module 3
• Community Level
Module 4
• Individual and Family Level
ROMA Next Generation and the CSBG Annual Report - Overview
30
Module 1
STATE ADMINISTRATION
ROMA Next Generation and the CSBG Annual Report - Overview
31
Module 1: State Administration
•
•
•
•
Similar to Sections A-D in the CSBG IS
Completed by State CSBG Administrators/contractor
All information is based on the FFY
Includes information on:
– State administration of CSBG funding
– Use of State administrative funds and discretionary funds
for staff positions, as well as training and technical
assistance
– Compares use of planned funds to actual use
ROMA Next Generation and the CSBG Annual Report - Overview
32
Module 1: State Administration
• Includes information on (Continued):
– Progress of eligible entities in meeting Local Organizational
Standards (Section D)
– Includes information on progress of State in meeting
accountability measures (Multiple Sections)
– Information on State monitoring activities (Section H)
– Details about CAA Quality Improvement Plans (Section H)
– ROMA Support for CAAs and State and CAA continuous
improvement efforts (Section I)
ROMA Next Generation and the CSBG Annual Report - Overview
33
ROMA Next Generation and the CSBG Annual Report - Overview
34
Module 2
CSBG ELIGIBLE ENTITY
EXPENDITURES,
CAPACITY, AND
RESOURCES
ROMA Next Generation and the CSBG Annual Report - Overview
35
Module 2: CSBG Eligible Entity Expenditures,
Capacity, and Resources
• Similar to Sections E-F in the CSBG IS
• Completed by eligible entities; reviewed, evaluated, and
analyzed by State CSBG Lead Agencies.
• Section A meets the Congressional requirement for an
explanation of the total amount of CSBG funding expended during
the reporting period based on categories referenced in the CSBG
Act.
• Section B provides detail on agency capacity building funded by
CSBG and other funding sources.
• Section C provides data on resources allocated to, administered
through, and generated by the CSBG Eligible Entity.
ROMA Next Generation and the CSBG Annual Report - Overview
36
Module 2: CSBG Eligible Entity Expenditures,
Capacity, and Resources
ROMA Next Generation and the CSBG Annual Report - Overview
37
ROMA Next Generation and the CSBG Annual Report - Overview
38
Module 2
ROMA Next Generation and the CSBG Annual Report - Overview
39
ROMA Next Generation and the CSBG Annual Report - Overview
40
ROMA Next Generation and the CSBG Annual Report - Overview
41
Module 3
COMMUNITY LEVEL
ROMA Next Generation and the CSBG Annual Report - Overview
42
CSBG Annual Report | Module 3
• Collects information on the agency’s community level
initiatives.
• Showcases the connection between initiatives and
outcomes.
• Demonstrates how initiatives would be reported on
over time.
• Auto-population where information carries over from
year to year.
• Expects that most CAAs have a handful of initiatives
that include community strategies and achieve
community level change.
ROMA Next Generation and the CSBG Annual Report - Overview
43
ROMA Next Generation and the CSBG Annual Report - Overview
44
Community Level Work
• Economic Opportunity
Act and CSBG Act
include the importance
of addressing poverty
on both the
individual/family and
community levels.
ROMA Next Generation and the CSBG Annual Report - Overview
45
CSBG Act
• Included in the purpose and goals:
“…to provide assistance to States and local communities,
working through a network of community action agencies and
other neighborhood based organizations for the reduction of
poverty, the revitalization of low-income communities, and the
empowerment of low-income families and individuals…”
“…the greater use of innovative and effective communitybased approaches to attacking the causes and effects of
poverty and of community breakdown;”
ROMA Next Generation and the CSBG Annual Report - Overview
46
Community Level Work
• Module 3 is a renewal of the CSBG network’s
understanding of the necessity of working
toward community change as well as
individual and family outcomes.
• Module 3 creates the reporting space for CAAs
to tackle complex community level issues.
ROMA Next Generation and the CSBG Annual Report - Overview
47
ROMA Next Generation and the CSBG Annual Report - Overview
48
ROMA Next Generation and the CSBG Annual Report - Overview
49
Module 3
ROMA Next Generation and the CSBG Annual Report - Overview
50
Module 3
ROMA Next Generation and the CSBG Annual Report - Overview
51
Module 4
INDIVIDUAL AND
FAMILY LEVEL
ROMA Next Generation and the CSBG Annual Report - Overview
52
Outcomes, Services, People
• At the individual and family level, ROMA Next Generation
connects outcomes, services and participants to facilitate
robust analysis.
– Outcomes (Examples): Obtained jobs, completed education,
increased income, improved parenting, secured housing
(Proposed Family Level Performance Indicators)
– Services (Examples): Job Training, Work Experience,
Scholarships, Financial Education, Support Groups, Housing
Counseling, Food Assistance (Family Level Services).
– People: Unduplicated count of people served. All
participant characteristics (income, job status, education,
etc.); and, participants at the time they first engage.
ROMA Next Generation and the CSBG Annual Report - Overview
53
ROMA Next Generation and the CSBG Annual Report - Overview
54
What’s in the new Annual Report?
ROMA Next Generation and the CSBG Annual Report - Overview
55
Module 4|Services List
• New list in the Annual Report.
• The things (services) we deliver to individuals and
families.
• Currently in the IS outputs and outcomes are mixed
together.
• Services and outcomes have been separated so that
we can better understand and tell the story of what
services are being provided by the Network to achieve
results for individuals and families.
ROMA Next Generation and the CSBG Annual Report - Overview
56
ROMA Next Generation and the CSBG Annual Report - Overview
57
ROMA Next Generation and the CSBG Annual Report - Overview
58
DATA ANALYSIS
ROMA Next Generation and the CSBG Annual Report - Overview
59
ROMA Next Generation and the CSBG Annual Report - Overview
60
What does data tell us about the needs in
our specified community? What identified
needs can we reasonably address either
independently or in partnership with other
organizations?
Did the Outcomes achieved address the needs
identified in the assessment phase? How well
did we track our success? Did we meet our
targets?
Assessment
Evaluation
How do specific
Services and
Initiatives (Strategies)
help support and
produce Outcomes to
respond to the needs
of our community?
What Outcomes
are observed and
measured as
Community and
Family level NPIs?
How do the
Outcomes we are
tracking move us
towards our
agency goals in
our local TOC?
What has changed for
the people we served?
What has changed for
our community? What
Outcomes were
achieved and for whom?
What Services and
Initiatives contributed
to achieving the
Outcomes? What can we
improve to better
respond to local needs?
How do the Core
Principles in the Theory
of Change help guide our
agency strategic plan and
community action plan?
How will we
implement our unique
combination of
Services and
Initiatives? And for
what Outcomes (NPIs)?
Planning
ROMA Next
Generation
Achievement of
Results
Implementation
How will we strategically
respond as an agency to
individual, family, and
community needs? What
impact do we want to
have? What are our
performance targets?
What services and
initiatives do we select?
Do we have a process for observing progress and using
data to make changes as needed?
Do we need to make changes to our services and
ROMA Next Generation and the CSBG Annual Report - Overview
initiatives?
61
Not Just a Clockwise Movement
The phases of the ROMA cycle must be
considered together, with the understanding
that the agency might move from
Implementation back to Assessment, or from
Reporting back to Planning.
ROMA Next Generation and the CSBG Annual Report - Overview
62
HOW DOES THIS ALL FIT TOGETHER?
CAA Community
Needs
Assessment
CAA Strategic
Plan
CAA Community
Action Plan
CSBG State Plan
CSBG Annual
Report
Congressional
Report
ROMA Next Generation and the CSBG Annual Report - Overview
63
RESOURCES AND TOOLS
ROMA Next Generation and the CSBG Annual Report - Overview
64
Annotated CSBG
Annual Report
ROMA Next Generation and the CSBG Annual Report - Overview
65
CSBG IS – CSBG
Annual Report
Crosswalk
ROMA Next Generation and the CSBG Annual Report - Overview
66
CSBG Annual Report Numbering
ROMA Next Generation and the CSBG Annual Report - Overview
67
Additional Tools and Resources Coming
June/July:
CSBG Annual Report Crosswalk with LIHEAP, Head Start, WIOA,
and Weatherization.
June/July:
CSBG Annual Report, Webinar Series, focus on Modules
3 & 4.
July:
Instruction Manuals and Lexicon
ROMA Next Generation and the CSBG Annual Report - Overview
68
ROMA Next Generation and the CSBG
Annual Report - Overview
69
ROMA Next Generation and the CSBG
Annual Report - Overview
70
ROMA Next Generation and the CSBG
Annual Report - Overview
71
ROMA Next Generation and the CSBG
Annual Report - Overview
72
Questions?
Contact us!
Katy Kujawski: [email protected]
Lauren Cook: [email protected]
Jackie Orr: [email protected]
ROMA Next Generation and the CSBG Annual Report - Overview
73
Upcoming CSBG Annual Report
Webinars
Understanding Module 4, Individual and Family Level
July 6 - CSBG Annual Report, Module 4 - 1:00PM ET - Click here to register
July 7 - CSBG Annual Report, Module 4 - 10:00AM PT - Click here to register
July 14 - CSBG Annual Report, Module 4 - 11:00AM CT - Click here to register
Understanding Module 3, Community Level
July 17 - CSBG Annual Report, Module 3 - 11:00AM ET - Click here to register
July 21 - CSBG Annual Report , Module 3 - 10:00AM PT - Click here to register
July 25 - CSBG Annual Report, Module 3 - 11:00AM CT - Click here to register
ROMA Next Generation and the CSBG Annual Report - Overview
74