Final Report - Center for the Study of Social Policy

Final Report
Reporting Period: March 1, 2010 – December 31, 2013
Lead Agency:
File Report Prepared by:
Joyce Dean, Evaluation Liaison
P.O. Box 20400
Salem, Oregon 97307-0400
[email protected]
541-485-1086
Financial Status Report Prepared by:
Marsha Clark, Chief Financial Officer
P.O. Box 20400
Salem, Oregon 97307-0400
[email protected]
503.856.7094
Report Submitted to:
Dr. Charlyn Harper Browne, QIC-EC Project Director
Center for the Study of Social Policy
December 31, 2013
Fostering Hope Initiative
Final Report
Table of Contents
Executive Summary...................................................................................................................... 1
Introduction and Overview .......................................................................................................... 5
Introduction and Project Administration ................................................................................ 5
Overview of the Community, Population, and Problem ....................................................... 19
Overview of the Collaborative Partnership ........................................................................... 69
Overview of the Project Model ............................................................................................. 78
Overview of the Local Evaluation .......................................................................................... 85
Cross-Site Evaluation ............................................................................................................. 94
Project Implementation/Program Strategies ............................................................................ 95
Project Eligibility, Recruitment, Screening, Intake and Termination .................................... 95
Major Strategies and Services Provided.............................................................................. 103
Approach to Program (Model) Fidelity ............................................................................... 106
Use of a Protective Factors Approach ................................................................................. 107
Project Outcomes Evaluation .................................................................................................. 108
Increased Likelihood of Optimal Child Development: Findings ......................................... 108
Increased Family Strengths: Findings .................................................................................. 111
Decreased Likelihood of Child Maltreatment: Findings ...................................................... 135
Additional Local Outcomes: Findings ................................................................................. 140
Relationship among Outcomes ........................................................................................... 141
Community and Societal Domain Outcomes ...................................................................... 141
Sustainability/Integration ........................................................................................................ 143
Cost Tracking ....................................................................................................................... 147
Conclusions .............................................................................................................................. 147
Key Recommendations ............................................................................................................ 152
Dissemination .......................................................................................................................... 156
References ............................................................................................................................... 160
This report was prepared with the support and assistance of Fostering Hope Initiative staff and partners.
Special thanks go to Catholic Community Services staff, including James T. Seymour, Executive Director;
Maureen Casey FHI Director; Teri Alexander, FHI Associate Director, and the home visitors working for
FHI; as well as to all FHI partners, including Carrie Maheu, Salem Leadership Foundation Lightning Rod.
Each of these and all FHI partners contributed to this report and to the rich fabric of the Fostering Hope
Initiative which this report attempts to summarize.
Preparation of this report was supported in part by Subcontract Agreement #100314, Grant #270/QIC.
The material presented does not necessarily reflect the opinions and positions of the Center for the
Study of Social Policy, Quality Improvement Center on Early Childhood.
Final Report
December 31, 2013
I.
Executive Summary
A. Overview of the Project
The Fostering Hope Initiative (FHI) is a neighborhood-based Collective Impact Initiative that
promotes optimum child and youth development by supporting vulnerable families,
encouraging connections between neighbors, strengthening collaboration, intentionally
pursuing quality and accountability, and advocating for family-friendly public policy. The FHI
collaborative is sponsored by Catholic Community Services of the Mid-Willamette Valley and
Central Coast (CCS) and includes state and local government agencies, public and private sector
organizations, local service providers and individuals. FHI’s target population includes families
who reside in selected high-poverty neighborhoods in Marion and Yamhill Counties, Oregon.
B. Summary of Evaluation Findings
Catholic Community Services contracted with Pacific Research and Evaluation (PRE) to
conduct the project evaluation. The evaluation captured process data from program
participants and staff to monitor service provision and attendance rates and document
stakeholder perceptions of implementation quality. A repeated measures quasi-experimental
design compared participants from targeted neighborhoods who received Fostering Hope
Initiative services and families recruited from similar neighborhoods who did not receive
coordinated FHI services. In addition to capturing a variety of demographic data about families
who participated in the research, outcome measures included the Ages and Stages
Questionnaire Third Edition (ASQ3); ASQ Social-Emotional (ASQ SE); Parenting Stress Index
(PSI); Adult-Adolescent Parenting Inventory (AAPI); Self-Report Family Inventory (SRFI); Social
Network Map (SNM); and the Caregiver’s Assessment of Protective Factors (CAPF). Outcome
data were collected at intake and every six months thereafter. Key implementation and
outcome findings are summarized below. There were no significant barriers to implementation.
Implementation Findings
 As a result of a 72.2% retention rate, a total of 70 treatment and 65 comparison
caregivers participated in the study for at least 12 months.
1
 Among study participants, 70.0% of the treatment group and 81.5% of the comparison
group self-identified as Hispanic/Latino. Fewer than 30.0% of participants identified
English as their primary language; 54.4% of treatment and 26.4% of comparison
participants indicated that they were able to speak English.
 Half or more of treatment and comparison group participants reported elementary or
middle school as their highest education level (50% and 58.5%, respectively).
 Almost all caregivers were female (98.6% treatment, 100% of comparison group).
 The majority of caregivers indicated an income of less than $30,000 (88.5% treatment,
92.1% comparison).
 Caregivers receiving coordinated services received 2.4 home visits per month and eight
total referrals, on average.
 In addition to receiving home visiting and resource/referral, 34.7% participated in
parenting education, 17.1% attended at least one community café, and 18.6% attended
at least one community dinner.
 Results of the Caregivers Repeated Measures Survey indicated that caregivers were
generally satisfied with the services they received.
 In addition to the home visiting component, 13,346 caregivers attended Parent Council
meetings, Community Cafés, and community dinners (duplicated count).
Outcome Findings
Caregivers who received at least 12 months of home visiting were included in the outcome
analysis.
 A subset of risk factors decreased. Assessment of protective factors is inconclusive due
to measurement challenges.
• Participants receiving coordinated services demonstrated a statistically
significant decrease in stress associated with parenting as measured with the
Parenting, Child, and Total Stress Domains of the PSI.
• Significant results also were generated with Construct A of the Adult Adolescent
Parenting Inventory which measures the caregiver’s knowledge of the needs and
capabilities of children at various stages of growth and development.
• Due to a ceiling effect, the CAPF did not generate meaningful results, negating
efforts to quantitatively assess change in the protective factors.
 Optimal child development was supported, though to a moderate degree.
2
•
•
•
The PSI Sense of Competence Subscale generated statistically significant results
overall, as well as when data were disaggregated for Marion County and Hispanic
participants.
Statistically significant results generated by the Expectations of Children subscale
of the APPI suggest that the intervention had a small effect in this area.
The local measures (ASQ-3, ASQ SE) found that none of the participating families
were in need of a developmental intervention beyond the addition of learning
activities and continued monitoring, and a very small number of participants
required referral for mental health services.
 The evaluation did not generate robust evidence of increased family strengths.
• The Health/Competence, Conflict, and Cohesion Subscales of the SRFI did not
generate statistically significant results, however, the Expressiveness Subscale,
assessing the expression of warmth, caring, and closeness within the family unit,
approached significance (p=.058), indicating that there may have been some
improvement in this area among caregivers receiving FHI services over and
above that of comparison group participants.
• The items assessed with the Background Information Form (BIF) cannot be
directly attributed to the intervention due to analysis limitations posed by the
categorical data. Results generated with descriptive statistics were generally
positive, however, with the exception of financial solvency.
o With regard to home safety knowledge and practices, as well as
respondents’ use of emergency numbers (BIF item #18), responses for
both the treatment and comparison participants increased for most of
the items queried.
o For all the safety practices addressed in the BIF (item #19), respondents
in the treatment and comparison neighborhoods reported employing
most of the behaviors “all of the time”, on average, at both intake and
one year.
o The majority of both treatment and comparison group respondents
agreed that they would like to remain a resident of their neighborhood,
would be willing to work with people in their neighborhood to improve
the neighborhood, that they like living in their neighborhood, as well as
that they feel safe in their neighborhood (BIF item #17).
o Participants from both study groups reported experiencing a variety of
financial hardships including inadequate funds for rent/mortgage
payments, utility payments, or to buy food. Treatment group participants
did not demonstrate a notable change in this area. The majority of all
caregivers indicated a total household income of less than $30,000, and
almost all were receiving some form of government aid. These results did
not change from intake to one year (BIF Item #s 14-16).
 Data are not yet available from the Department of Human Services to assess change in
child maltreatment rates in the neighborhoods. The Department was able to confirm
3
that none of the study participants in any of the treatment or comparison
neighborhoods had been the subject of a substantiated case of child maltreatment
during the study period.
C. Key Lessons Learned
1. Lessons learned regarding supporting the building of protective factors at the
individual and relationship (family) domains of the social ecology.
• Specifically targeting child care providers, in addition to parents, for outreach
and involvement with increasing the quality of day care settings and
discussing the protective factors had an important impact.
• Sharing information about the protective factors was more effective when it
was infused across a variety of individual, family and neighborhood activities,
goals and supports, using vocabulary and examples that are culturally and
linguistically relevant.
2. Lessons learned regarding the role of the collaborative partnerships in supporting
the building of protective factors at the community domain (i.e., geographic
community, provider community, and/or special caregiver community).
• The collaborative role with school districts, in particular, was essential.
Ensuring that efforts are aligned with kindergarten and school core standards
will increase the probability of school success. The relationship between
young children's social emotional competence and their cognitive
development, language skills, health, mental health and school success needs
to be emphasized, incorporating existing standards.
• Providing temporary respite supports, like those offered by Safe Families for
Children, was an invaluable resource to assist in strengthening family
protective factors.
• The projects had to be alert for natural opportunities to bring in building
protective factors that arise within communities and the various socialecological domains. For example, a neighborhood event might offer a natural
opportunity to share information about protective factors.
3. Lessons learned regarding the role of the collaborative partnerships in supporting
the building of protective factors at the societal domain (i.e., city, county, state,
regional, or national) of the social ecology
• Each person working on the project needed to work in more than one domain
of the social ecology, e.g., home visitors worked at the Individual/Caregiver
level but also supported building protective factors in the Relationship and
Community domains. Administrators may have wanted to focus on advocacy
to change public policy, but to do that they also needed to work with the
Community (Service Provider) domain to ensure that providers were adopting
methods to build protective factors.
4
• Coordinating specific grant-writing efforts with public health entities and
school districts provided useful opportunities to broaden the inclusion of
protective factors.
5
II.
Introduction and Overview
A. Introduction and Project Administration
1. Purpose of the QIC-EC
The National Quality Improvement Center on Early Childhood (QIC-EC) was established in
2008 as a 5-year cooperative agreement between the Children’s Bureau and three partner
organizations: Center for the Study of Social Policy (lead agency); National Alliance of
Children’s Trust and Prevention Funds; and ZERO TO THREE: National Center for Infants,
Toddlers, and Families.
The QIC-EC was established to test evidence-based and evidence-informed approaches that
build protective factors and reduce risk factors in order to promote optimal child development,
increase family strengths, and decrease the likelihood of abuse and neglect among infants and
young children. To this end, the QIC-EC funded four research and demonstration projects. In
addition, funding was provided for five doctoral students whose dissertation research was
related to the focus of the QIC-EC. Through its Learning Network, the QIC-EC engaged a
multidisciplinary group of professionals in dialogue and information exchange on key policy,
research, and practice issues related to the prevention of child maltreatment.
The QIC-EC is funded by the United States Department of Health and Human Services,
Administration for Children, Youth and Families, Office on Child Abuse and Neglect, and is
supported by matching funds from the Doris Duke Charitable Foundation.
2. Rationale for Applying for Funding
“Children’s early development depends on the health and well-being of their parents. Yet
the daily experiences of a significant number of young children are burdened by the
untreated mental health problems of their families, recurrent exposure to family violence,
and the psychological fallout from living in a demoralized and violent neighborhood.”
(Shonkoff & Phillips, 2000, p. 7).
During Federal Fiscal Year 2007, an estimated 794,000 children nationally were determined
to be victims of child abuse or neglect. Of these, 20.7% of victims and 3.8% of non-victims were
placed into foster care (U.S, Department of Health and Human Services, 2009). In two Oregon
counties, a total of nearly 600 children were victims of substantiated child abuse/neglect,
representing nearly 17 per 1000 children in Marion County and 9.3 per 1000 in Yamhill County.
Of these, 6.2 per 1000 and 5.5 per 1000, respectively, suffered recurrence of maltreatment. In
6
Marion County, 2145 (2.53 %) children and 199 (.89%) of Yamhill County children were in foster
care at least once during 2007 (Children First for Oregon, 2008). Based on data provided by
Oregon’s Department of Human Services (DHS), approximately 70 children entered or reentered Marion County foster care every month due to parent drug abuse, cycle of child abuse
and neglect, or other issues making their lives unsafe. Most of those came from neighborhoods
with high rates of poverty and limited assets that allow children and families to thrive.
Economic conditions over the past several years have dramatically increased family stress in
Oregon, where the unemployment rate was 6th worst in the nation, according to the Bureau of
Labor Statistics (http://www.bis.gov/web/laumstrk.htm) at the time of the proposal for this
project. Between November 2007 and November 2008, the number of unemployment claims
in Marion County rose 52%.
Catholic Community Services (CCS) believes families have a responsibility to protect and
nurture their children and the community has a responsibility to support families to do that.
The Center for Disease Control’s Injury Center recognizes communities that support parents
and take responsibility for preventing abuse as a “Community Protective Factor” (CDC, 2010).
Failure to meet these responsibilities occurs at a tremendous cost to families, communities, and
society.
Supporting families reduces costs now and over time. At the time of the proposal, it was
estimated by the state Children and Families Commission that the cost of placing one child in
foster care for one year was $18,000, considering the cost of caseworkers from DHS, protective
services investigations, and the cost of foster care itself. In 2013, at a meeting sponsored by the
governor’s office to develop a legislative strategy for “Pay for Prevention,” the average cost of
one year of foster care was given as $29,000. Neither figure includes the cost of the other
systems that must step in when children fail to thrive in foster care, e.g., psychiatric hospitals,
detention centers, remedial education, mental health services, addictions services, and medical
services to restore physical health. Fostering Hope Initiative partners believe that reducing child
maltreatment will lead to safely reducing the need for foster care, which will result in significant
cost reductions for public systems. FHI wants to convince government to reinvest those funds
into strengthening families programs that protect and promote optimum child development,
thus further reducing child maltreatment. The governor’s Pay for Prevention initiative is
evidence that vision is now closer to becoming a reality.
The point at which CCS submitted the FHI proposal was a unique time when we felt we
might be close to a “tipping point” (Gladwell, 2002) for producing radical change:
• Casey Family Programs had funded Oregon’s Department of Human Services and the
Oregon Commission on Children and Families to carry out a $2,000,000 project to
reduce child maltreatment and safely reduce the need for foster care in Oregon.
• Marion County was one of several counties to receive support from the Casey project.
The Fostering Hope Initiative (FHI) was a key element of the county’s Casey plan.
• The Oregon Department of Human Services (DHS) itself had several active projects
working to reduce child maltreatment and foster care.
7
•
•
•
•
Local media coverage in the year prior to the application had dramatically raised
community awareness of needs related to child maltreatment and foster care.
Government leaders—such as then Oregon Governor Ted Kulongoski; The Honorable
Paul DeMuniz, then chief justice of the Oregon Supreme Court (official spokesperson for
the Fostering Hope Initiative); Bruce Goldberg, M.D., DHS director; and Mickey Lansing,
then executive director of the Oregon Commission on Children and Families—were
speaking out about the issues of child abuse/neglect and foster care and how the
community must come together to address the problem.
Local business leaders were stepping up to take action to improve the experience of
families and children. Businesses supported the development and start-up of FHI, have
spoken on our behalf, and provided funding for FHI efforts.
With leadership from the Marion County Children and Families Commission, local social
services organizations, schools, faith communities, businesses and neighborhood
leaders realized the benefits of collaboration for reducing child maltreatment.
Project partners believed this was a window of opportunity and it was time to act. It was
time to take on a coordinated high-impact initiative that relied on the rich network of resources
available in selected neighborhoods so that families would find the supports they needed to
raise their children well and keep their families together. The QIC-EC request for proposals
gave FHI an opportunity to study the processes and outcomes of our work to support future
replication.
3. Funders
Since its inception, FHI has relied on a blending of funding from different sources plus inkind contributions of services, staff time and space. As FHI has matured, the project has come
to use the following funding model:
• Direct services. FHI primarily relies on existing service funding streams to fund direct
services such as home visiting for residents of FHI neighborhoods. Project partners hold
contracts with government agencies for providing services to the target population.
• Backbone organization functions. Based on a collective impact model, backbone support
functions are funded primarily through foundation grants and donor gifts, but also
through administrative overhead charged to programs within CCS.
• Evaluation. FHI has used a variety of funding to support FHI evaluation—foundations,
donor gifts, and government grants. Nearly all proposals now submitted by CCS related
to FHI include external evaluation, and thus include requests for funding to support
those evaluation efforts. The most substantial of these evaluations has been the project
funded by the QIC-EC.
• Research. FHI has required funding from federal grantors (or subcontractors) to support
research studies to obtain publishable data confirming the results of FHI.
4. Overall Organizational/Management Structure of Project
8
FHI’s management structure has evolved over the past four years. In the early years of FHI,
CCS management staff and consultants made decisions on behalf of FHI, sometimes based on
input from partners. A group of mid-managers from partner organizations attended a monthly
Participatory Evaluation and Planning Team meeting in which data were shared and strategies
developed for improving project performance. This structure ended in the spring of 2013,
primarily because the participants, being mid-managers, were unable to commit their
organizations to decisions made in the group. Therefore, FHI established a new FHI Executive
Council for Marion County. This council consists of the Executive Directors of each of the
partner organizations that provide services in Marion County, and some of them also provide
services in Yamhill and Polk Counties, as well. The Council has taken over the participatory
evaluation and planning process as well as overall leadership for FHI. Because the number of
service providers is smaller in Polk and Yamhill County, leadership in those counties is primarily
conducted in meetings with the providers there. See Figure 1 for a current organizational chart.
5. The Lead Organization of the Project
For 75 years, CCS has offered a variety of programs for children, youth, and families at-risk,
as well as for adults with intellectual and developmental disabilities (I/DD). CCS—dedicated to
providing the highest quality services using research-based practices and accredited since 1998
by the national Council on Accreditation (COA) for children and families programs— served as
the lead entity for this project, received and managed grant funds, and provided project
management. Known for innovative solutions, CCS opened the first counseling center in the
mid-Willamette Valley more than 50 years ago; brought the treatment foster care concept to
Oregon nearly 30 years ago; and pioneered the Community Homes for Children concept 15
years ago. CCS now serves approximately 2000 children and adults each year and has an annual
budget of approximately $14,000,000.
 CCS Mission. Catholic Community Services is a faith-based organization whose mission
is: “A Forever Home for Everyone – an opportunity to live responsibly in a nurturing
home and caring community you call your own.”
CCS Vision. Children, families, adults with knowledge, ability and desire to take control
of their own lives, and live responsibly with others in a just society.
CCS Goal. Promote and protect optimum human development: child safety; knowledge,
skills, attributes to succeed at home, school, work, and community; good health; and
financial self-sufficiency.
 Key Staff
James T. Seymour has been the Executive Director of CCS for over 30 years. Karen Ross is the
Director of Quality. The current director for Fostering Hope is Maureen Casey, Ph.D. The FHI
Director position changed a few times during the course of the project. Teri Alexander is the
Associate Director of FHI.
9
10
Catholic Community Services
Board of Directors
FHI Strategy Council
(Blue Ribbon Advisory Council
that advocates for policy
change, raises money,
addresses barriers)
• Community Leaders
• Business Leaders
• Philanthropists
FHI Executive Council
Marion County
Catholic Community Services
Executive Director
(Backbone Organization and
Lead Agency for research
project funded by QIC-EC)
Evaluation
Liaison
FHI Project Director
(Collective Impact Coordinator)
Planning, Implementation,
Supervision, Communications
FHI Executive Council
Polk County (Planned)
FHI Executive Council
Yamhill County (Planned)
Partner Service Providers
e.g., Options Counseling,
Family Building Blocks
FHI Associate
Director and
Program
Coordinator
for Safe
Families for
Children
Neighbor
Connectors
(The Ford
Family
Foundation)
Neighborhood
Mobilization
Subcontracts
• Salem
Leadership
Foundation
• Mano a Mano
Family Center
Pacific
Research and
Evaluation
(External
Evaluation)
Home
Visitors*
* Home Visitors are
now provided by
partners, not by CCS,
and do not report to
the Project Director
Figure 1. Organizational chart for the Fostering Hope Initiative as of the end of the project.
11
 Other Work
CCS’s current children, youth and families programs include treatment foster care; the
Cavazos Center for adjudicated Hispanic/Latino youth; Center Court Commons, a supportive
apartment community for youth transitioning out of foster care; Community Homes for
Children in long-term foster care; the Community Counseling Center; Father Taaffe Homes for
pregnant and parenting teen mothers; Independent Living for Teens; Rainbow Family Services
in Yamhill County; Rainbow Lodge Respite Center for youth; and Safe Families for Children,
offering volunteer supports to at-risk families. The programs for adults with intellectual/
developmental disabilities are residential—including nursing—employment and brokerage
services. The annual CCS operating budget is about $14,000,000. CCS has approximately 370
staff and 120 volunteers. CCS’s major funding sources include government contracts,
foundation grants, and corporate and individual donations.
CCS also sponsors another initiative, known as “Living the Dream”: Assuring a voice and
choice for people with developmental disabilities. The initiative’s vision is: “People with
developmental disabilities enjoy the rights and responsibilities of self-determination: the
freedom to enjoy a meaningful life of one’s choice.” This initiative includes components related
to workforce investment, employment, education, kin and kith connections, appropriate
housing, civic and cultural community life, and information technology.
Catholic Community Services Foundation (CCSF) was established in 1987 to support and
assure financial sustainability of Catholic Community Services and its programs and develop and
maintain facilities to house CCS programs. CCSF has now developed expertise in property
development and management, and is a community resource for affordable housing. The
organization now offers more than 100 rental units and a home ownership assistance program
while managing more than 300,000 square feet of office and living space.
6. The Local Evaluation of the Project in Terms of its:
• General Approach to Project Evaluation
• Fit with the Needs of the Project
Catholic Community Services contracted with Pacific Research and Evaluation (PRE) to
conduct the project evaluation. The evaluation captured process data from program
participants and staff to monitor service provision and attendance rates and to document
stakeholder perceptions of implementation quality. A repeated measures quasi-experimental
design compared participants from targeted neighborhoods who received Fostering Hope
Initiative services and families recruited from similar neighborhoods who did not receive
coordinated FHI services. In addition to capturing a variety of demographic data about families
who participated in the research, outcome measures included the Ages and Stages
Questionnaire Third Edition (ASQ3); ASQ Social-Emotional (ASQ SE); Parenting Stress Index
(PSI); Adult-Adolescent Parenting Inventory (AAPI); Self-Report Family Inventory (SRFI); Social
12
Network Map (SNM); and the Caregiver’s Assessment of Protective Factors (CAPF). Data were
collected at intake and every six months thereafter.
During Participatory Evaluation and Planning (PEP) meetings that occurred monthly over the
course of the project, evaluation staff worked with the CCS Evaluation Liaison to present data
to the PEP Team (composed of project leaders and staff from CCS and the partner agencies) for
the dual purposes of project monitoring and identifying opportunities to improve
implementation and outcomes. This approach was chosen for evaluating the Fostering Hope
Initiative because CCS, as the backbone organization of the Collective Impact Initiative, was
deeply vested in engaging the partnership in regular discussions about data in order to move
the partnership toward greater levels of shared measurement. Additionally, because partner
organizations were responsible for recruiting comparison group participants in the study and
submitting service tracking data about the neighborhood services provided through the
Initiative, ongoing meetings to ensure implementation was on-track also were expected to be
beneficial.
In addition to the program-level evaluation, common measures were collected for the
purpose of contributing to the cross-site evaluation conducted on behalf of the QIC-EC by
InSites. The combination of evaluation activities effectively met the needs of both the local
project (including the collaborative partners) and the national cross-site evaluation.
7. Essential Project Implementers/Staff and Their Roles
Table1 includes the essential project implementers and their roles, credentials, experience,
time assigned to the project, and type.
Table 1
Key Project Implementers
Project
Credentials and
Implementers
Experience
and Type
CCS Staff
James T. Seymour, 30 years as CCS Exec. Dir. ;
M.P.A.
recognized leader in Child
Professional
and Family Services,
appointed by Gov. to
several statewide
committees.
Maureen Casey,
Ph.D.,
Professional
Ph. D. in Educational
Psychology with minor in
Deafness Rehabilitation;
Role and
Time on
Project
CCS Executive
Director;
Part time on
FHI
Collective
Impact
Coordinator,
13
Role Description
Overall leadership, communications with funders. Ensure the
integrity of collaborative
relationships. Serve on FHI
Executive Council; support the
Parents’ and Youth Councils, PEP
team. Ensure project research,
evaluation and are conducted in
an ethical, competent, complete
and timely manner.
Manage project goals &
objectives. Ensure compliance
with grant requirements. Deepen
Project
Implementers
and Type
(Position
previously held by
Tedra Stuart,
James Seymour,
and Heiko Junge)
Joyce Dean, M.Ed.
Nicole Fierro,
Professional
Elizabeth
Underwood,
M.S.Wa
Professional
Teri Alexander,
M.S., Professional
Jeni Bastida,
Adriana Islas and
Brittani Padilla
Parent Leaders
Partner Staff
Kay Cepeda,
Family Building
Blocks
Professional
Maria Lemus,
Mano a Mano
Role and
Time on
Project
Credentials and
Experience
MA in Communication
Disorders, MS in
Counseling
30 years senior research
assistant at University of
Oregon; author/coauthor
on books, articles on
methods of Quality
Improvement and services
for people with
intellectual/developmental
disabilities
Bilingual Spanish/English
Experienced Healthy
Families America Home
Visitor
FHI Project
Director
Full Time on
FHI
Evaluation
Liaison; Part
time on FHI
Home Visitor
Supervisor;
Parent
educator; Full
time FHI
15 years of experience with
Healthy Start; HFA peer
reviewer; 19 years as a
clinical social worker
MS in Management and
Organizational Leadership;
Developed/managed CCS
volunteer programs,
including Safe Families for
Children
Parents
Healthy Start
Program
Director, Part
time FHI
Program
Coordinator
Safe Families
for Children;
FHI Associate
Director
Facilitator for
Neighborhood
Community
Café; Part-time
on FHI
Mid-Manager
FHI/FBB
Liaison;
Part-time on
FHI
Outreach;
Part-time on
Bilingual Spanish/English
Community Worker
14
Role Description
relationships with partners,
develop new partners.
Develop/improve systems for
collective impact. Attend PEP,
support Executive Council.
Work with PRE, CCS staff and
partners to establish data
collection systems. Lead for all
narrative reporting on the project.
Assist with systems, materials and
form development. Plan/attend
PEP meetings.
Support and supervise home
visitors. Provide HV data to PRE.
Provide parenting education
classes. Coordinate with
neighborhood resources and
organizations in Marion Count.
Attend PEP meetings.
Manage the Healthy Start home
visitors/parent educators assigned
to FHI. Ensure fidelity to HFA
model, train staff. Attend PEP.
Recruit faith communities and
Host Families for SFFC program,
and coordinate services provided.
Assist project director in carrying
out project responsibilities. Attend
PEP meetings.
Plan logistics and facilitate
neighborhood meetings to discuss
how to support families to build
Protective Factors (Swegle).
Coordinate FBB activities related
to FHI. Attend PEP meetings.
Recruit participants in target and
comparison neighborhoods.
Project
Implementers
and Type
Professional
FHI
Levi HerreraLopez, Mano a
Mano
Professional
Carrie Maheu,
Salem Leadership
Foundation
Professional
Executive Director
Bilingual Spanish/English
Sam Skillern,
Salem Leadership
Foundation
Professional
Graciela Jaquez
Options
Counseling
Professional
Executive Director
Christopher Hupp,
Options
Counseling
Professional
Steven Rider,
Ph.D., Pacific
Research &
Evaluation (PRE)
Professional
Mid-Manager
Katie Winters,
M.A, PRE,
Professional
Role and
Time on
Project
Credentials and
Experience
McKay area “Lightning
Rod”
Bilingual Spanish/English
Ph.D. Clinical Psychology.
More than 20 years of
research and program
evaluation experience.
Director of several
federally funded research/
evaluation projects. Author
of journal articles, book
chapters; research
presentations; taught
college classes. Expertise in
qualitative and quantitative
designs and methods,
statistical analysis.
MA in Applied Psychology
More than a decade
conducting evaluations for
community-based, state
Project
leadership;
Part-time on
FHI
Neighborhood
mobilization;
Part-time on
FHI
Project
leadership;
Part-time on
FHI
Washington
neighborhood
Community
Café; Part-time
on FHI
Liaison; Parttime on FHI
Role Description
Support neighborhood activities,
including activities at La Casita.
Attend PEP meetings.
Outreach. Advise project on
cultural competency. Attend PEP
meetings, Executive Council.
Develop and coordinate
opportunities that arise through
neighborhood faith communities,
e.g., La Casita and the Community
Dinners. Attend PEP meetings.
Relationships with faith
community, outreach. Attend PEP
Meetings, Executive Council.
Plan, organize logistics, and
facilitate Community Cafés in the
Washington Neighborhood.
Supervise Options Counseling staff
working with FHI. Coordinate with
FHI. Attend PEP meetings
Subcontract:
External
Evaluator;
Part-time on
FHI
Lead the utilization-focused
evaluation, including data analysis,
interpretation, and reporting.
Present data to PEP team,
Executive Council. Coordinate with
cross-site evaluation. Lead on
ZERO to THREE article. Present
project results at conferences and
national project meetings. Attend
grantee meetings.
Subcontract:
External
Evaluator;
Part-time on
Work with CCS and partner staff
to conduct the utilization-focused
evaluation, including data analysis,
interpretation, and reporting.
15
Project
Implementers
and Type
and national organizations.
a
Role and
Time on
Project
Credentials and
Experience
Role Description
FHI
Present data to PEP team,
Executive Council. Assist in
developing/giving presentations.
Attend grantee meetings.
This position was later filled by Tedra Stuart who had similar credentials and responsibilities.
8. Workforce Recruitment, Training, Supervision, Retention, and Project Staff
 Procedures for Recruiting Project Staff
The Fostering Hope Initiative built on existing programs. Therefore, the home visiting
component, based on the Healthy Families America model, began with existing home visitors
within Catholic Community Services and, for the first few years of the project, Yamhill County’s
Healthy Start program. Recruitment for replacement staff followed typical CCS procedures,
including internal posting of positions, external posting on a website, and recruitment through
other avenues such as English and Spanish language newspapers, and personal contacts.
Project leaders and evaluators were recruited primarily through personal contacts.
In 2013, through a donation from a local philanthropist, CCS developed a part-time “Parish
Liaison” position to identify people attending a local Catholic parish who are called to providing
caregiving services, such as foster parents or personal assistance aides. The position has been
so successful in that parish, it is now being expanded to a second local Catholic parish.
 Initial Training and Orientation of Staff, Particularly about The Protective Factors
Framework
In addition to the training required by the Healthy Families America model for home
visitors, staff received training in facilitating Community Cafés, in the Strengthening Families
Protective Factors, and in the Asset-Based Community Development approach to communitybuilding. Depending on the skills of local residents, the power of local associations, and the
supportive functions of local institutions, Asset-Based Community Development draws on
existing community strengths to build stronger, more sustainable communities for the future.
Once FHI was invited to join Harvard’s Center on the Developing Child’s Frontiers of Innovation
group, training also included information on the effects of toxic stress, the development of
executive function, and on building parental capacities. During the project, CCS developed a
team to lead implementation of the Sanctuary Model, and began training on Sanctuary.
Sanctuary supports an organizational culture that understands the effects of trauma on servicerecipients and staff alike, and uses methods to reduce the consequences of that trauma.
 Staff Supervision Procedures and Opportunities
16
Home visitor supervision met the criteria for Healthy Families America, with at least 1.5-2
hours each week of one-on-one supervision, reviewing each family on each home visitor’s
caseload. The Healthy Start~Healthy Families director at CCS provided model supervision to the
home visitor working in Yamhill County, when no credentialed supervisor was available there,
and to ensure consistency across home visiting in the two counties. CCS parenting education
class instructors, who in many cases also were home visitors, also received supervision through
the Healthy Start~Healthy Families Director.
Management staff was supervised through CCS’ Fostering Hope Initiative Management
Team, or through individual meetings with the Executive Director or Project Director.
Supervision included review of task assignments, progress, due dates, and discussion of issues,
including discussion of strategies for building family Protective Factors, reducing toxic stress,
Asset-Based Community Development, and mobilizing neighborhoods to support families.
Supervision meetings with the Executive Director focused on implementation problems that
required reallocation of resources and strategic issues. For example, FHI provided catalytic
leadership designed to mobilize FHI neighborhood leaders to build “protective factors” in the
neighborhood. When leaders from a neighborhood church stepped forward and offered FHI a
“little house” owned by the church, there was no budget to help cover remodeling and utility
costs. As the backbone organization CCS took on this challenge on and met it.
 Staff Retention Plan
CCS has adopted several strategies to support staff retention. These include:
• Revised the staff evaluation format so that it includes a review of how staff
members are supported in their work, applying the Performance Engineering Matrix
approach (Albin, 1992) to supporting staff performance.
• Improved training for supervisors.
• Implemented the Employee Stewardship Team system, which gives employees the
opportunity to review data on program performance in seven outcome areas,
identify needed improvements, and implement strategies to improve performance.
These teams, organized by department, ensure that employees have a voice and
that staff support issues are addressed.
• Improved core competency training for new staff.
• Incorporating the Sanctuary Model, related to trauma-informed care and traumasensitive organizations, into the culture of CCS. We believe once this approach is
fully integrated, we will experience a decrease in staff turnover.
 Opportunities for Staff Professional Development
FHI used several strategies related to staff professional development.
• All CCS staff members identify desired training opportunities during their annual
performance review. CCS also provides annual diversity training, including content
related to poverty, disability, race and ethnicity.
17
•
•
•
Home visitors participated in the staff development sessions provided as part of the
Healthy Start-Healthy Families program.
FHI participated in webinars provided by Harvard University’s Center on the
Developing Child related to, e.g., toxic stress, executive function and self-regulation,
and by the Center for the Study of Social Policy, on its funded research projects.
Since 2011, CCS has sponsored the Fostering Hope: Closing the Gap Summit, which
brought to Salem researchers in neuroscience, child development, family protective
factors, community-building, collective impact, and other fields so that FHI partners
and staff could learn about the science underlying best practices in early childhood
services.
 Technical Assistance Accessed
FHI received substantial technical assistance from the Quality Improvement Center on Early
Childhood and the Center for the Study of Social Policy. Technical assistance was provided
through annual site visits, phone and email support, and grantee meetings. Throughout the
project, the Center provided research and evaluation resources, shared results of other
successful projects, and communicated about promising practices. In addition, QIC assisted in
providing Community Café training, helped to connect CCS and FHI with Harvard’s Frontiers of
Innovation project (see below), as well as supporting proposals to other funding sources and
assisting in developing a measurement instrument to assess levels of protective factors in
families.
In January 2012, CCS applied to and was selected to become a participant in the Frontiers of
Innovation Project, a project of Harvard University’s Center on the Developing Child. This
project provided technical assistance for improving FHI’s theory of change, as well as support
for understanding that one science underlies long-term educational, health and financial selfsufficiency outcomes.
Throughout the project, CCS contracted with a former University of Oregon research
assistant to act as a liaison between CCS and the external evaluators. This consultant had
worked with CCS for more than a dozen years, was familiar with CCS staff and procedures, and
so could assist CCS personnel to better understand what was required of them to participate in
a formal research project, and assist the external evaluators to access information and people
within CCS. In addition, the evaluation liaison provided training and technical assistance on the
Shewhart Cycle and other methods of continuous quality improvement.
The former director of the Neighborhoods Department in the City of Salem provided
consultation related to neighborhood mobilization—both in devising a method for assessing
social capital in neighborhoods, and in working with Neighbor Connectors—primarily in rural
communities where FHI was not funded by QIC-EC.
CCS also contracted with an employee of PeaceHealth, a non-profit health care organization
which operates nine hospitals in the Western United States. This consultant helped CCS to
18
understand how to approach health care professionals and met with local health care leaders
related to expanding the Fostering Hope Initiative to include a larger presence in health care.
 Staff Turnover that Occurred during the Project and How Staff Turnover was Handled
FHI experienced turnover in two key project positions: Project Director and Healthy
Start~Healthy Families Program Director. However the Executive Director, Healthy Start
supervisor, some of the home visitors, evaluators and evaluation liaison were with the project
throughout its funded period.
When the original Project Director, Heiko Junge, left CCS, Jim Seymour assumed the
responsibilities of Project Director. This allowed continuity in approach during the transition to
a new director. In addition, at that time the Healthy Start~Healthy Families Director assumed a
larger role to include FHI. CCS has for many years used consultants to complete work that is
difficult for program staff to take on—e.g., systems development and data analysis. Therefore,
during this time two consultants assumed larger roles: Jan Calvin, a former City of Salem
department manager, and Joyce Dean, formerly a University of Oregon researcher. Ms. Calvin
led the Neighborhood Mobilization strategies, and Ms. Dean assumed responsibilities related to
evaluation and systems improvement. Both helped in providing continuity for the project.
When the Meyer Memorial Trust funded a proposal for a full time Collective Impact
Coordinator in November 2012, it offered an opportunity to have a full time project director
again. Maureen Casey, Ph.D. initially took on the role of Collective Impact Coordinator
(February 2013), and a few months later became FHI Project Director.
10. Challenges and How They Were Handled
 Management
• Challenge: Balancing speedy decision-making with including FHI partners in FHI
management decisions. This issue was raised most directly related to proposals
submitted to foundations to fund expansion or improvement of FHI. As a result,
CCS backbone staff presented information at each monthly PEP meeting related
to planned and active proposals, and invited partners to join in proposal-planning
and development.
 Garnering Support for the Project
• Challenge: Gaining the trust of a wide range of service providers and funders. At
times, some service providers and funders were hesitant to support FHI, viewing
it as “empire-building” by CCS rather than a true collaborative. Over time, much
of this distrust has faded. When CCS decided to no longer compete for service
funding in early childhood—so that it could focus on its role as a backbone
organization and not compete with its partners for services funding—it helped
remove another barrier to trust.
19
 Implementing Aspects of the Project across the Domains of the Social Ecology
• Challenge: Individual/Family/Caregiver Domain. The transient nature of the
families being served presented challenges. Because FHI is a place-based initiative
and a research project, it had to clearly define families “in” and “not in” the
neighborhood. This was challenging for home visitors, particularly when families
lived in their car; or moved in, out, and back into the neighborhood; as well as
when families moving “out” had only moved a block or two but were outside the
formal boundary for the target neighborhoods.
• Challenge: Relationships (Neighborhood) Domain. Each FHI neighborhood has its
own culture, assets, and issues. For FHI, it was important to develop relationships
with local leaders in each neighborhood—both formal and informal leaders—and
make sure that the FHI design and approach in each neighborhood fit that
neighborhood.
• Challenge: Community Domain (Service Providers). “Collaboration” and “partner”
are concepts that exist along a continuum. Each organization in the collaboration
invested at a different level in the goals of the project. Language became difficult
because of that continuum. Some “partners” had participated in discussions of
the goals and methods of FHI and indicated, “Yes, we support that” but had no
other investment. Others contributed services to the collaboration, participated
in its management, and/or worked to extend the partnership to other
organizations. It is important to work with partners to clearly define the
expectations of the partner and of the collaborative, and to follow-up to ensure
these expectations are met.
• Challenge: Public Policy and Social Norms Domain. CCS has had an active
advocacy effort across many years. However it is always difficult to find
appropriate funding to support advocacy and, and particularly, lobbying efforts.
During this project, CCS submitted a proposal to the Robert Wood Johnson
Foundation’s Roadmaps to Health competition, which would have funded a
comprehensive advocacy effort. Unfortunately, the proposal was not funded.
Therefore, the work to advocate for changes in public policy has been funded by a
private donor, allowing CCS to hire a lobbyist. The increased presence with
legislators led to successfully getting a bill passed to expand Healthy Start to all
births, not just first birth families. Getting financial support to work at the Public
Policy level is difficult, given rules related to lobbying connected to many funding
opportunities.
 Other Important Challenges
• Challenge: The geography which FHI wanted to impact presented challenges. FHI
now exists across three counties—Marion, Yamhill (which were part of this QICEC project) and now Polk. When the project first started, FHI held one
Participatory Evaluation and Planning (PEP) meeting each month, with
expectations that Yamhill County partners would travel to Salem to participate in
these meetings. While they did that for quite a while, it became clear that the
20
•
Salem PEP meeting was not working well for the Yamhill County partners.
Therefore, FHI leaders started attending existing meetings in those two counties,
which has resulted in improved relationships.
Challenge: The changing landscape in early learning services and finding FHI’s
role in that. It is a very exciting time in Oregon related to early learning services.
The governor has led a major initiative to change the way early learning services
are structured and funded. A new state Early Learning Council (ELC) now oversees
funding and programs that previously had been managed through separate
departments. In August, 2013, the ELC released a request for applications (RFA)
for organizations and consortia interested in providing “early learning hub”
services for a defined region. After many discussions, CCS and FHI decided not to
apply to become a hub, and rather to collaborate with a new organization formed
by Marion County service providers to respond to the RFA, Early Learning Hub,
Inc. (ELH). CCS provided proposal-writing support for the application. The ELC has
now announced the successful applicants, which included ELH. CCS and FHI will
continue to work with ELH to ensure that FHI and ELH are operating in alignment.
In Yamhill County, CCS was asked to serve as the facilitator for their county team
to respond to the RFA and design their proposed aligned early learning system.
The FHI Collective Impact Coordinator served as the facilitator and their plan
incorporated the Strengthening Families Protective Factors. They also were
selected, along with Marion County, as one of six initial Early Learning Hubs.
B. Overview of the Community, Population, and Problem
1. How “Community” is Defined in the Project
FHI used a neighborhood-based service delivery model that was chosen intentionally in
response to research highlighting the benefits of providing services in this way. For the
purposes of this project, it was important to distinguish between community-based and
neighborhood-based interventions. Early on, Bruner and Chavez (1998) defined the term
“community” to “…refer to the local political jurisdiction (and its boundaries) that is used by the
community collaborative to define its overall territory. ‘Neighborhood’ is used to refer to
distinct (and not so distinct) areas within that community with which residents identify.”
Neighborhoods within a larger community often differ with respect to ethnicity, culture, class,
opportunity, and the current outcomes being experienced by children. In addition, parents
from different neighborhoods within a given community may hold opposing views in terms of
what constitutes child abuse and neglect (Korbin et. al., 2000). Finally, research had not
produced clear data to delineate the relationships between neighborhoods and child
maltreatment (Coulton et. al., 2007). It therefore follows that research addressing a
neighborhood-based intervention is of the utmost relevance. By designing FHI to concentrate
on neighborhood-specific rather than community-wide needs, it served as a clear opportunity
to contribute to research in this area.
21
Korbin et. al. (2000) also summarized sociological and political research that seeks to
differentiate between communities and neighborhoods and identifies additional benefits to
neighborhood-based programming. More specifically, they summarize Susan Keller’s
sociological definition describing neighborhoods as having “social networks” and Robert
Chaskin’s political perspective which emphasizes that neighborhoods, “…are connected by a
complex web of relationships, needs, priorities, and concerns and, further, that they recognize,
or have the potential to recognize, their common concerns and that they have the ability to act
upon these concerns as a unit.” According to the authors, it is these qualities, specific to
neighborhoods and often differing from the larger communities where they are nested, that
can facilitate greater outcomes in the social services sector. They argue that neighborhoodbased efforts are more likely to increase social capital, bringing neighborhood members
together to support each other and collectively influence neighborhood wellbeing.
2. The Geographic Region(s) in which the Project Provides Services
 Geographic Scope
For this project, the Fostering Hope Initiative selected a total of six high-poverty
neighborhoods in Marion and Yamhill counties in northwestern Oregon. The project defined
the specific neighborhoods based on elementary school catchment areas. Therefore, treatment
neighborhoods were Swegle and Washington in Salem, Marion County, Oregon, and the Sue
Buel neighborhood in McMinnville, Yamhill County, Oregon. Comparison neighborhoods,
selected based on their similarity to the treatment neighborhoods, were Hoover and Hallman in
Salem. Because McMinnville (population 32,451) did not contain another neighborhood similar
to Sue Buel, the project selected the Edwards neighborhood in Newberg (population 22,244),
15 miles away but also in Yamhill County.
 Type
Both Marion and Yamhill counties include both urban (cities and small cities) and rural
areas. The neighborhoods selected for focus in the initiative are in urban areas, the city of
Salem (population 156,244), which is the capitol of Oregon, and McMinnville, a much smaller
city at about 32,000 residents. With the support of The Ford Family Foundation and the
region’s United Way, FHI has now expanded into two rural neighborhoods in Polk County (in
Dallas and Independence), and one additional rural neighborhood in Marion County (in
Woodburn).
 Demographic Characteristics
At the start of the project, economic conditions had dramatically increased family stress in
Oregon, where the unemployment rate was 6th worst in the nation, according to the Bureau of
Labor Statistics at that time (http://www.bis.gov/web/laumstrk.htm). Between November
2007 and November 2008, the number of unemployment claims in Marion County rose 52%.
In 2009, Salem Leadership Foundation (SLF) completed an analysis of ten elementary school
neighborhoods in Salem: nine in the McKay High School feeder district, and one (Hoover) that
is on the border of the McKay area and ranked at the top of Need, Readiness, and Proximity,
22
compared with other schools district-wide. The purpose of the analysis was to make a
recommendation on which neighborhoods should be selected for FHI. During their review, SLF
staff assessed the following factors:
• Need: SLF assessed the level of need based on free/reduced price lunch rates, the
Oregon Department of Education Report Card and federal Annual Yearly Progress
rankings, neighborhood crime rates, the number of non-English-speaking students,
and the number of foster children in each neighborhood.
• Proximity: SLF considered whether the school relied on busing and parent
transportation to get the children to campus, or if students and families lived in
close proximity to the school, providing a stronger “center of gravity” for FHI.
• Readiness: For the five neighborhoods that made it past SLF’s first cut, SLF assessed
the building blocks the neighborhoods had in place related to “neighborhood
efficacy.” These included whether the neighborhood surrounding the school had a
local neighborhood association, as well as the principal’s interest, the involvement
of each school’s Community School Outreach Coordinator, the school’s volunteer
programs and its demonstrated partnerships with the surrounding neighborhood.
Tables 2 and 3 summarize the data related to each of the neighborhoods considered. Based
on these reviews, SLF recommended three neighborhoods as finalists: Washington, Swegle,
and Hallman. They also presented information on each possible pairing, for selecting two
neighborhoods. SLF presented the report to the steering committee, which selected the Salem
area neighborhoods.
FHI’s steering committee selected four high poverty neighborhoods in Marion County—
Hallman and Hoover (comparison), Washington and Swegle (treatment sites). All are in highpoverty northeast Salem, where approximately 80% of students qualify for free and reduced
lunch. In addition, the neighborhoods ranked in the top 30% of neighborhoods in the city for
crime. Approximately 78% of students in these schools reported an ethnicity other than white,
as compared with an average of 30% across Oregon schools, with about 61% Hispanic students
(18% average across Oregon schools). 1 About 50% of the students in these schools were in
English as a Second Language programs. The high levels of unemployment, poverty, and crime
within these neighborhoods put the child population at increased risk for child maltreatment.
According to the Data Book from Children First for Oregon, 1287 children in Marion County
were victims of child abuse or neglect in 2008, representing 17 of every 1000 children.
Table 2
Comparison of Neighborhoods Considered for FHI, School-based Measures
Elementary
Enroll
%
% in ESL
Federal
% FRL
Report Card
-ment
Minority
Program
AYP
School
Did Not
Hallman 450
87.5%
82.3%
56.8%
Low
Meet
Hammond 500
54.6%
52.3%
17.5%
Exceptional Met
Hayesville 515
64.7%
75.8%
47.4%
Satisfactory Did Not
1
Proximity
Middle
School
Walk
Waldo
Walk
Bus
Stephens
Stephens
Drawn from school district records and http://www.publicschoolreview.com/school_ov/school_id/65055 on
January 12, 2010
23
Elementary
School
Enroll
-ment
%
Minority
% FRL
% in ESL
Program
Report Card
Federal
AYP
Proximity
Middle
School
Meet
Met
Walk
Parrish
Did Not
Lamb 480
76.7%
78.1%
45.1%
Walk
Stephens
Meet
Middle Grove 185
81.6%
81.0%
45.9%
Strong
Met
Bus
Stephens
Did Not
Scott 600
66.1%
68.2%
40.0%
Satisfactory
Bus
Waldo
Meet
Swegle 500
70.9%
78.8%
36.5%
Strong
Met
Walk
Waldo
Satisfactory Did Not
Washington 450
76.4%
74.8%
56.6%
Walk
Waldo
Meet
Yoshikai 525
65.9%
69.5%
30.3%
Satisfactory Met
Bus
Stephens
Note. FRL = Free/Reduced Lunch; ESL = English as a Second Language; AYP = Annual Yearly Progress.
Table 3
Comparison of Neighborhoods Considered for FHI, Community Measures
# in Foster
# Foster Homes
Crime Incidents
Crime Incidents
Elementary School
Care
in Area
2008
2007
Hallman
30
8
1812
1990
Hammond
2
9
1812
1990
Hayesville
21
11
County
County
Hoover
37
9
1629
1875
Lamb
11
7
1139
1447
Middle Grove
9
2
1139
1447
Scott
25
15
1139
1447
Swegle
24
9
1042
1020
Washington
17
8
762
807
Yoshikai
21
11
County
County
TOTAL
197
89
Hoover
605
84.0%
95.4%
59.2%
Satisfactory
Satisfactory
In addition, the project selected two neighborhoods in Yamhill County: around Sue Buel
Elementary school in McMinnville (treatment neighborhood), and around Edwards Elementary
in Newberg (comparison neighborhood). Although less data were available on the specific
neighborhoods, the mayor, chief of police and superintendent of schools identified these as
their city’s high-poverty, high-crime neighborhood.
Tables 4-7 present data on median income, child welfare, unemployment rate, and ethnicity
for each county and/or FHI neighborhood.
Table 4
Estimated Median Income for a Family of Four
Estimated
Source
Median Income
http://www.liheap.ncat.org/profiles/povertytables/FY2011/orsmi.htm
Oregon
$71,541
http://www.salarylist.com/company/Marion-County-OregonMarion County
$79,518
Geographic Area
24
Salary.htm
http://www.city-data.com/city/Salem-Oregon.html
http://www.city-data.com/county/Yamhill_County-OR.html
http://www.city-data.com/city/McMinnville-Oregon.html
Salem 2009: $42,035
Yamhill County 2009: $51,441
McMinnville
2009: $41,003
(Treatment)
http://www.city-data.com/city/Newberg-Oregon.html
Newberg
2011: $52,853 (drawn 10/15/2013)
(Comparison)
Note. Child Welfare summary for 2010, from the Children First for Oregon, Oregon County Data Book
(drawn 6/15/2012 from http://www.cffo.org/images /pdf_downloads /county_data_books/)
Table 5
Child Welfare Data by County
Reports of child abuse/neglect
% of reports assessed
% of assessed reports founded
# of children in the county who been in foster care at
least once in the past year
% of founded abuse/neglect/threat of harm referrals
were related to domestic violence
…related to substance abuse
# youth aged out of foster care
Marion County
Yamhill County
9,033 (region)
38%
22%
1,686
28%
35%
1,680
232
20.3%
14.3%
46.7%
45
39.9%
7
Table 6
Unemployment Rates July 2013
Geographic Area
Oregon
Marion County
Yamhill County
Source
Drawn 10/15/2013
Unemployment Rates
8.1%
8.8%
7.8%
http://www.bls.gov/lau/
http://www.bls.gov/lau/laucntycur14.txt
http://www.bls.gov/lau/laucntycur14.txt
The ethnic composition for each elementary school, from which the program boundary areas
were defined, is presented in Table 7.
Table 7
Ethnicity of FHI Treatment and Comparison Neighborhoods at the Start of the Study
Marion County
Program
Ethnicity
Washington Swegle
Caucasian/White
26.7%
29.7%
Hispanic/Latino
58.6%
43.8%
Asian/ Pacific Islander
6.2%
7.8%
Comparison
Hallman
Hoover
19.4%
16.5%
73.0%
74.7%
1.6%
1.3%
25
Yamhill County
Program
Sue Buel
65.8%
29.1%
2.0%
Comparison
Edwards
59.5%
37.9%
0.8%
American Indian/
Alaska Native
2.1%
1.0%
2.0%
1.5%
0.8%
Black
0.5%
1.2%
0.7%
0.7%
0.8%
Note. Marion County and Edwards Elementary data drawn from
http://www.schoolmatters.com/schools on April 25, 2010. Sue Buel data drawn from
http://www.msd.k12.or.us/district/fast-facts on April 25, 2010.
0.8%
1.0%
3. Demographic Characteristics, Needs, and Size of the Target Population of
Children and/or Families Served by the Project
The target population for this study consisted of high-risk families with children under the
age of 24 months and for whom there had been no substantiated report of abuse/neglect at
the time of enrollment. Families meeting these criteria and residing in the selected
neighborhoods were eligible for home visiting under the auspices of the Initiative. However, all
neighborhood residents were eligible to participate in other programs provided in the
treatment neighborhoods, including parent education classes, Community Cafés, community
dinners, and other neighborhood engagement activities. The purpose of this policy was to
reduce any potential stigma that might be attached to participation. The target population did
not change during the project. However, the composition of the staff responsible for outreach
did result in overrepresentation of Hispanic/Latino caregivers in the study population, discussed
in greater detail in subsequent sections of this report.
Tables 8 – 89 below summarize demographic data for the program participants who
received home visiting and for the comparison group study participants. Data were captured
with the Background Information Form developed by the QIC-EC. The tables display data only
for those participants who were enrolled in the study for at least 12 months. Two sets of tables
are presented for each demographic item. The first table organizes the results by county and
overall. The second table presents results by neighborhood. For a subset of demographic items,
additional tables presenting data for Hispanic/Latino participants also are included.
26
Caregiver Demographics
As shown in Tables 8 - 10 below, participants from both study groups were most apt to be
between 30 and 39 years of age. All were the mother or father of the child enrolled in the study
(data not tabled).
Table 8
Caregiver Age Overall and by County
Caregiver Age
Study Group
Under 20
20-24
25-29
30-39
40+
Overall
Marion County
Yamhill County
Treatment
(n=70)
Comparison
(n=65)
Treatment
(n=55)
Comparison
(n=49)
Treatment
(n=15)
Comparison
(n=16)
15.7%
12.9%
27.1%
40.0%
4.3%
4.6%
15.4%
35.4%
38.5%
6.2%
12.7%
12.7%
29.1%
40.0%
5.5%
2.0%
16.3%
34.7%
38.8%
8.2%
26.7%
13.3%
20.0%
40.0%
0.0%
12.5%
12.5%
37.5%
37.5%
0.0%
Table 9
Caregiver Age Overall and by County – Hispanic/Latino Participants
Caregiver Age
Overall
Marion County
Yamhill County
Treatment Comparison Treatment Comparison Treatment Comparison
(n=50)
(n=53)
(n=36)
(n=43)
(n=14)
(n=10)
Study Group
Under 20
20-24
25-29
30-39
40+
16.0%
12.0%
24.0%
42.0%
6.0%
1.9%
17.0%
34.0%
39.6%
7.5%
11.1%
11.1%
25.0%
44.4%
8.3%
0.0%
18.6%
32.6%
39.5%
9.3%
28.6%
14.3%
21.4%
35.7%
0.0%
10.0%
10.0%
40.0%
40.0%
0.0%
Table 10
Caregiver Age by Neighborhood
Caregiver Age
Study Group
Neighborhood
Under 20
20-24
25-29
30-39
40+
Marion County
Treatment
Yamhill County
Comparison
Treatment
Comparison
Washington
(n=27)
Swegle
(n=28)
Hallman
(n=29)
Hoover
(n=20)
Sue Buel
(n=15)
Edwards
(n=16)
7.4%
18.5%
25.9%
40.7%
7.4%
17.9%
7.1%
32.1%
39.3%
3.6%
3.4%
17.2%
34.5%
37.9%
6.9%
0.0%
15.0%
35.0%
40.0%
10.0%
26.7%
13.3%
20.0%
40.0%
0.0%
12.5%
12.5%
37.5%
37.5%
0.0%
27
Almost all participants were female, regardless of county or neighborhood (Tables 11 and 12).
Table 11
Caregiver Gender Overall and by County
Caregiver Gender
Study Group
Female
Male
Overall
Marion County
Yamhill County
Treatment
(n=70)
Comparison
(n=65)
Treatment
(n=55)
Comparison
(n=49)
Treatment
(n=15)
Comparison
(n=16)
98.6%
1.4%
100.0%
0.0%
98.2%
1.8%
100.0%
0.0%
100.0%
0.0%
100.0%
0.0%
Table 12
Caregiver Gender by Neighborhood
Caregiver Gender
Study Group
Neighborhood
Female
Male
Marion County
Treatment
Washington
Swegle
(n=27)
(n=28)
96.3%
3.7%
Yamhill County
Comparison
Hallman
Hoover
(n=29)
(n=20)
100.0%
0.0%
100.0%
0.0%
100.0%
0.0%
Treatment
Sue Buel
(n=15)
Comparison
Edwards
(n=16)
100.0%
0.0%
100.0%
0.0%
The majority of participants were Hispanic/Latino (62.5-93.3%), both by county and overall
(Table 13), and within each neighborhood (Table 14).
Table 13
Caregiver Race Overall and by County
Caregiver Racial/Ethnic Identification
Study Group
Overall
Tx.
(n=70)
Comp.
(n=65)
Marion County
Tx.
(n=55)
Comp.
(n=49)
Yamhill County
Tx.
(n=15)
Comp.
(n=16)
African American/Black
1.4%
0.0%
1.8%
0.0%
0.0%
0.0%
Asian/Asian American
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
Caribbean Islander/African National
0.0%
1.5%
0.0%
0.0%
0.0%
6.3%
Caucasian/White/European American 21.4%
16.9%
25.5%
12.2%
6.7%
31.3%
Hispanic/Latino 71.4%
81.5%
65.5%
87.8%
93.3%
62.5%
Native American/Alaska Native
1.4%
0.0%
1.8%
0.0%
0.0%
0.0%
Native Hawaiian/Pacific Islander
5.7%
0.0%
7.3%
0.0%
0.0%
0.0%
Middle Eastern
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
Multi-racial/Biracial
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
Other
1.4%
0.0%
1.8%
0.0%
0.0%
0.0%
Note. Participants could select more than one response. Tx. = Treatment; Comp. = Comparison.
28
Table 14
Caregiver Race by Neighborhood
Caregiver Racial/
Ethnic Identification
Study Group
Neighborhood
Marion County
Treatment
Washington
Swegle
(n=27)
(n=28)
Yamhill County
Comparison
Hallman
Hoover
(n=29)
(n=20)
Tx.
Sue Buel
(n=15)
Comp.
Edwards
(n=16)
African American/Black
0.0%
3.6%
0.0%
0.0%
0.0%
0.0%
Asian/Asian American
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
Caribbean Islander/
0.0%
0.0%
0.0%
0.0%
0.0%
6.3%
African National
Caucasian/White/
29.6%
21.4%
13.8%
10.0%
6.7%
31.3%
European American
Hispanic/Latino
66.7%
64.3%
86.2%
90.0%
93.3%
62.5%
Native American/Alaska
3.7%
0.0%
0.0%
0.0%
0.0%
0.0%
Native
Native Hawaiian/Pacific
3.7%
10.7%
0.0%
0.0%
0.0%
0.0%
Islander
Middle Eastern
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
Multi-racial/Biracial
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
Other
3.7%
0.0%
0.0%
0.0%
0.0%
0.0%
Note. Participants could select more than one response. Tx. = Treatment; Comp. = Comparison.
Less than one third of participants reported that English was their primary language when
disaggregated by County (12.5-37.5%, Table 15), and by neighborhood (10.0-37.5%, Table 16).
Table 15
Caregiver Primary Language Overall and by County - % Yes
Language
Study Group
Overall
Treatment
(n=70)
Is English your main
27.1%
language? % Yes
Note. Comp. = Comparison.
Marion County
Yamhill County
Comparison
(n=64)
Treatment
(n=55)
Comparison
(n=48)
Treatment
(n=15)
Comp.
(n=16)
18.8%
30.9%
12.5%
13.3%
37.5%
Table 16
Caregiver Primary Language by Neighborhood - % Yes
Language
Study Group
Neighborhood
Is English your main
language? % Yes
Marion County
Treatment
Washington
Swegle
(n=27)
(n=28)
33.3%
28.6%
Yamhill County
Comparison
Hallman Hoover
(n=28)
(n=20)
14.3%
29
10.0%
Treatment
Sue Buel
(n=15)
Comparison
Edwards
(n=16)
13.3%
37.5%
Among treatment group participants, approximately half indicated that they were able to
speak or read English (51.2-64.3%, Table 17). Comparison group participants were considerably
less apt to report the ability to speak or read English (10-30.2%, Table 17). Participants from
the Hoover and Edwards comparison neighborhoods were the least likely to report the ability
to speak or read English (10-20%, Table 18).
Table17
Caregiver Ability to Speak and Read English Overall and by County - % Yes
Language
Study Group
Overall
Treatment
(n=55)
Marion County
Comparison
(n=53)
If English is not your
main language, can you
54.5%
26.4%
speak English? % Yes
If English is not your
main language, can you
54.5%
28.3%
read English? % Yes
Note. Tx. = Treatment; Comp. = Comparison.
Yamhill County
Treatment
(n=41)
Comp.
(n=43)
Tx.
(n=14)
Comp.
(n=10)
51.2%
30.2%
64.3%
10.0%
53.7%
30.2%
57.1%
20.0%
Table 18
Caregiver Ability to Speak and Read English by Neighborhood - % Yes
Language
Study Group
Neighborhood
If English is not your main
language, can you speak
English? % Yes
If English is not your main
language, can you read
English? % Yes
Marion County
Treatment
Washington Swegle
(n=19)
(n=22)
Yamhill County
Comparison
Hallman Hoover
(n=25)
(n=18)
Treatment
Sue Buel
(n=14)
Comparison
Edwards
(n=10)
47.4%
54.5%
40.0%
16.7%
64.3%
10.0%
52.6%
54.5%
40.0%
16.7%
57.1%
20.0%
Approximately half of the respondents, both overall and by county, were married to the
father or mother of the child in the project at the time they were surveyed. The Edwards
neighborhood contained both the smallest proportion of caregivers who had never been
married and the largest proportion of respondents who were not married but residing with the
father or mother or the child in the project (Tables 19-21).
30
Table 19
Caregiver Marital Status Overall and by County
Overall
Marital Status
Marion County
Yamhill County
Tx.
(n=70)
Comp.
(n=65)
Tx.
(n=55)
Comp.
(n=49)
Tx.
(n=15)
Comp.
(n=16)
Never married
Divorced
Separated
Widowed
24.3%
4.3%
1.4%
0.0%
18.5%
1.5%
3.1%
0.0%
23.6%
5.5%
1.8%
0.0%
20.4%
0.0%
4.1%
0.0%
26.7%
0.0%
0.0%
0.0%
12.5%
6.3%
0.0%
0.0%
Married to father or mother of child in
the project
47.1%
47.7%
47.3%
53.1%
46.7%
31.3%
Married, but not to the father or
mother of the child in the project
2.9%
1.5%
3.6%
0.0%
0.0%
6.3%
Not married, but living with the father
or mother of the child in the project
20.0%
27.7%
18.2%
22.4%
26.7%
43.8%
Not married, but living with boyfriend,
girlfriend, or partner who is not the
parent of the child in the project
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
Study Group
Note. Tx. = Treatment; Comp. = Comparison.
Table 20
Caregiver Marital Status Overall and by County – Hispanic/Latino Participants
Marital Status
Overall
Marion County
Yamhill County
Tx.
(n=50)
Comp.
(n=53)
Tx.
(n=36)
Comp.
(n=43)
Tx.
(n=14)
Comp.
(n=10)
Never married
Divorced
Separated
Widowed
22.0%
2.0%
0.0%
0.0%
13.2%
0.0%
3.8%
0.0%
19.4%
2.8%
0.0%
0.0%
14.0%
0.0%
4.7%
0.0%
28.6%
0.0%
0.0%
0.0%
10.0%
0.0%
0.0%
0.0%
Married to father or mother of child in the
project
50.0%
50.9%
52.8%
58.1%
42.9%
20.0%
Married, but not to the father or mother of
the child in the project
2.0%
0.0%
2.8%
0.0%
0.0%
0.0%
24.0%
32.1%
22.2%
23.3%
28.6%
70.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
Study Group
Not married, but living with the father or
mother of the child in the project
Not married, but living with boyfriend,
girlfriend, or partner who is not the parent of
the child in the project
Note. Tx. = Treatment; Comp. = Comparison.
31
Table 21
Caregiver Marital Status by Neighborhood
Marital Status
Study Group
Neighborhood
Never married
Divorced
Separated
Widowed
Married to father or
mother of child in the
project
Married, but not to the
father or mother of the
child in the project
Not married, but living
with the father or mother
of the child in the project
Not married, but living
with boyfriend, girlfriend,
or partner who is not the
parent of the child in the
project
Marion County
Treatment
Yamhill County
Comparison
Treatment
Comparison
Washington
(n=27)
22.2%
11.1%
3.7%
0.0%
Swegle
(n=28)
25.0%
0.0%
0.0%
0.0%
Hallman
(n=29)
20.7%
0.0%
6.9%
0.0%
Hoover
(n=20)
20.0%
0.0%
0.0%
0.0%
Sue Buel
(n=15)
26.7%
0.0%
0.0%
0.0%
Edwards
(n=16)
12.5%
6.3%
0.0%
0.0%
40.7%
53.6%
62.1%
40.0%
46.7%
31.3%
0.0%
7.1%
0.0%
0.0%
0.0%
6.3%
22.2%
14.3%
10.3%
40.0%
26.7%
43.8%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
As demonstrated by data displayed in Table 22, few respondents indicated completing
education beyond high school or a GED. Overall, half or more of treatment and comparison
group participants reported elementary or middle school as their highest education level (50%
and 58.5%, respectively). Respondents from the Hallman and Hoover comparison
neighborhoods reported the lowest education levels as compared to other study
neighborhoods (Table 24).
32
Table 22
Caregiver Education Level Overall and by County
Highest Education Level Completed
Overall
Marion County
Yamhill County
Tx.
(n=68)
Comp.
(n=65)
Tx.
(n=53)
Comp.
(n=49)
Tx.
(n=15)
Comp.
(n=16)
Completed elementary school 19.1%
Completed middle school/junior high 30.9%
Completed high school 26.5%
Earned GED
8.8%
Completed trade/technical school
8.8%
Received 2-year college degree
4.4%
(Associate's)
Received 4-year college degree
1.5%
(Bachelor's)
Received a graduate degree
0.0%
Note. Tx. = Treatment; Comp. = Comparison.
27.7%
30.8%
27.7%
6.2%
6.2%
17.0%
34.0%
24.5%
9.4%
9.4%
28.6%
38.8%
20.4%
8.2%
2.0%
26.7%
20.0%
33.3%
6.7%
6.7%
25.0%
6.3%
50.0%
0.0%
18.8%
1.5%
3.8%
2.0%
6.7%
0.0%
0.0%
1.9%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
Study Group
Table 23
Caregiver Education Level Overall and by County – Hispanic/Latino Participants
Highest Education Level Completed
Overall
Marion County
Yamhill County
Tx.
(n=48)
Comp.
(n=53)
Tx.
(n=34)
Comp.
(n=43)
Tx.
(n=14)
Comp.
(n=10)
Completed elementary school 27.1%
Completed middle school/junior high 27.1%
Completed high school 29.2%
Earned GED 10.4%
Completed trade/technical school 4.2%
Received 2-year college degree 2.1%
(Associate's)
Received 4-year college degree 0.0%
(Bachelor's)
Received a graduate degree 0.0%
Note. Tx. = Treatment; Comp. = Comparison.
34.0%
32.1%
26.4%
7.5%
0.0%
0.0%
26.5%
29.4%
29.4%
11.8%
2.9%
0.0%
32.6%
37.2%
20.9%
9.3%
0.0%
0.0%
28.6%
21.4%
28.6%
7.1%
7.1%
7.1%
40.0%
10.0%
50.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
Study Group
33
Table 24
Caregiver Education Level by Neighborhood
Highest Education
Level Completed
Marion County
Study Group
Treatment
Washington Swegle
Neighborhood
(n=27)
(n=26)
Completed elementary school
22.2%
11.5%
Completed middle school/junior
29.6%
38.5%
high
Completed high school
25.9%
23.1%
Earned GED
7.4%
11.5%
Completed trade/technical
14.8%
3.8%
school
Received 2-year college degree
0.0%
7.7%
(Associate's)
Received 4-year college degree
(Bachelor's)
Yamhill County
Comparison
Hallman Hoover
(n=29)
(n=20)
34.5%
20.0%
Tx.
Comp.
Sue Buel Edwards
(n=15)
(n=16)
26.7%
25.0%
24.1%
60.0%
20.0%
6.3%
31.0%
6.9%
5.0%
10.0%
33.3%
6.7%
50.0%
18.8%
0.0%
5.0%
6.7%
0.0%
3.4%
0.0%
6.7%
0.0%
0.0%
3.8%
0.0%
0.0%
0.0%
0.0%
Received a graduate degree
0.0%
Note. Tx. = Treatment; Comp. = Comparison.
0.0%
0.0%
0.0%
0.0%
0.0%
Program group participants were more likely to indicate that they or a member of their
family had a drinking problem (Table 25). These findings held when data were disaggregated for
Marion County. With regard to neighborhood, drinking and drug problems were reported most
often by caregivers residing in the Washington treatment neighborhood (Table 26).
Table 25
Caregiver & Family Member Drinking and Drug Use Overall and by County - % Yes
Drinking and Drugs
Study Group
Have you ever had a drinking or drug
problem? % Yes
Overall
Marion County
Yamhill County
Tx.
(n=70)
Comp.
(n=65)
Tx.
(n=55)
Comp.
(n=49)
Tx.
(n=15)
Comp.
(n=16)
14.3%
4.6%
14.5%
4.1%
13.3%
6.3%
23.1%
36.4%
20.4%
20.0%
31.3%
0.0%
3.6%
0.0%
0.0%
0.0%
Has any family member ever had a
32.9%
drinking or drug problem? % Yes
Do you feel that you have a drinking
or drug problem now?
2.9%
% Yes
Note. Tx. = Treatment; Comp. = Comparison.
34
Table26
Caregiver & Family Member Drinking and Drug Use by Neighborhood - % Yes
Drinking and Drugs
Marion County
Study Group
Neighborhood
Have you ever had a
drinking or drug problem?
% Yes
Has any family member
ever had a drinking or drug
problem? % Yes
Do you feel that you have
a drinking or drug problem
now? % Yes
Note. Comp. = Comparison.
Treatment
Yamhill County
Comparison
Treatment
Comp.
Washington
(n=27)
Swegle
(n=28)
Hallman
(n=29)
Hoover
(n=20)
Sue Buel
(n=15)
Edwards
(n=16)
18.5%
10.7%
3.4%
5.0%
13.3%
6.3%
40.7%
32.1%
17.2%
25.0%
20.0%
31.3%
7.4%
0.0%
0.0%
0.0%
0.0%
0.0%
Fewer than 15% of respondents were concerned about the types of violence queried in the
Background Information Form, overall as well as by county and neighborhood (Tables 27 and
28). The only exception was in the Sue Buel comparison neighborhood in Yamhill County, where
20% of caregivers were worried that someone might attack them with a weapon (Table 28).
Table 27
Caregiver Concerns about Violence Overall and by County - % Yes
Concerns about Violence: Are you
currently worried that…
Study Group
Overall
Tx.
(n=70)
Someone might attack you with a gun,
knife, stick, bottle, or other weapon? 11.4%
% Yes
Someone might hurt you by striking
you, beating you, or otherwise 10.0%
physically abusing you? % Yes
Someone might force you to engage in
4.3%
sexual acts against your will? % Yes
Note. Tx. = Treatment; Comp. = Comparison.
35
Marion County
Yamhill County
Comp.
(n=65)
Tx.
(n=55)
Comp.
(n=49)
Tx.
(n=15)
Comp.
(n=16)
6.2%
9.1%
6.1%
20.0%
6.3%
3.1%
9.1%
4.1%
13.3%
0.0%
0.0%
3.6%
0.0%
6.7%
0.0%
Table 28
Caregiver Concerns about Violence by Neighborhood - % Yes
Concerns about Violence: Are you
currently worried that…
Study Group
Marion County
Treatment
Wash. Swegle
(n=27) (n=28)
Neighborhood
Yamhill County
Comparison
Hallman Hoover
(n=29)
(n=20)
Treatment
Sue Buel
(n=15)
Comp.
Edwards
(n=16)
Someone might attack you with a
gun, knife, stick, bottle, or other
weapon? % Yes
7.4%
10.7%
6.9%
5.0%
20.0%
6.3%
Someone might hurt you by striking
you, beating you, or otherwise
physically abusing you? % Yes
7.4%
10.7%
0.0%
10.0%
13.3%
0.0%
0.0%
0.0%
6.7%
0.0%
Someone might force you to engage
in sexual acts against your will? % 7.4%
0.0%
Yes
Note. Comp. = Comparison. Wash. = Washington
Child Demographics
Similar to the tables in the previous section, the following pages present data summarizing
child demographics overall, as well as by county and neighborhood. In alignment with the
requirements of the QIC-EC grant, all children enrolled in the study were under 24 months of
age at baseline (Tables 29 and 30).
Table 29
Child Age Overall and by County
Child Age in Months
Study Group
Overall
Treatment
(n=68)
Minimum
0
Maximum
24
Mean
8.90
Note. Comp. = Comparison.
Marion County
Yamhill County
Comparison
(n=64)
Treatment
(n=53)
Comp.
(n=48)
Treatment
(n=15)
Comp.
(n=16)
0
22
9.39
0
24
8.26
0
20
9.19
0
22
11.13
0
22
10.00
36
Table 30
Child Age by Neighborhood
Child Age in Months
Study Group
Marion County
Treatment
Washington
Swegle
(n=26)
(n=27)
Neighborhood
Minimum
Maximum
Mean
0
24
10.19
Yamhill County
Comparison
Hallman
Hoover
(n=28)
(n=20)
0
19
6.41
0
19
10.46
0
20
7.40
Treatment
Sue Buel
(n=15)
Comparison
Edwards
(n=16)
0
22
11.13
0
22
10.00
As shown in Table 31, over half of children enrolled in the study were male, both overall and
across Marion and Yamhill Counties. This held true in five of six study neighborhoods. In the
Hoover comparison neighborhood, however, 60% of participating children were female (Table
32).
Table 31
Child Gender Overall and by County
Child Gender
Study Group
Female
Male
Overall
Marion County
Yamhill County
Treatment
(n=68)
Comparison
(n=64)
Treatment
(n=53)
Comparison
(n=48)
Treatment
(n=15)
Comparison
(n=16)
36.8%
63.2%
45.3%
54.7%
35.8%
64.2%
47.9%
52.1%
40.0%
60.0%
37.5%
62.5%
Table 32
Child Gender by Neighborhood
Child Gender
Study Group
Neighborhood
Female
Male
Marion County
Treatment
Washington
Swegle
(n=26 )
(n=27 )
34.6%
65.4%
37.0%
63.0%
Yamhill County
Comparison
Hallman
Hoover
(n=28)
(n=20)
39.3%
60.7%
60.0%
40.0%
Treatment
Sue Buel
(n=15)
Comparison
Edwards
(n=16)
40.0%
60.0%
37.5%
62.5%
Table 33 demonstrates that, similar to parent/caregiver data presented previously, most
children were Hispanic/Latino (75.7-84.6%, overall). As shown in Table 34, Swegle was the most
diverse study neighborhood with notable representation from several racial/ethnic groups.
Table 33
Child Race Overall and by County
Child Racial/Ethnic Identification
Study Group
African American/Black
Overall
Marion County
Yamhill County
Tx.
(n=70)
Comp.
(n=65)
Tx.
(n=55)
Comp.
(n=49)
Tx.
(n=15)
Comp.
(n=16)
4.3%
1.5%
5.5%
0.0%
0.0%
6.3%
37
Asian/Asian American
1.4%
0.0%
1.8%
0.0%
0.0%
0.0%
Caribbean Islander/African National
1.4%
0.0%
1.8%
0.0%
0.0%
0.0%
Caucasian/White/European American
20.0%
16.9%
21.8% 10.2% 13.3%
37.5%
Hispanic/Latino
75.7%
84.6%
70.9% 89.8% 93.3%
68.8%
Native American/Alaska Native
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
Native Hawaiian/Pacific Islander
7.1%
0.0%
9.1%
0.0%
0.0%
0.0%
Middle Eastern
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
Multi-racial/Biracial
4.3%
3.1%
5.5%
4.1%
0.0%
0.0%
Other
1.4%
0.0%
1.8%
0.0%
0.0%
0.0%
Note. Participants could select more than one response. Tx. = Treatment; Comp. = Comparison.
Table 34
Child Race by Neighborhood
Child Racial/Ethnic
Identification
Study Group
Neighborhood
Marion County
Treatment
Washington Swegle
(n=27 )
(n=28 )
Yamhill County
Comparison
Hallman
Hoover
(n=29)
(n=20)
African American/Black
3.7%
7.1%
0.0%
Asian/Asian American
0.0%
3.6%
0.0%
Caribbean Islander/
0.0%
3.6%
0.0%
African National
Caucasian/White/
22.2%
21.4%
13.8%
European American
Hispanic/Latino
74.1%
67.9%
89.7%
Native American/Alaska
0.0%
0.0%
0.0%
Native
Native Hawaiian/Pacific
3.7%
14.3%
0.0%
Islander
Middle Eastern
0.0%
0.0%
0.0%
Multi-racial/Biracial
3.7%
7.1%
3.4%
Other
0.0%
3.6%
0.0%
Note. Participants could select more than one response.
Treatment
Sue Buel
(n=15)
Comparison
Edwards
(n=16)
0.0%
0.0%
0.0%
0.0%
6.3%
0.0%
0.0%
0.0%
0.0%
5.0%
13.3%
37.5%
90.0%
93.3%
68.8%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
5.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
When asked to indicate with whom the target child lives, 50% or more of respondents, both
overall and across counties, reported that their child lives with a relative, typically in addition to
the primary caregiver and the child’s other parent (Table 35). Hispanic/Latino children were
notably more likely to reside with both parents and a relative (Table 36).
38
Table 35
With Whom the Child Lives Overall and by County
Right now, who does your child
live with?
Overall
Tx.
(n=70)
Study Group
Marion County
Comp.
(n=65)
Tx.
(n=55)
Yamhill County
Comp.
(n=49)
Tx.
(n=15)
Comp.
(n=16)
Project participant
84.3%
93.8%
80.0%
91.8%
100.0%
100.0%
Other parent
51.4%
75.4%
43.6%
75.5%
80.0%
75.0%
A relative
54.3%
63.1%
50.9%
67.3%
66.7%
50.0%
Child is currently hospitalized
2.9%
7.7%
3.6%
8.2%
0.0%
6.3%
A friend
1.4%
0.0%
0.0%
0.0%
6.7%
0.0%
Child is in foster care
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
Other
1.4%
1.5%
1.8%
2.0%
0.0%
0.0%
Note. Participants could select more than one response. Tx. = Treatment; Comp. = Comparison.
Table 36
With Whom the Child Lives Overall and by County – Hispanic/Latino Participants
Right now, who does your
child live with?
Overall
Yamhill County
Comp.
(n=53)
Tx.
(n=36)
Comp.
(n=43)
Tx.
(n=14)
Comp.
(n=10)
88.0%
92.5%
Project participant
62.0%
81.1%
Other parent
62.0%
69.8%
A relative
2.0%
7.5%
Child is currently hospitalized
2.0%
0.0%
A friend
0.0%
0.0%
Child is in foster care
2.0%
1.9%
Other
Note. Tx. = Treatment; Comp. = Comparison.
83.3%
55.6%
61.1%
2.8%
0.0%
0.0%
2.8%
90.7%
79.1%
69.8%
7.0%
0.0%
0.0%
2.3%
100.0%
78.6%
64.3%
0.0%
7.1%
0.0%
0.0%
100.0%
90.0%
70.0%
10.0%
0.0%
0.0%
0.0%
Study Group
Tx.
(n=50)
Marion County
Table 37
With Whom the Child Lives by Neighborhood
Right now, who does
your child live with?
Study Group
Neighborhood
Project participant
Other parent
A relative
Child is currently
Marion County
Treatment
Yamhill County
Comparison
Treatment
Comparison
Washington
(n= 27)
Swegle
(n=28 )
Hallman
(n=29)
Hoover
(n=20)
Sue Buel
(n=15)
Edwards
(n=16)
81.5%
44.4%
55.6%
0.0%
78.6%
42.9%
46.4%
7.1%
89.7%
72.4%
58.6%
3.4%
95.0%
80.0%
80.0%
15.0%
100.0%
80.0%
66.7%
0.0%
100.0%
75.0%
50.0%
6.3%
39
hospitalized
A friend
0.0%
0.0%
0.0%
Child is in foster care
0.0%
0.0%
0.0%
Other
0.0%
3.6%
0.0%
Note: Participants could select more than one response
0.0%
0.0%
5.0%
6.7%
0.0%
0.0%
0.0%
0.0%
0.0%
Over 90% children were insured at the baseline data collection time-point, overall, by
county, and when disaggregated by neighborhood (Tables 38 and 39).
Table 38
Child Health Insurance Overall and by County - % Yes
Does your child have any health
insurance now?
Overall
Marion County
Yamhill County
Tx.
(n=66)
Comp.
(n=64)
Tx.
(n=52)
Comp.
(n=48)
Tx.
(n=14)
Comp.
(n=16)
% Yes 93.9%
Note. Tx. = Treatment; Comp. = Comparison.
98.4%
94.2%
97.9%
92.9%
100.0%
Study Group
Table 39
Child Health Insurance by Neighborhood - % Yes
Does your child have any
health insurance now?
Study Group
Neighborhood
% Yes
Marion County
Treatment
Washington Swegle
(n=25)
(n=27)
96.0%
92.6%
Comparison
Hallman Hoover
(n=29)
(n=19)
96.6%
100.0%
Yamhill County
Treatment
Sue Buel
(n=14)
92.9%
Comparison
Edwards
(n=16)
100.0%
The majority of caregivers reported that their children’s health was “good,” “very good,” or
“excellent” across all counties and neighborhoods (Tables 40 -42). The child health item also
was analyzed with repeated measures analysis of variance (ANOVA), which did not produce
significant results overall, by county, or by race.
40
Table 40
Child Health Overall and by County
In general, how good
is your child's health?
Overall
Treatment
(n=61)
Study Group
Marion County
Yamhill County
Comparison
(n=61)
Treatment
(n=46)
Comp.
(n=45)
Treatment
(n=15)
Comp.
(n=16)
36.1%
16.4%
37.7%
9.8%
0.0%
37.0%
23.9%
32.6%
6.5%
0.0%
35.6%
15.6%
37.8%
11.1%
0.0%
46.7%
13.3%
20.0%
20.0%
0.0%
37.5%
18.8%
37.5%
6.3%
0.0%
Excellent
39.3%
Very good
21.3%
Good
29.5%
Fair
9.8%
Poor
0.0%
Note. Comp. = Comparison.
Table 41
Child Health Overall and by County – Hispanic/Latino Participants
In general, how good
is your child's health?
Study Group
Overall
Treatment
(n=45)
Marion County
Yamhill County
Comparison
(n=49)
Treatment
(n=31)
Comp.
(n=39)
Treatment
(n=14)
Comp.
(n=10)
24.5%
18.4%
44.9%
12.2%
0.0%
29.0%
29.0%
35.5%
6.5%
0.0%
30.8%
15.4%
41.0%
12.8%
0.0%
42.9%
14.3%
21.4%
21.4%
0.0%
0.0%
30.0%
60.0%
10.0%
0.0%
Excellent
33.3%
Very good
24.4%
Good
31.1%
Fair
11.1%
Poor
0.0%
Note. Comp. = Comparison.
Table 42
Child Health by Neighborhood
In general, how good is
your child's health?
Study Group
Marion County
Treatment
Neighborhood
Excellent
Very good
Good
Fair
Poor
Yamhill County
Comparison
Treatment
Comparison
Washington
(n=23)
Swegle
(n=23)
Hallman
(n=26)
Hoover
(n=19)
Sue Buel
(n=15)
Edwards
(n=16)
34.8%
30.4%
30.4%
4.3%
0.0%
39.1%
17.4%
34.8%
8.7%
0.0%
38.5%
15.4%
34.6%
11.5%
0.0%
31.6%
15.8%
42.1%
10.5%
0.0%
46.7%
13.3%
20.0%
20.0%
0.0%
37.5%
18.8%
37.5%
6.3%
0.0%
41
Most respondents indicated that they use a clinic for their child’s regular check-ups and
illness. Program participants in Yamhill County, however, were almost equally likely to take
their child to a doctor’s office (Tables 43 and 44).
Table 43
Child Health Service Location Overall and by County
What type of place do you usually take
your child for regular check-ups or
when he/she is sick?
Study Group
Overall
Tx.
(n=70)
Comp.
(n=65)
Marion County
Yamhill County
Tx.
(n=55)
Tx.
(n=15)
Comp.
(n=49)
Comp.
(n=16)
Doctor's office 24.3%
27.7%
23.6%
20.4% 26.7%
Emergency room or urgent care unit
2.9%
1.5%
0.0%
2.0%
13.3%
Clinic 77.1%
75.4%
74.5%
81.6% 86.7%
Other
1.4%
0.0%
1.8%
0.0%
0.0%
Note. Participants could select more than one response. Tx. = Treatment; Comp. = Comparison.
50.0%
0.0%
56.3%
0.0%
Table 44
Child Health Service Location by Neighborhood
What type of place do you usually take
your child for regular check-ups or
when he/she is sick?
Marion County
Yamhill County
Study Group
Treatment
Comparison
Tx.
Comp.
Wash. Swegle Hallman Hoover Sue Buel Edwards
Neighborhood
(n=27) (n=28)
(n=29)
(n=20)
(n=15)
(n=16)
Doctor's office 18.5%
28.6%
13.8%
30.0%
26.7%
50.0%
Emergency room or urgent care unit
0.0%
0.0%
0.0%
5.0%
13.3%
0.0%
Clinic 74.1%
75.0%
82.8%
80.0%
86.7%
56.3%
Other
0.0%
3.6%
0.0%
0.0%
0.0%
0.0%
Note. Participants could select more than one response. Tx. = Treatment; Comp. = Comparison; Wash. =
Washington
Overall, fewer than 5% of caregivers indicated that their child has special health care needs.
Caregivers from the Washington treatment neighborhood were most likely to report special
health care needs for their children (13%).
Table 45
Child Special Health Care Needs Overall and by County - % Yes
Does your child have any special
health care needs?
Study Group
Overall
Tx.
(n=61)
% Yes
4.9%
Note. Tx. = Treatment; Comp. = Comparison.
Marion County
Yamhill County
Comp.
(n=61)
Tx.
(n=46)
Comp.
(n=45)
Tx.
(n=15)
Comp.
(n=16)
3.3%
6.5%
4.4%
0.0%
0.0%
42
Table 46
Child Special Health Care Needs by Neighborhood - % Yes
Does your child have any
special health care needs?
Marion County
Study Group
Neighborhood
Treatment
Washington
(n=23)
% Yes
13.0%
Note. Tx. = Treatment; Comp. = Comparison.
Yamhill County
Comparison
Tx.
Comp.
Swegle
(n=23)
Hallman
(n=26)
Hoover
(n=19)
Sue Buel
(n=15)
Edwards
(n=16)
0.0%
7.7%
0.0%
0.0%
0.0%
Health conditions that caregivers reported for their children were:
• Anemia (n=4)
• Asthma (n=9)
• Blind or visually impaired (n=1)
• Deaf or hearing impaired (n=1)
• Heart disease or heart condition (n=1)
• Other (n=12)
Approximately one third of caregivers reported having taken their child to the emergency
room in the past 12 months (33.3-38.6%, overall). Emergency room visits were most common
in the Swegle and Sue Buel program neighborhoods (42.9%).
Table 47
Child Emergency Room Visits Overall and by County - % Yes
During the past 12 months, has
your child visited a hospital
emergency room to receive
medical care for any reason?
Overall
Marion County
Yamhill County
Tx.
(n=57)
Comp.
(n=60)
Tx.
(n=43)
Comp.
(n=44)
Tx.
(n=14)
Comp.
(n=16)
% Yes
38.6%
Note. Tx. = Treatment; Comp. = Comparison.
33.3%
37.2%
36.4%
42.9%
25.0%
Study Group
Table 48
Child Emergency Room Visits by Neighborhood - % Yes
During the past 12 months, has
your child visited a hospital
emergency room to receive
medical care for any reason?
Study Group
Neighborhood
Marion County
Treatment
Washington Swegle
(n=22)
(n=21)
% Yes
31.8%
Note. Tx. = Treatment; Comp. = Comparison.
42.9%
43
Yamhill County
Comparison
Hallman Hoover
(n=26)
(n=18)
38.5%
33.3%
Tx.
Sue Buel
(n=14)
Comp.
Edwards
(n=16)
42.9%
25.0%
Among caregivers who had taken their child to the emergency room, 85% or more reported
two or fewer visits in the past 12 months when responses were analyzed overall (Table 49).
One third of caregivers in the Hoover neighborhood who had used the emergency room had
done so three times in the past 12 months and 25% of respondents from Edwards had used the
emergency room six or more times (Table 50).
Table 49
Number of Emergency Room Visits Overall and by County
If your child has visited a hospital emergency
room to receive medical care over the past 12
months, how many times?
Study Group
One time
Two times
Three times
Four times
Five times
Six or more times
Note. Tx. = Treatment; Comp. = Comparison.
Overall
Marion County
Yamhill County
Tx.
(n=22)
Comp.
(n=20)
Tx.
(n=16)
Comp.
(n=16)
Tx.
(n=6)
Comp.
(n=4)
72.7%
18.2%
9.1%
0.0%
0.0%
0.0%
65.0%
20.0%
10.0%
0.0%
0.0%
5.0%
68.8%
25.0%
6.3%
0.0%
0.0%
0.0%
62.5%
25.0%
12.5%
0.0%
0.0%
0.0%
83.3%
0.0%
16.7%
0.0%
0.0%
0.0%
75.0%
0.0%
0.0%
0.0%
0.0%
25.0%
Table 50
Number of Emergency Room Visits by Neighborhood
If your child has visited a
hospital emergency room to
receive medical care over the
past 12 months, how many
times?
Study Group
Neighborhood
Marion County
Treatment
Washington
(n=7)
One time
57.1%
Two times
28.6%
Three times
14.3%
Four times
0.0%
Five times
0.0%
Six or more times
0.0%
Note. Tx. = Treatment; Comp. = Comparison.
Yamhill County
Comparison
Swegle
(n=9)
Hallman
(n=10)
Hoover
(n=6)
77.8%
22.2%
0.0%
0.0%
0.0%
0.0%
60.0%
40.0%
0.0%
0.0%
0.0%
0.0%
66.7%
0.0%
33.3%
0.0%
0.0%
0.0%
44
Tx.
Comp.
Sue Buel Edwards
(n=6)
(n=4)
83.3%
0.0%
16.7%
0.0%
0.0%
0.0%
75.0%
0.0%
0.0%
0.0%
0.0%
25.0%
Caregivers’ reasons for taking their child to the emergency room are summarized in Tables
51 and 52. Ear infections, high fever, and HIV/AIDS were the reasons mentioned most often.
The CDC reports that an estimated 3.1% of black/African American women, 0.9% of
Hispanic/Latino women, and 0.2% of white women will be diagnosed with HIV infection at some
point during their lifetime. Also, in 2010, young women between the ages of 25 and 44 made
up for the majority of new HIV infections among women 2. As the majority of study participants
were young women of color, these statistics may help explain the frequency at which caregivers
reported visiting the emergency room for HIV/AIDS-related reasons. None of the black/African
American program participants reported having taken their child to the emergency room in the
past year for reasons related to HIV/AIDS, although it should be noted that this study included a
small representation of black/African American participants. A disproportionately high
percentage of Hispanic/Latino and Caucasian participants fell into this category, with 10.7% of
Hispanic/Latino participants and 7.7% of Caucasian participants reporting having taken their
child to the emergency room in the past year for reasons related to HIV/AIDS.
Table 51
Reasons for Emergency Room Visits Overall and by County
If your child has visited a hospital
emergency room to receive medical care
over the past 12 months, indicate the
reason
Study Group
Overall
Tx.
(n=70)
Comp.
(n=65)
Marion County
Tx.
(n=55)
Comp.
(n=49)
Yamhill County
Tx.
(n=15)
Comp.
(n=16)
Acute pain from sickle cell anemia 0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
Allergies 1.4%
0.0%
0.0%
0.0%
6.7%
0.0%
Asthma attack 1.4%
3.1%
1.8%
4.1%
0.0%
0.0%
Colic 0.0%
1.5%
0.0%
0.0%
0.0%
6.3%
Digestive problems 1.4%
0.0%
1.8%
0.0%
0.0%
0.0%
Ear infections 5.7%
4.6%
5.5%
4.1%
6.7%
6.3%
Eczema or other skin problems 1.4%
1.5%
1.8%
2.0%
0.0%
0.0%
Fall or other injury 1.4%
0.0%
1.8%
0.0%
0.0%
0.0%
Frequent or repeated vomiting 1.4%
9.2%
1.8%
8.2%
0.0%
12.5%
Frequent or repeated diarrhea 1.4%
4.6%
1.8%
6.1%
0.0%
0.0%
Head injury 0.0%
1.5%
0.0%
0.0%
0.0%
6.3%
High fever 7.1%
9.2%
5.5%
10.2%
13.3%
6.3%
Respiratory or breathing problems 0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
HIV/AIDS 10.0%
9.2%
10.9%
8.2%
6.7%
12.5%
Seizures 1.4%
1.5%
1.8%
0.0%
0.0%
6.3%
Wouldn't stop crying 0.0%
1.5%
0.0%
0.0%
0.0%
6.3%
Other 10.0%
7.7%
9.1%
8.2%
13.3%
6.3%
Note. Participants could select more than one response. Tx. = Treatment; Comp. = Comparison.
2
http://www.cdc.gov/hiv/pdf/risk_women.pdf
45
Table 52
Reasons for Emergency Room Visits by Neighborhood
If your child has visited a hospital
emergency room to receive
medical care over the past 12
months, indicate the reason
Study Group
Neighborhood
Marion County
Treatment
Washington
(n=27)
Swegle
(n=28)
Yamhill County
Comparison
Hallman Hoover
(n=29)
(n=20)
Tx.
Comp.
Sue Buel Edwards
(n=15)
(n=16)
Acute pain from sickle cell anemia
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
Allergies
0.0%
0.0%
0.0%
0.0%
6.7%
0.0%
Asthma attack
0.0%
3.6%
3.4%
5.0%
0.0%
0.0%
Colic
0.0%
0.0%
0.0%
0.0%
0.0%
6.3%
Digestive problems
0.0%
3.6%
0.0%
0.0%
0.0%
0.0%
Ear infections
7.4%
3.6%
0.0%
10.0%
6.7%
6.3%
Eczema or other skin problems
0.0%
3.6%
3.4%
0.0%
0.0%
0.0%
Fall or other injury
3.7%
0.0%
0.0%
0.0%
0.0%
0.0%
Frequent or repeated vomiting
3.7%
0.0%
6.9%
10.0%
0.0%
12.5%
Frequent or repeated diarrhea
0.0%
3.6%
6.9%
5.0%
0.0%
0.0%
Head injury
0.0%
0.0%
0.0%
0.0%
0.0%
6.3%
High fever
7.4%
3.6%
13.8%
5.0%
13.3%
6.3%
Respiratory or breathing problems
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
HIV/AIDS
11.1%
10.7%
6.9%
10.0%
6.7%
12.5%
Seizures
3.7%
0.0%
0.0%
0.0%
0.0%
6.3%
Wouldn't stop crying
0.0%
0.0%
0.0%
0.0%
0.0%
6.3%
Other
11.1%
7.1%
10.3%
5.0%
13.3%
6.3%
Note. Participants could select more than one response. Tx. = Treatment; Comp. = Comparison.
Employment, Income, and Financial Indicators
The Background Information Form also included a number of items addressing employment,
income, and various other financial indicators of family wellbeing. The tables below present
results overall, by county, and by neighborhood. As shown in Table 53, less than one third of
the caregivers surveyed were currently working, both overall and by county. In the Washington
neighborhood, however, 37% of caregivers were employed (Table 54).
Table 53
Employment Status– Do You Have a Job - % Yes Overall and by County
Employment
Overall
Marion County
Yamhill County
Tx.
(n=70)
Comp.
(n=64)
Tx.
(n=55)
Comp.
(n=48)
Tx.
(n=15)
Comp.
(n=16)
Do you currently have a job? % Yes 28.6%
Note. Tx. = Treatment; Comp. = Comparison.
12.5%
29.1%
10.4%
26.7%
18.8%
Study Group
46
Table 54
Employment Status–Do You Have a Job - % Yes by Neighborhood
Employment
Marion County
Study Group
Neighborhood
Treatment
Yamhill County
Comparison
Treatment
Comparison
Washington
(n=27)
Swegle
(n=28)
Hallman
(n=29)
Hoover
(n=19)
Sue Buel
(n=15)
Edwards
(n=16)
37.0%
21.4%
10.3%
10.5%
26.7%
18.8%
Do you currently
have a job? % Yes
Among caregivers who were employed, notable differences were reported between
treatment and comparison group participants. Overall, about half of employed treatment group
participants were employed full-time whereas comparison group caregivers were more likely to
work part-time (Table 55).
Table 55
Employment Status– Part-time or Full-time Overall and by County
Employment: part time or full time
Overall
Marion County
Yamhill County
Tx.
(n=20)
Comp.
(n=8)
Tx.
(n=16)
Comp.
(n=5)
Tx.
(n=4)
Comp.
(n=3)
Is your job full-time? 55.0%
Is your job part-time? 45.0%
Note. Tx. = Treatment; Comp. = Comparison.
12.5%
87.5%
56.3%
43.8%
20.0%
80.0%
50.0%
50.0%
0.0%
100.0%
Study Group
Neighborhood level data for part-time and full-time employment status are presented in
Table 56
Table 56
Employment Status– Part-time or Full-time by Neighborhood
Employment: part time
or full time
Study Group
Marion County
Treatment
Washington Swegle
Neighborhood
(n=10)
(n= 6)
Is your job full-time?
80.0%
16.7%
Is your job part-time?
20.0%
83.3%
Comparison
Hallman Hoover
(n=3)
(n=2)
0.0%
50.0%
100.0%
50.0%
Yamhill County
Treatment
Sue Buel
(n=4)
50.0%
50.0%
Comparison
Edwards
(n=3)
0.0%
100.0%
Caregivers who indicated that they were employed most often reported stable employment
(Tables 57 and 58).
47
Table 57
Employment Status– Temporary or Stable Overall and by County
Employment: temporary or stable
Overall
Marion County
Yamhill County
Tx.
(n=20)
Comp.
(n=8)
Tx.
(n=16)
Comp.
(n=5)
Tx.
(n=4)
Comp.
(n=3)
Is your job temporary? 10.0%
Is your job stable? 90.0%
Note. Tx. = Treatment; Comp. = Comparison.
25.0%
75.0%
12.5%
87.5%
20.0%
80.0%
0.0%
100.0%
33.3%
66.7%
Study Group
Table 58
Employment Status– Temporary or Stable by Neighborhood
Employment:
temporary or stable
Study Group
Neighborhood
Is your job temporary?
Is your job stable?
Note. Comp. = Comparison.
Marion County
Treatment
Washington Swegle
(n=10)
(n=6)
10.0%
16.7%
90.0%
83.3%
Comparison
Hallman
Hoover
(n=3)
(n=2)
33.3%
0.0%
66.7%
100.0%
Yamhill County
Treatment
Sue Buel
(n=4)
0.0%
100.0%
Comp.
Edwards
(n=3)
33.3%
66.7%
The survey queried numerous types of financial problems. As shown in Tables 59-67,
respondents reported a variety of financial hardships including inadequate funds for
rent/mortgage payments, utility payments, or to buy food. Results are presented by county and
neighborhood for both the intake and one year time-points. Among the treatment
neighborhoods, residents of the Washington neighborhood demonstrated the biggest
improvement from intake to one year, with fewer participants indicating that they experienced
eleven out of the twelve financial hardships at the one year time-point.
48
Table 59
Financial Problems in the Past 12 Months - % Yes – Overall
Financial Problems: In the past 12 months, was there
ever a time when... (% Yes)
Study Group
Overall
Tx. (n=68-70)
Time-point
You did not pay the full amount of the rent or mortgage
because you didn't have enough money?
You were evicted from your home or apartment for not
paying the rent or mortgage?
You missed a payment or were late with the gas,
electricity, or water bill because you didn't have enough
money?
Your gas, electric, or water service was disconnected
because payments were not made?
Your home phone or cell phone was disconnected
because payments were not made?
You or your child needed to see a medical doctor or go
to the hospital but did not go because you did not have
the money?
You ran short of money to buy food?
Comp. (n=64-65)
Intake
1 Year
Intake
1 Year
30.0%
30.0%
30.8%
17.2%
4.3%
1.4%
0.0%
1.6%
62.9%
60.0%
72.3%
54.7%
18.8%
25.7%
9.2%
10.9%
38.6%
38.6%
40.6%
26.6%
20.0%
8.6%
20.0%
9.4%
38.6%
28.6%
39.1%
25.0%
You received free food or meals from a food pantry,
food bank, or meal program?
You received free food or meals from family members or
friends because you didn't have enough money to buy
food?
You or your child went hungry because there wasn't
enough money to buy food?
52.9%
51.4%
56.9%
56.3%
34.3%
38.6%
41.5%
26.6%
11.4%
2.9%
3.1%
3.1%
You moved in with other people, even for a little while,
because of financial problems?
15.7%
20.0%
10.8%
1.6%
You stayed at a shelter, in an abandoned building, a car,
or any other place not meant for regular housing, even
for one night, because you didn't have enough money
for a place to live?
2.9%
2.9%
4.6%
1.6%
Note. Tx. = Treatment; Comp. = Comparison.
49
Table 60
Financial Problems in the Past 12 Months - % Yes – Marion County
Financial Problems: In the past 12 months, was
there ever a time when... (% Yes)
Study Group
Time-point
Marion County
Treatment
Intake
One Year
(n=54-55) (n=53-55)
You did not pay the full amount of the rent or
mortgage because you didn't have enough
money?
You were evicted from your home or apartment
for not paying the rent or mortgage?
Comparison
Intake
One Year
(n=48-49) (n=48-49)
30.9%
27.3%
26.5%
16.7%
5.5%
1.8%
0.0%
2.1%
69.1%
63.6%
73.5%
60.4%
20.4%
30.9%
12.2%
12.5%
41.8%
40.0%
40.8%
29.2%
You or your child needed to see a medical doctor
or go to the hospital but did not go because you
did not have the money?
21.8%
9.1%
14.3%
6.3%
You ran short of money to buy food?
41.8%
27.3%
37.5%
22.9%
You received free food or meals from a food
pantry, food bank, or meal program?
49.1%
47.3%
51.0%
54.2%
You received free food or meals from family
members or friends because you didn't have
enough money to buy food?
30.9%
34.5%
44.7%
25.0%
You or your child went hungry because there
wasn't enough money to buy food?
10.9%
3.8%
4.1%
4.2%
You moved in with other people, even for a little
while, because of financial problems?
16.4%
21.8%
12.2%
2.1%
You stayed at a shelter, in an abandoned
building, a car, or any other place not meant for
regular housing, even for one night, because you
didn't have enough money for a place to live?
3.6%
3.6%
6.1%
2.1%
You missed a payment or were late with the gas,
electricity, or water bill because you didn't have
enough money?
Your gas, electric, or water service was
disconnected because payments were not
made?
Your home phone or cell phone was
disconnected because payments were not
made?
50
Table 61
Financial Problems in the Past 12 Months - % Yes – Yamhill County
Financial Problems: In the past 12 months, was
there ever a time when... (% Yes)
Yamhill County
Study Group
Treatment
Comparison
Intake
(n=15)
One Year
(n=16)
Intake
(n=15-16)
One Year
(n=15)
26.7%
40.0%
43.8%
18.8%
0.0%
0.0%
0.0%
0.0%
You missed a payment or were late with the gas,
electricity, or water bill because you didn't have
enough money?
40.0%
46.7%
68.8%
37.5%
Your gas, electric, or water service was
disconnected because payments were not made?
13.3%
6.7%
0.0%
6.3%
Your home phone or cell phone was disconnected
because payments were not made?
26.7%
33.3%
40.0%
18.8%
You or your child needed to see a medical doctor
or go to the hospital but did not go because you
did not have the money?
13.3%
6.7%
37.5%
18.8%
You ran short of money to buy food?
26.7%
33.3%
43.8%
31.3%
You received free food or meals from a food
pantry, food bank, or meal program?
66.7%
66.7%
75.0%
62.5%
You received free food or meals from family
members or friends because you didn't have
enough money to buy food?
46.7%
53.3%
62.5%
31.3%
You or your child went hungry because there
wasn't enough money to buy food?
13.3%
0.0%
0.0%
0.0%
You moved in with other people, even for a little
while, because of financial problems?
13.3%
13.3%
6.3%
0.0%
You stayed at a shelter, in an abandoned building,
a car, or any other place not meant for regular
housing, even for one night, because you didn't
have enough money for a place to live?
0.0%
0.0%
0.0%
0.0%
Time-point
You did not pay the full amount of the rent or
mortgage because you didn't have enough money?
You were evicted from your home or apartment for
not paying the rent or mortgage?
51
Table 62
Financial Problems in the Past 12 Months - % Yes – Washington Treatment Neighborhood
(Marion Co.)
Financial Problems: In the past 12 months, was there ever a time when...
(% Yes)
Washington
Intake
(n=26-27)
One Year
(n=26-27)
You did not pay the full amount of the rent or mortgage because you
didn't have enough money?
25.9%
22.2%
You were evicted from your home or apartment for not paying the rent or
mortgage?
7.4%
0.0%
You missed a payment or were late with the gas, electricity, or water bill
because you didn't have enough money?
74.1%
63.0%
Your gas, electric, or water service was disconnected because payments
were not made?
34.6%
33.3%
44.4%
33.3%
29.6%
14.8%
51.9%
29.6%
48.1%
44.4%
37.0%
40.7%
18.5%
0.0%
22.2%
18.5%
7.4%
3.7%
Time-point
Your home phone or cell phone was disconnected because payments were
not made?
You or your child needed to see a medical doctor or go to the hospital but
did not go because you did not have the money?
You ran short of money to buy food?
You received free food or meals from a food pantry, food bank, or meal
program?
You received free food or meals from family members or friends because
you didn't have enough money to buy food?
You or your child went hungry because there wasn't enough money to buy
food?
You moved in with other people, even for a little while, because of
financial problems?
You stayed at a shelter, in an abandoned building, a car, or any other
place not meant for regular housing, even for one night, because you
didn't have enough money for a place to live?
52
Table 63
Financial Problems in the Past 12 Months - % Yes – Swegle Treatment Neighborhood (Marion
County)
Financial Problems: In the past 12 months, was there ever a time when...
(% Yes)
Time-point
You did not pay the full amount of the rent or mortgage because you
didn't have enough money?
Swegle
Intake
(n=28)
One Year
(n=27-28)
35.7%
32.1%
You were evicted from your home or apartment for not paying the rent or
mortgage?
You missed a payment or were late with the gas, electricity, or water bill
because you didn't have enough money?
Your gas, electric, or water service was disconnected because payments
were not made?
3.6%
3.6%
64.3%
64.3%
7.1%
28.6%
Your home phone or cell phone was disconnected because payments were
not made?
39.3%
46.4%
14.3%
3.6%
32.1%
25.0%
50.0%
50.0%
25.0%
28.6%
3.6%
7.4%
10.7%
25.0%
0.0%
3.6%
You or your child needed to see a medical doctor or go to the hospital but
did not go because you did not have the money?
You ran short of money to buy food?
You received free food or meals from a food pantry, food bank, or meal
program?
You received free food or meals from family members or friends because
you didn't have enough money to buy food?
You or your child went hungry because there wasn't enough money to buy
food?
You moved in with other people, even for a little while, because of
financial problems?
You stayed at a shelter, in an abandoned building, a car, or any other
place not meant for regular housing, even for one night, because you
didn't have enough money for a place to live?
53
Table 64
Financial Problems in the Past 12 Months - % Yes – Hallman Comparison Neighborhood (Marion
County)
Financial Problems: In the past 12 months, was there ever a time when...
(% Yes)
Hallman
Intake
(n=29)
One Year
(n=28)
27.6%
21.4%
0.0%
0.0%
72.4%
57.1%
17.2%
10.7%
31.0%
21.4%
13.8%
7.1%
41.4%
21.4%
You received free food or meals from a food pantry, food bank, or meal
program?
51.7%
67.9%
You received free food or meals from family members or friends because
you didn't have enough money to buy food?
37.9%
25.0%
You or your child went hungry because there wasn't enough money to buy
food?
6.9%
0.0%
You moved in with other people, even for a little while, because of
financial problems?
6.9%
0.0%
You stayed at a shelter, in an abandoned building, a car, or any other
place not meant for regular housing, even for one night, because you
didn't have enough money for a place to live?
3.4%
3.6%
Time-point
You did not pay the full amount of the rent or mortgage because you
didn't have enough money?
You were evicted from your home or apartment for not paying the rent or
mortgage?
You missed a payment or were late with the gas, electricity, or water bill
because you didn't have enough money?
Your gas, electric, or water service was disconnected because payments
were not made?
Your home phone or cell phone was disconnected because payments were
not made?
You or your child needed to see a medical doctor or go to the hospital but
did not go because you did not have the money?
You ran short of money to buy food?
54
Table 65
Financial Problems in the Past 12 Months - % Yes – Hoover Comparison Neighborhood (Marion
County)
Financial Problems: In the past 12 months, was there ever a time when...
(% Yes)
Hoover
Intake
(n=19-20)
One Year
(n=20)
You did not pay the full amount of the rent or mortgage because you
didn't have enough money?
25.0%
10.0%
You were evicted from your home or apartment for not paying the rent or
mortgage?
0.0%
5.0%
You missed a payment or were late with the gas, electricity, or water bill
because you didn't have enough money?
75.0%
65.0%
Your gas, electric, or water service was disconnected because payments
were not made?
5.0%
15.0%
55.0%
40.0%
15.0%
5.0%
31.6%
25.0%
50.0%
35.0%
30.0%
25.0%
0.0%
10.0%
20.0%
5.0%
10.0%
0.0%
Time-point
Your home phone or cell phone was disconnected because payments were
not made?
You or your child needed to see a medical doctor or go to the hospital but
did not go because you did not have the money?
You ran short of money to buy food?
You received free food or meals from a food pantry, food bank, or meal
program?
You received free food or meals from family members or friends because
you didn't have enough money to buy food?
You or your child went hungry because there wasn't enough money to buy
food?
You moved in with other people, even for a little while, because of
financial problems?
You stayed at a shelter, in an abandoned building, a car, or any other
place not meant for regular housing, even for one night, because you
didn't have enough money for a place to live?
55
Table 66
Financial Problems in the Past 12 Months - % Yes – Sue Buel Treatment Neighborhood (Yamhill
County
Financial Problems: In the past 12 months, was there ever a time when...
(% Yes)
Sue Buel
Intake
(n=15)
One Year
(n=15)
26.7%
40.0%
0.0%
0.0%
40.0%
46.7%
13.3%
6.7%
26.7%
33.3%
13.3%
6.7%
26.7%
33.3%
You received free food or meals from a food pantry, food bank, or meal
program?
66.7%
66.7%
You received free food or meals from family members or friends because
you didn't have enough money to buy food?
46.7%
53.3%
You or your child went hungry because there wasn't enough money to buy
food?
13.3%
0.0%
You moved in with other people, even for a little while, because of
financial problems?
13.3%
13.3%
You stayed at a shelter, in an abandoned building, a car, or any other
place not meant for regular housing, even for one night, because you
didn't have enough money for a place to live?
0.0%
0.0%
Time-point
You did not pay the full amount of the rent or mortgage because you
didn't have enough money?
You were evicted from your home or apartment for not paying the rent or
mortgage?
You missed a payment or were late with the gas, electricity, or water bill
because you didn't have enough money?
Your gas, electric, or water service was disconnected because payments
were not made?
Your home phone or cell phone was disconnected because payments were
not made?
You or your child needed to see a medical doctor or go to the hospital but
did not go because you did not have the money?
You ran short of money to buy food?
56
Table 67
Financial Problems in the Past 12 Months - % Yes – Edwards Comparison Neighborhood (Yamhill
County)
Financial Problems: In the past 12 months, was there ever a time when...
(% Yes)
Edwards
Intake
(n=15-16)
One Year
(n=16)
You did not pay the full amount of the rent or mortgage because you
didn't have enough money?
43.8%
18.8%
You were evicted from your home or apartment for not paying the rent or
mortgage?
0.0%
0.0%
You missed a payment or were late with the gas, electricity, or water bill
because you didn't have enough money?
68.8%
37.5%
Your gas, electric, or water service was disconnected because payments
were not made?
0.0%
6.3%
Your home phone or cell phone was disconnected because payments were
not made?
40.0%
18.8%
You or your child needed to see a medical doctor or go to the hospital but
did not go because you did not have the money?
37.5%
18.8%
You ran short of money to buy food?
43.8%
31.3%
You received free food or meals from a food pantry, food bank, or meal
program?
75.0%
62.5%
You received free food or meals from family members or friends because
you didn't have enough money to buy food?
62.5%
31.3%
You or your child went hungry because there wasn't enough money to buy
food?
0.0%
0.0%
You moved in with other people, even for a little while, because of
financial problems?
6.3%
0.0%
You stayed at a shelter, in an abandoned building, a car, or any other
place not meant for regular housing, even for one night, because you
didn't have enough money for a place to live?
0.0%
0.0%
Time-point
Overall and across Marion and Yamhill Counties, apartments and public housing were the
most commonly reported types of living arrangements (Table 68). Within the Edwards
comparison neighborhood in Yamhill County, 75% of respondents resided in an apartment or
public housing (Table 69). Additionally, a notable proportion of treatment respondents (25.7%)
reported residing with a family member.
57
Table 68
Current Living Arrangements Overall and by County
What are your current living arrangements?
Study Group
In a house or mobile home that I am buying
In a house or mobile home that I am renting
In an apartment or public housing
In a group home or treatment center
On a military base
With a family member
With a friend
In a shelter (homeless or abused)
Other
Note. Tx. = Treatment; Comp. = Comparison.
Overall
Marion County
Yamhill County
Tx.
(n=70)
Comp.
(n=65)
Tx.
(n=55)
Comp.
(n=49)
Tx.
(n=15)
Comp.
(n=16)
15.7%
16.9%
14.5%
18.4%
20.0%
12.5%
27.1%
34.3%
1.4%
21.5%
60.0%
1.5%
29.1%
34.5%
1.8%
24.5%
55.1%
2.0%
20.0%
33.3%
0.0%
12.5%
75.0%
0.0%
0.0%
25.7%
2.9%
1.4%
2.9%
0.0%
4.6%
1.5%
0.0%
1.5%
0.0%
27.3%
1.8%
1.8%
1.8%
0.0%
4.1%
2.0%
0.0%
2.0%
0.0%
20.0%
6.7%
0.0%
6.7%
0.0%
6.3%
0.0%
0.0%
0.0%
Table 69
Current Living Arrangements by Neighborhood
What are your current living
arrangements?
Study Group
Neighborhood
Marion County
Treatment
Washington Swegle
(n=27)
(n=28)
Yamhill County
Comparison
Hallman Hoover
(n=29)
(n=20)
Tx.
Comp.
Sue Buel Edwards
(n=15)
(n=16)
In a house or mobile home that I
am buying
22.2%
7.1%
20.7%
15.0%
20.0%
12.5%
In a house or mobile home that I
am renting
29.6%
28.6%
24.1%
25.0%
20.0%
12.5%
In an apartment or public housing
25.9%
42.9%
51.7%
60.0%
33.3%
75.0%
3.7%
0.0%
3.4%
0.0%
0.0%
0.0%
0.0%
25.9%
0.0%
0.0%
28.6%
3.6%
0.0%
6.9%
0.0%
0.0%
0.0%
5.0%
0.0%
20.0%
6.7%
0.0%
6.3%
0.0%
3.7%
0.0%
0.0%
0.0%
0.0%
0.0%
Other
3.7%
Note. Tx. = Treatment; Comp. = Comparison.
0.0%
3.4%
0.0%
6.7%
0.0%
In a group home or treatment
center
On a military base
With a family member
With a friend
In a shelter (homeless or abused)
58
When asked how many times they had moved in the past 12 months, the majority of
caregivers reported that they had not moved. More than a quarter had moved one or two
times (Tables 70-72).
Table 70
Moves in the Past 12 Months Overall and by County
How many times have you moved in the
past 12 months?
Overall
Study Group
1 Time
2 Times
3 Times
4 or More Times
I have not moved in the past 12 months
Note. Tx. = Treatment; Comp. = Comparison.
Marion County
Yamhill County
Tx.
(n=68)
Comp.
(n=64)
Tx.
(n=53)
Comp.
(n=48)
Tx.
(n=15)
Comp.
(n=16)
23.5%
11.8%
2.9%
2.9%
58.8%
25.0%
3.1%
3.1%
0.0%
68.8%
26.4%
11.3%
1.9%
3.8%
56.6%
22.9%
4.2%
4.2%
0.0%
68.8%
13.3%
13.3%
6.7%
0.0%
66.7%
31.3%
0.0%
0.0%
0.0%
68.8%
Table 71
Moves in the Past 12 Months Overall and by County – Hispanic/Latino Participants
How many times have you moved in the past
12 months?
Study Group
1 Time
2 Times
3 Times
4 or More Times
I have not moved in the past 12 months
Note. Tx. = Treatment; Comp. = Comparison.
Overall
Marion County
Yamhill
County
Tx.
(n=48)
Comp.
(n=52)
Tx.
(n=34)
Comp.
Tx.
Comp.
(n=42) (n=14) (n=10)
20.8%
10.4%
4.2%
0.0%
64.6%
21.2%
1.9%
0.0%
0.0%
76.9%
23.5%
8.8%
2.9%
0.0%
64.7%
19.0%
2.4%
0.0%
0.0%
78.6%
14.3%
14.3%
7.1%
0.0%
64.3%
30.0%
0.0%
0.0%
0.0%
70.0%
Table 72
Moves in the Past 12 Months by Neighborhood
How many times have you moved in
the past 12 months?
Study Group
Neighborhood
Marion County
Treatment
Wash.
(n=26)
Swegle
(n=27)
Yamhill County
Comparison
Hallman
(n=28)
1 Time 19.2% 33.3%
32.1%
2 Times 11.5% 11.1%
7.1%
3 Times 3.8%
0.0%
3.6%
4 or More Times 3.8%
3.7%
0.0%
I have not moved in the past 12 mos 61.5% 51.9%
57.1%
Note. Tx. = Treatment; Comp. = Comparison.; Wash. = Washington
59
Hoover
(n=20)
10.0%
0.0%
5.0%
0.0%
85.0%
Tx.
Comp.
Sue Buel Edwards
(n=15)
(n=16)
13.3%
13.3%
6.7%
0.0%
66.7%
31.3%
0.0%
0.0%
0.0%
68.8%
Tables 73 through 80 present the number of children within various age ranges and adults
residing within the household. For each category, the majority of caregivers indicated one or
two.
Table 73
Children under 5 Years Old Residing in the Home Overall and by County
Number of children, 5 years old or younger,
currently living in your household (including
the project child)
Overall
Study Group
1
2
3
4
5
6 or more
Note. Tx. = Treatment; Comp. = Comparison.
Tx.
(n=67)
47.8%
40.3%
7.5%
3.0%
1.5%
0.0%
Comp.
(n=63)
34.9%
44.4%
14.3%
6.3%
0.0%
0.0%
Marion County
Yamhill County
Tx.
(n=52)
44.2%
44.2%
7.7%
1.9%
1.9%
0.0%
Tx.
(n=15)
60.0%
26.7%
6.7%
6.7%
0.0%
0.0%
Comp.
(n=47)
40.0%
36.2%
17.0%
6.4%
0.0%
0.0%
Comp.
(n=16)
18.8%
68.8%
6.3%
6.3%
0.0%
0.0%
Table 74
Children under 5 Years Old Residing in the Home by Neighborhood
Number of children, 5 years old or
younger, currently living in your
household (including the project child)
Study Group
Marion County
Treatment
Wash. Swegle
(n=26) (n=26)
Neighborhood
1 34.6%
2 61.5%
3 3.8%
4 0.0%
5 0.0%
6 or more 0.0%
Note. Tx. = Treatment; Comp. = Comparison.
53.8%
26.9%
11.5%
3.8%
3.8%
0.0%
Yamhill County
Comparison
Hallman Hoover
(n=27)
(n=20)
48.1%
25.9%
18.5%
7.4%
0.0%
0.0%
30.0%
50.0%
15.0%
5.0%
0.0%
0.0%
Tx.
Comp.
Sue Buel Edwards
(n=15)
(n=16)
60.0%
26.7%
6.7%
6.7%
0.0%
0.0%
18.8%
68.8%
6.3%
6.3%
0.0%
0.0%
Table 75
Children 6-12 Years Old Residing in the Home Overall and by County
Number of children, 6 - 12 years old,
currently living in your household
Overall
Study Group
1
2
Tx.
(n=39)
56.4%
33.3%
60
Comp.
(n=35)
54.3%
31.4%
Marion County
Yamhill County
Tx.
(n=31)
54.8%
32.3%
Tx.
(n=8)
62.5%
37.5%
Comp.
(n=28)
50.0%
35.7%
Comp.
(n=7)
71.4%
14.3%
3 10.3%
4
0.0%
5
0.0%
6 or more
0.0%
Note. Tx. = Treatment; Comp. = Comparison.
11.4%
2.9%
0.0%
0.0%
12.9%
0.0%
0.0%
0.0%
10.7%
3.6%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
14.3%
0.0%
0.0%
0.0%
Table 76
Children 6-12 Years Old Residing in the Home by Neighborhood
Number of children, 6 - 12 years
old, currently living in your
household
Study Group
Neighborhood
Marion County
Treatment
Washington Swegle
(n=16)
(n=15)
1
50.0%
2
37.5%
3
12.5%
4
0.0%
5
0.0%
6 or more
0.0%
Note. Tx. = Treatment; Comp. = Comparison.
Yamhill County
Comparison
Hallman Hoover
(n=19)
(n=9)
60.0%
26.7%
13.3%
0.0%
0.0%
0.0%
52.6%
26.3%
15.8%
5.3%
0.0%
0.0%
Tx.
Comp.
Sue Buel Edwards
(n=8)
(n=7)
44.4%
55.6%
0.0%
0.0%
0.0%
0.0%
62.5%
37.5%
0.0%
0.0%
0.0%
0.0%
71.4%
14.3%
14.3%
0.0%
0.0%
0.0%
Table 77
Teenagers 13-18 Years Old Residing in the Home Overall and by County
Number of teenagers, 13-18 years old,
currently living in your household
Overall
Marion County
Yamhill County
1
2
3
4
5
Tx.
(n=23)
56.5%
26.1%
13.0%
0.0%
4.3%
Comp.
(n=12)
66.7%
25.0%
0.0%
8.3%
0.0%
Tx.
(n=19)
57.9%
26.3%
10.5%
0.0%
5.3%
Comp.
(n=10)
70.0%
30.0%
0.0%
0.0%
0.0%
Tx.
(n=4)
50.0%
25.0%
25.0%
0.0%
0.0%
Comp.
(n=2)
50.0%
0.0%
0.0%
50.0%
0.0%
6 or more
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
Study Group
Note. Tx. = Treatment; Comp. = Comparison.
61
Table 78
Teenagers 13-18 Years Old Residing in the Home by Neighborhood
Number of teenagers, 1318 years old, currently
living in your household
Study Group
Neighborhood
1
2
3
4
5
6 or more
Marion County
Treatment
Yamhill County
Comparison
Treatment
Comparison
Washington
(n=10)
Swegle
(n=9)
Hallman
(n=4)
Hoover
(n=6)
Sue Buel
(n=4)
Edwards
(n=2)
50.0%
30.0%
20.0%
0.0%
0.0%
0.0%
66.7%
22.2%
0.0%
0.0%
11.1%
0.0%
75.0%
25.0%
0.0%
0.0%
0.0%
0.0%
66.7%
33.3%
0.0%
0.0%
0.0%
0.0%
50.0%
25.0%
25.0%
0.0%
0.0%
0.0%
50.0%
0.0%
0.0%
50.0%
0.0%
0.0%
Table 79
Adults Older than 18 Residing in the Home Overall and by County
Number of adults older than 18 currently
living in your household
Overall
Marion County
Yamhill County
Tx.
(n=66)
Comp.
(n=61)
Tx.
(n=51)
Comp.
(n=45)
Tx.
(n=15)
Comp.
(n=16)
1 59.1%
2 22.7%
3
9.1%
4
3.0%
5
3.0%
6 or more
3.0%
Note. Tx. = Treatment; Comp. = Comparison.
75.4%
11.5%
11.5%
1.6%
0.0%
0.0%
54.9%
27.5%
7.8%
3.9%
2.0%
3.9%
73.3%
13.3%
13.3%
0.0%
0.0%
0.0%
73.3%
6.7%
13.3%
0.0%
6.7%
0.0%
81.3%
6.3%
6.3%
6.3%
0.0%
0.0%
Study Group
Table 80
Adults Older than 18 Residing in the Home by County and Neighborhood
Number of adults older than 18
currently living in your household
Study Group
Marion County
Treatment
Washington Swegle
(n=24)
(n=27)
Neighborhood
1
2
3
4
5
6 or more
50.0%
33.3%
4.2%
4.2%
0.0%
8.3%
59.3%
22.2%
11.1%
3.7%
3.7%
0.0%
62
Yamhill County
Comparison
Hallman Hoover
(n=26)
(n=19)
73.1%
15.4%
11.5%
0.0%
0.0%
0.0%
73.7%
10.5%
15.8%
0.0%
0.0%
0.0%
Tx.
Comp.
Sue Buel Edwards
(n=15)
(n=16)
73.3%
6.7%
13.3%
0.0%
6.7%
0.0%
81.3%
6.3%
6.3%
6.3%
0.0%
0.0%
Almost all caregivers indicated that they are the parent of one or more children under the
age of five and residing within the household (Tables 83 and 84).
Table 81
Respondent is Parent of Children 5 Years Old and Younger Overall and by County
Are you the parent, stepparent, or
guardian of the children who are 5 years
old or younger?
Overall
Marion County
Yamhill County
Tx.
(n=68)
Comp.
(n=65)
Tx.
(n=53)
Comp.
(n=49)
Tx.
(n=15)
Comp.
(n=16)
% Yes 97.1%
Note. Tx. = Treatment; Comp. = Comparison.
98.5%
96.2%
98.0%
100.0%
100.0%
Study Group
Table 82
Respondent is Parent of Children 5 Years Old and Younger by Neighborhood
Are you the parent,
stepparent, or
guardian of the
children who are 5
years old or younger?
Study Group
Neighborhood
% Yes
Marion County
Treatment
Yamhill County
Comparison
Treatment
Comparison
Washington
(n=26)
Swegle
(n=27)
Hallman
(n=29)
Hoover
(n=20)
Sue Buel
(n=15)
Edwards
(n=16)
100.0%
92.6%
96.6%
100.0%
100.0%
100.0%
Caregivers were most apt to indicate parenting two or fewer children under the age of five
(Tables 83 - 85).
Table 83
Number of Children under 5 the Caregiver is Guardian of Overall and by County
If you are the parent, stepparent, or guardian
of the children who are 5 years old or younger,
indicate how many children:
Study Group
1
2
3
4
5
6 or more
Note. Tx. = Treatment; Comp. = Comparison.
Overall
Marion County
Yamhill County
Tx.
(n=66)
Comp.
(n=62)
Tx.
(n=51)
Comp.
(n=46)
Tx.
(n=15)
Comp.
(n=16)
51.5%
36.4%
10.6%
0.0%
0.0%
1.5%
40.3%
48.4%
6.5%
4.8%
0.0%
0.0%
52.9%
35.3%
9.8%
0.0%
0.0%
2.0%
45.7%
41.3%
8.7%
4.3%
0.0%
0.0%
46.7%
40.0%
13.3%
0.0%
0.0%
0.0%
25.0%
68.8%
0.0%
6.3%
0.0%
0.0%
63
Table 84
Number of Children under 5 the Caregiver is Guardian of Overall and by County –
Hispanic/Latino Participants
If you are the parent, stepparent, or
guardian of the children who are 5
years old or younger, indicate how
many children:
Overall
Marion County
Yamhill County
Tx.
(n=48)
Comp.
(n=50)
Tx.
(n=34)
Comp.
(n=40)
Tx.
(n=14)
Comp.
(n=10)
1 52.1%
2 35.4%
3 12.5%
4
0.0%
5
0.0%
6 or more
0.0%
Note. Tx. = Treatment; Comp. = Comparison.
38.0%
48.0%
8.0%
6.0%
0.0%
0.0%
52.9%
35.3%
11.8%
0.0%
0.0%
0.0%
40.0%
45.0%
10.0%
5.0%
0.0%
0.0%
50.0%
35.7%
14.3%
0.0%
0.0%
0.0%
30.0%
60.0%
0.0%
10.0%
0.0%
0.0%
Study Group
Table 85
Number of Children under 5 the Caregiver is Guardian of by Neighborhood
If you are the parent, stepparent,
or guardian of the children who
are 5 years old or younger,
indicate how many children:
Study Group
Neighborhood
Marion County
Treatment
Washington Swegle
(n=26)
(n=25)
1
42.3%
2
46.2%
3
7.7%
4
0.0%
5
0.0%
6 or more
3.8%
Note. Tx. = Treatment; Comp. = Comparison.
64.0%
24.0%
12.0%
0.0%
0.0%
0.0%
64
Yamhill County
Comparison
Hallman Hoover
(n=26)
(n=20)
50.0%
30.8%
15.4%
3.8%
0.0%
0.0%
40.0%
55.0%
0.0%
5.0%
0.0%
0.0%
Tx.
Comp.
Sue Buel Edwards
(n=15)
(n=16)
46.7%
40.0%
13.3%
0.0%
0.0%
0.0%
25.0%
68.8%
0.0%
6.3%
0.0%
0.0%
Neighborhood Characteristics
Caregivers were asked to respond to a number of items addressing neighborhood
characteristics. Most reported living in suburban areas. In the Sue Buel neighborhood, a
notable proportion also indicated that they live in a rural locale (Tables 86 and 87).
Table 86
Population Density of Residential Area Overall and by County
What type of area do you live in?
Study Group
Overall
Treatment
(n=66)
Urban
16.7%
Suburban
75.8%
Rural
7.6%
Note. Tx. = Treatment; Comp. = Comparison.
Marion County
Yamhill County
Comparison
(n=65)
Tx.
(n=53)
Comp.
(n=49)
Tx.
(n=13)
Comp.
(n=16)
16.9%
78.5%
4.6%
18.9%
81.1%
0.0%
18.4%
77.6%
4.1%
7.7%
53.8%
38.5%
12.5%
81.3%
6.3%
Table 87
Population Density of Residential Area by Neighborhood
What type of area do you live
in?
Study Group
Neighborhood
Marion County
Treatment
Washington Swegle
(n=26)
(n=27)
Urban
23.1%
Suburban
76.9%
Rural
0.0%
Note. Tx. = Treatment; Comp. = Comparison.
14.8%
85.2%
0.0%
Yamhill County
Comparison
Hallman Hoover
(n=29)
(n=20)
24.1%
69.0%
6.9%
10.0%
90.0%
0.0%
Tx.
Sue Buel
(n=13)
Comp.
Edwards
(n=16)
7.7%
53.8%
38.5%
12.5%
81.3%
6.3%
Survey items also invited caregivers to indicate the types of programs and services available
to them in their community. Health centers, food banks, and education programs were the
services most frequently identified as being available in the project neighborhoods. Rent/utility
assistance programs, shelters/emergency housing, and employment programs were also
identified by some respondents as available, though were less likely than the previous set of
items to be selected. Responses by neighborhood in Table 89 demonstrate a need for
additional programs or services, as well as a lack of knowledge (or variation in awareness) of
services that are currently available.
65
Table 88
Availability of Services or Programs Overall and by County
Are any of the following
services or programs available
in your community? (% Yes)
Study Group
Overall
Tx.
(n=69-70)
Health center
88.6%
Childbirth classes
65.7%
Parenting classes
70.0%
Shelters or emergency
46.4%
housing
Mental health center
60.0%
Legal aid services
67.1%
Food banks
82.9%
Rent or utility assistance
55.7%
programs
Education programs
80.0%
Employment programs
57.1%
Child care programs
61.4%
Note. Tx. = Treatment; Comp. = Comparison.
Marion County
Yamhill County
Comp.
(n=64-65)
Tx.
(n=54-55)
Comp.
(n=48-49)
Tx.
(n=15)
Comp.
(n=15-16)
83.1%
49.2%
50.8%
85.5%
61.8%
72.7%
83.7%
44.9%
40.8%
100.0%
80.0%
60.0%
81.3%
62.5%
81.3%
30.8%
40.7%
28.6%
66.7%
37.5%
43.8%
49.2%
87.7%
60.0%
63.6%
78.2%
44.9%
44.9%
85.7%
60.0%
80.0%
100.0%
40.0%
62.5%
93.8%
53.8%
52.7%
53.1%
66.7%
56.3%
75.4%
35.4%
54.7%
80.0%
50.9%
58.2%
69.4%
32.7%
52.1%
80.0%
80.0%
73.3%
93.8%
43.8%
62.5%
Table 89
Availability of Services or Programs by Neighborhood
Are any of the following services
or programs available in your
community? (% Yes)
Marion County
Study Group
Treatment
Wash.
Swegle
Neighborhood
(n=27) (n=27-28)
Health center 85.2%
85.7%
Childbirth classes 70.4%
53.6%
Parenting classes 77.8%
67.9%
Shelters or emergency housing 40.7%
40.7%
Yamhill County
Comparison
Hallman
Hoover
(n=19-20)
(n=29)
82.8%
85.0%
51.7%
35.0%
37.9%
45.0%
Tx.
Sue Buel
(n=15)
100.0%
80.0%
60.0%
Comp.
Edwards
(n=15-16)
81.3%
62.5%
81.3%
34.5%
20.0%
66.7%
37.5%
Mental health center
Legal aid services
Food banks
Rent or utility assistance
programs
66.7%
66.7%
74.1%
53.6%
60.7%
82.1%
41.4%
44.8%
86.2%
50.0%
45.0%
85.0%
60.0%
80.0%
100.0%
40.0%
62.5%
93.8%
63.0%
42.9%
65.5%
35.0%
66.7%
56.3%
Education programs
Employment programs
Child care programs
85.2%
51.9%
70.4%
75.0%
50.0%
46.4%
75.9%
34.5%
55.2%
60.0%
30.0%
47.4%
80.0%
80.0%
73.3%
93.8%
43.8%
62.5%
66
Families faced a wide range of needs, well-known to families in poverty. Families, for
example, faced food and housing insecurity, fears and barriers related to their immigration
status, domestic violence, or had limited knowledge of child development. One source of
information about target population needs is self-report data about service use. A site-specific
measure, the Caregivers Repeated Measures Survey, invited respondents to indicate all of the
community services and resources they had used in the last six months. Table 90 presents
intake and one year data for treatment and comparison group participants enrolled in the
program/study for at least 12 months. Results demonstrate a great need for (and use of) food
assistance and health insurance/services. Of interest, use of almost all the programs and
services queried increased among treatment group participants from intake to one year, likely
as a result of the resource and referral support provided by the home visitors.
Table 90
Services Used in the Past Six Months
Treatment
Program or Service
Comparison
Intake
(n=70)
One Year
(n=70)
Intake
(n=65)
One Year
(n=64)
Financial assistance/public assistance/welfare
Energy/utility/heating assistance
Clothing (free or low cost)
Food bank/WIC/food stamps/meals
Furniture/household supplies
Housing assistance
Transportation assistance
Children's programs or services
Child care
Child support enforcement
Family resource centers
Parent support/play groups
Parenting classes
Relief nursery
Alcohol/drug services
Mental health/counseling
Crisis services
Domestic violence
Oregon Health Plan/other health insurance
Public health services
Well-child check-ups
30.0%
14.3%
25.7%
97.1%
5.7%
7.1%
7.1%
17.1%
11.4%
10.0%
2.9%
7.1%
15.7%
0.0%
2.9%
8.6%
0.0%
0.0%
94.3%
30.0%
68.6%
38.6%
18.6%
45.7%
94.3%
20.0%
17.1%
15.7%
31.4%
20.0%
11.4%
15.7%
25.7%
24.3%
0.0%
1.4%
10.0%
4.3%
1.4%
97.1%
28.6%
88.6%
49.2%
32.3%
20.0%
98.5%
7.7%
6.2%
12.3%
18.5%
1.5%
1.5%
3.1%
10.8%
16.9%
0.0%
1.5%
9.2%
0.0%
0.0%
98.5%
35.4%
56.8%
26.6%
37.5%
32.8%
98.4%
6.3%
9.4%
7.8%
26.6%
7.8%
7.8%
9.4%
10.9%
9.4%
0.0%
0.0%
6.3%
0.0%
0.0%
96.9%
31.3%
76.6%
Education (GED, ESL, Adult Education)
18.6%
22.9%
12.3%
18.8%
Employment assistance
1.4%
8.6%
4.5%
9.4%
Legal assistance
2.9%
12.9%
1.5%
9.4%
Library
34.3%
51.4%
40.0%
45.3%
Recreation
40.0%
80.0%
24.6%
67.2%
Multi-cultural services
7.1%
22.9%
6.2%
15.6%
67
Target population needs also can be described with resource and referral data collected by
the home visitors. Resources and referrals were coded as alcohol and drug services, basic
needs, child development services, domestic violence, education, health/dental, job assistance,
mental health, safety, and “other”. A Fostering Hope Initiative Community Referral Data Report
developed in September 2012 and contained in Appendix A summarizes referral types and
completion rates for the first 15 months of the project.
Table 91 presents referral data collected from home visiting participants during their first
year of service. Specifically, the table displays the minimum, maximum, and average number of
referrals received during that time period that resulted in a service being received, both by
referral type and overall. Data are displayed for the first six months of enrollment (1-6 months)
and for the second six months of enrollment (7-12 months). As shown, basic needs and
referrals to health/dental resources were most common. “Other” referrals also were popular,
many of which were for community events. The mean number of referrals changed little from
the first to the second six month enrollment periods, suggesting that participants’ needs did not
change substantially over the course of their first year of participation in the Initiative.
Table 91
Referrals Resulting in Services Received During the First Year of Enrollment – Treatment Group
Referrals (n=55)
Date Range
Minimum
Maximum
1-6 months
0
13
7-12 months
0
6
1-6 months
0
1
Child Development Services
7-12 months
0
1
1-6 months
0
2
Education
7-12 months
0
2
1-6 months
0
6
Health/Dental
7-12 months
0
4
1-6 months
0
2
Job Assistance
7-12 months
0
0
1-6 months
0
2
Mental Health
7-12 months
0
3
1-6 months
0
10
Other
7-12 months
0
6
1-6 months
0
1
Safety
7-12 months
0
2
1-6 months
0
14
All referrals
7-12 months
0
10
Note. The data include only those referrals that resulted in a service being received
Basic Needs
68
Mean
1.38
1.20
0.07
0.11
0.36
0.18
0.78
0.49
0.07
0.00
0.11
0.16
1.04
1.45
0.04
0.07
3.85
3.67
4. Purpose, Specific Research Question(s), and Overview/Summary of the Project
High-risk families in high-poverty neighborhoods face multiple risks for child maltreatment,
at both the family and community levels. These neighborhoods have higher substantial rates of
child maltreatment and few assets for supporting families to thrive. In a paper commissioned
by RAND Child Policy, Carrasco (2008) states that the historical orientation of intervention to
high-risk families at the end-stage of the continuum of maltreatment—rather than
prevention—is too expensive to achieve marked declines in child abuse rates. In addition, in
studies that verified the effectiveness of models, those who agreed to participate are often the
least likely to be those with the highest risk of negative outcomes.
Carrasco continues by saying we need to invest in developing community engagement,
changing community environments to promote a sense of community responsibility for
children, families, and neighbors. Using a public health approach, this would mean looking at
the issue as one of greater child well-being rather than only as intervention that takes place one
person at a time. The full RAND Child Policy Working Paper, based on papers by Carrasco and
five other experts and a web-based survey of professionals working in the field of child abuse
and neglect, listed home-visiting and parent education as the strategies viewed as having the
greatest promise for prevention (Shaw & Kilburn, 2009).
Thus, collaborators designed FHI to focus on specific neighborhoods; improve neighborhood
engagement in prevention of child maltreatment; improve neighborhood assets for supporting
families and child well-being; use non-threatening, non-stigmatizing methods to attract the
families with the highest risk of negative outcomes to participate; provide ongoing parent
education and support groups available to all parents in the focus neighborhoods; provide
professional home visitors for high-risk families to provide in-home parenting education,
information on child development, and access to other services and supports. These reflect the
fundamental design of the Fostering Hope Initiative as an intervention to reduce the incidence
of child maltreatment.
 How the Project Responds to the Overarching QIC-EC Research Question
The overarching QIC-EC research question is:
“How and to what extent do collaborations that increase protective factors and
decrease risk factors in core areas of the social ecology result in optimal child
development, increased family strengths, and decreased likelihood of child
maltreatment, within families of young children at high-risk for child
maltreatment?”
FHI directly responded to this research question through strategies directly focused on each
level of the social ecology:
Primary Caregiver and Target Child (Individual Domain). FHI provided direct supports to
the parents/caregivers directly responsible for the target child. The project used the risk factors
69
included in eligibility screening for Healthy Start~Healthy Families as one criterion for project
eligibility. Home visiting, based on the Healthy Families America model, included support for
the family in all areas of the Strengthening Families Protective Factors, while assisting the
family to decrease risk factors.
Social Support (Relationship Domain)—Neighborhoods. FHI used a neighborhood-based
service delivery model that was intentionally chosen in response to research highlighting the
benefits of providing services in this way. As of the start of the study, research had not
produced clear data to delineate the relationships between neighborhoods and child
maltreatment (Coulton, Crampton, Irwin, Spilsbury, Korbin, 2007). By designing FHI to
concentrate on neighborhood-specific rather than community-wide needs, it contributes to
research in this area.
FHI’s neighborhood mobilization strategies focused on high-risk neighborhoods and
included Community Cafés, in which neighborhood residents were invited to discuss their
experiences related to the protective factors and consider how they might improve support for
the protective factors within their neighborhood to make their neighborhood a safe, healthy
place in which to raise children. In addition, FHI supported other neighborhood mobilization
efforts that occurred within each neighborhood. For example, the Swegle neighborhood
developed a weekly free Community Dinner that was held at a neighborhood church. In the
Washington neighborhood, the Holy Cross Lutheran Church donated the use of a small house—
La Casita—to serve as a neighborhood center for activities. FHI also participated in Annual Night
Out parties, Family Literacy Nights, play groups, coffee clubs, community gardens,
neighborhood restoration projects, and walking groups, for example.
Community Connections (Community Level)—The Service System. Research analyzing the
benefits and challenges of collaborative service delivery has been voluminous. As a result,
interagency collaboration, when meeting certain criteria, is generally presumed to improve the
quality of service delivery in programs that serve young children (Gardner & Young, 2009). By
coordinating services rather than operating in isolation, providers can offer comprehensive
programming that is better able to meet the needs of their clients. The collaborative
partnership underlying FHI was already well developed at the start of the project, having spent
over a year in collective planning. FHI is now a Collective Impact Initiative, in which
organizations representing different sectors come together around a common purpose, sharing
a common agenda, using shared measurement, carrying out mutually reinforcing activities, with
consistent and open communication and backbone support. CCS has served as the backbone
organization, supporting both accountability for outcomes and improved performance.
Public Policy and Social Norms (Systems Level). Although not a formal part of the QIC-EC
research project, FHI developed an active advocacy effort. That effort, in the 2013 legislative
session, resulted in a law that changed the eligibility for the Healthy Start~Healthy Families
program in Oregon. As a result of the change, any family with a new infant and meeting criteria
for risk factors can now receive Healthy Families Oregon services; previously, only first birth
families were eligible. In 2010, CCS, a local business advocate and the Department of Human
70
Services worked with the Senate President to craft and pass Senate Bill 991 to make Safe
Families for Children possible. This bill removed regulatory barriers that prevented private
organizations from providing voluntary respite care for children. The bill was lauded as a
successful bipartisan effort with the proposed legislation winning unanimous support.
The measures employed in the quasi-experimental design, which focused on levels 1 and 2
of the social ecology as they are listed above, attended to the overarching research question.
Specifically, data were captured that addressed child development, family strengths, and risk
for child maltreatment.
 How the Project Responds to the Needs of the Target Population
Families served by FHI experienced issues such as substance abuse or HIV/AIDS-affected
caregivers; psychological distress; family disorganization, dissolution and violence; lack of social
cohesion; social isolation; lack of understanding of children’s needs, child development and
parenting skills; parent history of child abuse in family of origin; young, single parents; poverty,
and unemployment or lack of education. FHI served pregnant women, as well as infants and
children up to age 5 and their primary caregivers, offering a variety of services (home visits,
resource and referral, parent education classes and support groups) designed to increase
protective factors and decrease risk factors associated with child maltreatment.
 What the Project is Trying to Accomplish to Address its Specific Outcomes and the QICEC’s Cross-site Outcomes
The project was an excellent fit for the QIC-EC research and demonstration project in that
the Initiative was designed to support optimal child development, strengthen families, and
reduce maltreatment rates in the targeted neighborhoods.
5. Significant Contextual Conditions, Events, or Community Changes or
Characteristics Not Previously Described that Occurred during the Grant Period
which Impacted the Families Served, the Project or the Outcomes Measured
Exciting work has been underway in Oregon in early childhood and health care over the last two
years. The governor has promoted a redesign of the education system from pre-kindergarten
through college. His new Early Learning Council is now implementing a multi-faceted plan to
address all early childhood domains. Backed by legislation, in August 2013, the Early Learning
Council issued a request for applications for organizations wanting to become regional hubs for
early learning services. The governor also has changed how Oregon Health Plan services are
managed—creating a system of regional Coordinated Care Organizations (CCO) to manage funding
at local levels, related to physical and behavioral health, and soon, dental health as well. CCS has
developed a strong relationship with the local CCOs for Marion, Polk and Yamhill Counties—
Willamette Valley Community Health and the Yamhill County Care Organization. CCS
representatives participated on committees in all three counties related to both initiatives during
their development. CCS provided a grant writer to assist the local organization—Early Learning
Hub, Inc.,--in preparing their application to become the hub for the Marion County area, and a
71
facilitator to lead planning in Yamhill County. CCS has informed the Governor’s Office about FHI,
and has had discussions with his staff on the social determinants of lifelong health.
Oregon, like many other states, has had struggles related to Immigration status and
undocumented workers. During the last legislative session, one positive change did occur:
undocumented persons now can obtain a permit to drive, which allows them to be able to drive
to work. Although not a full drivers’ license, the permit is a step forward for families that have
many other barriers to supporting their children well.
C. Overview of the Collaborative Partnership
FHI’s vision is that every child and youth in every neighborhood lives in a safe, stable
nurturing home; is healthy; succeeds at school; and goes on to financial self-sufficiency.
Together, partners provide a continuum of services and supports to strengthen families and
create better neighborhoods—building the infrastructure to improve and scale up the programs
proven to have high impact results for children, youth and adults. FHI partners include
representatives from education, the business community, Latino organizations, faith-based
groups, the public and private sector social services network, and health care.
1. The Collaborative Partnership
 The Lead Organization’s Role in Forming or Supporting the Collaborative Partnership
In the spring of 2008, the CCS executive director was invited to join a delegation from
Oregon to attend a conference where the Casey Family Programs shared their 2020 vision:
“Safely reduce foster care by 50% by 2020.” The delegation included DHS Child Welfare, a
judge, a state legislator and others.
The CCS Forever Home Youth Council, composed of foster youth, embraced the Casey 2020
vision and advocated for CCS to convene a planning group. A community planning group began
meeting around the question, “How can we build a neighborhood-based system of family
support strong enough to reduce the need for foster care by 50% by 2020?” When Oregon was
subsequently selected as a Casey Family Programs project state, CCS had already begun work
around planning the neighborhood-based initiative to reduce child maltreatment and foster
care.
As the initial vision grew, CCS invited additional organizations to the table that had a stake
in preventing child maltreatment and reducing foster care. By April, 2008, CCS engaged a high
profile community leader—a former school superintendent—to act as “champion” to lead the
meetings. This group worked diligently into 2009 to define FHI’s vision, goals, and strategies,
and to address FHI’s cross-agency procedures. A summary of their work from these original
discussions is included in Appendix B. While there have been changes over time, much of what
the participants developed is still very relevant to FHI.
 History of Collaboration between the Lead Organization and Collaborative Partners
72
FHI is based upon the belief that a neighborhood-based, collective impact initiative that
promoted protective factors would lead to breakthrough outcomes for poor and vulnerable
young children and their families as evidenced by improved child safety, health, and
kindergarten readiness. CCS has had a long history of successful collaborations with many
organizations critical to achieving this vision, including important work with neighborhood
associations, community progress teams, funders, parents, and community-based human
service organizations.
CCS’s strong relationships with local and State partners are key to its capacity to operate
programs. These relationships expand outreach into the community, enrich leadership and
strengthen the capacity to provide additional services for families. Because it has operated
since 1938, has had the same executive director for 30 years, and has run programs for infants
and toddlers, children, youth, adults, and families, CCS has long-standing connections with both
the community and the public/private service delivery system for children and families. For
example, CCS and the Salem Leadership Foundation have collaborated often on joint projects to
strengthen families and neighborhoods. These projects have included co-sponsoring a “Future
Search” in the Grant and Highland neighborhoods, which helped lead to today's communitywide emphasis on family support and foster care, and FHI’s focus on concentrating services in
high poverty neighborhoods. The North Neighborhoods Community Progress Team grew out of
this Future Search with the support of SLF and CCS. SLF and CCS also worked to help resurrect
the struggling Salem-Keizer Community Development Corporation, which owns affordable
housing in high-needs areas. CCS works diligently to build community relationships related to
specific projects and programs. CCS’ Community Homes for Children, for example, provide longterm foster care for children and youth who have lost ties with families and are unlikely to be
adopted. The development process includes working with Neighborhood Associations and
doing “Knock-and-Talks” to meet neighborhood families, answer questions, and gain support.
FHI requires the active collaboration of services and supports provided by several different
organizations and programs. These organizations, their roles and responsibilities in FHI, and the
contributions they have brought to the project are provided below.
• Salem Leadership Foundation (SLF) has worked with CCS since the initial stages of
Fostering Hope, including completing the analysis of high-poverty neighborhoods in
Salem, Oregon, to identify those that should be prioritized for being the focus of
Fostering Hope Initiative efforts in Marion County. SLF provided neighborhood outreach
coordination for Fostering Hope.
• Mano a Mano Family Center staff provided neighborhood outreach coordination for
Fostering Hope in Marion County, focusing on the Latino community. Mano-A-Mano
was invited to participate in Fostering Hope because of their success in organizing
parents in support of student success in the high school catchment area that includes
the project’s targeted neighborhoods. Mano a Mano uses a parents-supporting-parents
approach, with hundreds of Latino/Hispanic parents volunteering in Salem
neighborhoods. Mano a Mano also has been a valuable resource to ensure that
73
•
•
•
•
•
•
•
Fostering Hope Initiative processes integrate cultural considerations in planning and
that interventions are culturally responsive.
Options Counseling Services of Oregon participated in planning for the Fostering Hope
Initiative and provided parent education and support groups. Options contributed
Oregon Health Plan (OHP) Prevention Services and Family Support and Connections
services to project participants. Options offers quality home-based, family-centered,
outcome-focused mental health, family preservation, life skills and domestic violence
interventions to at-risk rural, urban and homeless children, adolescents, individuals and
families.
Healthy Start~Healthy Families of Marion County (HS~HF) (now Healthy Families
Oregon), during the time of the project, provided the Healthy Families America
research-based home-visiting model to reduce the incidence of child abuse and neglect
in eligible first-birth families. Trained parent educators offer parenting education,
developmental screenings, and referrals to community resources. HS~HF contributed
home visiting and parent education and support classes for first-birth families in the
research project and additional resources in donated tangible goods, such as food and
diapers.
Family Building Blocks (FBB) is located in the McKay High School catchment area (the
two Salem area neighborhoods are a part of that high school catchment area) and
provides children’s therapeutic classes, parent education, home visits, and other
services for families to keep children safe and families together. CCS has worked with
FBB related to early childhood initiatives and served with them on Great Beginnings, the
group sponsored by the Marion County Children and Families Commission to address
early childhood needs.
DHS District 3’s Children, Adults and Families (CAF) Division is responsible for foster care,
protective services, and other child welfare activities in Marion, Polk, and Yamhill
counties. The District 3 manager has been integrally involved in planning for the
Fostering Hope Initiative. She strongly feels that the work of Fostering Hope is in close
alignment with her own department’s goals and objectives related to reducing child
maltreatment and safely reducing the need for foster care. CCS has worked with District
3 over the years related to treatment foster care, Community Homes for Children
needing long-term foster care, and other services for vulnerable families.
Yamhill County Health Department (YCHD). Staff members from YCHD participated in
the planning for FHI in Yamhill County. At the start of the project, YCHD operated
Healthy Start in Yamhill County, with a subcontract from CCS to expand the services to
families meeting the eligibility for the QIC-EC project. However, partway through the
project, CCS no longer contracted with YCHD and the Healthy Start family support
worker became an employee of CCS.
Catholic Community Services Foundation (CCSF). Formed in 1985 to financially support
the programs and projects of CCS, CCSF committed to providing matching funding for
the QIC-EC project, particularly related to wrap around services.
Pacific Research and Evaluation is a new partner to FHI that was added after receiving
the QIC-EC RFP to bring to the group needed expertise on research design and
74
evaluation for the project proposal, and to conduct the local evaluation for the project.
 How the Collaborative Partnership has Evolved or Changed over the Course of the
Project
At the beginning of the project, CCS established a Participatory Evaluation and Planning
meeting that was attended by both Marion and Yamhill County partners. However, the distance
and time required for Yamhill County partners to attend the meetings in Salem was difficult.
Therefore, generally only the county Health Department representative and Family Support
Worker attended. A survey assessing the collaborative partnership across all partners indicated
that the Yamhill County partners were not satisfied with their primary connection to FHI being
through a meeting in Salem. Therefore, CCS changed its approach to attending existing
meetings in Yamhill County which included FHI partners and others. Thus, CCS now attends the
Yamhill County Early Childhood Coordinating Council and a subcommittee of that council that
designed and prepared the application to the state to become the Early Learning Hub for
Yamhill County. FHI’s Collective Impact Coordinator provided facilitation services, technical
assistance and backbone support to that committee as it prepared its application.
In the spring of 2013, CCS changed how it addresses Participatory Evaluation and Planning
in Marion County. After the site visit by the QIC-EC team in April, and the FHI Planning meeting
in June, CCS ended the existing Marion County Participatory Evaluation and Planning Team.
That team primarily was composed of mid-level managers of partner organizations. Instead,
over the summer, CCS established a Marion County FHI Executive Council, made up of partner
executive directors—some of which also provide services in Polk and Yamhill counties. The
council took over responsibility for Participatory Evaluation and Planning. This shift put each
organization’s decision-maker into the active leadership of FHI.
 New Partners that Emerged Since the Original Application
As CCS approached the end of QIC-EC funding, it was necessary to develop a strategy for
continuing FHI across the two counties. In the spring of 2013, CCS developed and submitted a
proposal to the United Way of the Mid-Willamette Valley which included new partnerships for
FHI. Although they did not officially join FHI until the United Way contract was signed at the
end of June, new partners are: Lutheran Community Services Northwest (now the Healthy
Families Oregon provider for Yamhill County); Yamhill County Head Start; Salem Keizer Coalition
for Equality (a multi-cultural, multi-racial organization that supports equality and justice in
education); Willamette Education Service District (which provides Early Intervention/Early
Childhood Special Education in Yamhill, Polk, and Marion counties to young children with
disabilities); Center 50+ (a full-service focal point senior center in Salem in Marion County); and
Oregon Child Development Coalition (a provider of Migrant Head Start in Polk and Marion
counties). In addition, a representative of It Takes a Neighborhood—a Kaiser Permanente
project in cooperation with Northwest Human Services—has now joined the Executive Council
and is providing invaluable support in both building connections with the health care industry
and in bringing a health care perspective to the Executive Council. These all joined FHI after the
end of direct service delivery for the QIC-EC project, March 31, indicating the ongoing success
of FHI in terms of sustainability and partner commitment.
75
The representative of “It Takes a Neighborhood” fills a gap in the FHI partnership identified
in the Fall 2011 Fostering Hope Partner Survey conducted by InSites: “Expertise in providing
medical care to young children.” It Takes a Neighborhood is a project of the Oregon Primary
Care Association funded by Kaiser Permanente Northwest. It Takes a Neighborhood’s Health
Instigator has joined the FHI Executive Council and is working with FHI’s Collective Impact
Coordinator on defining how health care and FHI will work together.
 Partners Who Left the Partnership
At the start of the project, Yamhill County Health Department was the Healthy
Start~Healthy Families provider in Yamhill County and a subcontractor from FHI for providing
home visiting in that county. During the project, however, CCS took over providing the home
visiting services, hiring the Yamhill County Healthy Start~Healthy Families family support
worker. Despite this change, Yamhill County Health Department continued to work with FHI in
local meetings.
 The Implementation Roles/Responsibilities of Partners and How They May Have
Changed as a Result of Working Together
In June, 2013, well after the end of the direct service delivery phase of the QIC-EC project,
CCS decided it would no longer compete to provide Healthy Start~Healthy Families services but
rather focus on Collective Impact backbone organization responsibilities. Therefore, CCS
supported Family Building Blocks, an active FHI partner, to provide all Healthy Families services
in both Polk and Marion Counties. Lutheran Community Services provides these services in
Yamhill County.
 The Collaborative Partners’ Linkages with Child Welfare, CBCAP, ECCS Leaders, Parent
Organizations, Community Organizations
CCS and its community partners have longstanding ties to many state and community
organizations. These include connections with Oregon’s Community-Based Child Abuse
Prevention Program (CBCAP)—through the DHS Office of Self-Sufficiency CAF Unit; Oregon’s
Early Childhood Comprehensive Systems (ECCS) leader in the Public Health Division of DHS; and
the Oregon Children’s Trust Fund which manages Oregon’s Trust and Prevention Funds. All
three agencies were involved in formulating Oregon’s Casey Family Programs project. DHS is a
leader for FHI, and has been active in the FHI Participatory Evaluation and Planning group, and
now in the Executive Council. The DHS District 3 CAF director has participated from the start of
planning for the Fostering Hope Initiative.
The values and goals of FHI are in strong alignment with the goals of Oregon’s ECCS
program. DHS, the Oregon Commission on Children and Families (OCCF) which has now been
replaced by the state’s Early Learning Council, the Oregon Department of Education (ODE), and
Yamhill Family and Youth Programs (YFYP) were among the ECCS partners in developing their
strategic plan. While they were still operating, CCS had good connections with OCCF through
our Healthy Start~Healthy Families program. Because of the youth and family services
76
programs operated by CCS, we have connections both with YFYP, and with the Willamette
Education Service District, a subcontractor of the Oregon Department of Education.
Similarly, FHI is in alignment with the Oregon Children’s Trust Fund, with its approach of
strengthening families and protective factors, and building parent partnerships. CCS offers four
types of services that the Trust Fund finances: community outreach and education, parenting
classes, comprehensive family support, and respite care. Indeed, during the course of the QICEC project, CCS worked with the Oregon Children’s Trust Fund related to two applications for
funding.
FHI established a Parents’ Council, comprising teens and adults who have been involved in
the foster care system. The Council has been very active, and members have participated in
presentations on FHI to United Way, Catholic Charities USA, and each Fostering Hope: Closing
the Gap Summit, as well as other community functions.
FHI is currently forging a new partnership with MERIT (MicroEnterprise Resources,
Initiatives, and Training, Salem, Oregon) and Frontiers of Innovation partner All Our Kin (New
Haven, Connecticut) to address economic self-sufficiency issues as well as increased quality of
child care. MERIT helps entrepreneurs by providing training and ongoing support from prebusiness through start-up, and beyond business-launch. All Our Kin has an approach for
working with family/friend child care providers to help them both improve their knowledge of
child development, improve the quality of their service, and improve the financial outcomes
achieved by their business. Based on meetings held in October, we are developing a
partnership within FHI that is focused on improving the financial self-sufficiency of families
living in Fostering Hope neighborhoods.
2. Required to Support and Sustain the Collaborative Partnership
 Opportunities and Strengths Provided by the Collaborative Partnership
FHI partners bring diverse but complementary skills, knowledge, and relationships to the
project. Each organization has been responsible for a specified component of the project (e.g.,
neighborhood outreach, home visiting, parent education and support groups) and was selected
to carry out that component due to their unique skills, knowledge, and resources. The FHI
partnership has included the right mix of people to do this unique project. Implementing a
neighborhood-focused approach required the collaboration of many partners that provide
services within the target neighborhoods. For example, FHI benefited from Salem Leadership
Foundation’s strong relationship with faith communities in the neighborhoods in Salem when
Holy Cross Lutheran Church offered a small house on the edge of the Washington
neighborhood for use by FHI. “La Casita” has become a community center, offering, for
example, a lending library, coffee club, garden club, counseling, and parenting support to
Washington residents.
 Challenges Resulting from the Collaborative Partnership
77
One challenge of working within a collaborative partnership is ensuring that decisions made
on behalf of the partnership are made with full awareness and input from partners, and made
in a timely fashion. Far too often, CCS made decisions for FHI—such as which funding
opportunities to go after, how to design a submission—and informed partners after the
decision was made. This was especially true of grant proposals, since the monthly Participatory
Evaluation and Planning meeting did not always sync well with upcoming grant deadlines.
The challenge around proposals being submitted for FHI is an example of a larger
communication challenge. Because most of the participants in the Participatory Evaluation and
Planning meetings were largely mid-level managers, there wasn’t a regular communication
meeting with executive directors, i.e., partner decision-makers. Shifting to an Executive Council
has alleviated that issue and increased the ability of the partnership to make definitive
decisions that are supported by the partners’ top executives.
 Unexpected Events that Developed in the Collaborative
Two unexpected events developed during the project:
1. Legislation that passed in the 2013 Oregon legislative session abolished the State
Children and Families Commission and established, through the Department of Education, the
Early Learning Council as well as the Youth Development Council. The Early Learning Council’s
mandate is to create a unified system of early learning services that significantly increased the
number of children who arrive at kindergarten healthy and ready to learn. This legislation, while
supported by FHI partners, has temporarily destabilized an already fragile early childhood
development system of care.
2. Because the Fostering Hope Initiative during the QIC-EC project focused on early
childhood, we did not expect to enlist a partner focused on serving seniors. However, Center
50+ asked to become a partner both as a resource to provide volunteer support in the two
Salem neighborhoods and also to participate in meetings and Community Cafés to focus on
how to involve seniors as part of the neighborhood mobilization process and increase their
social connections. Center 50+ is well-connected with the senior community: more than 700
seniors use the Center daily and more than 500 senior citizens annually use the health
screening clinics at the Center. Center 50+ is accredited by the National Institute of Senior
Centers. Of more than 15,000 senior centers across the country, only 120 are accredited.
Center 50+ is the first senior center in the state of Oregon to receive this recognition.
 Resources Needed to Support the Partnership
CCS has assumed the role of a backbone organization for FHI’s Collective Impact Initiative.
In addition to service funds from state/federal funders—which with the end of the QIC-EC
project, now come from service contracts held by partners—CCS has sought funding to support
the collaboration. For example, small organizations have fewer resources and less flexibility for
attending the necessary meetings with partners to maintain and improve the collaborative.
Therefore, CCS found a donor to provide funds to help smaller organizations be able to
participate in collaboration meetings—$5000 per organization per year.
78
In November, 2012, CCS obtained funding from the Meyer Memorial Trust for a full-time
Collective Impact Coordinator to expand and deepen partner relationships, as well as to
improve the systems that support collective impact. This position, with its focus, has had a
tremendous impact on improving the quality of the relationships in FHI, attracting new
partners, improving communication with partners, and designing improved systems for
collaborative work.
CCS has funded a part-time grant-writer whose primary responsibility has been to write
proposals to support the FHI collaboration. This effort has led to funding for FHI from The Ford
Family Foundation (rural FHI), the Oregon Community Foundation (parenting education),
United Way of the Mid-Willamette Valley (costs of collaboration), and the Kaiser Permanente
Community Fund of the Northwest Health Foundation, as well as from the Meyer Memorial
Trust.
3. Roles of Parents as Partners in the Collaboration
 How Parents were Recruited and Supported in their Work
FHI used several strategies to recruit parents to participate with the project. Home Visitors
and Neighbor Connectors recruited parents willing to take on a leadership role in Community
Cafés. Training and ongoing facilitation support were provided for organizing and leading the
Cafés. Also, partners identified prospective parents from their respective service networks. At
each event, parent volunteers are solicited to take on responsibilities for upcoming activities.
Meeting arrangements, notes, flyers, etc. are provided by the backbone organization with help
from FHI partners. Salem-Keizer Coalition for Equality, an FHI partner, recruits, trains, and
supports parent leaders to provide the parent education classes.
The CCS Executive Director recruited participants for the Parents and Youth Councils. Both
councils primarily include persons who have been involved with the foster care system, either
as a child or as a parent. Individuals were recruited from youth and adults who were former
residents of CCS foster care homes, and through personal networks.
 Specific Contributions that were Made by Parents
Parent involvement in the Initiative took place in several ways, including in Parents’ Council
meetings facilitated by the CCS Executive Director. The Council is a team of parent leaders that
advocates for policy and funding to build neighborhood-based systems of support for children
and families that will reduce child abuse and neglect. Members include individuals who have
been involved with the foster care system, either as a child or parent. The Council provided
input for the project during the planning stages and continued in an advisory role throughout
the implementation period. The Council has been very active, and members have participated
in presentations on FHI to United Way, Catholic Charities USA, and the Fostering Hope: Closing
the Gap Summits, as well as other community functions.
In addition to the Parents Council:
79
•
•
•
Parents from the neighborhoods have been involved in leading Community Café
meetings and events held at La Casita, the Washington Neighborhood FHI community
center.
CCS partnered with the Salem Keizer Coalition for Equality and Mano a Mano Family
Center for outreach to Latino parents and for participation in various meetings, classes
and other activities involving Latino parents.
At key time points during project implementation an FHI newsletter was distributed
within the target communities, summarizing current results and inviting comment and
additional participation from community members
 Challenges, Opportunities, And Lessons Learned Regarding Building and Sustaining
Strong Partnerships with Parents as Part of the Collaborative Effort
The parent perspective is vital to a project such as the Fostering Hope Initiative. Their
engagement will support sustainability of project activities—particularly those associated with
neighborhood mobilization. However, getting their active and ongoing participation requires
the project to accommodate their needs. Many of these families have very complicated lives.
For example, providing stipends or bus passes for transportation, offering child care at events,
occasionally giving incentives for attendance (e.g., goods such as diapers), providing a safe
environment to meet, and using trained interpreters when necessary are all strategies that may
help support parent participation. Project staff also must show empathy, be consistent, live up
to promises, listen to both the words and hidden messages, and be flexible when working with
parents and families to develop trust.
When working with parents of different cultures, it is important to be alert for and
understand their family’s norms, values and individual roles within the family. For example, the
location from which they emigrated to come to the U.S. affects which person the family may
view a as “head of household”—for some, it will be the father, for others, it may be the
grandmother or even oldest child. Home visitors must observe family dynamics to know which
family member will be open to receiving information. These cultural differences exist from
country to country—e.g., cultural and language differences between people from Peru and
those from Mexico, and even larger differences between people from these countries and
those from Pacific Islands. However, there also are regional cultural and language differences
within a country of origin.
Parent relationships, whether from the perspective of a family receiving services or in a role
as a project leader requires that staff be respectful of parents’ multiple priorities and followthrough on all promises. Project staff needs to “step aside” at times to allow space for parents
to engage in leadership roles. Key parent leaders in the community can be very helpful to a
project by initiating contacts with other families and helping to disseminate project
information.
80
In Yamhill County, as part of the new United Way project, CCS pursued the opportunity to
hire a current Head Start parent to serve as the Neighbor Connector. This parent has received
leadership training from Head Start and served as the chair of their policy committee. She
brings a unique skill set to the role. In the Washington neighborhood in Woodburn, the
Neighbor Connector is a bilingual/bicultural former resident of the neighborhood who recently
graduated from Western Oregon University and is wanting to give back to her community. Her
parents still live in the neighborhood and are monolingual Spanish speakers. She is a far more
effective than the previous connector who did not reside in the community, and was not
bilingual.
4. The Partnership’s Role in Impacting Larger Systems Issues (Program and/or
Policy), Including Changes in Practices that have been or may be Adopted by the
Larger Systems in the Region or State.
FHI carried out an advocacy campaign to inform the legislature of the effect of the then
current policy of the Healthy Start~Healthy Families program to limit eligible families to only
those having their “first birth.” However, the experience of partners was that many families
face increased stress with subsequent births, having to balance caring for an infant with their
existing child care needs, as well as dealing with the additional costs associated with having
another child. The advocacy effort was successful: in the 2013 legislative session, the policy
was changed for the “Healthy Families Oregon” program so that any family with an infant three
months of age or younger, including prenatal, that has qualifying risk factors could be served.
In 2010, CCS, a local business advocate and the Department of Human Services worked with
the Senate President to craft and pass Senate Bill 991 to make Safe Families for Children
possible. This bill removed regulatory barriers that prevented private organizations from
providing voluntary respite care for children. The bill was lauded as a successful bipartisan
effort with the proposed legislation winning unanimous support.
In addition to these formal legislative changes, FHI partners have adopted the
Strengthening Families Protective Factors Framework, and some of them have built the
framework into their organizational policies.
D. Overview of the Project Model
1. Theoretical Foundation and Guiding Principles of the Project
The overarching goal of the FHI partnership is to build an enduring system of neighborhoodbased supports for fragile families at high-risk for child maltreatment—a system robust enough
to reduce child abuse and neglect and safely reduce the need for foster care in Marion and
Yamhill counties by 50% by 2020. In alignment with research findings recommending focus on
risk and protective factors, the FHI collaborative provides services that enhance family and
community well-being among high-risk families in the targeted neighborhoods. This includes
81
neighborhood outreach and coordination; ongoing developmentally-specific neighborhoodbased parent education and support groups; and home visiting with wraparound services.
FHI works at all four levels of the social ecology. The project: 1) provides services such as
home visiting, parent education/support, and volunteer respite care to mitigate sources of toxic
stress and teach parents to be more resilient in the face of stress, 2) mobilizes neighborhood
residents to promote family protective factors and thereby make their neighborhood a better
place to raise children, 3) uses collective impact strategies to improve collaboration, quality and
accountability across partners, and 4) advocates for family-friendly public policy, including
policy that pays for outcomes rather than units of service and supports collaboration. CCS, as
the “backbone organization,” supports collaboration across sectors for collective impact.
Principles guiding the project include:
• Services must be family-centered, strength-based, individualized, culturally competent,
developmentally appropriate, and outcome driven.
• The project must address the neighborhood around families, through community
outreach, neighborhood mobilization, and activities that bring families together.
• The project must be founded on principles of quality management, including a focus on
the customer, teamwork, and a scientific approach to data collection and analysis for
program improvement.
Several key assumptions, based on scientific research, underlie FHI’s Theory of Change:
• Safe, stable nurturing relationships are the key social determinant of optimum child
development.
• “Toxic stress” disrupts safe, stable nurturing relationships by interfering with the brain
“executive function” (problem-solving, self-regulation, the ability to delay gratification)
and triggering fight-flight responses.
• Acute and/or chronic adversity in childhood leads to hypersensitivity to stress. Traumainformed approaches to service delivery are, therefore, often necessary.
• Toxic stress can be reduced and access to executive function developed by providing
support and services which address the sources of stress; by teaching knowledge, skills
and personal attributes to help parents become more resilient in the face of stress; and
by promoting Strengthening Families Protective Factors at home and in the
neighborhood.
• Early childhood investment will benefit both a child’s capacity to learn and the child’s
prospects for lifelong health.
• Living in a safe neighborhood where neighbors know and care about one another
strengthens families and promotes and protects optimum child development.
• The intentional pursuit of quality and accountability—i.e., grounding service design in
credible science, evaluating service delivery to ensure fidelity to service design,
evaluating results, and using the data to continually improve decision-making—is vital to
achieving the desired results.
• Collaboration is vital for solving complex social problems and creating collective impact.
82
•
Public policy can strengthen families and promote/protect optimum child/youth
development, or it can undermine families and child/youth development.
2. The Project’s Specific Goals and Objectives, Activities/Interventions, and
Outcomes being Measured at Each Domain of the Social Ecology
Tables 92 and 93 display the outcome and process goals and objectives guiding FHI
implementation and evaluation. The tables also include activities/interventions and measures
associated with each goal.
Table 92
Project-specific Goals and Objectives, Activities/Interventions and Outcomes Being Measured at
each Domain of the Social Ecology
Goal(s)
Parents are
satisfied with FHI
Activities/
Interventions
Individual/Parent/Caregiver Domain
80% of parents will report
Home visiting and
neighborhood-based
satisfaction
services
Objective(s)
Promote parent
involvement in
service planning,
delivery, and
decision-making
80% of parents will report a
satisfactory level of
involvement in decisionmaking and service delivery
planning
Home visiting
Referrals are
utilized
50% of referrals made by
FHI staff will be utilized
Resource/referral to
home visiting recipients
Decrease child
maltreatment
risk
Maltreatment risk will
decrease significantly
among program participants
Home visiting and
neighborhood-based
services
Increase child
well-being
Decreases in maltreatment
risk among program
participants will be
significantly greater than
among comparison group
participants
A significantly smaller
proportion of child program
participants will test as
delayed than children in the
comparison group
Home visiting and
neighborhood-based
services
83
Outcome Measures
Satisfaction with FHI
staff and services
(Caregiver’s Repeated
Measures Survey)
Perceptions of
involvement in decisionmaking and service
delivery planning
(Caregiver’s Repeated
Measures Survey)
Referrals resulting in
services received
(Resource/referral
tracking)
Risk for child abuse and
neglect (APPI)
Developmental status
and social-emotional
functioning (ASQ:3 and
ASQ-SE)
Goal(s)
Ensure home
safety
Decrease parent
stress
Decrease family
conflict
Increase
protective
factors
Increase social
capital
Objective(s)
Indicators of home safety
will increase significantly
among program participants
Increases in home safety
indicators among program
participants will be
significantly greater than
among comparison group
participants
Parent stress will decrease
significantly among program
participants
Decreases in parent stress
among program participants
will be significantly greater
than among comparison
group participants
Family functioning will
improve significantly among
program participants
Family functioning
improvements among
program participants will be
significantly greater than
among comparison group
participants
Protective factors will
increase significantly among
program participants
Increases in protective
factors among program
participants will be
significantly greater than
among comparison group
participants
Activities/
Interventions
Home visiting and
neighborhood-based
services
Outcome Measures
Home safety indicators
(Items adapted from the
Family and Child
Experiences Scale,
FACES)
Home visiting and
neighborhood-based
services
Parent stress (PSI)
Home visiting and
neighborhood-based
services
Family functioning (SRFI)
Home visiting and
neighborhood-based
services
Protective factors
(CAPF)
Relationship Domain
Social capital will increase
Home visiting and
significantly among program neighborhood-based
participants
services
Increases in social capital
among program participants
will be significantly greater
84
Social support (SNM,
Social Connections CAPF
subscale, Isolation PSI
subscale)
Goal(s)
Activities/
Interventions
Objective(s)
Outcome Measures
than among comparison
group participants
Reduce child
maltreatment
Community Domain
Child maltreatment rates
Home visiting and
will decrease by at least 20% neighborhood-based
in target neighborhoods
services
Department of Human
Services (DHS)
maltreatment data
Reductions in child
maltreatment rates in the
targeted neighborhoods will
be significantly greater than
in comparison
neighborhoods
Ensure effective
collaborative
functioning
The collaborative will
demonstrate characteristics
of effective functioning
CCS serves as backbone
organization and
provides administrative
support to FHI as a
collective impact
initiative
Collaboration survey
Table 93
Process Goals and Objectives
Goal(s)
Collect background
information from
participants
Recruit the targeted
number of
participants
Maintain acceptable
retention rates
Objective(s)
Activities/
Interventions
Individual/Parent/Caregiver Domain
Generate a description of the
program and comparison
participants targeted by the
program and the evaluation
Recruit 100 program and 100
comparison participants
70% of enrolled families will
complete at least one year of
service.
85
Process
Measures
Collect evaluation data
on enrolled participants
Demographic
data (BIF)
Participant recruitment
activities in the
neighborhoods
Healthy Families
America creative
outreach activities
Enrollment data
− Retention data
− Parent phone
interviews
− Home visitor
focus group data
Goal(s)
Objective(s)
Maintain acceptable
participation rates
Caregivers will receive the
number of home visits
identified in their service plan
Facilitate parent
involvement
Parents will participate in the
Parents’ Council
Refer clients to
support services
Address caregiver needs.
Document
Implementation Team
meeting frequency
and attendance rates
Activities/
Interventions
Home visiting
Process
Measures
Home visitor
service tracking
data
Invite parent
attendance
Parents’ Council
attendee tracking
Referrals made as
needed
Community Domain (Service Providers)
Support collaborative
Monthly
Implementation Team
functioning
meetings
Resource/
referral data
Meeting
attendance
3. How the Project Supports Building Protective Factors
FHI includes several strategies for building protective factors and addressing risk factors in
families. These strategies are summarized in Table 94.
Table 94
FHI Components Addressing Protective and Risk Factors
Protective Factors
Parental Resilience
Social Connections
Knowledge of
Parenting and Child
Development
Concrete Support in
Times of Need
Nurturing Children’s
Social and Emotional
Competence
FHI Component
Home visiting
Parent education and support groups
Home visiting
Parent education and support groups
Activities and connections resulting from Neighborhood mobilization,
including Community Cafés, Community Dinners, etc.
Home visiting
Parent education and support groups
Use of evidence-based curricula such as Parents as Teachers © and Abriendo
Puertas
Tangible goods and incentives for participation provided during home visiting
and/or parent education and support groups
Other supports/referrals identified through home visiting
Home visiting
Other supports identified through home visiting
Parent education and support classes
Parent/child activities e.g., play groups
86
Protective Factors
Risk Factors
E.g., Substanceabusing or HIV/ AIDS
affected caregivers;
Lack of social
cohesion
FHI Component
Home visiting
Parent education and support groups
Activities and connections resulting from Neighborhood mobilization,
including Community Cafés, community dinners, and literacy activities.
FHI components focus most directly on protective factors. However, other
needed supports were identified through home visiting. FHI has included
funding support for mental health and substance abuse treatment for those
who are not eligible for existing funded programs such as Oregon Health Plan
services. In addition, home visitors provide referrals to other programs and
follow-up on referrals to ensure families have made connections with those
programs.
FHI includes strategies for building protective factors within activities related to each
domain of the social ecology:
Individual /Family/Caregiver Domain: FHI’s services have focused on infants and children
up to age 2 at the start of service and their primary caregivers. FHI includes a variety of
services—home visits, resource and referral, parent education classes and support groups—
each of which is designed to increase protective factors and decrease risk factors associated
with child maltreatment. Parent education classes use developmentally-appropriate evidencebased curricula. and parent support groups use the Community Café approach
(http://www.thecommunitycafe.com/), to ensure effectiveness. Together, these services
address each of the protective factors over time. The experience of home visitors suggests that
families first need support with addressing concrete needs as they develop trust in the home
visitor. As the first several months go by, and the home visitor has been a consistent source of
support to them, caregivers are more willing to be open to sharing other needs and receiving
other types of support.
Relationship (Neighborhood) Domain. In addition to working with the primary caregiver,
the home visitors also worked with secondary caregivers (e.g., fathers, grandparents, other
relatives, friends) who most closely surround and are involved with families and young children
to offer support and education focused on maltreatment prevention. The parent education
classes and support groups also address this level of the social ecology, working to build a
community of neighbors. The groups are structured to bring parents together as a source of
social support for each other (e.g., Transmit cultural values and engender feelings of
connectedness and security), as well as to provide training on child development and parenting
from evidence-based curricula. Both the parent education classes and Community Café
meetings are open to any caregiver from the neighborhood, in order to eliminate any stigma
that might be attached with attending these meetings, and to support developing relationships
with other neighborhood residents. The Community Café has had a high level of participation
and interest. Indeed, CCS offered a training session in October, 2013, which was attended by
87
individuals from each of the three counties. In addition, the neighborhood outreach workers
and Neighbor Connectors, much like community organizers, assist in local projects to address
neighborhood issues. For example, staff members from Mano a Mano and Salem Leadership
Foundation have supported a variety of activities available at La Casita—FHI’s neighborhood
center in Salem’s Washington neighborhood—including a lending library, garden club, literacy
activities, a coffee club, and play groups. Thus, each of the protective factors may be addressed
within these neighborhood mobilization activities.
Community (Service System) Domain: FHI has focused on improving its systems to support
collective impact. FHI collaborators share a common vision, support a common set of strategies
and measures, communicate with each other about their activities and outcomes, and benefit
from the support of a backbone agency (CCS.) The collaboration is committed to continuously
improving quality and accountability. All partners regularly discuss the protective factors. Some
have adjusted their policies and procedures to embed their important role in building
protective factors. Because of the FHI collaborative, more service agencies have become aware
of the importance of helping families to build protective factors, and it has become a common
objective of their work.
Systems (Policy) Domain: While the project funded by the QIC-EC did not address the
systems level, FHI has been very active at the policy level related to protective factors, as well.
• FHI was a component of Marion County’s Casey Family Programs project to reduce child
maltreatment and foster care. That project had a goal of influencing policy at the
systems level, and FHI worked closely with that project to achieve change.
• By offering parenting education and support groups to a critical mass of child caregivers
and neighbors in the targeted neighborhoods, the project tried to shift social norms and
attitudes within neighborhoods related to the appropriate treatment of young children.
• The research findings from FHI have been used as evidence to influence child
maltreatment policy. Relevant findings have been disseminated to key policy makers,
leaders, and state and federal agencies.
• CCS and its partners have been active in advocating for policy change at the state level,
working to achieve changes so that policies are more family-friendly, support
collaboration across providers, fund prevention activities at both a family and
neighborhood level, and invest savings from reductions in foster care and a reduced
need for residential treatment facilities—and concomitant savings in other state
systems such as juvenile justice, behavioral health—into effective programs such as
Fostering Hope. Thus, these policy changes would support increased focus and activities
within the first three domains of the social ecology.
4. The Project’s Final Logic Model
After being selected to participate in Harvard University’s Frontiers of Innovation (FOI)
project, FOI staff provided substantial assistance to CCS to improve the logic model for FHI. The
current version of the FHI Theory of Change (available
at: http://fosteringhopeinitiative.org/images/Theory%20of%20Change.pdf ) includes
88
additional assumptions, based in science, and clarifies the target population. CCS is currently
working with Harvard’s FOI on a theory of change logic model specific to incorporating financial
self-sufficiency into FHI’s Theory of Change.
E. Overview of the Local Evaluation
1. The evaluation (research) design, data collection procedures, and the data
analysis plan
The evaluation was primarily guided by the overarching research question generated by the
QIC-EC:
How and to what extent do collaborations that increase protective factors and decrease
risk factors in core areas of the social ecology result in optimal child development,
increased family strengths, and decreased likelihood of child maltreatment, within
families of young children at high-risk for child maltreatment?
The study employed multiple methods to assess the implementation of and outcomes
associated with the Initiative. Evaluation methods associated with project implementation and
outcomes are addressed below.
Implementation Research Questions
•
•
•
•
•
•
To what extent is the collaborative marked by indicators of high-level collaborative
development?
What are the background characteristics of the target and comparison populations/
neighborhoods?
Are the targeted number of children and families attending or using the various FHI
events and services?
Does FHI maintain acceptable retention rates?
What does the Initiative cost per program recipient?
What type(s)/how many referrals are made for participating children/families?
Implementation Measures
Service tracking data. FHI includes numerous program components and services provided
by CCS and its collaborative partners. Home visitors tracked home visits and referrals. Home
visiting participants’ utilization of parenting education, community cafes, community dinners,
and partner agency services was captured with a follow-up survey. Attendance forms were
used to track parent support groups, Parents’ Council meetings, community dinners and
Community Cafés.
89
Process data. Program staff and recipients assisted in the process evaluation by offering
feedback and recommendations about the program during the first six months of the
implementation period. Staff focus groups were conducted with the home visitors/parent
educators and addressed client enrollment, retention, and participation in home visiting and
parenting education classes. Client outcomes and staff support also were discussed. Parent
telephone interviews were carried out with a sample of primary caregivers and queried
neighborhood characteristics, enrollment/retention/participation issues, perceptions about
their involvement in program processes and decision-making, social supports, and perceptions
of program successes and challenges. The Year 1 Process Evaluation Report is provided in
Appendix A.
Table 95 presents the implementation measures employed in the evaluation with their
purpose and associated data collection schedule.
Table 95
Implementation Measures
Performance Measure
Parents’ Council
Attendance Record
Community Café
Attendance Record
Purpose
Document Parents’ Council attendance
Document attendance at Community Cafés
Schedule
All Parents’ Council
meetings
All Community Cafés
Home Visit Monthly
Service Log
Document all FHHV home visits
Monthly
Referral Tracking Form
Track number and type of referrals
Treatment Follow Up
Survey
Track participation in parenting education,
Community Cafés, community dinners, and partner
agency services
Collect background information
All referrals made by FHI
staff
Discharge
QIC-EC Background
Information Form (BIF)
Staff Focus Groups
Parent Telephone
Interviews
Address outreach, enrollment, and retention
Assess parent participation in services
Assess parent involvement in treatment planning
Assess caregivers' response to offers of social
support and resulting change
Reflect on program successes and challenges
Address retention/ participation
Assess perceptions of involvement
Reflect on program successes and challenges
90
Intake and every 6 mos.
thereafter
Year 1
Year 1
Outcome Research Questions
•
•
•
•
•
•
•
•
How effectively does the collaborative function?
To what extent are parents satisfied with their level of involvement in programmatic
decision-making and service delivery planning?
To what extent are parents satisfied with Initiative programs and services?
What percentage of referrals is used?
To what extent does the FHI influence social connections among service recipients in the
targeted neighborhoods?
How does participant ethnicity influence program outcomes?
How do county differences influence program outcomes?
How and to what extent does the set of services and supports offered by FHI increase
protective factors and decrease risk factors among families in the targeted
neighborhoods, resulting in optimal child development, increased family strengths, and
decreased likelihood of child maltreatment?
Outcome Measures
Collaborative functioning. The functioning of the partnership was assessed with a survey
completed in the summer of 2011. Survey items addressed both the individual and
organizational levels of involvement and satisfaction at the planning stage and at the time of
the survey. Additional survey items were taken from Borden and Perkin’s (1999) Collaboration
Rubric. 3
Client level outcome data. The majority of program outcome measures were collected
from/about primary caregivers and children receiving home visits. Outcome data were
collected at baseline (i.e., intake) and at six month intervals to assess the extent to which
program participants would demonstrate statistically significant improvements, both
independently and as compared to children/families in comparison neighborhoods. Table 96
contains a list of outcome measures, their purpose, and the schedule according to which the
data were collected. Those required for the cross-site evaluation are indicated with “QIC-EC” in
parentheses following the name of the measure. 4 The table reflects an expectation that DHS
will provide neighborhood-level child maltreatment data at baseline and annually thereafter. 5
3
A copy of the Year 1 Collaboration Survey Report is contained in Appendix A
4
Copies of program-specific outcome measures developed for the evaluation are contained in Appendix C: Referral
Tracking Form, Collaboration Survey, and Caregiver Repeated Measures Survey.
5
In May, 2013 Pacific Research and Evaluation received notification from DHS informing us that errors related to
children and their founded allegations were identified in the DHS (NCANDS) data file for fiscal year 2012. While
DHS is unable to determine if the errors were specific to the children in our study neighborhoods, we have been
advised to disregard the data file and await a corrected copy. DHS has been unable to provide an estimate as to
when we will receive a replacement file. Once a corrected file for the 2012 fiscal year (date TBD) and the
91
Table 96
Client Level Outcome Measures
Performance Measure
FHI Referral Tracking Form
Purpose
Track referral resolution turnaround time
Track outcome of referrals
Assess collaborative functioning
Implementation Team
Collaborative Functioning Survey
Background Information Form
Measure change in child health
(QIC-EC)
indicators
Measure change in home
maintenance and safety
Measure neighborhood context
Measure income, housing
stability, and food security
FHI Caregiver Repeated
Measure change in service use
Measures Survey
Assess satisfaction with the FHI
Assess level of involvement in
decision-making and service
delivery planning
Ages and Stages Questionnaire 3 Assess/measure change in child
and Ages and Stages Socialwell-being (education/cognitive
Emotional
and social-emotional)
Parenting Stress Index (QIC-EC)
Measure change in parenting
stress
Adult-Adolescent Parenting
Measure change in parenting
Inventory (QIC-EC)
and child-rearing attitudes, risk
for child abuse and neglect
Self-Report Family Inventory
Measure change in family
(QIC-EC)
functioning and family cohesion
Social Network Map (QIC-EC)
Measure change in perceived
social support
Caregivers' Assessment of
Measure change in protective
Protective Factors (QIC-EC)
factors
DHS maltreatment data
Measure change in child
maltreatment rates
Schedule
All referrals made by
FHI staff
Year 1
Intake and every 6
mos. thereafter
Intake and every 6
mos. thereafter
Every 6 mos. after
intake
Intake and every 6
mos. thereafter
Intake and every 6
mos. thereafter
Intake and every 6
mos. thereafter
Intake and every 6
mos. thereafter
Intake and every 6
mos. thereafter
Intake and every 6
mos. thereafter
Baseline and end of
Y1, Y2, Y3
subsequent data file for the 2013 fiscal year (anticipated receipt date of June, 2014) are both received, we will
assess change over the entire study period for each of the six study neighborhoods.
92
The target for the home visit study population and comparison group (from whom the client
level outcome measures were collected) was 100 treatment and 100 comparison participants,
distributed among the neighborhoods as shown in Figure 2.
Figure 2. Sample distribution by county and neighborhood.
Data Collection and Management
Following completion of informed consent procedures approved by Western IRB
(www.wirb.com), client level data were collected by a bilingual Research Assistant (BIF, PSI,
AAPI, SRFI, SNM, ASQ-3, ASQ SE) and home visitors (SNM, ASQ-3, ASQ SE) at intake and 6month intervals thereafter. Data were collected in the caregiver’s primary language (English or
Spanish).
Data Analysis and Data Monitoring
Qualitative data from the focus groups and interviews were compiled, synthesized, and
analyzed to discern key findings. Quantitative data collected from the service tracking tools,
surveys, and outcome measures were cleaned and the responses were entered and checked for
accuracy. All quantitative data were analyzed using descriptive statistics such as frequencies,
and when applicable, means.
93
The primary analysis for comparing treatment and comparison neighborhoods was analysis
of covariance, using data collected on each outcome measure at intake as the covariate, and
data collected 12 months post-intake as the dependent variable.
Effect size estimates were also calculated when appropriate. Effect size (ES) is a name given
to a family of indices that measure the magnitude of a treatment effect. Whereas statistical
tests of significance tell us that the likelihood that experimental results differ from chance
expectations, effect-size measurements tell us the relative magnitude of the experimental
treatment.
Sample Size(s) and Estimated Power to Detect Impacts
During the design phase it was anticipated that final enrollment in the program (and by
proxy, the evaluation) would include at least 100 treatment and 100 comparison families over
the three-year implementation period. In order to estimate the effect size of the Fostering
Hope Initiative, a literature search was conducted to identify similar interventions, and several
relevant studies of home visiting programs were found. All effect sizes noted below were
measured using Cohen’s d.
In a randomized, control group study of the effects of the Early Start home visiting program,
Ferguson (2006) obtained effect sizes of 0.26 on severe physical abuse, and 0.22 on punitive
parenting. Armstrong (1999) conducted a randomized, controlled trial of a nurse home visiting
program for at-risk families, and obtained effect sizes of 0.77 on establishing a positive and
healthy home environment, 0.53 on parent responsivity, and 0.44 on symptoms of parental
depression. Olds (2002) also studied a nurse home visiting program and found effect sizes of
0.37 on establishing a positive and healthy home environment, and 0.31 on cognitive
development in children.
Several studies of the effects of home visiting programs on parent outcomes found smaller
effect sizes. These include effects of 0.16 on parent supportiveness during play (Love, 2005),
0.14 on parenting stress (U.S. Department of Health and Human Services, 2002), and 0.18 on
maternal sensitivity (Olds, 2004).
Two studies of the Family Connections Program are also relevant to the Fostering Hope
Initiative. The Family Connections Program is a multifaceted, community-based service
program that works with families to help them meet the basic needs of their children and
reduce the risk of child neglect. Parker (2008) studied the effects of Family Connections on selfsufficiency, and found effect sizes of 0.34 for economic self-sufficiency, 0.17 for social
emotional self-sufficiency, and 0.31 for total self-sufficiency. Another study of the Family
Connections program conducted by Girvin, DePanfilis, and Daining (2007) focused on various
aspects of the quality of the helping relationship between parents and home visitors. Effect
sizes in this study ranged from 0.89 to 1.11, indicating an extremely large effect.
94
Based on caseloads for the five home visitors contributing to the project, a sample size of
100 treatment participants was projected. Adding a matching comparison group of equal size,
we anticipated a total sample size of 200.6
All power analysis calculations described below were conducted using G*Power 3.0 (Faul,
Erdfelder, Lang, and Buchner, 2009). It is suggested by Cohen (1992) that studies should
attempt to obtain a power of at least .80. Because of its similarity to the Family Connections
intervention, the researchers anticipated that the Fostering Hope Initiative would achieve at
least moderate effect sizes (i.e., d = 0.50). Electing to make conservative estimates, however, a
small effect size of 0.25 was projected for the study. Using the parameters detailed above,
calculations indicated that the required total sample size (treatment and comparison groups
combined) was 108. Additional power analyses indicated that a sample size of 108 would also
be adequate for conducting non-parametric analysis of categorical data (e.g., reports of child
abuse or neglect). Using the same parameters discussed above (power = .80, alpha = .05), the
required sample size for detecting an effect size of 0.25 using non-parametric statistical tests
was 155, well below our estimated sample size of 200.
Table 97 below displays the goal and final enrollment in the home visiting component for
each study neighborhood. The final sample (n=135) was sufficiently large to achieve statistical
power for the primary proposed analysis (ANCOVA). The sample fell short, however, for
administration of nonparametric tests.
Table 97
Final Study Enrollment
Neighborhood
Swegle
Washington
Sue Buel
Treatment totals
Hallman
Hoover
Edwards
Comparison totals
TOTAL:
Study
Goal
Final
Study
Total
Hispanic Study
Participant
Total
% Hispanic
Study
Participants
Hispanic % Neighborhood
Overall
40
40
20
100
40
40
20
100
200
28
27
15
70
28
20
17
65
135
19
17
13
49
25
18
10
53
102
67.86%
62.96%
86.67%
70.00%
89.29%
90.00%
58.82%
81.54%
75.56%
43.80%
58.60%
29.10%
N/A
73.00%
74.70%
37.90%
N/A
N/A
2. Problems Encountered in the Implementation of the Evaluation Plan
A total sample of 220 was initially projected for the study. It was determined shortly after the study period
began, however, that the projected sample should be reduced to 200 to accommodate the distribution of home
visitors across the two counties.
6
95
Recruiting was slow during program startup. It also waned during the summer months and
the holiday season. Enrollment was monitored closely and numerous strategies were employed
to increase enrollment, including team canvassing, recruitment from large community events,
and “friend and family” referrals in which the family member making the referral received a $20
gift card for every participant enrolled. Ultimately, however, the study targets were not met.
Additionally, within each study neighborhood, Hispanic representation was expected to
match that of the targeted elementary school. However, most FHI outreach workers and home
visitors responsible for recruiting and enrolling participants were Hispanic, which resulted in
over-enrollment of Latinos in the early months of the project. After adjusting the targets (with
QIC-EC approval) to increase the proportion of Hispanic participants (60% Hispanic, 40% nonHispanic English speakers), Hispanics continued to be overrepresented in the neighborhoods.
The right-most column in Table 97 above displays Hispanic representation in the study
neighborhoods.7 As shown in the table, Hispanic study participant enrollment exceeded that of
all six study neighborhoods. The discrepancy was greatest in the Sue Buel neighborhood. While
this overrepresentation of Hispanic/Latino families was a problem from a research perspective,
it also was a benefit. Since Hispanic/Latino children have lower achievement scores once they
reach school, overrepresentation of those families allowed FHI to learn more about working
with this group.
Data acquisition and sharing also was a challenge. The FHI is a neighborhood-based
intervention and service areas are defined by elementary school boundary lines. Few agencies
collect data at the neighborhood level, FHI collaborative partners included. This made data
sharing and documentation of results more challenging. Specifically, it was not possible to
collect service data from the partners at the neighborhood level, and as such, all results
contained within this report focus on study participants receiving home visiting services whose
data were collected by evaluation research staff and the FHI home visitors, who were all
employed by CCS by the end of the study. Exceptions include service monitoring data collected
for Community Cafes, community dinners, and Parents’ Council meetings.
Obtaining child maltreatment data from the Department of Human Services (DHS) also
proved to be a challenge. At the start of the study an agreement was established with the
Department in which DHS agreed to provide child maltreatment data for each of the six study
neighborhoods. During the study period the Department transitioned to a new data system
(OR-Kids), delaying submission of the requested data. Ultimately the study team received
notice that the transition to the new system had caused errors related to children and their
founded allegations and that DHS would be unable to provide the requested data for an
indeterminate amount of time. The most recent communication from the Department, received
on October 7, 2013, indicated that the requested data for fiscal years 2012 and 2013 were still
unavailable, and that we could expect to receive the files in 2014.
7
Marion County and Edwards Elementary data drawn from http://www.schoolmatters.com/schools on April 25,
2010. Sue Buel data drawn from http://www.msd.k12.or.us/district/fast-facts on April 25, 2010.
96
3. Changes in the Evaluation Plan
The study population shifted to include greater representation of Hispanic families, as
described in previous sections. The distribution of families across the study neighborhoods also
changed. Initially the researchers believed distribution would be equal, but assignment of home
visitors varied in that just one visitor worked in the Sue Buel neighborhood. As such, 40
caregivers were slated for recruitment in the Marion County neighborhoods (Swegle,
Washington, Hallman, and Hoover) whereas 20 caregivers were targeted for inclusion from Sue
Buel and Edwards.
The data collection plan for the site-specific collaboration survey also changed. It was
expected that the collaboration survey of partner agency leadership and staff would be
administered at two time-points during the study. The cross-site team administered a separate
survey collecting similar data (PARTNER survey), and it was determined that the site-specific
collaboration survey constituted duplication of effort and was not re-administered as planned.
Finally, staff focus groups and parent interviews were expected to occur each year of the
study. The evaluation budget became constrained, however, so these activities were only
facilitated by the research team during Year 1. For similar reasons, community safety, housing
quality, and crime rate data were not collected.
F. Cross-Site Evaluation
In addition to the program-level evaluation, the Initiative contributed to the national crosssite evaluation conducted by InSites on behalf of the QIC-EC. Quantitative participant data for
the cross-site evaluation included the following measures: Background Information Form (BIF),
Caregivers’ Assessment of Protective Factors (CAPF), Adult-Adolescent Parenting Inventory
(APPI), Parenting Stress Index (PSI), Self-Report Family Inventory (SRFI), and Social Network Map
(SNM). Data were collected from home visiting participants on the agreed-upon schedule
(intake and subsequent 6-month intervals) and submitted for entry as the forms were
completed. Collaboration partner members also completed the requested PARTNER survey at
two time points.
In addition to the quantitative measures, the evaluation team and key members of the FHI
project staff participated in monthly calls with the InSites cross-site evaluation team members,
describing progress to date toward achieving project milestones.
Each year the cross-site team and representatives from the QIC-EC conducted a two to
three day site visit. All site visit activities were coordinated by the FHI project team. FHI
arranged the site visit agendas to include activities and timelines requested by the cross-site
visitors. Specific agendas varied by year, but included meetings with the then-Chief Justice of
the Oregon Supreme Court, and separately with Yamhill and Marion County partners. In
addition, site visits included meetings with the CCS project team and evaluation team. The final
site visit in April, 2013, included a focus group with caregivers who had received home visiting
97
services, participation at the Community Dinner in the Swegle Neighborhood, and attendance
at a parenting education class.
98
III.
Project Implementation/Program Strategies
A. Project Eligibility, Recruitment, Screening, Intake, Retention, and Termination
Inclusion Criteria
In addition to the enrollment criteria stated previously (children had to be under 24 months
of age at intake and without a substantiated report of abuse/neglect), participants also needed
to be willing to participate in the program and/or evaluation and be characterized as “high-risk”
for abuse/neglect. Because the home visitation component employed the Healthy Start/Healthy
Families America (HS/HF) research-based home visiting model, the New Baby Questionnaire
(NBQ), the tool used by HS/HF, was used to identify high-risk families during the screening
process. Families were identified as high-risk if NBQ responses to items 1, 2, or 3 were present:
1. They report depression
2. They report drinking/drug use issues
3. They have any two or more risk factors in the bulleted list below:
• Mother is 17 years old or younger (teen parent)
• The primary caregiver is unmarried
• Prenatal care began more than 12 weeks into the pregnancy
• Lack of comprehensive prenatal care (less than 5 times)
• Education of the primary caregiver is less than a high school diploma
• Primary caregiver and spouse/partner are unemployed or seasonally employed
• Family experiences trouble paying for basic expenses “some” or “most of” the time
• “Some” or “serious” problems in marital/family relationships
The results of the NBQ screening process are summarized in Table 98 below for all study
participants included in the outcome analyses presented in subsequent sections of this report.
As shown, treatment group participants were more likely to report feeling down, depressed, or
hopeless (87.1%), to be a teen parent (17.4%), for the first prenatal visit to have taken place
after 12 weeks of pregnancy (44.1%), to have difficulty paying for basic expenses “some” or
“most of” the time (98.6%), and to report “some” or “serious” problems in family relationships
(55.7%).
99
Table 98
New Baby Questionnaire Maltreatment Risk Criteria
New Baby Questionnaire
Feeling down, depressed, or hopeless in the past month
Caregiver or partner feel a need to cut down on drinking or drugs
Teen parent
Primary caregiver is unmarried
First prenatal visit after 12 weeks
Less than 5 prenatal visits
Primary caregiver has less than a high school diploma
Primary caregiver and spouse/partner are unemployed or seasonally
employed
Difficulty paying for basic expenses "some" or "most of" the time
"Some" or "serious" problems in family relationships
Treatment
Comparison
(n=70)
87.1%
(n=69)
1.4%
(n=69)
17.4%
(n=70)
48.6%
(n=68)
44.1%
(n=67)
3.0%
(n=69)
55.0%
(n=70)
35.7%
(n=70)
98.6%
(n=70)
55.7%
(n=63)
39.7%
(n=64)
0.0%
(n=65)
3.1%
(n=64)
50.0%
(n=64)
26.6%
(n=64)
9.0%
(n=64)
64.1%
(n=65)
46.2%
(n=64)
90.6%
(n=64)
20.4%
Children for whom there had been a substantiated case of abuse/neglect and children over
24 months of age at intake were excluded from the study per the QIC-EC program expectations.
DHS provided substantiation information for all study participants and those who had an active
case with DHS were not enrolled in the study. Inclusion/exclusion criteria are summarized
below:
Inclusion:
• Child between the ages of birth and 24 months at the time of enrollment
• No substantiated case of child maltreatment on the targeted child for the
program/study
• Screened as “high risk” for abuse/neglect according to HS/HF NBQ criteria
• Willingness to participate in the program/study
• Provision of consent
• English/Spanish language speakers
100
Method of Subject Identification and Recruitment
Recruitment from the treatment and comparison neighborhoods was conducted by the FHI
Program Director, outreach workers, and home visitors. The Program Director facilitated flyer
distribution through the Department of Human Services (to TANF families), collaborative
partner agencies, hospitals, and the elementary schools. Outreach workers identified families
by contacting pregnancy and family resource centers, childcare providers, preschools, and
churches, as well as by posting flyers at high-traffic areas in the targeted neighborhoods (e.g.,
local markets and laundromats). The home visitors recruited program families from the parent
education and support groups they led, in addition to assisting the outreach workers with
neighborhood canvassing and other outreach efforts. FHI staff responsible for recruitment also
made presentations about the Initiative at relevant organizations and service provider
locations, during which FHI staff asked them to inform families about the FHI/research study.
Flyers, information cards and coupons describing the program/study and incentives were
distributed during all of the above activities.
These efforts, as well as other outreach activities to raise awareness of the Initiative in the
neighborhoods, are summarized in the Outreach Data Report developed in September, 2011
that documents all outreach conducted in the first nine months of the project. A copy of the
Fostering Hope Initiative Outreach Data Report is provided in Appendix A.
Study Screening and Intake Data Collection
Families interested in participating in the study were screened in person and by telephone.
The screening process began with administration of the NBQ by a home visitor (treatment
neighborhoods) or a PRE Research Assistant (comparison neighborhoods). In addition to the
NBQ, potential participants were asked to indicate whether they met the additional QIC-EC
criteria (home address within a study neighborhood and parenting a child under 24 months of
age). The researchers and program staff also relied on parent self-report to initially determine
whether a substantiated claim of child abuse/neglect existed for the child; these data were
confirmed by DHS subsequent to enrollment. Those who met the study criteria were enrolled in
FHI (treatment neighborhoods only) and invited to participate in the evaluation (treatment and
comparison neighborhoods). During the in-person intake process that followed, each family
completed IRB-approved consent forms, in addition to participating in collection of all baseline
outcome measures. All data were managed in compliance with HIPAA regulations. Participant
needs were assessed during the first home visit conducted by the participants’ assigned home
visitor with the referral form. The form queried a variety of services and community linkages,
determining which resources the caregiver was already linked to and those that were needed.
Incentives and Retention
Study participants from the comparison neighborhoods received a gift card following each
completed interview ($25, $50, and $75 for the intake, 6-month, and 12-month interviews,
respectively). Study participants who received home visiting services received tangible goods
101
such as books, clothing, and diapers to incentivize their participation. Retention strategies also
included “creative outreach”, the structured retention process defined by the Healthy Families
America evidence-based model (treatment families), and ongoing contact through telephone
and visits to the home, and through distribution of reminder items such as flyers and
refrigerator magnets with study information and incentive reminders (comparison families).
Final retention rates for the study are shown in Table 99.
Table 99
Study Enrollment and Retention Rates
Neighborhood
Goal
Final Enrollment
Final Total with
Attrition
Retention Rate
Swegle
Washington
Sue Buel
Treatment totals
40
40
20
100
40
40
20
100
200
41
39
29
109
33
25
20
78
187
28
27
15
70
28
20
17
65
135
68.3%
69.2%
51.7%
64.2%
84.8%
80.0%
85.0%
83.3%
72.2%
Hallman
Hoover
Edwards
Comparison totals
TOTAL:
 The Referral Process for the Program
FHI has strong connections with many service programs and other potential referral sources
in Marion and Yamhill Counties. In addition, FHI staff met with caseworkers from other
organizations to ensure they were familiar with FHI and how to refer someone for FHI support.
These included: Healthy Start, Exchange Club Parenting Center, Options Counseling, DHS
District 3, neighborhood schools, pregnancy and family resource centers, child care providers,
preschools, and the faith community. To avoid issues with confidentiality, some organizations
gave families information on FHI and asked them to contact FHI directly, i.e., self-refer.
 How Families Who were Eligible for Services Learned about the Program
Families learned about FHI in different ways. These included:
• Flyers that were posted in community locations frequented by families in poverty with
young children, e.g., grocery stores, laundromats, food banks, churches.
• Door-to-door campaigns, in which FHI staff in pairs walked through the neighborhood,
knocking on doors and handing out information. During these campaigns, staff also
interacted with any mothers with infants or very young children whom they met on the
street.
• Caregivers who attended parenting education classes or Community Cafés received
information on the larger FHI project.
• Informational tables on FHI, with FHI staff, at school and neighborhood events.
• Information provided by a case worker from another agency.
102
•
•
By word of mouth from their friends and neighbors.
By attending an event at La Casita, the FHI neighborhood center in the Washington
neighborhood.
The Procedure for Determining Which Protective Factors Were of Priority for Each
Family/Caregiver.
According to the home visitors, attending to families’ basic needs (food, housing, etc.) or
providing “crisis services” (mental health, domestic violence) typically comes first, and as a
result families gain trust in the home visitors and see them as a source of concrete and social
support. Once crisis services and basic needs have been addressed, home visitors reported that
they work with all of the protective factors to some degree, catering services to families’
individualized needs. In both home visiting and parent education, special emphasis is placed on
the “Nurturing and Attachment” protective factor.
 The Process of Seeking, Obtaining, and Using Caregiver or Community Input Regarding
Recruitment and Retention
During the Year 1 telephone interviews, caregivers who received home visits were queried
about study recruitment and retention. When asked how they heard about Fostering Hope,
parent interview respondents were most likely to indicate that they heard about the program
through their child’s school. Parents also learned about the program from a variety of other
sources, listed below.
• Catholic Community Services staff member
• Local health clinic
• Healthy Start
• Department of Human Services
• Church event
• Letter in the mail
• Parenting class
Complete results of the Year 1 parent interviews are contained in the Year 1 Process
Evaluation Report, presented in Appendix A.
When asked to suggest ways to increase awareness of the program in the targeted
communities or increase program enrollment, fliers and mailings were mentioned most often-recruitment strategies already in place. One parent raised a concern over how the program is
presented in the community. She stated, “Honestly I wasn’t even going to go with the program.
One of the volunteers passing out fliers said the purpose of the program was to keep my kids
out of foster care. This really turned me off and I at first said that I was not interested. Then
another lady saw how I was offended so she told me, ‘Let our director call you and she’ll explain
more.’” Other recommendations to increase awareness/enrollment are listed below.
• Face-to-face (neighborhood canvassing, informative meetings, school visits)
• Rely on word-of-mouth/ask parents to tell their friends
103
•
Explain that the program can help people suffering from depression
The majority of parents who accepted services did so to gain information about parenting.
One parent stated, “I was pregnant at the time and I had other children as well, so I wanted to
learn about how to treat the children, how to educate them and how to help them get along
with each other better.” Another shared, “It seemed like a good program to help people
become better mothers.” Other reasons for deciding to participate included:
• General help/help attaining resources
• Depression
When queried about persistence, parents cited the information and assistance provided by
the home visitors most often as their reasons for continuing with the program over time.
Moving out of the neighborhood was mentioned most often as the reason for discontinuing
services. Additionally, one parent who dropped from the program stated, “What happened is
that I simply don’t have time to go to all of the appointments and meetings that they were
scheduling because I have many children and many other things that I have to do. It wasn’t a
problem with the program; I just don’t have enough time.” Parents who missed appointments
or events while enrolled offered the following reasons:
• Work hours
• Lack of transportation
• Illness
• Had a baby
• School
Among those who missed FHI events or appointments, parents suggested holding events at
various times (e.g., during the day, evening, and on the weekend) and providing transportation
assistance to increase access.
In addition to qualitative data collected during the parent interviews, caregivers also
completed a local measure, the Caregivers Repeated Measures Survey, which queried general
satisfaction with the Fostering Hope Initiative home visiting services they had received. At the
six-month and one-year time-points, caregivers were asked to rate a series of items on a 5point scale from one or “strongly disagree” to five or “strongly agree”. Results are presented in
Table 100 below and demonstrate that caregivers were generally satisfied with the services
they received. Mean ratings for all but one item were between agree and strongly agree.
Exceptions included the two items addressing caregivers’ involvement in planning Fostering
Hope services for the future, indicating a desire to be more involved in these activities.
104
Table 100
Caregiver Repeated Measures Survey – Satisfaction
Mean Response
Statement
Six Months
(n=54)
One Year
(n=62)
Fostering Hope staff have the time to see me.
Fostering Hope staff ask for my opinions about my problems and how
to solve them.
Fostering Hope staff are sensitive to my cultural background.
Fostering Hope staff are prepared and organized.
Fostering Hope staff are knowledgeable.
Fostering Hope staff present information in a way that is easy to
understand.
I have used the information presented in Fostering Hope.
My parenting skills have improved because of Fostering Hope.
Fostering Hope is helpful.
I would recommend Fostering Hope to others.
I am involved in planning Fostering Hope programs and services for the
future.
I would like to be more involved in planning Fostering Hope programs
and services for the future.
4.33
4.34
4.31
4.23
4.41
4.37
4.31
4.42
4.31
4.42
4.44
4.47
4.22
4.20
4.43
4.48
4.34
4.19
4.47
4.50
3.24
4.39
3.80
3.81
Data about recruitment and retention also were gathered from home visiting staff and
parent educators during a focus group conducted in year 1. According to respondents, face-toface contact was more successful than flyer/literature distribution for recruitment. With her
office located in the Public Health Department, the home visitor assigned to Yamhill County
recruited numerous Department walk-ins for home visiting. She reported that referrals through
the school often did not qualify for services, and that efforts to obtain referrals from other
agencies such as Head Start or the county mental health center were not successful either.
In Marion County, team canvassing in the targeted neighborhoods met with mixed results.
Apartments generated more screenings than canvassing single or multi-family homes. The
home visiting team also attended large community events such as International Night and the
No Child Left Behind Literacy Conference. Both canvassing and event attendance efforts sought
to access a large number of families in a small area over a short time. When conducting
outreach, home visitors made an effort to bring activities rather than make presentations about
Fostering Hope, which they found to be more effective when engaging potential participants or
partner agencies. Additionally, Marion County established a relationship with the Head Start
Outreach Coordinator who “hand-picked” families for FHI home visiting, a memorandum of
agreement was established with the hospital to screen new births, and mothers were recruited
for services from teen parent programs in the area.
105
According to program staff, challenges that caused clients to drop from the program or miss
out on events or services included transience/moving out of the service area, lack of
transportation (primarily an issue for parent education attendees), and domestic violence and
addictions issues.
 Challenges in Recruiting, Intake, and Maintaining Families in the Project and
Responses to the Challenges
Recruitment was closely monitored throughout the study period and program staff and
project leadership received monthly updates during Participatory Evaluation and Planning (PEP)
meetings. PEP is a real-time, issue-focused data sharing partnership that supports
implementation and facilitates outcome achievement. PEP combines participatory, utilizationfocused evaluation methods with the Shewhart Cycle, a process for continuous quality
improvement, to monitor implementation and progress toward program outcomes. An
example of a graph developed to monitor enrollment is presented in Figure 3. As shown in the
graph, in May of 2011, projected enrollment generated from an average of enrollment from
previous months indicated that the study would not achieve its enrollment target for the
neighborhood shown. Similar graphs were created for each neighborhood and the
Implementation Team brainstormed strategies to improve enrollment rates. At subsequent
meetings, the results of the strategies employed were discussed and new ideas generated. The
process produced gains in enrollment rates, in addition to providing staff with regular
opportunities to collectively discuss project data.
40
36.
60
Number of participants
35
30
28.20
23.80
25
Target, accounting for
attrition (30% added)
Target, simple value
20
15
10
13
Actual, enrolled and
maintained
Projected, enrolled and
maintained
5
0
Figure 3. Study enrollment/retention monitoring example from the Washington neighborhood.
106
 The Process for Termination of Services to Project Participants and Providing Them
with Linkages to Community Resources at Termination
FHI home visitors did not terminate any project participants who had an interest in
continuing with the program, except at the end of project funding, in March 2013. While the
frequency and intensity of services decreased over time with families, as they built protective
factors and exhibited greater skills at managing parenting, families were not asked to leave the
program. Most terminations were due to the family leaving—moving out of the neighborhood
or deciding to end their participation. However, in March, 2013, with the end of project funding
for direct services, home visitors took several steps to smooth the transition for families served
by FHI:
• Gave families information at least several weeks prior to the end of service that the
project was ending and that they would no longer receive home visits after the end of
March.
• Reminded families that they had been told from the beginning that the program would
be time-limited.
• Connected families with other resources to ensure that they had other strategies and
supports available to help them.
• Distributed the remaining “tangible goods” (e.g., diapers, books) to families.
• Invited families to participate in a focus group with the cross-site evaluation team as a
way of debriefing their involvement with the project.
• Held a formal “graduation ceremony” to celebrate the accomplishments of the families
during their participation with FHI.
B. Major Strategies Implemented/Services Provided as Part of the Intervention
A total of 70 caregivers received at least 12 months of home visiting services under the
auspices of the initiative. Table 101 summarizes the number of home visits that participants
received. Specifically, the table presents the minimum, maximum, and average (mean) number
of home visits that participants received during the first six months of service, the second six
months of service, and for the first year. The right-most column displays the average number of
home visits received monthly. According to the Healthy Families America model, participants
typically receive weekly home visits during the first six months of service and bi-monthly visits
during the second six months of service. As shown, visitors were not successful in scheduling 4
visits per month during the first six months of service, averaging 2.65 visits per month. Home
visits decreased during the second six months of service (in accordance with the model). On
average, participants received two visits per month during the second six months of service.
Collectively, the 70 treatment neighborhood participants who completed at least 12 months of
service received 582 home visits during their first year of participation in the Initiative.
Table 101
Home Visit Summary
Time
1-6 Months
Minimum
Maximum
Mean
Monthly Average
5
24
15.89
2.65
107
7-12 Months
Year 1
5
12
19
40
12.44
28.33
2.07
2.36
Caregivers receiving home visiting from a Fostering Hope Initiative home visitor were
encouraged to participate in other services provided in their neighborhoods. With a follow-up
survey, caregivers in the treatment group were asked to report on the programs and services in
which they had participated. As shown in Table 102, among the 49 caregivers who responded,
most indicated that they had not attended a parenting education class while enrolled in home
visiting (65.3%). Additionally, one participant reported receiving home visiting services and
another received therapeutic classroom services for his/her child through Family Building
Blocks (FBB), a Fostering Hope partner (data not tabled).
Table 102
Participation in Parenting Classes
Parenting Class
% Yes (n=49)
Make Parenting a Pleasure
24.5%
Parenting with Love and Logic
8.2%
Incredible Years
10.2%
Strengthening Families
4.1%
None
65.3%
In addition to the caregivers
receiving home visiting, Parent Council
meetings, Community Cafes, and
community dinners also were tracked.
Data for these parent involvement and
neighborhood engagement strategies
are summarized in Table 103 Results
display the number of meetings or events and the overall attendance for the study period
running from October, 2010-March, 2013.
It should be noted that 12 home visiting recipients indicated that they had attended at least
one Community Café in their neighborhood. Specifically, respondents reported attending
between two and 15 cafes, with an average of seven cafes attended by the respondents who
were able to recall this information. In addition, 13 home visiting recipients attended at least
one community dinner. Caregivers who attended the dinners reported attending six dinners, on
average.
Table 103
Activity Summary Data
Activity
Parent Council Meetings
Washington Neighborhood Community Cafes
Swegle Neighborhood Community Cafes
Swegle Neighborhood Community Dinners
Number of
Meetings
Number Attending
(Duplicated Count)
20
28
22
63
102
151
237
12,856
Fostering Hope Initiative used a variety of service strategies (See Table 104). Basic to each
treatment neighborhood were home visiting, parenting education, and Community Cafés.
Additional strategies, such as a community dinner (Swegle), an FHI Neighborhood Center (La
108
Casita, in Washington), emerged in individual neighborhoods and then were supported by FHI
partners. None of these services were provided by the Fostering Hope Initiative in the
comparison neighborhoods. However, other programs, such as Healthy Start~Healthy Families
and Family Support and Connections held contracts that funded services provided throughout
each county, and therefore could have included services within the comparison neighborhoods.
No FHI-sponsored neighborhood mobilization activities occurred in the comparison
neighborhoods.
Table 104
Summary of FHI Service Strategies
Strategy and
Leaders
Home
Visiting:
Healthy Starttrained home
visitors
Dosage/
Duration
1 Hour visits
based on skill
level:
Level 1: Weekly
Level 2: Twice
monthly
Level 3: Monthly
Parenting
Education
Classes:
Certified
parent
educators
Community
Cafés: Parent
educators
and
neighborhood
residents
Approx. 1.5
hours/class;
8-12 weeks
varied with
curriculum
La Casita—
the FHI
Neighborhood
Centera:
Salem
Once monthly
for about 2
hours
“La Casita”
emerged in one
neighborhood
out of local
relationships.
Open for use
Challenges/Barriers
− Fears due to immigration
status
− Partner resistance
− Mobility of families
− Difficulty contacting families
− Gaining family trust
− Finding and enrolling eligible
families
− Families finding time in their
busy schedules
− Inconsistent attendance
− Recruiting other families who
were not receiving home
visiting service
− Recruiting ongoing parent
leaders for Cafés
− Parent educators needing to
fill gaps when parent leaders
can’t do it
− Deciding to stay together or
split when a group gets large
− Parent educators “stepping
back” as leaders emerge from
the group
− Coordinating the various
events and organizations
using the house
− Ensuring that maintenance is
shared
− Providing volunteer support
109
Lessons Learned
− Address concrete needs first
− Address the issues the
caregiver presents
− Be a consistent nonjudgmental listener and
supporter
− Be patient waiting for trust to
develop
− Classes held after a weekly
Community Dinner
encouraged participation
− Use tangible goods incentives
− Provide on-site child care
− Recruit through classes and
home visiting
− Use as a way to help groups
stay together after the end of
a parenting class
− Serve food
− Provide resource lists for
tangible goods and/or
distribute goods at meetings
− Plan dates and topics 2-3
months in advance to allow
families to plan ahead
− Provide on-site child care
− Use a single coordinator for
scheduling
− Post the monthly schedule in
the house
− Hold regular “management”
meetings of leaders to ensure
Strategy and
Leaders
Leadership
Foundation &
Mano a
Mano
Dosage/
Duration
most days,
some evenings.
Community
Dinnersa:
Salem
Leadership
Foundation,
Christian
Center of
Salem, and
Marion/Polk
Food Share
Weekly dinners
during fall,
winter and
spring, except
for holiday
times
Neighbor
Connectorsa:
CCS
(Funded
through
other
sources)
Neighbor
Connectors get
to know the
neighborhood
and its residents
and help to
connect them
with other
neighbors and
needed
resources
a
Challenges/Barriers
Lessons Learned
to keep house open and
available to neighbors
− Obtaining needed resources,
e.g., internet connection and
computer for family use,
books for lending library
activities and plans are
coordinated
− Encourage neighborhood
ownership at all levels,
including picking up and
cleaning after use of the house
− Invite community groups to
offer events or services there
− Sponsor “clubs”
− Hold coffee clubs the morning
after a community event (e.g.,
after Parent-Teacher
meetings)
− Invite community schools to
help furnish, paint, decorate,
or make signage for house
− Look for cooperative
opportunities with neighbors
− Listen to what the children
and parents say they want to
do
− Community dinners emerged
from one neighborhood’s
interest and would not be
appropriate to “force” if there
is not sufficient interest and
major players (site,
coordinator, chef, food share)
willing to invest in it
− Finding a chef who will
volunteer time to plan and
cook the meals
− Developing menus based on
what is available from the
Food Share
− Having sufficient volunteers
to help with serving and
clean-up
− Coordinating the various
players
− Finding people who get to
− May need a strategy for hiring
know people easily
individuals from
neighborhoods who may not
− Finding people who live in the
meet the typical profile for
neighborhood and already
hiring (e.g., drug use, criminal
know many neighborhood
record)
residents
− Use multiple methods to find
− Finding people who meet
potential candidates, including
other requirements and also
radio commercials, and
are bilingual
recruitment in the Latino
(Spanish/English)
newspaper
Strategy was new or changed during the course of the project
110
C. Approach to Program (Model) Fidelity
FHI used the evidence-based model, Healthy Families America, for home visiting, with two
modifications: the infant or pregnancy did not have to be the first-birth for the family, and the
target child could be as old as 24 months at the start of service (HFA requires service begin
within 3 months of birth). The home visitors also used the Parents as Teachers evidence-based
curriculum during their home visits. FHI Home Visitors received supervision from a qualified
HFA supervisor, for the required amount of time each week (i.e., 1.5-2 hours of reflective
supervision each week for staff working 20 hours or more per week; 1 hour per week for staff
working less than 20 hours per week). In these sessions, the supervisor reviewed progress on
cases, case plans, issues and next steps at each meeting—coaching and providing feedback on
strength-based approaches and interventions. The supervisor supported accountability by
discussing home visit completion rates, as well as family retention, and attrition.
In addition, the supervisor accompanied the FHI Home Visitor on selected home visits, to
check fidelity and to ensure that the supervisor was known to the family, in the event the
supervisor needed to fill in for the home visitor due to sickness, or other reason for absence.
For additional information on supervision in Healthy Start~Healthy Families, go to:
umchsresources/administration/pandp/Healthy_Start/HS4_Healthy%20Start%20for%20Supervi
sors%20&20Managers/Oregons_Healthy_Start_PM_Sup_Reference_Guide.pdf. This UmatillaMorrow county site has excellent information related to the model.
The parenting education classes used evidence-based curricula. Some of the classes were
taught with a pair of certified parent educators, who could give feedback to each other. Class
series were evaluated by participants, including whether they felt they had learned helpful
information. No other strategies to assess fidelity were used with the parenting education
classes.
Community Cafés used the facilitation process developed and disseminated by the National
Alliance of Children’s Trust and Prevention Funds (http://ctfalliance.org/initiative_parents2.htm). No assessment of fidelity was completed for Community Cafés.
Other FHI strategies emerged from the interests of families in service, other neighborhood
families and/or from the involvement of partner organizations.
C. Use of a Protective Factors Approach
Jim Seymour, CCS’ Executive Director, embraced the Strengthening Families Protective
Factors Framework™ early on in the project. As a result, at every Initiative meeting and event,
the Framework was explicitly addressed. Additionally, Dr. Charlyn Harper Browne was invited to
speak at each Fostering Hope: Closing the Gap Summit, presenting the Framework in detail. As a
result of this leadership, the partner agencies and project staff engaged directly with the
111
Protective Factors, which shaped their attitudes and practices related to improving child and
family wellbeing. The broader community engaged in the Initiative also is now well-versed in
the Framework.
112
IV.
Project Outcome Evaluation
Analysis Approach
All outcome evaluation measures were administered to study participants at baseline and at
six-months and 12-months post-baseline. Qualitative data collected from Fostering Hope home
visitors indicated that for many families participating in the Fostering Hope program,
relationship and rapport-building takes approximately six months. Hence, while data collected
at the 6-month time point was used during the course of the project for formative purposes
and to examine early outcomes, the primary analyses in the outcome evaluation involve
comparisons of outcomes for the treatment and comparison groups at the 12-month time
point.
While study participants in the treatment and comparison neighborhoods were very similar
in most respects, there were slight differences between groups on some demographic variables
(e.g., ethnicity, maltreatment risk indicators). In addition, analysis of outcome data at baseline
revealed differences between the treatment and comparison groups on several measures:
• The Parental Stress Index Total Stress Domain: t(117) = 2.51, p = .013.
• The Parental Stress Index Parent Domain: t(116) = 2.09, p = .039.
• The Self-Report Family Inventory Conflict Scale: t(134) = 2.32, p = .022.
• The Caregivers Assessment of Protective Factors Resilience 1 Scale: t(133) = 1.97, p =
.051.
To account for these differences at baseline, analysis of covariance (ANCOVA) was selected
as the primary statistical test for the outcome evaluation. Specifically, for each outcome
measure, baseline scores were entered as a covariate, with 12-month scores as the dependent
variable. Overall results are reported for each measure, as are noteworthy findings for
subgroups of interest. Effect size, partial eta squared (η2p), is presented for selected results.
A. Increased Likelihood of Optimal Child Development: Findings
Competence Subscale on the PSI
High scores on the Competence subscale may be produced by a number of factors. For
example, it is expected that young parents of an only child will earn somewhat higher scores
than multiparous parents. Parents who are lacking in practical child development knowledge or
who possess a limited range of child management skills will also earn high scores. Finally, high
scores will be found among parents who do not find the role of parent as reinforcing as they
had expected. These parents are often overwhelmed by the feeling that “this child is more than
I bargained for” and “I am not sure I would have children if I had it do over again” (Parenting
Stress Index Third Edition Professional Manual, p.10). Analysis of covariance (ANCOVA)
comparing results for all treatment and comparison participants generated a statistically
significant result (p=.035) but the effect size was not noteworthy (η2p = .038).
113
•
PSI Competence Subscale: F(1, 116) = 4.55, p = .035; η2p = .038
To further explore the data, the same analyses were conducted for Marion County
neighborhoods only:
• PSI Competence Subscale: F(1, 89) = 7.22, p = .009; η2p = .075
Results were also conducted for Hispanic participants only:
• PSI Competence Subscale: F(1, 87) = 6.52, p = .012; η2p = .070
Finally, ANCOVAs were conducted for Hispanic participants in Marion County:
• PSI Competence Subscale: F(1, 66) = 6.72, p = .012; η2p = .092
The results of these subgroup analyses indicate that the Fostering Hope Initiative may have
had a greater impact, at least in terms of caregivers’ sense of competence, in Marion County.
The FHI also appears to have been more effective among Hispanic participants, and particularly
among Hispanic participants residing in the two Marion County neighborhoods. For this latter
analysis, sample sizes were quite small (n = 31 in the treatment group and 38 in the comparison
group), but yielded somewhat noteworthy effect sizes (η2p = .070-.092).
Group mean scores at baseline and 12-months for the PSI Competence subscale are
presented in the table below. Reductions in scores over time represent an improvement in
ones’ sense of competence.
Table 105
PSI Subscale Means at Baseline and 12-months
PSI Sense of
Competence
Baseline
12-months
Overall
Marion County
Hispanic
Participants
Marion County
Hispanic
Participants
Tx.
(n=59)
Comp.
(n=60)
Tx.
(n=47)
Comp.
(n=45)
Tx.
(n=42)
Comp.
(n=48)
Tx.
(n=31)
Comp.
(n=38)
33.02
31.71
30.81
32.63
33.07
31.21
30.07
32.51
32.72
31.73
31.01
33.23
32.56
31.25
30.77
33.05
Note. Tx = Treatment; Comp. = Comparison.
Adult Adolescent Parenting Inventory (AAPI)
The AAPI measures five constructs regarding parenting and child-rearing attitudes. These
constructs provide an index of risk for behaviors related to child abuse and neglect. Results of
ANCOVAs conducted on each of these constructs are presented below. It should be noted that
AAPI raw scores were converted to STEN scores for analysis and reporting.
• Construct A - Expectations of Children: F(1, 132) = 3.93, p = .049; η2p = .029
• Construct B - Empathy Towards Children's Needs: F(1, 132) = 2.50, p = .116
• Construct C - Use of Corporal Punishment as a Means of Discipline: F(1, 132) = 0.22, p =
.643
114
• Construct D - Parent-Child Role Responsibilities: F(1, 132) = 1.03, p = .311
• Construct E - Children's Power and Independence: F(1, 132) = 0.18, p = .668
Only the ANCOVA conducted on Construct A, measuring expectations of children, yielded
statistically significant results, with the treatment group showing a slightly larger improvement
over time than the comparison group. The associated effect size of .029, however, is quite
small indicating that the effect may not be particularly meaningful.
Additional ANCOVAs conducted with subgroups (Marion County only, Hispanic participants,
Marion County Hispanic participants) yielded a virtually identical pattern of results. Specifically,
only results for Construct A reached or approached statistical significance. ANCOVAs for
Construct A are presented below for these subgroups.
• Marion County, AAPI Construct A: F(1, 101) = 3.52, p = .064; η2p = .034
• Hispanic Participants, AAPI Construct A: F(1, 99) = 4.05, p = .047; η2p = .039
• Marion County Hispanic Participants, AAPI Construct A: F(1, 75)= 3.50, p = .065; η2p = .045
Overall, analysis of data from the AAPI suggests that treatment group participants showed
improvement, relative to comparison group participants, in terms of having more appropriate
expectations of their children. This finding appears to be consistent across subgroups.
Group mean scores at baseline and 12-months for all AAPI subscales are presented in the
table below. Increases in scores over time represent improvement in parenting and childrearing attitudes.
Table 106
AAPI Scale Means at Baseline and 12-months
Overall
AAPI Construct A
Baseline
12-months
AAPI Construct B
Baseline
12-months
AAPI Construct C
Baseline
12-months
AAPI Construct D
Baseline
12-months
AAPI Construct E
Marion County
Hispanic
Participants
Marion County
Hispanic
Participants
Tx.
(n=70)
Comp.
(n=65)
Tx.
(n=55)
Comp.
(n=49)
Tx.
(n=50)
Comp.
(n=52)
Tx.
(n=36)
Comp.
(n=42)
4.96
5.79
4.60
5.06
4.82
5.69
4.53
4.94
4.74
5.78
4.37
4.94
4.53
5.67
4.36
4.88
3.50
4.24
3.06
3.51
3.33
4.27
2.63
3.33
3.30
4.14
2.50
3.04
3.03
4.14
2.31
3.07
5.24
5.04
5.20
4.92
5.15
5.05
5.18
4.80
5.14
4.98
4.90
4.62
5.00
4.97
5.00
4.67
4.66
5.31
4.25
4.72
4.36
5.05
3.86
4.53
4.64
5.14
3.73
4.31
4.22
4.72
3.67
4.36
115
Baseline
12-months
5.51
5.43
4.91
4.98
5.31
5.42
4.57
4.67
5.44
5.20
4.37
4.38
5.19
5.17
4.29
4.36
B. Increased Family Strengths: Findings
Self-Report Family Inventory
The Self-Report Family Inventory is intended to assess an individual’s perception of his/her
family’s functioning. Subscales include Health/Competence, Conflict, Cohesion, Expressiveness,
and Leadership. It was determined by QIC-EC leadership and the cross-site evaluation team
that the Leadership subscale would not be used in this evaluation. Results of ANCOVAs
conducted on each of the four remaining scales are presented below.
• SRFI Health/Competence: F(1, 133) = 0.40, p = .529
• SRFI Conflict: F(1, 133) = 0.78, p = .379
• SRFI Cohesion: F(1, 133) = 0.03, p = .867
• SRFI Expressiveness: F(1, 133) = 3.66, p = .058; η2p = .027
Only the ANCOVA conducted on the Expressiveness subscale approached statistical
significance, with the treatment group showing slightly more improvement over time than the
comparison group. The effect size of .027 for this result is quite small, however, indicating that
the effect may not be particularly meaningful.
Additional ANCOVAs conducted with subgroups of interest (Marion County only, Hispanic
participants, Marion County Hispanic participants) did not yield any results approaching
statistical significance. The results of these analyses are listed below for the Expressiveness
subscale only:
• Marion County, SRFI Expressiveness: F(1, 102) = 2.23, p = .138; η2p = .021
• Hispanic Participants, SRFI Expressiveness: F(1, 100) = 2.08, p = .152; η2p = .020
• Marion County Hispanic Participants, SRFI Expressiveness: F(1, 76) = 0.67, p = .417; η2p =
.009
Overall, results from the SRFI suggest that treatment group participants improved slightly
relative to comparison group participants on the Expressiveness subscale. The magnitude of
this group difference, as measured its effect size, is not particularly noteworthy. Scale mean
scores for the entire sample are presented in the table below. It should be noted that on the
SRFI, decreases in scores over time indicate improvement.
116
Table 107
SRFI Scale Means at Baseline and 12-months
Overall Scale Scores
Treatment
(n=70)
Comparison
(n=66)
59.44
59.11
59.97
59.91
35.77
37.20
37.53
37.33
14.77
14.83
14.61
14.74
15.84
15.61
16.53
16.42
SRFI Health/Competence (Max = 90)
Baseline
12-months
SRFI Conflict (Max = 60)
Baseline
12-months
SRFI Cohesion (Max = 25)
Baseline
12-months
SRFI Expressiveness (Max = 25)
Baseline
12-months
Background Information Form, Items 18 and 19 - Safety
Tables 108 - 125 below present data about home safety knowledge and practices, as well as
respondents’ use of emergency numbers. As shown below, responses for both the treatment
and comparison participants increased for most of the items queried. Exceptions included
receipt of CPR training, which demonstrated a small decrease from intake to one year. Similarly,
rates of emergency calls also decreased.
117
Table 108
Safety Statements – Overall - % True
Safety (% True)
Overall
Study Group
Treatment
Intake
One Year
(n=70)
(n=70)
Comparison
Intake
One Year
(n=65)
(n=65)
I have a first-aid kit at home
I have received first-aid training
I have received CPR training
I know how to do CPR on infants and young children
I have the poison control center telephone number
in my cell phone or by a phone at home
I have other emergency numbers in my cell phone or
by a phone at home
50.0%
41.4%
45.7%
38.6%
34.3%
64.3%
44.3%
44.3%
45.7%
54.3%
35.4%
40.0%
41.5%
33.8%
35.4%
63.1%
43.1%
36.9%
44.6%
60.0%
65.7%
80.0%
61.5%
72.3%
I have had to call poison control, 911 or another
emergency number in the past 12 months
18.6%
14.3%
10.8%
7.7%
Time-point
Table 109
Safety Statements – Marion County - % True
Safety (% True)
Marion County
Study Group
Treatment
Intake
One Year
(n=55)
(n=55)
Comparison
Intake
One Year
(n=49)
(n=49)
I have a first-aid kit at home
I have received first-aid training
I have received CPR training
I know how to do CPR on infants and young children
I have the poison control center telephone number
in my cell phone or by a phone at home
50.9%
40.0%
45.5%
36.4%
40.0%
63.6%
41.8%
43.6%
43.6%
50.9%
30.6%
36.7%
40.8%
32.7%
28.6%
59.2%
40.8%
36.7%
44.9%
59.2%
I have other emergency numbers in my cell phone or
by a phone at home
63.6%
81.8%
55.1%
67.3%
I have had to call poison control, 911 or another
emergency number in the past 12 months
16.4%
14.5%
10.2%
4.1%
Time-point
118
Table 110
Safety Statements – Yamhill County - % True
Safety (% True)
Yamhill County
Study Group
Time-point
I have a first-aid kit at home
I have received first-aid training
I have received CPR training
I know how to do CPR on infants and young
children
I have the poison control center telephone
number in my cell phone or by a phone at home
I have other emergency numbers in my cell phone
or by a phone at home
I have had to call poison control, 911 or another
emergency number in the past 12 months
Treatment
Intake
One Year
(n=15)
(n=15)
Comparison
Intake
One Year
(n=16)
(n=16)
46.7%
46.7%
40.0%
40.0%
66.7%
46.7%
40.0%
46.7%
50.0%
50.0%
50.0%
43.8%
75.0%
56.3%
43.8%
50.0%
20.0%
66.7%
50.0%
62.5%
73.3%
73.3%
81.3%
87.5%
20.0%
13.3%
18.8%
18.8%
Table 111
Safety Statements – Washington Treatment Neighborhood (Marion Co.) - % True
Safety (% True)
Washington
Time-point
I have a first-aid kit at home
I have received first-aid training
I have received CPR training
I know how to do CPR on infants and young children
I have the poison control center telephone number in my cell phone or by a
phone at home
I have other emergency numbers in my cell phone or by a phone at home
I have had to call poison control, 911 or another emergency number in the
past 12 months
119
Intake
(n=27)
One Year
(n=27)
51.9%
48.1%
59.3%
55.6%
44.4%
70.4%
51.9%
51.9%
48.1%
51.9%
70.4%
92.6%
18.5%
7.4%
Table 112
Safety Statements – Swegle Treatment Neighborhood (Marion Co.) - % True
Safety (% True)
Swegle
Intake
(n=28)
One Year
(n=28)
I have a first-aid kit at home
I have received first-aid training
I have received CPR training
I know how to do CPR on infants and young children
I have the poison control center telephone number in my cell phone or by a
phone at home
50.0%
32.1%
32.1%
17.9%
35.7%
57.1%
32.1%
35.7%
39.3%
50.0%
I have other emergency numbers in my cell phone or by a phone at home
57.1%
71.4%
I have had to call poison control, 911 or another emergency number in the
past 12 months
14.3%
21.4%
Time-point
Table 113
Safety Statements – Hallman Comparison Neighborhood (Marion Co.) - % True
Safety (% True)
Hallman
Time-point
I have a first-aid kit at home
I have received first-aid training
I have received CPR training
I know how to do CPR on infants and young children
I have the poison control center telephone number in my cell phone or by a
phone at home
I have other emergency numbers in my cell phone or by a phone at home
I have had to call poison control, 911 or another emergency number in the
past 12 months
Intake
(n=29)
One Year
(n=29)
37.9%
44.8%
48.3%
37.9%
27.6%
58.6%
44.8%
37.9%
48.3%
58.6%
58.6%
13.8%
69.0%
3.4%
Table 114
Safety Statements – Hoover Comparison Neighborhood (Marion Co.) - % True
Safety (% True)
Hoover
Time-point
I have a first-aid kit at home
I have received first-aid training
I have received CPR training
I know how to do CPR on infants and young children
I have the poison control center telephone number in my cell phone or by a
phone at home
120
Intake
(n=20)
One Year
(n=20)
20.0%
25.0%
30.0%
25.0%
30.0%
60.0%
35.0%
35.0%
40.0%
60.0%
I have other emergency numbers in my cell phone or by a phone at home
I have had to call poison control, 911 or another emergency number in the
past 12 months
50.0%
65.0%
5.0%
5.0%
Table 115
Safety Statements – Sue Buel Treatment Neighborhood (Yamhill Co.) - % True
Safety (% True)
Sue Buel
Time-point
I have a first-aid kit at home
I have received first-aid training
I have received CPR training
I know how to do CPR on infants and young children
I have the poison control center telephone number in my cell phone or by a
phone at home
I have other emergency numbers in my cell phone or by a phone at home
I have had to call poison control, 911 or another emergency number in the
past 12 months
Intake
(n=15)
One Year
(n=15)
46.7%
46.7%
40.0%
40.0%
20.0%
66.7%
46.7%
40.0%
46.7%
66.7%
73.3%
20.0%
73.3%
13.3%
Table 116
Safety Statements – Edwards Comparison Neighborhood (Yamhill Co.) - % True
Safety (% True)
Edwards
Time-point
I have a first-aid kit at home
I have received first-aid training
I have received CPR training
I know how to do CPR on infants and young children
I have the poison control center telephone number in my cell phone or by a
phone at home
I have other emergency numbers in my cell phone or by a phone at home
I have had to call poison control, 911 or another emergency number in the
past 12 months
121
Intake
(n=16)
One Year
(n=16)
50.0%
50.0%
50.0%
43.8%
50.0%
75.0%
56.3%
43.8%
50.0%
62.5%
81.3%
18.8%
87.5%
18.8%
Table 117
Child Safety Statements – Overall – Mean Response (1=All of the time; 2=Most of the time;
3=Some of the time; 4=None of the time)
Child Safety (Mean Response)
Overall
Study Group
Treatment
Intake
One Year
(n=68-70)
(n=70)
Time-point
Comparison
Intake One Year
(n=65)
(n=65)
I use a safety seat or seat belt for my child when
riding in the car
1.04
1.01
1.00
1.02
I keep medicines in childproof bottles
I keep medicines out of children's reach
1.14
1.11
1.11
1.04
1.23
1.06
1.08
1.08
I have at least one working smoke detector in my
house
1.29
1.04
1.12
1.00
I regularly change the battery in my smoke detector
I keep cleaning materials out of reach of my child
I keep cleaning materials in locked cabinets
1.56
1.41
1.48
1.23
1.29
2.37
1.16
1.93
1.20
1.77
1.11
1.63
I keep matches and cigarette lighters out of my
child's reach
1.09
1.13
1.02
1.08
I supervise my child when he or she is in the bathtub
1.09
1.04
1.02
1.00
122
Caregivers also reported on their rates of employing various child safety practices on a
4-point Likert scale ranging from 1, or “all of the time”, to 4, or “none of the time”. Mean
responses are displayed in the tables below. For all the safety practices addressed in this
portion of the survey, respondents in the treatment and comparison neighborhoods indicated
employing the behaviors “all of the time”, on average. The only exception was with regard to
keeping cleaning materials in locked cabinets. Both groups were most apt to indicate doing so
“most of the time” 8.
Table 118
Child Safety Statements – Marion County - Mean Response (1=All of the time; 2=Most of the
time; 3=Some of the time; 4=None of the time)
Child Safety (Mean Response)
Marion County
Study Group
Treatment
Comparison
Intake
(n=53-55)
One Year
(n=55)
Intake
(n=49)
One Year
(n=49)
I use a safety seat or seat belt for my child when
riding in the car
1.06
1.02
1.00
1.02
I keep medicines in childproof bottles
I keep medicines out of children's reach
1.16
1.07
1.31
1.13
1.05
1.04
1.29
1.06
1.10
1.10
1.08
1.00
1.60
1.27
1.44
1.09
1.49
1.20
1.20
1.12
I keep cleaning materials in locked cabinets
I keep matches and cigarette lighters out of my
child's reach
2.44
1.06
1.84
1.11
1.94
1.02
1.80
1.06
I supervise my child when he or she is in the bathtub
1.11
1.00
1.02
1.00
Time-point
I have at least one working smoke detector in my
house
I regularly change the battery in my smoke detector
I keep cleaning materials out of reach of my child
Table 119
Child Safety Statements – Yamhill County - Mean Response (1=All of the time; 2=Most of the
time; 3=Some of the time; 4=None of the time)
Child Safety (Mean Response)
Yamhill County
Study Group
Treatment
Intake
One Year
(n=15)
(n=15)
Time-point
8
Comparison
Intake One Year
(n=16)
(n=16)
I use a safety seat or seat belt for my child when
riding in the car
1.00
1.00
1.00
1.00
I keep medicines in childproof bottles
I keep medicines out of children's reach
1.07
1.27
1.07
1.00
1.06
1.06
1.00
1.06
Child safety items were analyzed with ANCOVA. None of the items generated statistically significant results.
123
I have at least one working smoke detector in my
house
I regularly change the battery in my smoke detector
I keep cleaning materials out of reach of my child
I keep cleaning materials in locked cabinets
I keep matches and cigarette lighters out of my
child's reach
I supervise my child when he or she is in the bathtub
1.20
1.07
1.19
1.00
1.40
1.33
1.93
1.20
1.33
1.40
2.27
1.27
1.44
1.19
1.44
1.00
1.31
1.06
1.13
1.06
1.00
1.20
1.00
1.00
Table 120
Child Safety Statements – Washington Treatment Neighborhood (Marion Co.) - Mean Response
(1=All of the time; 2=Most of the time; 3=Some of the time; 4=None of the time)
Child Safety (Mean Response)
Washington
Time-point
I use a safety seat or seat belt for my child when riding in the car
I keep medicines in childproof bottles
I keep medicines out of children's reach
I have at least one working smoke detector in my house
I regularly change the battery in my smoke detector
I keep cleaning materials out of reach of my child
I keep cleaning materials in locked cabinets
I keep matches and cigarette lighters out of my child's reach
I supervise my child when he or she is in the bathtub
Intake
(n=26-27)
One Year
(n=27)
1.00
1.04
1.04
1.00
1.26
1.30
1.89
1.04
1.04
1.00
1.04
1.00
1.22
1.04
1.44
1.19
1.04
1.00
Table 121
Child Safety Statements – Swegle Treatment Neighborhood (Marion Co.) - Mean Response
(1=All of the time; 2=Most of the time; 3=Some of the time; 4=None of the time)
Child Safety (Mean Response)
Swegle
Intake
(n=27-28)
1.11
One Year
(n=28)
1.00
I keep medicines in childproof bottles
I keep medicines out of children's reach
I have at least one working smoke detector in my house
I regularly change the battery in my smoke detector
I keep cleaning materials out of reach of my child
I keep cleaning materials in locked cabinets
I keep matches and cigarette lighters out of my child's reach
1.29
1.11
1.61
1.93
1.25
2.96
1.07
1.25
1.07
1.07
1.64
1.14
2.21
1.04
I supervise my child when he or she is in the bathtub
1.19
1.00
Time-point
I use a safety seat or seat belt for my child when riding in the car
124
Table 122
Child Safety Statements – Hallman Comparison Neighborhood (Marion Co.) - Mean Response
(1=All of the time; 2=Most of the time; 3=Some of the time; 4=None of the time)
Child Safety (Mean Response)
Hallman
Intake
(n=29)
One Year
(n=29)
I use a safety seat or seat belt for my child when riding in the car
1.00
1.00
I keep medicines in childproof bottles
I keep medicines out of children's reach
1.10
1.07
1.17
1.10
1.14
1.00
1.45
1.14
1.14
1.14
1.72
1.00
1.62
1.10
1.00
1.00
Time-point
I have at least one working smoke detector in my house
I regularly change the battery in my smoke detector
I keep cleaning materials out of reach of my child
I keep cleaning materials in locked cabinets
I keep matches and cigarette lighters out of my child's reach
I supervise my child when he or she is in the bathtub
Table 123
Child Safety Statements – Hoover Comparison Neighborhood (Marion Co.) - Mean Response
(1=All of the time; 2=Most of the time; 3=Some of the time; 4=None of the time)
Child Safety (Mean Response)
Hoover
Time-point
I use a safety seat or seat belt for my child when riding in the car
I keep medicines in childproof bottles
I keep medicines out of children's reach
I have at least one working smoke detector in my house
I regularly change the battery in my smoke detector.
I keep cleaning materials out of reach of my child
I keep cleaning materials in locked cabinets
I keep matches and cigarette lighters out of my child's reach
I supervise my child when he or she is in the bathtub
125
Intake
(n=20)
One Year
(n=20)
1.00
1.55
1.05
1.00
1.55
1.30
2.25
1.05
1.05
1.05
1.10
1.00
1.00
1.30
1.10
2.05
1.00
1.00
Table 124
Child Safety Statements – Sue Buel Treatment Neighborhood (Yamhill Co.) - Mean Response
(1=All of the time; 2=Most of the time; 3=Some of the time; 4=None of the time)
Child Safety (Mean Response)
Sue Buel
Intake
(n=15)
One Year
(n=15)
I use a safety seat or seat belt for my child when riding in the car
1.00
1.00
I keep medicines in childproof bottles
I keep medicines out of children's reach
I have at least one working smoke detector in my house
I regularly change the battery in my smoke detector.
I keep cleaning materials out of reach of my child
I keep cleaning materials in locked cabinets
I keep matches and cigarette lighters out of my child's reach
I supervise my child when he or she is in the bathtub
1.07
1.27
1.20
1.40
1.33
1.93
1.20
1.00
1.07
1.00
1.07
1.33
1.40
2.27
1.27
1.20
Time-point
Table 125
Child Safety Statements – Edwards Comparison Neighborhood (Yamhill Co.) - Mean Response
(1=All of the time; 2=Most of the time; 3=Some of the time; 4=None of the time)
Child Safety (Mean Response)
Edwards
Intake
(n=16)
One Year
(n=16)
1.00
1.00
I regularly change the battery in my smoke detector.
1.06
1.06
1.19
1.44
1.00
1.06
1.00
1.31
I keep cleaning materials out of reach of my child
I keep cleaning materials in locked cabinets
I keep matches and cigarette lighters out of my child's reach
I supervise my child when he or she is in the bathtub
1.19
1.44
1.00
1.00
1.06
1.13
1.06
1.00
Time-point
I use a safety seat or seat belt for my child when riding in the car
I keep medicines in childproof bottles
I keep medicines out of children's reach
I have at least one working smoke detector in my house
126
Background Information Form, Item 17 – Neighborhood Statements
Caregivers responded to a number of statements about their neighborhoods. Tables 126 –
132 present results, both overall and by neighborhood. Overall, respondents were most apt to
agree that they would like to remain a resident of their neighborhood, would be willing to work
with people in their neighborhood to improve the neighborhood, that they like living in their
neighborhood, as well as that they feel safe in their neighborhood. Overall, treatment
caregivers demonstrated the greatest increase in agreement with the item ‘I invite my
neighbors to my home to visit’ between intake and the one year time-point. Comparison
caregivers demonstrated the greatest increase in agreement with the item ‘there is a strong
feeling of friendship between me and other people in my neighborhood.’
Table 126
Neighborhood Statements – Overall - % Yes
Please answer "yes" or "no" to the statements
about your neighborhood. (% Yes)
Treatment
Comparison
Intake
(n=70)
One Year
(n=70)
Intake
(n=65)
One Year
(n=62-63)
If I can, I will remain a resident of my
neighborhood for a long time.
81.4%
80.0%
89.2%
82.5%
There is a strong feeling of friendship between me
and other people in my neighborhood.
52.9%
52.9%
50.8%
61.9%
75.7%
75.7%
73.8%
77.8%
71.4%
78.6%
81.5%
81.0%
If I needed advice about something personal, I
could go to someone in my neighborhood.
37.1%
40.0%
38.5%
47.6%
I would be willing to work with the people in my
neighborhood to improve my neighborhood.
94.3%
92.9%
92.3%
92.1%
I think I agree with most people in my
neighborhood about what is important in life.
62.3%
48.6%
64.6%
68.3%
Time-point
I feel loyal to people in my neighborhood.
I believe people in my neighborhood would help
me in an emergency.
I am similar to the people who live in my
neighborhood.
I feel like I belong in my neighborhood.
If I had the chance, I would like to move out of my
neighborhood.
46.4%
28.6%
33.8%
39.7%
84.1%
80.0%
69.2%
72.6%
38.6%
41.4%
53.8%
58.7%
Overall, I like living in my neighborhood.
I visit with my neighbors in their home.
I invite my neighbors to my home to visit.
I feel safe in my neighborhood.
94.3%
37.1%
42.9%
80.0%
90.0%
35.7%
51.4%
84.3%
87.3%
41.5%
47.7%
91.9%
82.5%
46.0%
57.1%
93.7%
127
Table 127
Neighborhood Statements – Washington Treatment Neighborhood (Marion Co.)
Please answer "yes" or "no" to the statements about your
neighborhood. (% Yes)
Washington
Intake
(n=27)
One Year
(n=27)
If I can, I will remain a resident of my neighborhood for a long time.
85.2%
88.9%
There is a strong feeling of friendship between me and other people in
my neighborhood.
48.1%
55.6%
74.1%
63.0%
74.1%
81.5%
If I needed advice about something personal, I could go to someone in
my neighborhood.
44.4%
44.4%
I would be willing to work with the people in my neighborhood to
improve my neighborhood.
92.6%
96.3%
I think I agree with most people in my neighborhood about what is
important in life.
59.3%
63.0%
I am similar to the people who live in my neighborhood.
I feel like I belong in my neighborhood.
If I had the chance, I would like to move out of my neighborhood.
Overall, I like living in my neighborhood.
I visit with my neighbors in their home.
I invite my neighbors to my home to visit.
I feel safe in my neighborhood.
48.1%
88.9%
44.4%
100.0%
40.7%
48.1%
88.9%
37.0%
85.2%
29.6%
92.6%
22.2%
37.0%
88.9%
Time-point
I feel loyal to people in my neighborhood.
I believe people in my neighborhood would help me in an emergency.
128
Table 128
Neighborhood Statements – Swegle Treatment Neighborhood (Marion Co.)
Please answer "yes" or "no" to the statements about your
neighborhood. (% Yes)
Swegle
Intake
(n=27-28)
85.7%
One Year
(n=28)
75.0%
50.0%
60.7%
71.4%
64.3%
78.6%
60.7%
21.4%
39.3%
I would be willing to work with the people in my neighborhood to
improve my neighborhood.
96.4%
100.0%
I think I agree with most people in my neighborhood about what is
important in life.
55.6%
50.0%
I am similar to the people who live in my neighborhood.
I feel like I belong in my neighborhood.
If I had the chance, I would like to move out of my neighborhood.
Overall, I like living in my neighborhood.
I visit with my neighbors in their home.
I invite my neighbors to my home to visit.
I feel safe in my neighborhood.
48.1%
85.2%
28.6%
96.4%
35.7%
35.7%
82.1%
42.9%
75.0%
39.3%
78.6%
32.1%
32.1%
89.3%
Time-point
If I can, I will remain a resident of my neighborhood for a long time.
There is a strong feeling of friendship between me and other people in
my neighborhood.
I feel loyal to people in my neighborhood.
I believe people in my neighborhood would help me in an emergency.
If I needed advice about something personal, I could go to someone in
my neighborhood.
129
Table 129
Neighborhood Statements – Hallman Comparison Neighborhood (Marion Co.)
Please answer "yes" or "no" to the statements about your
neighborhood. (% Yes)
Hallman
Intake
(n=27-29)
One Year
(n=29)
If I can, I will remain a resident of my neighborhood for a long time.
100.0%
82.8%
There is a strong feeling of friendship between me and other people in
my neighborhood.
51.7%
58.6%
75.9%
82.8%
75.9%
79.3%
51.7%
41.4%
I would be willing to work with the people in my neighborhood to
improve my neighborhood.
89.7%
96.6%
I think I agree with most people in my neighborhood about what is
important in life.
72.4%
62.1%
I am similar to the people who live in my neighborhood.
I feel like I belong in my neighborhood.
If I had the chance, I would like to move out of my neighborhood.
Overall, I like living in my neighborhood.
I visit with my neighbors in their home.
I invite my neighbors to my home to visit.
I feel safe in my neighborhood.
44.8%
79.3%
44.8%
92.6%
41.4%
41.4%
88.9%
34.5%
75.9%
58.6%
79.3%
44.8%
55.2%
82.8%
Time-point
I feel loyal to people in my neighborhood.
I believe people in my neighborhood would help me in an emergency.
If I needed advice about something personal, I could go to someone in
my neighborhood.
Table 130
130
Neighborhood Statements – Hoover Comparison Neighborhood (Marion Co.)
Please answer "yes" or "no" to the statements about your
neighborhood. (% Yes)
Hoover
Intake
(n=19-20)
One Year
(n=20)
If I can, I will remain a resident of my neighborhood for a long time.
There is a strong feeling of friendship between me and other people in
my neighborhood.
80.0%
90.0%
45.0%
65.0%
I feel loyal to people in my neighborhood.
I believe people in my neighborhood would help me in an emergency.
70.0%
90.0%
70.0%
85.0%
If I needed advice about something personal, I could go to someone in
my neighborhood.
25.0%
55.0%
I would be willing to work with the people in my neighborhood to
improve my neighborhood.
95.0%
95.0%
I think I agree with most people in my neighborhood about what is
important in life.
70.0%
75.0%
I am similar to the people who live in my neighborhood.
15.0%
45.0%
I feel like I belong in my neighborhood.
If I had the chance, I would like to move out of my neighborhood.
Overall, I like living in my neighborhood.
I visit with my neighbors in their home.
I invite my neighbors to my home to visit.
I feel safe in my neighborhood.
55.0%
65.0%
80.0%
45.0%
50.0%
94.7%
75.0%
55.0%
85.0%
55.0%
60.0%
85.0%
Time-point
131
Table 131
Neighborhood Statements – Sue Buel Treatment Neighborhood (Yamhill Co.)
Please answer "yes" or "no" to the statements about your
neighborhood. (% Yes)
Sue Buel
Intake
(n=15)
66.7%
One Year
(n=15)
73.3%
66.7%
53.3%
86.7%
66.7%
80.0%
86.7%
If I needed advice about something personal, I could go to someone in
my neighborhood.
53.3%
33.3%
I would be willing to work with the people in my neighborhood to
improve my neighborhood.
93.3%
93.3%
I think I agree with most people in my neighborhood about what is
important in life.
80.0%
60.0%
I am similar to the people who live in my neighborhood.
I feel like I belong in my neighborhood.
If I had the chance, I would like to move out of my neighborhood.
40.0%
73.3%
26.7%
73.3%
46.7%
53.3%
Overall, I like living in my neighborhood.
I visit with my neighbors in their home.
I invite my neighbors to my home to visit.
I feel safe in my neighborhood.
80.0%
33.3%
46.7%
60.0%
93.3%
26.7%
53.3%
93.3%
Time-point
If I can, I will remain a resident of my neighborhood for a long time.
There is a strong feeling of friendship between me and other people in
my neighborhood.
I feel loyal to people in my neighborhood.
I believe people in my neighborhood would help me in an emergency.
132
Table 132
Neighborhood Statements – Edwards Comparison Neighborhood (Yamhill Co.)
Please answer "yes" or "no" to the statements about your
neighborhood. (% Yes)
Edwards
Intake
(n=16)
One Year
(n=16)
If I can, I will remain a resident of my neighborhood for a long time.
81.3%
75.0%
There is a strong feeling of friendship between me and other people in
my neighborhood.
56.3%
75.0%
75.0%
93.8%
81.3%
93.8%
31.3%
56.3%
I would be willing to work with the people in my neighborhood to
improve my neighborhood.
93.8%
100.0%
I think I agree with most people in my neighborhood about what is
important in life.
43.8%
81.3%
I am similar to the people who live in my neighborhood.
I feel like I belong in my neighborhood.
If I had the chance, I would like to move out of my neighborhood.
Overall, I like living in my neighborhood.
I visit with my neighbors in their home.
I invite my neighbors to my home to visit.
I feel safe in my neighborhood.
37.5%
68.8%
56.3%
87.5%
37.5%
56.3%
93.8%
56.3%
93.8%
56.3%
93.8%
56.3%
62.5%
81.3%
Time-point
I feel loyal to people in my neighborhood.
I believe people in my neighborhood would help me in an emergency.
If I needed advice about something personal, I could go to someone in
my neighborhood.
Background Information Form, Items 15a,b,c - Financial Problems
The survey queried numerous types of financial problems. As shown in Table 135,
respondents reported a variety of financial hardships including inadequate funds for
rent/mortgage payments, utility payments, or to buy food. Results are presented by county and
neighborhood for both the intake and one year time-points. Among the treatment
neighborhoods, residents of the Washington neighborhood demonstrated the biggest
improvement from intake to one year, with fewer participants indicating that they experienced
eleven out of the twelve financial hardships at the one year time-point.
133
Table 133
Financial Problems in the Past 12 Months - % Yes – Overall
Financial Problems: In the past 12 months, was there
ever a time when... (% Yes)
Study Group
Time-point
You did not pay the full amount of the rent or mortgage
because you didn't have enough money?
You were evicted from your home or apartment for not
paying the rent or mortgage?
You missed a payment or were late with the gas,
electricity, or water bill because you didn't have enough
money?
Overall
Tx. (n=68-70)
Intake
1 Year
Comp. (n=64-65)
Intake
1 Year
30.0%
30.0%
30.8%
17.2%
4.3%
1.4%
0.0%
1.6%
62.9%
60.0%
72.3%
54.7%
Note. Tx = Treatment; Comp. = Comparison
Table 134
Financial Problems in the Past 12 Months - % Yes – Marion County
Financial Problems: In the past 12 months,
was there ever a time when... (% Yes)
Study Group
Time-point
You did not pay the full amount of the rent
or mortgage because you didn't have
enough money?
You were evicted from your home or
apartment for not paying the rent or
mortgage?
You missed a payment or were late with
the gas, electricity, or water bill because
you didn't have enough money?
Marion County
Treatment
Intake
One Year
(n=54-55)
(n=53-55)
Comparison
Intake
One Year
(n=48-49)
(n=48-49)
30.9%
27.3%
26.5%
16.7%
5.5%
1.8%
0.0%
2.1%
69.1%
63.6%
73.5%
60.4%
134
Table 135
Financial Problems in the Past 12 Months - % Yes – Yamhill County
Financial Problems: In the past 12 months,
was there ever a time when... (% Yes)
Study Group
Time-point
You did not pay the full amount of the rent
or mortgage because you didn't have
enough money?
You were evicted from your home or
apartment for not paying the rent or
mortgage?
You missed a payment or were late with
the gas, electricity, or water bill because
you didn't have enough money?
Yamhill County
Treatment
Intake
One Year
(n=15)
(n=16)
Comparison
Intake
One Year
(n=15-16)
(n=15)
26.7%
40.0%
43.8%
18.8%
0.0%
0.0%
0.0%
0.0%
40.0%
46.7%
68.8%
37.5%
Table 136
Financial Problems in the Past 12 Months - % Yes – Washington Treatment Neighborhood
(Marion Co.)
Financial Problems: In the past 12 months, was there ever a time
when... (% Yes)
Washington
Intake
(n=26-27)
One Year
(n=26-27)
You did not pay the full amount of the rent or mortgage because you
didn't have enough money?
25.9%
22.2%
You were evicted from your home or apartment for not paying the
rent or mortgage?
7.4%
0.0%
You missed a payment or were late with the gas, electricity, or water
bill because you didn't have enough money?
74.1%
63.0%
Time-point
Table 137
Financial Problems in the Past 12 Months - % Yes – Swegle Treatment Neighborhood (Marion
County)
Financial Problems: In the past 12 months, was there ever a time
when... (% Yes)
Swegle
Intake
(n=28)
One Year
(n=27-28)
You did not pay the full amount of the rent or mortgage because you
didn't have enough money?
35.7%
32.1%
You were evicted from your home or apartment for not paying the
rent or mortgage?
3.6%
3.6%
You missed a payment or were late with the gas, electricity, or water
bill because you didn't have enough money?
64.3%
64.3%
Time-point
135
Table 138
Financial Problems in the Past 12 Months - % Yes – Hallman Comparison Neighborhood (Marion
County)
Financial Problems: In the past 12 months, was there ever a time
when... (% Yes)
Hallman
Intake
(n=29)
One Year
(n=28)
You did not pay the full amount of the rent or mortgage because you
didn't have enough money?
27.6%
21.4%
You were evicted from your home or apartment for not paying the
rent or mortgage?
0.0%
0.0%
You missed a payment or were late with the gas, electricity, or water
bill because you didn't have enough money?
72.4%
57.1%
Time-point
Table 139
Financial Problems in the Past 12 Months - % Yes – Hoover Comparison Neighborhood (Marion
County)
Financial Problems: In the past 12 months, was there ever a time
when... (% Yes)
Hoover
Intake
(n=19-20)
One Year
(n=20)
You did not pay the full amount of the rent or mortgage because you
didn't have enough money?
25.0%
10.0%
You were evicted from your home or apartment for not paying the
rent or mortgage?
0.0%
5.0%
You missed a payment or were late with the gas, electricity, or water
bill because you didn't have enough money?
75.0%
65.0%
Time-point
Table 140
Financial Problems in the Past 12 Months - % Yes – Sue Buel Treatment Neighborhood (Yamhill
County
Financial Problems: In the past 12 months, was there ever a time
when... (% Yes)
Sue Buel
Intake
(n=15)
One Year
(n=15)
You did not pay the full amount of the rent or mortgage because you
didn't have enough money?
26.7%
40.0%
You were evicted from your home or apartment for not paying the
rent or mortgage?
0.0%
0.0%
You missed a payment or were late with the gas, electricity, or water
bill because you didn't have enough money?
40.0%
46.7%
Time-point
136
Table 141
Financial Problems in the Past 12 Months - % Yes – Edwards Comparison Neighborhood (Yamhill
County)
Financial Problems: In the past 12 months, was there ever a time
when... (% Yes)
Edwards
Intake
(n=15-16)
One Year
(n=16)
You did not pay the full amount of the rent or mortgage because you
didn't have enough money?
43.8%
18.8%
You were evicted from your home or apartment for not paying the
rent or mortgage?
0.0%
0.0%
You missed a payment or were late with the gas, electricity, or water
bill because you didn't have enough money?
68.8%
37.5%
Time-point
Background Information Form, Items 14 and 16 – Household Income and Aid Received
When asked to report an estimate of their household’s total income, the majority of
caregivers indicated an income of less than $30,000. Disparities between treatment and
comparison families were most notable in Yamhill County. One quarter of treatment families
reported incomes of $30,001-$40,000 whereas 80% of comparison neighborhood respondents
indicated household incomes of $20,000 or less (Table 142).
Table 142
Estimate of Household Income Overall and by County
Estimate of the total household
income for a year
Study Group
$0-$10,000
$10,001-$20,000
$20,001-$30,000
$30,001-$40,000
$40,001-$50,000
More than $50,000
Overall
Marion County
Yamhill County
Tx.
(n=61)
Comp.
(n=63)
Tx.
(n=49)
Comp.
(n=48)
Tx.
(n=12)
Comp.
(n=15)
13.1%
49.2%
26.2%
6.6%
3.3%
1.6%
28.6%
47.6%
15.9%
3.2%
4.8%
0.0%
14.3%
57.1%
22.4%
2.0%
4.1%
0.0%
29.2%
45.8%
20.8%
2.1%
2.1%
0.0%
8.3%
16.7%
41.7%
25.0%
0.0%
8.3%
26.7%
53.3%
0.0%
6.7%
13.3%
0.0%
Note. Tx. = Treatment; Comp. = Comparison
137
Table 143
Estimate of Household Income Overall and by County- Hispanic/Latino Participants
Estimate of the total household
income for a year
Study Group
$0-$10,000
$10,001-$20,000
$20,001-$30,000
$30,001-$40,000
$40,001-$50,000
More than $50,000
Overall
Marion County
Yamhill County
Tx.
(n=44)
Comp.
(n=53)
Tx.
(n=33)
Comp.
(n=43)
Tx.
(n=11)
Comp.
(n=10)
9.1%
47.7%
31.8%
6.8%
2.3%
2.3%
30.2%
49.1%
17.0%
1.9%
1.9%
0.0%
9.1%
57.6%
27.3%
3.0%
3.0%
0.0%
27.9%
46.5%
20.9%
2.3%
2.3%
0.0%
9.1%
18.2%
45.5%
18.2%
0.0%
9.1%
40.0%
60.0%
0.0%
0.0%
0.0%
0.0%
Note. Tx. = Treatment; Comp. = Comparison
Table 144
Estimate of Household Income by Neighborhood
Estimate of the total
household income
Marion County
for a year
Study Group
Tx.
Comp.
Washington Swegle Hallman Hoover
Neighborhood
(n=24)
(n= 25) (n=28)
(n=20)
$0-$10,000
20.8%
8.0%
39.3%
15.0%
$10,001-$20,000
45.8%
68.0%
32.1%
65.0%
$20,001-$30,000
29.2%
16.0%
21.4%
20.0%
$30,001-$40,000
0.0%
4.0%
3.6%
0.0%
$40,001-$50,000
4.2%
4.0%
3.6%
0.0%
More than $50,000
0.0%
0.0%
0.0%
0.0%
Yamhill County
Tx.
Sue Buel
(n=12)
8.3%
16.7%
41.7%
25.0%
0.0%
8.3%
Comp.
Edwards
(n=15)
26.7%
53.3%
0.0%
6.7%
13.3%
0.0%
Note. Tx. = Treatment; Comp. = Comparison
Almost all caregivers reported receiving some form of Federal or state aid. Food stamps
(SNAP), Women Infants Children (WIC) funds, Temporary Assistance for Needy Families (TANF),
Medicaid, and “other” sources of support were reported most often (Tables 145 and 146).
138
Table 145
Sources of Federal and State Aid Overall and by County
Select all of the aid or income you
currently receive
Overall
Marion County
Yamhill County
Tx.
(n=70)
Comp.
(n=65)
Tx.
(n=55)
Comp.
(n=49)
Tx.
(n=15)
Comp.
(n=16)
I do not receive any federal or state aid
1.4%
0.0%
1.8%
0.0%
0.0%
0.0%
Food stamps (SNAP)
WIC
TANF
SSI (Supplemental Security Income)
82.9%
90.0%
15.7%
1.4%
28.6%
4.3%
5.7%
2.9%
2.9%
40.0%
90.8%
98.5%
21.5%
1.5%
36.9%
3.1%
7.7%
7.7%
3.1%
46.2%
80.0%
89.1%
14.5%
1.8%
32.7%
5.5%
7.3%
3.6%
3.6%
29.1%
89.8%
100.0%
26.5%
2.0%
38.8%
2.0%
10.2%
10.2%
4.1%
49.0%
93.3%
93.3%
20.0%
0.0%
13.3%
0.0%
0.0%
0.0%
0.0%
80.0%
93.8%
93.8%
6.3%
0.0%
31.3%
6.3%
0.0%
0.0%
0.0%
37.5%
Study Group
Medicaid
Rental certificates or vouchers
HUD apartment/subsidized housing
Telephone assistance program
Unemployment compensation
Other
Note. Tx = Treatment; Comp. = Comparison
Table 146
Sources of Federal and State Aid by Neighborhood
Select all o.f the aid or income
you currently receive
Study Group
Neighborhood
I do not receive any federal or
state aid
Food stamps (SNAP)
WIC
TANF
SSI (Supplemental Security
Income)
Medicaid
Rental certificates or
vouchers
HUD apartment/ subsidized
housing
Telephone assistance
program
Unemployment
compensation
Marion County
Treatment
Yamhill County
Comparison
Tx.
Comp.
Washington
(n=27)
Swegle
(n=28)
Hallman
(n=29)
Hoover
(n=20)
Sue Buel
(n=15)
Edwards
(n=16)
0.0%
3.6%
0.0%
0.0%
0.0%
0.0%
81.5%
81.5%
11.1%
78.6%
96.4%
17.9%
86.2%
100.0%
20.7%
95.0%
100.0%
35.0%
93.3%
93.3%
20.0%
93.8%
93.8%
6.3%
0.0%
3.6%
0.0%
5.0%
0.0%
0.0%
22.2%
42.9%
37.9%
40.0%
13.3%
31.3%
3.7%
7.1%
0.0%
5.0%
0.0%
6.3%
11.1%
3.6%
13.8%
5.0%
0.0%
0.0%
7.4%
0.0%
13.8%
5.0%
0.0%
0.0%
3.7%
3.6%
6.9%
0.0%
0.0%
0.0%
139
Select all o.f the aid or income
you currently receive
Study Group
Other
Marion County
Treatment
37.0%
Yamhill County
Comparison
21.4%
55.2%
40.0%
Tx.
Comp.
80.0%
37.5%
Note. Tx. = Treatment; Comp. = Comparison
C. Decreased Likelihood of Child Maltreatment: Findings
Parenting Stress Index (PSI)
The PSI includes scales measuring perceived stress from the Parent Domain and the Child
Domain. These two scales are summed to calculate Total Stress. The PSI also includes a scale
designed to detect defensive (socially desirable) responding. A total of 17 participants were
eliminated from PSI analyses due to defensive responding, including 11 from the treatment
group and six from the comparison group. Results of ANCOVAs on each of these three scales
are presented below. Only the results for the Total Stress scale approach statistical
significance, and the effect size of .028 is not noteworthy.
• PSI Parent Domain: F(1, 115) = 2.72, p = .102
• PSI Child Domain: F(1, 117) = 2.16, p = .144
• PSI Total Stress: F(1, 115) = 3.30, p = .072; η2p = .028
To further explore the data, the same analyses were conducted for Marion County
neighborhoods only:
• PSI Parent Domain: F(1, 89) = 4.76, p = .032; η2p = .051
• PSI Child Domain: F(1, 90) = 4.52, p = .036; η2p = .048
• PSI Total Stress: F(1, 89) = 5.81, p = .018; η2p = .061
Results were also conducted for Hispanic participants only:
• PSI Parent Domain: F(1, 86) = 3.22, p = .076
• PSI Child Domain: F(1, 88) = 10.04, p = .002; η2p = .102
• PSI Total Stress: F(1, 86) = 7.48, p = .008; η2p = .080
Finally, ANCOVAs were conducted for Hispanic participants in Marion County:
• PSI Parent Domain: F(1, 66) = 5.33, p = .024; η2p = .075
• PSI Child Domain: F(1, 67) = 11.87, p = .001; η2p = .150
• PSI Total Stress: F(1, 66) = 9.55, p = .003; η2p = .126
The results of these subgroup analyses indicate that the Fostering Hope Initiative (FHI) may
have had a greater impact, at least in terms of reducing parenting stress, in Marion County. The
FHI also appears to have been more effective in reducing stress among Hispanic participants,
and particularly among Hispanic participants residing in the two Marion County neighborhoods.
For this latter analysis, sample sizes were quite small (n=31 in the treatment group and 39 in
the comparison group), but yielded somewhat noteworthy effect sizes in the Child Domain (η2p
= .150) and in Total Stress (η2p = .126).
140
Group mean scores at baseline and 12-months for all analyses described above are
presented in the table below. Reductions in scores over time represent reduced levels of
perceived stress.
Table 147
PSI Scale Means at Baseline and 12-months
Overall
PSI Parent Domain
Baseline
12-months
PSI Child Domain
Baseline
12-months
PSI Total Stress
Baseline
12-months
Marion County
Hispanic
Participants
Marion County
Hispanic
Participants
Tx.
Comp.
Tx.
Comp.
Tx.
Comp.
Tx.
Comp.
(n=58)
136.96
129.23
(n=59)
107.36
105.63
(n=58)
244.77
234.53
(n=60)
127.48
130.62
(n=61)
101.02
108.54
(n=60)
228.43
239.16
(n=47)
135.91
127.66
(n=47)
108.54
104.47
(n=47)
244.45
232.13
(n=45)
123.57
130.20
(n=46)
101.61
108.88
(n=45)
225.11
239.10
(n=41)
136.59
127.32
(n=42)
106.93
102.24
(n=41)
244.16
229.02
(n=48)
125.68
129.73
(n=49)
102.88
110.73
(n=48)
228.51
240.52
(n=31)
135.02
125.26
(n=31)
107.82
100.67
(n=31)
242.84
225.93
(n=38)
124.64
130.34
(n=39)
103.54
110.07
(n=38)
228.14
240.46
Note. Tx. = Treatment; Comp. = Comparison
PSI subscale analyses were also conducted. Results are summarized below, beneath
subscale descriptions duplicated from the Parenting Stress Index Third Edition Professional
Manual.
Life Stress Subscale on the PSI
Parents who earn high life stress scores find themselves in stressful situational
circumstances that are often beyond their control (e.g., the death of a relative, loss of a job).
The Life Stress scale provides some index of the amount of stress outside the parent-child
relationship that the parent is currently experiencing (Parenting Stress Index Third Edition
Professional Manual, p. 12). Analysis of covariance (ANCOVA) comparing results for all
treatment and comparison participants did not generate a statistically significant result
(p=.735).
•
PSI Life Stress Subscale: F(1,121) = .115, p = .735
To further explore the data, the same analyses were conducted for Marion County
neighborhoods only:
• PSI Life Stress Subscale: F(1,94)=.297, p=.587
Results were also conducted for Hispanic participants only:
141
•
PSI Life Stress Subscale: F(1, 90)=.000, p=.993
Finally, ANCOVAs were conducted for Hispanic participants in Marion County:
• PSI Life Stress Subscale: F(1,69)=.035, p=.852
Similarly, the subgroup analyses did not generate statistically significant results.
Depression Subscale on the PSI
High scores on this subscale are suggestive of the presence of significant depression in the
parent. The general impact of high scores on this subscale is that the parent finds it difficult to
mobilize the psychic and physical energy needed to fulfill parenting responsibilities (Parenting
Stress Index Third Edition Professional Manual, p.11). Analysis of covariance (ANCOVA)
comparing results for all treatment and comparison participants did not generate a statistically
significant result (p=.709).
•
PSI Depression Subscale: F(1,116)=.140, p=.709
To further explore the data, the same analyses were conducted for Marion County
neighborhoods only:
• PSI Depression Subscale: F(1,89)=1.304, p=.257
Results were also conducted for Hispanic participants only:
• PSI Depression Subscale: F(1,87)=.107, p=.744
Finally, ANCOVAs were conducted for Hispanic participants in Marion County:
• PSI Depression Subscale: F(1,66)=1.36, p=.248
Similarly, the subgroup analyses did not generate statistically significant results.
Isolation Subscale on the PSI
Parents who earn high scores in this area are under considerable stress, and it is necessary
to establish an intervention program as soon as possible. These parents are often socially
isolated from their peers, relatives, and other emotional support systems. In many instances,
their relationships with their spouses are distant and lacking in support for their efforts as
parents (Parenting Stress Index Third Edition Professional Manual, p.10). Analysis of covariance
(ANCOVA) comparing results for all treatment and comparison participants did not generate
statistically significant results.
•
PSI Isolation Subscale: F(1,116)=.829, p=.364
To further explore the data, the same analyses were conducted for Marion County
neighborhoods only:
• PSI Isolation Subscale: F(1,89)=1.484, p=.226
Results were also conducted for Hispanic participants only:
142
•
PSI Isolation Subscale: F(1,87)=2.301, p=.133
Finally, ANCOVAs were conducted for Hispanic participants in Marion County:
• PSI Isolation Subscale: F(1, 66)=3.87, p=.054; η2p=.055
As shown above, when analyzed separately, Hispanic participants in Marion County
treatment neighborhoods approached a statistically significant improvement in isolation as
compared to treatment group participants (p=.054). The effect size estimate was not
noteworthy, however. Group mean scores at baseline and 12-months for the Life Stress,
Depression, and Isolation subscale analyses are presented in the table below. Reductions in
scores over time represent improvement.
Table 148
PSI Subscale Scale Means at Baseline and 12-months
Overall
PSI Life Stress
Baseline
12-months
PSI Depression
Baseline
12-months
PSI Isolation
Baseline
12-months
Marion County
Hispanic
Participants
Marion County
Hispanic
Participants
Tx.
Comp.
Tx.
Comp.
Tx.
Comp.
Tx.
Comp.
(n=62)
18.65
14.29
(n=59)
22.05
21.39
(n=59)
15.40
14.17
(n=62)
12.16
10.65
(n=60)
21.48
21.45
(n=60)
13.85
14.30
(n=50)
19.12
13.96
(n=47)
21.47
20.66
(n=47)
15.63
14.17
(n=47)
11.19
9.98
(n=45)
20.38
21.31
(n=45)
13.07
14.27
(n=43)
18.79
14.30
(n=42)
22.14
21.29
(n=42)
15.38
13.67
(n=50)
11.72
10.34
(n=48)
21.44
21.27
(n=48)
13.44
14.10
(n=32)
19.22
13.59
(n=31)
21.42
20.42
(n=31)
15.81
13.61
(n=40)
10.75
9.40
(n=38)
20.95
21.37
(n=38)
13.11
14.16
Note. Tx. = Treatment; Comp. = Comparison
Caregivers’ Assessment of Protective Factors (CAPF)
The CAPF was developed for QIC-EC grantees, and is intended to measure the Strengthening
Families Protective Factors. Midway through the QIC-EC grant period, psychometric testing of
the CAPF indicated that the scale intended to measure parent knowledge of child development
was inadequate. In addition, the psychometric analysis indicated that items intended to
measure parental resilience appeared to be measuring two separate constructs. Hence, the
final version of the measure contained five scales. Results of ANCOVAs conducted on each of
these scales are presented below.
• Nurturing Children’s Social and Emotional Competence: F(1, 132) = 2.20, p = .141; η2p =
.016
• Social Connections: F(1, 132) = 0.46, p = .497
• Concrete Support in Times of Need: F(1, 132) = 0.90, p = .345
143
•
•
Parental Resilience 1: F(1, 132) = 0.00, p = .988
Parental Resilience 2: F(1, 132) = 0.29, p = .590
Analyses did not reveal any noteworthy differences between treatment and comparison
group participants. Similarly, ANCOVAs conducted on subgroups of interest (Marion County
only, Hispanic participants, Marion County Hispanic participants) yielded no results approaching
statistical significance. The descriptive data presented in the table below includes scale totals
as well as item means for ease of comparison across the protective factor subscales. Higher
scores indicate greater levels of the protective factors.
Table 149
CAPF Scale and Item Means at Baseline and 12-months
Overall Scale
Scores
CAPF Nurturing Children’s Social and Emotional
Competence (Max = 65)
Baseline
12-months
CAPF Social Connections (Max = 30)
Baseline
12-months
CAPF Concrete Support in Times of Need (Max = 15)
Baseline
12-months
CAPF Resilience 1 (Max = 30)
Baseline
12-months
CAPF Resilience 2 (Max = 30)
Baseline
12-months
Item Means
(Scale of 1-5)
Tx.
(n=69)
Comp.
(n=66)
Tx.
(n=69)
Comp.
(n=66)
62.24
61.74
63.15
62.98
4.79
4.75
4.86
4.84
26.93
28.07
25.67
27.33
4.49
4.68
4.28
4.56
9.80
11.49
9.83
11.15
3.27
3.83
3.28
3.72
25.45
25.77
26.76
26.29
4.24
4.29
4.46
4.38
26.83
26.96
26.86
27.27
4.47
4.49
4.48
4.55
Note. Tx. = Treatment; Comp. = Comparison
The data presented in the table above suggests that the CAPF may suffer from a ceiling
effect, with treatment and comparison group participants reporting very high levels of the
protective factors even at baseline on all but one scale. Only the scale measuring Concrete
Support in Times of Need had baseline item means less than 4.0. Both treatment and
comparison group participants reported improvement on this scale from baseline to the 12month time point, but the other four scales left little room for improvement after baseline.
Due to the ceiling effect, it is difficult if not impossible to reach any conclusions regarding how
the protective factors may have changed during the study period for either treatment or
comparison group participants.
144
2. Changes in Child Maltreatment Administrative Data over the Course of the
Project in the Communities of Focus
As stated in previous sections, administrative data from DHS assessing child maltreatment
rates in the study neighborhoods will not become available until 2014. FHI was not able to
establish agreements with local hospitals to obtain emergency room visit data. Further,
hospitals do not collect data at the neighborhood level, making it unlikely that results would be
meaningful as relates to the current project.
The Department was able to confirm that none of the study participants in any of the
treatment or comparison neighborhoods had been the subject of a substantiated case of child
maltreatment during the study period.
D. Additional Local Outcomes: Findings
The local evaluation measures of child wellbeing were chosen because they were a part of
the Healthy Start~Healthy Families service delivery model. The Ages and Stages Questionnaire
Third Edition (ASQ-3) and ASQ Social-Emotional (ASQ SE) are highly reliable and valid screening
tools primarily used to identify children in need of additional support.
When assessed with the ASQ-3, a child is identified as being in one of three zones: 1) above
the cutoff, indicating that the child’s development appears to be on schedule; 2) close to the
cutoff, indicating that the child should receive learning activities and continued monitoring;
and, 3) below the cutoff, in which case further assessment with a professional is recommended.
None of the study participants were identified as below the cutoff at intake or one year. As
such, Table 150 below presents the percentage of children in each study group who scored in
the second zone, which indicated that additional supports were needed.
Table 150
ASQ-3: Percentage Close to the Cutoff – Learning Activities
and Continued Monitoring Recommended
As shown, concerns about
Time-point
Intake One Year Intake One Year communication increased among
both treatment and comparison
(n=67)
(n=49)
(n=65)
(n=59)
participants, a finding that one
Communication
7.5%
24.5%
16.9%
28.8%
would expect given that the
Gross Motor
13.4%
8.2%
24.6%
3.4%
children aged over the course of
Fine Motor
10.4%
2.0%
16.9%
16.9%
the study period and language
Problem Solving
10.4%
8.2%
7.7%
19.0%
development would become an
Personal-Social
11.9%
8.2%
6.2%
10.3%
increasing concern as they
developed their verbal abilities. Among treatment group participants, the proportion in the
second zone decreased from intake to one year for the gross motor, fine motor, problem
Study Group
Tx.
Comp.
145
solving, and personal-social subscales. In the comparison group, the proportion of children in
this zone increased for three of the subscales: communication, problem solving, and personalsocial.
Table 151
ASQ SE: Number of Children above the Cutoff – Referral
Recommended
The ASQ SE is used to identify
Time-point
Intake
One Year Intake
One Year children that should receive a
mental health evaluation. If a
Communication
n=2
n=4
n=3
n=4
child’s score on the instrument is
above the cutoff, he/she should be referred unless contextual factors such as a stressful event
taking place on the day of the assessment, developmental delay, or illness, for example, can
explain the child’s behavior. Table 151 summarizes the number of children in each study group
whose score indicated that further assessment may be necessary. The results are not
noteworthy.
Study Group
Treatment
Comparison
E. Relationship among Outcomes: Findings
With the exception of the Expectations of Children subscale on the APPI, the PSI was the
only measure that generated statistically significant results. As such, analyses to examine the
relationships among the three outcomes were not conducted.
F. Community and Societal Domain Outcomes: Findings
Administrative data from DHS was expected to address the community level of the social
ecology. The data will be analyzed in 2014 when data files are provided by DHS. Policy-level
work is addressed in other sections of this report.
 Interpretation of Findings
A meeting was held with key project leadership members to discuss the results of the
outcome measures and interpret the meaning of the findings. The discussion focused on the
most notable differences generated by the analyses. Specifically, the group discussed the
meaning of differences between the two counties (Marion and Yamhill), as well as why Latino
participants tended to generate lower p-values and larger effect sizes when examined
separately. A summary of staff members’ reflections is provided below.
Meaning of County Differences – PSI Results were better in Marion County
• As the backbone organization for the Collective Impact Initiative, CCS has operated in
Marion County since the 1930’s and has strong and longstanding connections with many
individuals and organizations there. CCS has worked to develop similar relationships in
Yamhill County, but has been present in that location for a significantly shorter period of
time. Approximately six months into the study period a collaboration survey was
146
•
administered among Implementation Team members representing both counties.
Yamhill County respondents reported notably lower satisfaction and involvement when
compared to Marion County. Ratings of collaborative functioning were also consistently
lower among Yamhill County partner members. While efforts were made to shift these
perceptions, CCS’ Executive Director reflected that the Initiative continued to be
perceived as a threat by established early childhood providers in Yamhill County who
viewed CCS and the Marion County partners as seeking to gain a foothold on limited
funding. Partner agency engagement in leadership and decision-making for the Initiative
was low among Yamhill County partners, and as a result, fewer support services were
available through interagency resource and referral mechanisms. Similarly, the
neighborhood engagement activities were not successful and Community Cafés and
dinners in Yamhill County were discontinued early on in the project period.
Staffing differences between the two counties also may have played a role in outcome
differences. The four visitors in Marion County were CCS employees, benefitting from a
peer culture and a high level of supervisory support. The Yamhill County visitor,
however, was a Yamhill County employee and regularly expressed feeling isolated and
under-resourced in her work. These factors, along with the county’s low level of
investment in the Initiative, may have limited the quality of services that families in that
county received. The visitor was ultimately hired on as a CCS employee where she
received a greater level of guidance and supervision, but this occurred well into the
study period.
Meaning of Differences between Latino and Anglo Participants – Results were better among
Hispanic/Latino Participants
• The FHI model is neighborhood-based, informal, and based on an empowerment model.
These design elements are particularly relevant to and were embraced by Latinos in the
target neighborhoods.
• The Initiative partnered with a local Latino outreach organization and service providers,
and members of these agencies participated in the Implementation Team and
associated PEP meetings. This resulted in increased reach in the Latino community.
Services were also provided by bilingual, bi-cultural staff.
• Because a greater proportion of participating families were Hispanic, there may have
been a (false) perception that the program was a Latino program for Latino participants.
These perceptions could explain the lower enrollment rates of Anglo families in home
visiting, in addition to influencing their receptiveness to using the variety of Initiative
services available in the neighborhoods (community dinners, Community Cafés, etc.).
• During the community dinners, Hispanic families tended to take up entire tables with
immediate and extended family members, choosing to mobilize everyone in the family
system to receive the benefit of the community meal. Non-Hispanic families tended to
be less receptive to increasing family connections and may have experienced more
stress because of the emphasis of the intervention on connecting family members to
each other.
147
•
•
Many Latinos in high poverty neighborhoods are undocumented, ineligible for many
social services, and therefore must rely on social networks to survive. Through word of
mouth they identify sources of support through local churches, food banks, or
organizations such as Mano a Mano that specialize in serving undocumented individuals
and families. Many Anglo families participating in the Initiative represented the second
or third generation living in poverty. These Anglo families, while typically living in social
isolation, tend to be fairly adept at working through the social service system to meet
their needs. These differences may have contributed to the higher level of participation
demonstrated by Latino participants, in addition to generating greater program effects.
Staffing differences were present when comparing Latino and non-Latino home visitors.
Latino visitors tended to employ the “friendship model” (Exchange Club), embracing
their role as neighborhood organizers and extending direct invitations to program
participants to engage in the various community events. Non-Latino visitors, however,
viewed themselves more narrowly as home visiting professionals, focusing on
implementing the HFA model with fidelity and allocating less time to the community
engagement activities.
 Implications of the Findings
The results of the outcome analysis indicate that the intervention produced a statistically
significant effect on parent stress. Caregivers from FHI neighborhoods demonstrated a greater
decrease in stress as demonstrated by the Parent, Child, and Total Stress Domains and the
Competence Subscale of the PSI when compared to caregivers who did not receive coordinated
services. Further, effects were stronger in Marion County and among Hispanic/Latino
participants.
According to the QIC-EC logic model, these findings are hypothesized to support an
increased likelihood of optimal child development and a decrease in the likelihood of child
maltreatment. As such, these results provide some evidence that replication or expansion of
the Initiative is warranted under certain conditions. One condition under which replication
would be recommended is in the case of strong interagency collaboration or a commitment to
Collective Impact. This is supported by the results generated when data were disaggregated for
Marion County, the location where the partnership had a long history of collaboration and the
relationships were marked by trust and commitment to the mission, vision, and goals of the
Initiative.
A second condition appropriate for replication is that of communities or neighborhoods that
are primarily composed of Hispanic residents, or similarly, those that are primarily populated by
any minority group living in poverty. While integration is always a goal within the social service
sector, it may be appropriate to work specifically with minority residents as the Initiative is first
implemented, expanding to include other racial or ethnic groups as the intervention gains
traction in the community.
148
VI.
Sustainability/Integration
A. The Parts of the Project that have been Most Effective in Obtaining Support in
Moving toward Sustainability; Parts FHI Plans to Sustain and How They will be
Sustained; Agencies or Funders that have been Most Responsive to this Project
CCS has been able to obtain support for several aspects of FHI:
• Safe Families for Children (SFFC). CCS has recruited 12 faith communities to participate
in this volunteer respite program, in which carefully vetted and trained Host Families
open their homes to families in stress who could benefit from a break in child care
responsibilities. This program often helps families to get through a difficult time,
without needing the intervention of DHS and Child Welfare. CCS has been able to
obtain funding from several sources for the coordination, materials, and training for the
Host Families and other volunteers, including Catholic Charities of Oregon.
• Collective Impact. The Meyer Memorial Trust has funded a Collective Impact
Coordinator to expand and deepen relationships with partners, and to develop a health
care pilot project.
• Collaboration. The United Way of the Mid-Willamette Valley, for its second two-year
cycle, funded FHI to support collaboration across partners. This grant supports
subcontracts to FHI partners to support their participation in the Executive Council, data
systems and other aspects of FHI. Prior to United Way support, CCS was able to obtain
funding from a local donor to provide funds for collaborators.
• Neighborhood Mobilization. The Ford Family Foundation has provided support to
embed “Neighbor Connectors” within rural FHI neighborhoods in Dallas and
Independence (Polk County) and Woodburn (Marion County). A recent award from the
Kaiser Permanente Community Fund of the Northwest Health Foundation will allow
expanding the availability of Neighbor Connectors to all six Fostering Hope
neighborhoods.
FHI will be sustained after the end of the QIC-EC funding. The significant parts of the project
that will be sustained, and the funders that have been most responsive are described below.
•
•
Collective Impact Backbone Support for Collaboration. CCS has chosen to stop providing
funded direct services in early childhood, including its contract for providing Healthy
Start~Healthy Families services, in order to not compete with partners for service
contracts and focus on being a backbone organization for the collective impact initiative.
CCS will continue to seek funding to sustain and improve the functions of a backbone
organization, as well as to support the collaboration activities of its partners. CCS has
had success with regional foundations and local donors to support this work.
Funding to Support Collaboration. CCS understands the issues that smaller organizations
have when they try to collaborate with other organizations—the extra time required to
meet with partners and to adjust internal systems to align with collaborative systems
are difficult to fund within a small organization’s budget. Therefore, CCS will continue
149
•
•
to seek support for collaboration to provide funding to partners for their engagement
with FHI. The United Way of the Mid-Willamette Valley has been interested in funding
collaborative projects over at least the last two funding cycles. In addition, individual
donors have provided funding to support collaboration. CCS will continue to seek
similar funding in the future.
Safe Families for Children: Voluntary Respite Care. CCS is committed to continuing to
work with faith communities in the three-county area that are interested in sponsoring
this faith-based respite care program. CCS currently is engaged in a recruitment
campaign to dramatically increase the number of volunteers thus expanding capacity to
handle increased referrals.
Neighborhood Mobilization. CCS and its partners have used several different strategies
for mobilizing neighborhoods, particularly to help neighborhood residents be aware of
the Protective Factors and support each other to make sure the neighborhood is a great
place to raise children. Some of the specific strategies used have emerged from the
neighborhoods—e.g., La Casita and Community Dinners. CCS has adopted the AssetsBased Community Development approach to community-building, and has sought
additional funding to support Neighbor Connectors for each FHI neighborhood.
Since the beginning of the Fostering Hope Initiative, several funders have been particularly
supportive of the efforts, in particular Meyer Memorial Trust, The Ford Family Foundation,
Kaiser Permanente Community Fund of the Northwest Health Foundation, The United Way of
the Mid-Willamette Valley, and Catholic Charities of Oregon. In addition, CCS has strong
relationships with local businesses and donors who have contributed to the development or
expansion of strategies within FHI.
B. The Role Collaboration has Played in Moving toward Sustainability and its Future
Working with a group of collaborators in a Collective Impact Initiative broadens the range of
connections beyond those of a single organization. Therefore, we strongly believe that FHI’s
collaborators have a critical role in sustaining FHI. Indeed, with the addition of a Collective
Impact Coordinator—focused on extending and deepening relationships, as well as improving
systems to support collective impact, the collaboration is becoming stronger. The new
Executive Council, consisting of executive directors of partner organizations, will have an
important role in ensuring FHI continues beyond current funding.
The addition of Center 50+ to the collaboration also points to project sustainability. Center
50+ has hired a home visitor to provide outreach and support to seniors who are homebound.
The Center also is coordinating with FHI Neighbor Connectors. FHI is working to expand this
collaboration to include recruiting senior volunteers to assist with supporting FHI families and
neighborhood activities.
150
C. Practices, Programs, Administrative, or Policy Changes that will be Sustained after
the Project Ends
•
•
Practices and Programs. After funding from CSSP ends, many of the practices and
programs of FHI will continue. This includes home visiting services and parenting
education (now funded through typical funding channels), Safe Families for Children
(donor and foundation support), and Community Cafés (CCS sponsored a day-long
training session for Community Café facilitators, attended by approximately 20 partners
and parents, in October). In order to focus on its role as a backbone organization and no
longer compete with FHI partners for service funding, CCS did not apply for a contract
renewal for its Healthy Start~Healthy Families services.
Policy Changes. At least one of the FHI partners, Mano a Mano Family Center, has
imbedded the Protective Factors in their organizational policies. At a statewide level, FHI
succeeded in advocating for legislative changes to expand the eligible families to receive
Healthy Start services to any birth meeting risk factor criteria, no longer limiting the
service to first birth families only.
D. How the Use of a Strengths-Based, Protective Factors Approach been Integrated into
Policy, Norms, and Practice/Service Delivery at Different Levels of the Social Ecology.
•
•
•
•
Individual/Caregiver Domain. Supporting development of the protective factors has
been built into home visiting, parenting education, and the work of Neighbor
Connectors. FHI service providers often frame their work based on protective factors.
Relationship (Neighborhood) Domain. Community Cafés focus on supporting dialog
among neighbors related to developing family protective factors. The work of Neighbor
Connectors, not funded by this project, includes a focus on building protective factors.
Community (Service System) Domain. Each of the partners working with FHI is now
familiar with the Protective Factors and considers how to incorporate them in their
work. Mano A Mano, for example, has built the Protective Factors Framework into their
organizational policies.
Systems (Policy) Domain. The Fostering Hope: Closing the Gap Summit which is targeted
to state and community leaders has presented information on the Protective Factors at
each of the three annual events that have been held. Both the Parents’ Council and the
Center for the Study of Social Policy have presented on the Protective Factors at the
Summits. The Yamhill County early learning system design team incorporated the
Protective Factors into their plan, submitted in response to the state’s RFA for the
restructured early learning system. Their plan organized the county’s goals and
indicators under the five Protective Factors. Yamhill County was the only plan
submitted tat incorporated Protective Factors, and they were one of six applications
selected in this initial round of early learning hub development.
E. Products Developed as a Result of the Project
151
CCS and other FHI partners have developed several products related to FHI:
• Memorandum of Understanding. FHI has had several MOUs developed over the past
several years, each usually related to a proposal being submitted. The current MOU is
based on the current United Way funding for Impact Collaboration and is included in
Appendix B.
• Theory of Change. With the help of the Frontiers of Innovation project at Harvard
University’s Center on the Developing Child, CCS has worked on improving the theory of
change for FHI, to make sure it is based in science. The most current version is available
at: http://fosteringhopeinitiative.org/images/Theory%20of%20Change.pdf .
• FHI Website. CCS developed an FHI website, which is now being redesigned and
updated. http://www.fosteringhopeinitiative.org/
• Protective Factors Grid. Pacific Research and Evaluation, in collaboration with the Center
for the Study of Social Policy and the collaborative partners, is developing a data
collection instrument that can be used with caregivers to track their progress in building
protective factors, reducing/managing toxic stress, and achieving financial stability. The
instrument is currently undergoing pilot testing. The Grid is provided in Appendix C.
• FHI Newsletters and Brochures. FHI distributed newsletters to stakeholders a few times
during the project, created a brochure on kindergarten readiness, and prepared a
simplified summary of the Strengthening Families Protective Factors. Most of these are
available on the FHI website: http://www.fosteringhopeinitiative.org/
•
•
FHI Videos. FHI has developed two videos, including one about a service recipient, “Brande’s
Story.” (Brande’s Story is available at: http://youtu.be/e7liGpOUWRE)
FHI Neighborhoods Map. This map depicts the general location of each of the FHI
neighborhoods.
In addition to the above, staff developed materials for specific events, including the Fostering
Hope: Closing the Gap Summits, a reception for Dr. Melissa Brodowski of the federal Children’s
Bureau, and specific presentations on FHI made by staff.
F. Cost Tracking
1. Summarize the actual costs to implement the project based on the categories
below. To the extent that projects are able to summarize the costs using a “per
family” or “per child” metric, whichever is most appropriate based upon the
intervention design, this would be
helpful, but is not required.
Table 152
Aggregate Costs to Implement the Project
a. Salaries and Fringe Benefits
b. Volunteer/In-Kind Labor (if can be determined)
c. Contracted Services (including staff training)
d. Incentives for Participantsa
152
Grant Funds
560,275
23,779
650
Match
282,826
Total
843,100
0
23,779
650
e. Office Space
f. Supplies and Materials
g. Travel
h. Indirect Costs
i. Developing Collaborative Relationships and
Working through Existing Relationships to Align
Goals and Strategies with Partners (if can be
determined)
j. Local Evaluation and Quality Improvement
Activities (e.g., supervision; data
Totalsb
a
b
22,980
31,880
24,900
193,830
94,604
8,926
201,257
441,156
1,299,450
0
117,584
31,880
33,826
395,087
441,156
587,613
1,887,063
Additional incentive costs are included in the Local Evaluation budget
Includes estimated evaluation costs for the month of December, 2013 not yet billed.
VII. Conclusions
A. Respond to the QIC-EC’s overarching research question:
“How and to what extent do collaborative interventions that increase protective
factors and decrease risk factors in core areas of the social ecology result in increased
likelihood of optimal child development, increased family strengths, and decreased
likelihood of child maltreatment within families of young children at high-risk for child
maltreatment?”
Results of the quasi-experimental outcome study suggest that the intervention was
effective in that participants receiving coordinated services demonstrated a decrease in stress
associated with parenting as measured with the Parenting Stress Index. Statistically significant
results were also generated with Construct A of the Adult Adolescent Parenting Inventory. The
treatment group experienced a slightly larger improvement over time than the comparison
group in terms of their knowledge of the needs and capabilities of children at various stages of
growth and development. In combination, these findings indicate that the intervention was
successful in reducing a subset of the targeted risk factors among participating families.
Unfortunately, due to a ceiling effect, the Caregivers Assessment of Protective Factors did
not generate meaningful results, negating efforts to quantitatively assess change in the
protective factors among participating caregivers.
Optimal child development was assessed with three measures: 1) Sense of Competence
Subscale on the Parenting Stress Index; 2) Adult-Adolescent Parenting Inventory; and, 3) Ages
and Stages Questionnaire. In addition to the Parent, Child, and Total Stress Domains of the PSI,
the Sense of Competence Subscale also generated statistically significant results overall, as well
as when data were disaggregated for Marion County and Hispanic participants. Although four
of five constructs assessed with the APPI did not generate statistically significant findings, as
stated previously, statistically significant results generated by the Expectations of Children
construct suggest that the intervention had a small effect in this area. Additionally, the local
measures (ASQ-3, ASQ SE) found that none of the participating families were in need of a
153
developmental intervention beyond the addition of learning activities and continued
monitoring, and a very small number of participants required referral for mental health
services. It follows that optimal child development was supported by the Initiative, though to a
moderate degree.
Increased family strengths were measured with the Self-Report Family Inventory, Social
Network Map, and six items addressing home and neighborhood safety and financial solvency
(Background Information Form). The Health/Competence, Conflict, and Cohesion Subscales of
the SRFI did not generate statistically significant results, however, the Expressiveness Subscale
approached significance (p=.058). The Expressiveness Subscale assesses the verbal and
nonverbal expression of warmth, caring, and closeness within the family unit, indicating that
there may have been some improvement in this area among caregivers receiving FHI services
over and above that of comparison group participants. Results of the Social Network Map,
being analyzed for all project sites through QIC-EC, are not yet available.
The items assessed with the BIF cannot be directly attributed to the intervention due to
analysis limitations posed by the categorical data. Results generated with descriptive statistics
were generally positive, however. With regard to home safety knowledge and practices, as well
as respondents’ use of emergency numbers (BIF item #18), responses for both the treatment
and comparison participants increased for most of the items queried. For all the safety
practices addressed in the BIF (item #19), respondents in the treatment and comparison
neighborhoods indicated employing most of the behaviors “all of the time”, on average, at both
intake and one year. When asked a series of statements about their neighborhoods (BIF item
#17), the majority of both treatment and comparison group respondents agreed that they
would like to remain a resident of their neighborhood, would be willing to work with people in
their neighborhood to improve the neighborhood, that they like living in their neighborhood, as
well as that they feel safe in their neighborhood.
With regard to financial solvency, the BIF also queried financial problems (Item #15),
household income (Item #14), and use of federal and state aid (Item #16). Participants from
both study groups reported experiencing a variety of financial hardships including inadequate funds
for rent/mortgage payments, utility payments, or to buy food. Treatment group participants did not
demonstrate a notable change in this area. The majority of all caregivers indicated a total
household income of less than $30,000, and almost all were receiving some form of
government aid. These results did not change from intake to one year.
It remains to be determined whether rates of child maltreatment changed in the study
neighborhoods. When data become available through DHS they will be analyzed in 2014. The
Department was able to confirm that none of the study participants in any of the treatment or
comparison neighborhoods had been the subject of a substantiated case of child maltreatment during
the study period.
154
B. The overall impact in helping families to build protective factors, using observations
and case examples, as well as evaluation data. The overall impact of the project on
the children, adults, and families served.
While the CAPF was not useful, ultimately, in assessing the presence of the protective
factors among caregivers, qualitative data gathered with parent interviews generated specific
examples of the building of protective factors among caregivers. A representative summary of
comments garnered from the interviews is provided below.
Parent Telephone Interviews –Quotes Addressing the Protective Factors
•
•
•
•
•
•
Nurturing and attachment: “Before, I didn’t play with my kids. I would give them their
meals and bathe them and take care of them, but I didn’t take time to just enjoy them.
Now I set aside time simply to play with them and I have much more patience and
tolerance than I used to have.”
Knowledge of parenting and child development: “Every week I learn more so I continue
…I wondered why my child couldn’t walk yet and [my home visitor] explained that all
children are different. It is always different at each visit so I stay with it.”
Parental resilience: “The home visitor also taught me that it is very important that I take
time to relax and calm down. If I take better care of myself then I will be better able to
take care of the needs that the children have.”
Social connections: “I have met new people that live in this neighborhood and it is all
because of the program.”
Concrete supports for parents: “My worker… found health insurance [for my child] and I
am really happy about that.”
Social and emotional competence of children: “[I have learned] how to calm down my
child when he is upset.”
The home visitors and parent educators also discussed the building of protective factors
during a focus group conducted during the first year of the evaluation. According to the visitors,
attending to families’ basic needs (food, housing, etc.) or providing “crisis services” (mental
health, domestic violence) often came first, and as a result families gained trust in the home
visitors and saw them as a source of concrete and social support. Once crisis services and basic
needs had been addressed, home visitors reported that they worked with all of the protective
factors to some degree, catering services to families’ individualized needs. In both home
visiting and parent education, staff reported placing special emphasis on the Nurturing and
Attachment protective factor.
In addition to addressing other protective factors, according to the facilitators, parent
education classes and community cafés are especially effective in building social support among
attendees. Educators recommended that neighbors carpool to the parenting education classes,
further cultivating connections among attendees.
155
C. Overall Impact of the Project on the Individual Agencies and Organizations Involved
The Fostering Hope Initiative and, in particular, the research project funded by QIC-EC have had
a profound impact on the individual agencies and organizations involved. Some of these are
listed below.
•
•
•
•
The Strengthening Families Protective Factors have provided a framework, not only for
service delivery, but how we think about supporting families, neighborhoods and
communities to support optimum child development.
o FHI partners have embraced the Protective Factors in their work, including
incorporating them into their policies/procedures.
o While many agencies, including CCS, have used a strengths-based approach to
services for many years, the Protective Factors provide a framework for how to
implement that approach.
o With the help of CSSP, PRE drafted a measurement tool, the Strengthening
FamiliesTM Protective Factors Grid (Appendix C), for assessing the presence of
protective factors within families. In addition to use by CCS and Mano a Mano,
DHS is using the Strengthening FamiliesTM Protective Factors Grid for interviewing
their families.
o The Yamhill County design team for their application to become an early learning
hub used the Protective Factors Framework as a basis for their work to redesign
their Early Learning System. A copy of their planning document is included in
Appendix D. The Yamhill County application was one of six selected for funding
by the state’s Early Learning Council in the first round of applications.
Opportunities for collaboration have expanded, and the nature of collaboration has
moved beyond cooperation to support collective impact to better achieve complex
community issues.
o School districts involved have embraced the neighborhood-based initiative and
welcome the opportunity to collaborate on early learning opportunities that will
increase the number of children entering Kindergarten prepared to succeed.
Center 50+ saw the potential of the initiative to increase the involvement of isolated
seniors in their respective neighborhoods and disseminate information to seniors about
how to be a good neighbor. The Center has now received a grant and hired a half time
person to provide home visiting and follow-up, including helping seniors to develop
social connections.
Agencies and organizations are developing an increased understanding of the science
behind best practice approaches. FHI has had wonderful opportunities to learn from
the Center for the Study of Social Policy, Harvard’s Center on the Developing Child, and
other researchers as a basis for improving our work. Among other results from science,
FHI partners now understand:
o That the same science underlies optimal child development, success at school,
and future economic self-sufficiency.
o The impact of toxic stress on the ability of adults to parent well, as well as its
long-term negative effects on the developing child. As described by the
156
•
Sanctuary Model, the issue isn’t “What is wrong with you,” but rather “What
happened to you” when looking at an individual needing support.
o That safe, stable, nurturing relationships are the key factor in supporting optimal
child development.
There is a growing awareness that the current funding system creates perverse
incentives for state funders and service providers, emphasizing reactive measures and
separating children from their families, and things need to change. Evidence of this
awareness is a new initiative supported by Governor Kitzhaber to develop legislative
support for “Pay for Prevention” in which cost reductions based on outcomes that
reduce the need for foster care and other costly services are used, instead, to pay for
supports that strengthen families.
D. Impact in the Communities Where FHI Operated
•
•
The shift in emphasis from “neighborhood outreach,” as implemented early in the
project, to “neighborhood mobilization” has had a great impact on FHI neighborhoods
and how people live together in those neighborhoods.
o Formerly isolated families with young children are getting to know others,
building their social connections support systems, and becoming involved in a
variety of neighborhood activities.
o Community Cafés have provided opportunities for neighborhood residents to
take on leadership roles, as well as to work together based on the Protective
Factors to develop ways to make their neighborhood a great place to raise
children.
o Adding an exercise component to neighborhood activities resulted in 50
participants attending Zumba classes, and others developing a walking club.
o The neighborhood, school building and city were all beneficiaries of the local
neighborhood projects to clean-up the park, build a community garden, and
clean-up/redesign school grounds.
o Community dinners in one neighborhood, once a week provide an opportunity
for neighbors to get to know each other and for families with food insecurity to
eat. At the same time, these dinners have given a church in the Swegle
neighborhood another means for being a good neighbor.
o La Casita has provided a place for neighbors to gather, for agencies to meet to
coordinate their work, and an effort by a church in the Washington
neighborhood to become a better neighbor.
The community is addressing equity issues.
o The state has charged all school districts with narrowing the significant
achievement gap, in particular, between Latino and white students. FHI’s success
in recruiting Latino families for participation has significant implications to assist
school districts in narrowing the achievement gap by increasing the number of
children entering kindergarten prepared to succeed.
o The Early Learning mandates require that all plans provide for strategies that
reflect an equity lens.
157
o Local church community members, predominantly older and Caucasian, have
reported a higher level of comfort and involvement with their younger, mostly
Latino neighbors.
It is clear that the project has had a great impact on communities; however, we are
convinced that even greater impacts are yet to be revealed.
VIII. Key Recommendations
A. Recommendations to administrators of future, similar projects
•
•
•
•
FHI is not a linear project. Administrators of future, similar projects must be
prepared for staff to become imbedded in the target neighborhoods and to
“follow the energy” that arises from the residents and programs in each
neighborhood. Each neighborhood will be different. FHI, working in six
neighborhoods spread across three counties, has experienced the great
difference between neighborhoods, for example, in smaller, rural communities
with few assets and those in larger communities such as Salem.
In order to maximize collaborative impact efforts, it is critical to involve the CEOs
and key decision-makers of the respective agencies, business partners and
community organizations. FHI’s experience with the Participatory Evaluation and
Planning team, largely composed of mid-managers, did not lead to the top-level
commitment that was needed for true collective impact.
The project needs to be considered as a long term process, one that will take
time to develop, grow, and achieve its desired impact. Both our experience with
learning more about how to achieve collective impact, and the work it takes to
align very different agencies and organizations around a common goal, and the
nature of relationships in neighborhoods, that must grow naturally as trust
develops, point to the need for a long-term commitment.
To change community norms around how to achieve optimum child
development, it would be important to implement a community marketing
campaign that emphasizes the importance of reaching families and children
before age five. While FHI has not been able to do this, partners in FHI are board
members of the new Early Learning Hub, Inc., in Marion County. ELH is building
such a campaign so that the whole community, in places throughout Marion
County, understands the critical importance of the first few years of a child’s life.
B. Recommendations to current project funders as well as potential funders
•
The project needs to “stand behind” and empower families and neighborhood
residents—finding natural leaders, supporting opportunities that emerge. A
project such as FHI which is imbedded in neighborhoods cannot be fully planned
in detail, as it must be able to be responsive to what is happening in the
neighborhood and with families. FHI initially struggled trying to work in rural
158
•
•
•
neighborhoods, because of their very different nature from city-based
neighborhoods. It was important that FHI’s funder for that effort—The Ford
Family Foundation—understood that FHI needed to extend the duration of that
project to progress to achieving the desired outcomes.
Do not overlook funding for training, e.g., Community Cafés and evidence-based
parent education. Community volunteers are willing to provide leadership
support, offer venues, and share skills without charge. Partners often will
volunteer to absorb some costs related to backbone support or staff time.
However, trainings and skill-building activities can present a significant cost but
are integral to success and sustainability. These activities should be included in
the budgeted costs. When FHI has sponsored training, we have observed
tremendous gains—in the skills of individuals attending, and in the way in which
organizations have approached their work.
Funding support for interpreting and translation support is essential. The system
is overwhelmed with requests for “volunteers” to provide these critical services
when bilingual staff persons are not available. Although FHI seeks to hire persons
who are bilingual/bicultural when working in the FHI neighborhoods with a high
proportion of Hispanic/Latino residents, sometimes a monolingual English
person is the best qualified for a position. In those cases, FHI has needed to
support that worker with an interpreter in times when she will be working with
monolingual Spanish families.
Funders should support projects that emphasize the benefits of investing in early
learning opportunities and how this has emerged as one of the most promising
strategies to help strengthen school success, impact the workforce, and
influence future economic development. Such messages are needed to be heard
by businesses as well as by families. FHI submitted a project proposal that would
have supported a communications campaign in high poverty neighborhoods, but
was not successful in getting it funded.
C. Recommendations to agencies or collaborative partnerships about developing or
implementing similar projects
•
•
Consider carefully who is involved from each partner at all points in the ongoing
collaboration. While Executive Directors are required to meet together for
decisions about committing their organizations and resources, staff from partner
organizations providing services, such as home visitors, also need opportunities
to work together to share insights and coordinate their efforts. This is also true
for community volunteers. FHI has worked most smoothly when partners work
together at multiple levels of each organization.
Successful collaboration requires investment from all parties, but particularly
from the “backbone” organization to ensure that all partners are engaged.
Relationships and ongoing communication are key. Funding received from the
Meyer Memorial Trust has supported a full-time Collective Impact Coordinator.
159
•
•
•
This investment has had tremendous returns in the strength of the relationships
among members of the collaborative and in developing systems to support
collective impact.
Relationship-building is a process and requires time. Administrators must be
realistic and plan accordingly in order to reach a level of trust that will ensure
efficient, collaborative teamwork and synergy. The return on the time
investment is definitely worth the effort.
Quantify commitments from partners and revisit them occasionally to ensure
that commitments are honored. FHI had to work at defining “partner” and what
was expected of different organizations that were supporters of FHI.
Establish a track record of results. Share successes. Organizations are more
willing to join a successful collaborative effort, than one that is at a standstill.
D. Recommendations to the general field about supporting the building of protective
factors at the individual and relationship (family) domains of the social ecology and
what services or interventions seem to be the most effective in doing so
•
•
Many of the families with whom FHI worked had multiple generations living in
the same home. It was important that the home visitor assist the entire family—
to gain trust and help others to improve their caregiving—rather than solely the
target child and primary caregiver. In FHI, these actions helped the families to
more quickly trust the home visitor and welcome them into their homes.
Sharing information about the protective factors is more effective when it is
infused across a variety of family and neighborhood activities, goals and
supports, using vocabulary and examples that are culturally and linguistically
relevant.
E. Recommendations to the general field about supporting the building of protective
factors at the community domain and societal domain of the social ecology
•
•
Projects must be alert for natural opportunities that arise within the various
communities and domains to bring in building of protective factors. This may
include, for example, participating in community/neighborhood events to have
information available on the protective factors.
Each person working on the project to support building protective factors likely
will need to work in more than one domain of the social ecology—e.g., home
visitors work at the Individual/Caregiver level but must also support building
protective factors in the Relationship (Neighborhood) domain. Administrators
may want to focus on advocacy to change public policy, but to do that must also
work at the Community (Service Provider) domain to ensure that providers are
adopting methods to build protective factors.
160
•
Craft specific communications for the business community and other partners
emphasizing pertinent messages, e.g. child development is economic
development; the importance of early learning and how the architecture of the
brain is affected; and the economic benefits of investing in the young child.
F. Recommendations to the general field about forging partnerships with parents
•
•
•
•
•
•
•
•
•
Provide families with support for transportation and child care, which may
include stipends, bus passes, or on-site child care, as well as incentives for
attendance (e.g., goods such as diapers, or food).
Follow-through on all promises.
Listen actively to parents’ concerns, dreams and priorities.
Be respectful of their multiple priorities.
Empower and engage parents to serve in leadership roles.
Choose a safe environment to meet and share information.
Coordinate the various systems and services available from multiple agencies.
Families from different cultures may have limited awareness and understanding
of services available to support them.
Identify key parent leaders in the community and partner with them to initiate
contacts and help disseminate information.
Provide trained interpreters when necessary. Do not use family members to
interpret.
G. Recommendations to the general field and funders about addressing multiple
domains of the social ecology in a research study
•
•
•
Studying multiple domains of the social ecology in a research study is critical to
successfully addressing the complex systems in families, neighborhoods, and
communities. The domains of the social ecology provide a framework for teasing
out aspects of that complexity inherent in community-based research.
Research addressing multiple domains of the social ecology requires projects
that are funded for longer than the typical one-to-three year funding cycle of
most public and private funders.
A study addressing multiple levels of the social ecology requires a high quality
evaluation, funded well enough to support input, process, output, and outcome
measurements at a frequency that will support taking action for continuous
improvement. Thus, funding for such a research study must include substantial
funds for evaluation.
161
IX.
Dissemination
A. Ways in which information about the project has already been disseminated within
Oregon and the impact of these dissemination efforts
A Fostering Hope: Closing the Gap Summit was held each fall since 2011 to share
implementation progress and early research results, as well as to build interest and momentum
around the goals of the Initiative.
CCS and partner staffs often share information about FHI, its strategies, and the science
underlying those strategies, informally in meetings with state and local agencies. It has become
much more common to hear others talk about protective factors, toxic stress, and the primacy
of safe, stable, nurturing relationships to optimum child development.
B. Ways in which information about the project has already been disseminated beyond
Oregon and the impact of these dissemination efforts
Dissemination beyond the state of Oregon has primarily occurred through presentations at
conferences, listed below.
• Canadian Child and Youth Care Conference in Banff, Canada (October, 2012). The theme
of the conference was “Inspiring Resiliency”. Dr. Rider and Ms. Winters (PRE)
contributed a presentation titled Fostering Hope: An Innovative Approach to Child
Maltreatment Prevention. The presentation included a description of the program
design and interactive discussion about the preliminary results of the evaluation.
• 18th National Conference on Child Abuse and Neglect in Washington D.C. (April, 2012).
Dr. Rider contributed to a group presentation in which the lead evaluators from each of
the four QIC-EC grantee sites provided an update on progress to date.
• 18th National Conference on Child Abuse and Neglect in Washington D.C. (April, 2012).
Dr. Rider and Ms. Winters (PRE) contributed a presentation titled Participatory
Evaluation and Planning: Engaging Collaborative Partners through Issue-focused Data
Sharing in a Place-based, Federally-funded Research and Demonstration Project. Using
the FHI to frame instruction, Rider and Winters presented Participatory Evaluation and
Planning (PEP), a real-time, issue-focused data sharing partnership between evaluation
and collaborative partner agency representatives that supports implementation and
facilitates outcome achievement.
• Catholic Charities Annual Gathering in San Francisco, California (September, 2013). Dr.
Rider contributed to a presentation titled Fostering Hope: Reducing Child Maltreatment
through Collective Impact. The design and implementation of the Initiative were
presented by CCS staff. Dr. Rider contributed preliminary evaluation results and shared
his perspective about working with an agency engaging in social innovation.
• Annual Meeting of the American Evaluation Association, Evaluation 2013, in Washington
D.C. (October, 2013): Dr. Rider and Ms. Winters (PRE) contributed to a panel
162
presentation titled Evaluating the Use of Evidence-Based Principles across the Social
Ecology. Others contributing to the panel included Dr. Charlyn Harper Browne (Center
for the Study of Social Policy), Dr. Patricia Jessup (InSites), Marah Moore (InSites), and
Dr. Beverly Parsons (InSites). Using the Protective Factors Framework as an example of
evidence-based principles, the QIC-EC R&D projects were used to disseminate
implications for single and multi-site evaluations of innovative, complex interventions
implemented at multiple levels of the social ecology.
C. Research publications completed or in progress.
An article is currently under development for publication in the journal Zero To Three
(special issue, November 2014).
D. Presentations about the Project at Local, Regional, National, and International
Meetings or Conferences
Formal conference presentations are summarized in Table 153. In addition, the Fostering Hope
Initiative was the focus of three convenings in Salem, Oregon. Fostering Hope: Closing the Gap
conferences, held each fall in 2011, 2012, and 2013, included presentations and discussions of
Fostering Hope and the science on which it is based. Presenters at each conference included
nationally recognized experts in fields such as neuroscience, community-building,
Strengthening Families Protective Factors, and Collective Impact
.
163
Table 153
Conference Presentations on FHI
Convening
Organization
Presentation
Date/Location
Canadian Child and
Fostering Hope: An Innovative Approach to
Youth Care Conference Child Maltreatment Prevention.
October, 2012
The presentation included a description of the
Banff, Canada“
program design and interactive discussion
Conference Theme:
about the preliminary results of the
“Inspiring Resiliency”
evaluation.
th
18 National
Group presentation in which the lead
Conference on Child
evaluators from each of the four QIC-EC
Abuse and Neglect
grantee sites provided an update on progress
April, 2012
to date.
Washington D.C.
18th National
Participatory Evaluation and Planning:
Conference on Child
Engaging Collaborative Partners through
Abuse and Neglect
Issue-focused Data Sharing in a Place-based,
April, 2012
Federally-funded Research and Demonstration
Washington D.C
Project.
Presentation on Participatory Evaluation and
Planning (PEP), a real-time, issue-focused data
sharing partnership between evaluation and
collaborative partner agency representatives
that supports implementation and facilitates
outcome achievement.
Catholic Charities
Fostering Hope: Reducing Child Maltreatment
Annual Gathering
through Collective Impact.
September, 2013
The design and implementation of the
San Francisco,
Initiative, preliminary evaluation results, and
California
perspectives about working with an agency
engaging in social innovation.
Annual Meeting of the Panel presentation, Evaluating the Use of
American Evaluation
Evidence-Based Principles across the Social
Association
Ecology. Using the Protective Factors
October, 2013
Framework as an example of evidence-based
Washington D.C.
principles, presentation on how the QIC-EC
Conference Theme:
R&D projects were used to disseminate
Evaluation 2013
implications for single and multi-site
evaluations of innovative, complex
interventions implemented at multiple levels
of the social ecology.
164
Presenters
Dr. Rider and Ms.
Winters (PRE)
Dr. Rider (PRE)
Dr. Rider and Ms.
Winters (PRE)
Dr. Rider (PRE)
CCS staff
Dr. Rider and Ms.
Winters (PRE)
Dr. Charlyn Harper
Browne (Center
for the Study of
Social Policy),
Dr. Patricia Jessup,
Marah Moore &
Dr. Beverly
Parsons (InSites)
E. Plans to disseminate information about the project when the project period ends.
CCS has several plans for disseminating information about the project when the project period
ends:
• Provide the Implementation Manual to the United Way of the Mid-Willamette Valley,
related to the Impact Collaboration grant received by CCS on behalf of FHI.
• Continue to present information on the Fostering Hope Initiative locally, and within our
region of the state to continue to expand and deepen local support for FHI.
• Maintain the FHI Website.
• Publish an article in a special issue of the journal Zero To Three.
• Participate in webinars sponsored by QIC-EC.
• Work at a state level to support “Pay for Prevention” by providing information to
legislators and others about FHI.
• Present at state, regional, and national conferences as opportunities arise.
165
References
Albin, J.M. (1992). Chapter 6, The Performance Engineering Matrix: Finding Solutions. In Quality
Improvement in Employment and Other Human Services: Managing for Quality through
Change (pp.81-95). Baltimore, MD: Paul H. Brookes Publishing Co.
Abidin, R. R. (1995). Parenting Stress Index, Third Edition: Professional Manual. Odessa, FL:
Psychological Assessment Resources, Inc.
Armstrong, K.L. (1999). A randomized, controlled trial of nurse home visiting to vulnerable
families with newborns. Journal of Pediatric Child Health, 35, 237–44.
Borden, L.M., Perkins, D.F. (1999) Assessing your collaboration: a self-evaluation tool. Journal of
Extension, 37. Internet: http://www.joe/1999april/tt1.php.
Bruner, C., Chavez, M. (1998). Getting to the Grassroots: Neighborhood Organizing and
Mobilization. A Matter of Commitment: Community Collaboration Guidebook Series.
Guidebook 6. Des Moines, IA: Child and Family Policy Center.
Carrasco, M. (2008, July). If you had $5 million to spend each year for the next five years to
prevent child abuse and neglect in the United States, how would you spend it? Working
Paper, RAND Child Policy. Drawn from:
http://www.rand.org/pubs/working_paper/2008/RAND_WR596.carrasco.pdf
Centers for Disease Control and Prevention, National Center for Injury Prevention and Control
(2010a). Child Maltreatment Prevention Scientific Information: Risk and Protective
Factors. http://www.cdc.gov/ncipc/dvp/cmp/cmp-risk-p-factors.htm
Children First for Oregon (2008). County Databook for 2008.
http://www.cffo.org/site/download/data_books_map/
Coulton, C., Crampton, D.S., Irwin, M., Spilsbury, J.C., Korbin, J.E. (2007). How Neighborhoods
Influence Child Maltreatment: A Review of the Literature and Alternative Pathways.
Cleveland, OH: Center on Urban Poverty and Community Development, Mandel School of
Applied Social Sciences, Case Western Reserve University.
Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159.
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*Power 3: A flexible statistical power
analysis program for the social, behavioral, and biomedical sciences. Behavior Research
Methods, 39, 175-191.
Fergusson, D. (2006). Randomized trial of the early start program of home visitation: parent and
family outcomes. Pediatrics, 117, 781–86.
Gardner, S., Young, N.K. (2009, October). An Assessment of Services Partnerships Affecting
Younger Children. Washington, DC: Quality Improvement Center on Early Childhood.
166
Girvin, H., DePanfilis, D., & Daining, C. (2007). Predicting program completion among families
enrolled in a child neglect preventive intervention. Research on Social Work Practice, 17,
674-685.
Gladwell, M. (2002). The Tipping Point: How Little Things Can Make a Big Difference. Boston:
Little, Brown and Company.
Korbin, J. Coulton, C., Lindstrom-Ufuti, H., & Spilsbury, J. (2000). Neighborhood views on the
definition and etiology of child maltreatment. Cleveland, OH: Department of
Anthropology, Case Western Reserve University.
Love, J.M. (2005). The effectiveness of early head start for 3-year-old children and their
parents: lessons for policy and programs. Developmental Psychology, 41, 885–901.
Olds, D.L. (2002). Home visiting by paraprofessionals and by nurses: a randomized, controlled
trial. Pediatrics, 110, 486–96.
Olds, D.L. (2004). Effects of home visits by paraprofessionals and by nurses: age 4 follow-up.
Pediatrics, 114, 1560–68.
Parker, W.D. (2008). Family Connections Program Two-Year Evaluation Report. Prepared for
the Arizona Department of Economic Security Office of Community Partnerships and
Innovative Practices.
Shaw, R., & Kilburn, M.R. (2009, April). Child Abuse and Neglect Prevention: Reports from the
Field and Ideas for the Future. Santa Monica, CA: RAND Corporation.
Shonkoff, J.B., & Phillips, D.A., Eds. (2000). From Neurons to Neighborhoods: The Science of
Early Childhood Development. Washington, DC: National Academy Press.
U.S. Department of Health and Human Services, Administration for Children and Families,
Administration on Children, Youth and Families, Children’s Bureau (2009). Child
Maltreatment 2007. Washington, D.C.: U.S. Government Printing Office.
U.S. Department of Health and Human Services, Administration for Children and Families.
(2002). Making a Difference in the Lives of Infants and Toddlers and Their Families: The
Impacts of Early Head Start. Washington, D.C.: U.S. Government Printing Office.
167