Develomental Evaluation in
Children’s Residential Care
24th of October 2013
FES Seminar
Developmental Evaluation at Work
Mirka Häyrynen
Malmi Children’s Home
Social Services and Health Care Office
City of Helsinki
[email protected],
[email protected]
Malmi Childrens Homes
Five homelike units with two small homes in each and independent living training
apartment. In every small home there lives four to five children. Each unit has 12
caretakers . A unit manager supervises the unit and the homes share a director,
psychologist and an office secretary.
JÄKÄLÄPOLKU:
Tuulikumpu
Kulmala
FALLPAKANTIE:
Vuorela
Mäntylä TILANHOITAJANKAARI:
Niittylä
Jukola
KOTIKAIVONTIE:
Niittylehto
Koivunotko
KARVIAISTIE: Pirttilä
Kaislikko
MALMIN
PIENKODIT
OFFICE
Malmin Children s Home
Participatory Development Work
•  Describing the children's care and education process, a circle of
care model, the current situation at Malmi Children’s Homes and
continuing development of the content of the model.
•  Developmental evaluation of the circle of care model on an
individual child level and on process level to create social
innovations that have the best possible outcome.
Why / Purpose
2010
2009
2008
2011
2012
2013
How / Action
What / Aim
Mirka Häyrynen
EVALUATION STEW
ü  Client children and families
ü  Couple of motivated workaholic unit managers
doing studies while working
ü  A Very supportive executive manager
ü  A Helpfull evaluation consultant
ü  Some supportive collegues
ü  A dozen of critical employees
ü  A dozen of inspired employees
ü  A large scale process map
ü  Pilot tests of evaluation tools
ü  A lot of forums with development work
Spice it up with creativity, determination, collaboration
etc.
Don´t forget! PEOPLE
are the most important
ingredient
Mix them up in a community pot.
Let it boil atleast a year.
Spice it up some more with evaluation methods
(Test the methods first in a smaller pot)
Serve it to evaluate the balance of tastes
Change what is needed
Let it stew.
Taste and evaluate
Change what is needed
Let it stew…
Mirka Häyrynen and Timo Jattu
Participatory Development Work of Children's Care
and Education Process at Malmi Children s Homes
7. CONSOLIDATING
THE NEW PRACTISE
6. Reflecting on the new
model in different forums
7. Sharing Knowledge and
Experiences
1. CARE AND
EDUCATION
PROCESS IS NOT
DESCRIBED
1.
QUESTIONING
6. REFLECTING ON
THE PROCESS
2A HISTORICAL ANALYSIS
2B ACTUAL-EMPIRICAL
ANALYSIS
5. Introducting and
implementing in
practice
2A Looking at how it
has been done before
2B Looking at how it´s
actually done now
5. IMPLEMENTING
THE NEW MODEL
4. Participatory
examination in
different forums
Applying
Developmental Work
Research Approach
(Engeström 2008)
3. MODELING
THE NEW
SOLUTION
4. EXAMINING
THE NEW
MODEL
3. Pulling together
the existing material
and developing the
content
Mirka Häyrynen
Malmin lastenkodin kasvatusvastuumalli
Circle of Care Model
1. Child moving in to
Malmin pienkodit
• 1.1 Decision of Placement
• 1.2 Parents Introduction Visit
• 1.3 Child’s Introduction Visits
• 1.4 Child Moves in
• 1.5 Incoming Meeting
• 1.6 Support Offered to the Parents
• 1.7 First Care and Education Plan
2. Child growing up in
Malmin pienkodit
3. Child moving out
from Malmin pienkodit
• 2.1 Rehabilitative Care and
Education Work
• 3.1. Supporting
independense
• 2.1.1 Basic Care and Education
• 2.1.2 Personal Caretaker
System
• 2.1.3 Support for Schooling
• 2.1.4 Working in Partnership
with the Families
• 2.1.5 Restriction Procedures
• 2.1.6 Rehabilitative Work
Methods
• 3.2 Independent living
training
• 3.2.1 Steps to
independent living
• 3.3 Aftercare
• 3.4 Moving out from the
Children’s Home
• 2.2 Planning and Evaluation of
the Care and Education Work
• 2.2.1 Evaluation and
operations management
practices
• 2.2.2 Support and
Collaboration Structures
• 2.2.3 Safety
• 2.2.4 Financial Assistance
Mirka Häyrynen
Malmi Children s Home
Circle of Care Model
Kasvatusvastuumalli
Parents
and
Family
CHILD
Malmin
Pienkodit
Workers
The circle of care
model describes how
the children s care
and upbringing is
carried out in
partnership and
cooperation with the
parents, caretakers
and with other child
welfare key players.
Support and
Service Network
Mirka Häyrynen
Participatory Development Work of the Evaluation of Circle of Care Model
(kasvatusvastuumalli)
7. Sharing Knowledge and
Experiences
6. Collecting Feedback from
participants
7. CONSOLIDATING
THE NEW PRACTISE
6. REFLECTING ON
THE PROCESS
1. QUESTIONING
1. THE EFFECTIVENESS
OF THE PROCESS IS
NOT SYSTEMATICALLY
EVALUATED AND
DOCUMENTED
5. Workshops and
using tools in
practice
2A HISTORICAL ANALYSIS
2B ACTUAL-EMPIRICAL
ANALYSIS
5.
IMPLEMENTING
THE NEW MODEL
4. Pilot testing new tools
4. EXAMINING THE
NEW MODEL
Applying
Developmental Work
Research Approach
(Engeström 2008)
3. MODELING
THE NEW
SOLUTION
2A Examining previous
ways of assessment
2B Focus Group Research
on critical points of
effectivenes
3. Using the research Results
to build an evaluation plan
Mirka Häyrynen
Care and Education Partners Views of the
Critical Points in the Effectivess That Apply Through the Process
1. Child moving in to
Malmin pienkodit
2. Child growing up in
Malmin pienkodit
3. Child Moving out
from Malmin pienkodit
Planning and Evaluation
Homelike Care and Enviroment
Experience of Participation and Experience of Wellbeing
Possibility to Reliable Attachment Relationships
Appreciative Interaction and Partnership
Häyrynen M. 2011, 115. Care and Education Process in a Children s Residential Care
Towards Evaluation of Effectiveness –Development Work in Malmi Children s Homes
Mirka Häyrynen
Leading and evaluating the care and education process
Unit
Manager
Personal
Caretaker
Forums
Care and education
plan
Tools and
measures
Work Teams
REFLECTION
Tools and measures
Children
and
Parents
See the possibilities, be ready with an open mind to question things, possibilify expansive learning, practice,
Mirka Häyrynen and Timo Jattu
evaluate, change, create and do it together dialogically and through networks.
Daily reporting in Effica Client
Information Processing
System:
Changes in the child s
wellbeing, monitoring specific
information as planned, school,
medication, collaboration with
parents, restriction procedures
etc.
Other evalution methods and
measurement tools needed
Care and
Education
plan
Malmin pien
kodit
Toolbox:
SDQand
s
t
h
g
Stren
lties
Difficu naire
on
Questi
Management
Information Tool
ly
Month ment
s
Asses
Mirka Häyrynen and Timo Jattu
Care & Education Plan (twice a year)
Documenting
the
situational
assesment
Team
meeting:
Peparing for the
plan meeting and
SDQ with the child,
parent and social
worker
SDQ Score
SDQ
questionnaire
Work plan
and
timetable
• Input of the
professional
team
• Evaluation
and setting
new goals
• SDQquestionnaire
Documenting
Care & Education Plan
• Evaluating
the goals
• SDQ results
• Setting goals
• Workplan
and timetable
for plan
Documenting
the Plan
Team meetings
every 6 weeks
monthly
assessments and
checking the plan
Delivering the
plan and going
through with the
child, parents
and social worker
Checking
the Plan
Mirka Häyrynen
Developmental evaluation to create Social
Innovations in Child Protection services
Our Experiences of the Strengths and Challenges?
• Seeing the possibilities
• High trust
• Reflective process and critical thinking
• Quick feedback, adjusting and changing plans and
being realistic
• Culture and resources for ongoing exploration
• Improvements versus development and creating
innovations
• Documenting and using the evaluation information
• informed decision making
• Focus and prioritizing
• Sharing the results and
lessons learned
Mirka Häyrynen
REFERENCES:
• 
• 
• 
• 
• 
• 
Gamble J. 2008. A Developmental Evaluation Primer. The J.W. McConnell Family
Foundation
http://www.mcconnellfoundation.ca/assets/Media%20Library/Publications/A
%20Developmental%20Evaluation%20Primer%20-%20EN.pdf
Engeström Y. 2008. From Teams to Knots Activity Theoretical Studies of
Collaboration and learning at Work. Cambridge University Press.
Häyrynen M. 2011. Lastenkodin hoito- ja kasvatusprosessi kohti vaikuttavuuden
arviointia –Malmin pienkotien yhteisöllinen tutkiva työnkehittäminen
http://urn.fi/URN:NBN:fi:amk-2011112816025
Jattu T. Lastenkotilasten hyvinvointia mittaamassa: SDQ-kyselyn käyttöönotto
arviointi- ja työvälineenä Malmin pienkodeissa.
http://urn.fi/URN:NBN:fi:amk-2011112816025 https://publications.theseus.fi/handle/
10024/39540
Patton M. Q. 2011. Developmental Evaluation Applying Complexity Concepts to
Enchance Innovation and Use. The Guilford Press.
Information for researchers and professionals about the Strengths & Difficulties
Questionnaires.
www.sdqinfo.com
Mirka Häyrynen