SEEP progress report - International Initiative for Impact Evaluation

Appendix 3: Stakeholder engagement and evidence uptake plan
(SEEP) progress report
The study team’s focal point will liaise with 3ie and address questions and issues raised during
the review process. Please see the last page for a list of supporting documents we would like
you to provide. In completing this form, please expand each section as needed.
1. Interactions (e.g. meetings, workshops, conferences or dissemination/sharing
events) related to the stakeholder engagement during the reporting period and
upcoming activities: Since the last report, list the stakeholder engagement meetings or
other events that the team organised or participated in where study-related discussions took
place. For each interaction (in not more than 200 words) please highlight the main
discussion points and feedback received and the follow-up planned. Please refer to Annex 1
on p.8 of this progress report template for guidance on supporting documents needed.
Please specify any upcoming activities and events planned and highlight changes, if any,
that you have made to planned interactions since submitting your stakeholder engagement
and evidence uptake plan or the last SEEP progress report.
2. Communication products: Please list any study-related communication products that the
team would like to highlight to showcase engagement with a wider audience. This could
include, but is not limited to, published blogs, stories, press clippings, newspaper articles,
videos, podcasts, PowerPoint presentations or policy briefs produced during the reporting
period. Please also list communication products that were part of the intervention and were
used to engage with communities e.g., cartoon story board, illustrations, songs and theatre.
Where relevant (e.g. in case of press clippings, newspaper articles and blogs) please
provide us information on where and when it was published along with the web link. Please
refer to annex 1 on guidance for supporting documents.
Version 14 October 2016
Page 2 of 9
3. Publications that used data or analysis supported by 3ie as part of this grant: Please
include the complete reference (including publication title, year of publication, authors, and
publication source) and a link, if available.
Version 14 October 2016
Page 3 of 9
4.
Engagement, uptake and use indicators: Please provide information on the 3ie indicators
for the current reporting period. You may additionally report on indicators that you may have
identified.
Indicator
# for
current
reporting
period
Engagement indicators
 # of formal or informal meetings and other events to discuss any aspect
related to the evaluation or for building relationships with stakeholders,
including community members, civil society, media, academia, donors
(e.g. please include a short description of why you engaged and whether
you discussed anything specifically about the study, e.g., study design,
study questions, justification for doing the evaluation, baseline, midline,
results)
 # of participants in those meetings and events (estimate)
 Estimated # of participants who are decision-makers (e.g. policymakers
and programme managers, including community members as decisionmakers, as appropriate)
 # of knowledge and information products produced that are related to the
study; please specify the intended main audience

Include the name, web links, draft copies and brief description e.g. briefs,
memos, articles, working papers, blogs as part of documenting impact
evaluation analysis and findings. This may also include products produced
as part of the intervention being evaluated, such as cartoon story boards,
illustrations, songs, stories or theatre.
Estimated # of stakeholders that received the knowledge products
(disaggregated by product)
Uptake indicators


# of media mentions (i.e. print, television, web or radio), where the study
was mentioned (please provide electronic clippings and web links when
possible)
Feedback from policymakers, programme managers or beneficiaries on the
study and findings





# of policymaker and programme management invitations to present on
interim or final findings
# presentations of the interim or final study findings by the implementing
agency at events
# of downloads of policy notes, briefs, blogs, memo articles, working
papers or other study-related materials from your website
Implementing agency website page on the study or if final report gets
posted on their website
Version 14 October 2016
Page 4 of 9

# of websites where the final study report was posted (please include web
links)
Use indicators
 Inform discussions of policies and programmes related to the programme
that was evaluated
o Meeting agendas, where the study appears on it; please include
enough detail to know the meeting and who was there (see above
for reporting on events)
o # of citations by implementing agency in policy documents
o Invitations to participate in working groups on policies and
programmes related to the focus of the study
o Influence funding decisions of donors
o Guide implementing agency or donor’s strategies and programme
priorities









Changes (positive or negative) in the design, implementation or budget of
the programme or policy being evaluated (please identify which one(s))
Changes in the local, national or global programmes or policies, to which
there is some type of verification that the study findings have contributed
to that change
Inform regional or global discussions related to the focus of the study, e.g.
study findings are used to inform policy priorities
o # citations of study findings by donors, international networks or
alliances in global policy documents
Inform the design of other similar programmes based on the study findings,
e.g. use of study findings by multilateral or bilateral donors to design similar
programmes in other contexts
Scale-up of the programme to which the findings have contributed in some
verifiable way
Scale-down or closure of the programme based on the study findings
Change in institutional culture of evidence use or commitment to
evaluation, e.g. the implementing agency changes their monitoring system,
changes programme or institutional practice, or it plans to commission
another impact evaluation. Please summarise details about causal
pathways for the change and contribution
Changes in public discourse on questions addressed by the study, with
details to allow verification and understanding of the change
Any other changes that you observe (and can verify) that you consider
evidence of use, either direct or indirect (i.e. an observable change related
to the study that is beyond the universe of known direct stakeholders for
the study. For example, a vitamin study that changed the culture of
evidence use by programme managers of an unrelated early childhood
development parenting programme)
Version 14 October 2016
Page 5 of 9
5. Feedback and quotes from key policy influencers or stakeholders: Please document
the feedback, preferably quotes, received from one or more of the stakeholders identified in
your SEEP as your target audience. This can be in the form of letter of endorsement or
support from stakeholders, partnership agreement, email from stakeholders, minutes of
meetings or working group meetings where the study would have been presented (to be
documented in supporting documents) or other documentation.
Version 14 October 2016
Page 6 of 9
6. Political context and challenges in stakeholder engagement1: Please describe any
changes in the policy context and associated challenges with stakeholder engagement and
communication. What strategies did you employ to alleviate these challenges? What
lessons do you draw from this?
1
This could include changes relating to the socio-political context such as change of administration, upcoming
elections, key influencers moved to another department not relevant to the project, changes in policies, laws or
regulations or specific changes relating to the implementing agency (policies or operations).
Version 14 October 2016
Page 7 of 9
7.
Other notable changes or challenges: Please note any significant changes that affect or
could affect stakeholder engagement and evidence uptake capacities or plans. Explain
what actions are being taken to respond to those changes.
Version 14 October 2016
Page 8 of 9
Annex 1: Supporting documents
Please supply supporting documents for the activities carried out during the reporting period.

For each meeting and/or event that you are reporting, please provide the following
information:
o copy of the presentations made, as appropriate
o list of participants
o main discussion points or feedback received from stakeholders
o follow up actions, if any

If you maintain a project website, please provide links to any content updates and
website statistics about number of visits and downloads of items from those pages

Links to blogs related to the study

Copies of media articles, op-eds and podcasts. If the link is not available, we request
you to please scan the clipping and email the same to us. Please note we encourage
you to provide each clipping in a separate pdf document so that we may upload the
same on our website on the page dedicated to the study.

Copies of any policy-related documents (e.g. policy notes, briefs) produced that were
submitted to any policy-making body

Knowledge products, including but not limited to any of the following: study flyers, info
graphics, reports, summaries, working papers, articles published in peer-reviewed
journals or grey literature

Policy-relevant reflections by any team member about any conferences or workshops
that they attended.
Version 14 October 2016
Page 9 of 9