BCURE Evidence-Informed Decision-Making Capacity Building Workshop
1st and 2nd June 2015
Pretoria, South Africa
Rapid Evidence Assessments
and Evidence Gap Maps
Philip Davies
International Initiative for Impact Evaluation
[3ie]
Philip Davies
www.3ieimpact.org
Rapid Evidence Assessments –
What Are They?
• Scaled down systematic
reviews of existing
evidence
• Timed to meet the needs of
policy makers/practitioners
(1-3 months)
• Strategically using the
‘three arms’ of systematic
searching, but less
• exhaustively
Critical appraisal of identified studies is included
Photo © Panos East Africa
• Summary of findings, with caveats and qualifications
Philip Davies
www.3ieimpact.org
Rapid Evidence Assessments –
How Scaled Down?
Philip Davies
www.3ieimpact.org
When to use a Rapid Evidence Assessment
• When a policy decision is required within months,
based on the best available evidence within that time.
• When there is uncertainty about the amount and
relevance of the available evidence
• When a map of evidence is required to establish the
existing evidence, and to direct future research needs.
• When evidence of the likely effects of an intervention is
required.
• When evidence of implementation barriers and
facilitating factors/mechanisms is required
• When evidence on the cost and cost-benefits is
required
Philip Davies
www.3ieimpact.org
Rapid Evidence Assessments - Advantages
•Timed to meet the needs of decision makers, not
academics/researchers
•A sounder evidence than selective literature reviews
•Better basis for making policy than being evidence-free
•Provides a challenge function to received wisdoms
•Challenges and strengthens a policy’s theory of change
•Provides more precise estimates of likely
outcomes/effects
•Provides valid and reliable evidence on implementation
•Transparent strengths/weaknesses of evidence-base
Philip Davies
www.3ieimpact.org
Rapid Evidence Assessments - Limitations
• Not as comprehensive as systematic reviews
• Not as data-detailed as a full systematic review
• May involve some selection bias and publication
bias
• Can misrepresent the totality of evidence
• Can lead to Type I and Type II errors
• Need to be continued to produce full systematic
reviews
• Need to use with caution
Philip Davies
www.3ieimpact.org
3ie Evidence Gap Maps
• Maps of the existing evidence base on a policy
issue, topic or sector such as maternal health,
HIV/AIDS, agriculture, extreme poverty
• Structured around a framework of interventions
and outcomes (intermediate and final)
• A ways of identifying where there is evidence,
and where there is not
• An indication of the quality of this evidence
• Links to user-friendly summaries in the 3ie
database of systematic reviews.
Philip Davies
www.3ieimpact.org
Objectives of 3ie evidence gap maps
• To provide user-friendly tools for accessing
and exploring existing evidence quickly and
efficiently
• To
facilitate
informed
judgement
evidence-based decision making
• To identify
evidence
key
“gaps”
in
the
and
available
• To indicate where future research should be
focused
• To facilitate strategic use of scarce research
funding
Philip Davies
www.3ieimpact.org
Evidence gap map of interventions
HIV/AIDS (Early Days)
Outcomes
Interventions / Outcomes
Awareness, Knowledge
Attitudes and Beliefs
Peer Education
Prevention for heterosexual men
Prevention for heterosexual men
Peer interventions
Risk Behaviour / Skills
HIV Transmission
Condom use for HIV positive women
Challenges in HIV prevention research
Take-up, Retention,
Adherence
Morbidity
Quality of Life,
Well-being
Mortality
Prevention in occupational settings
Household
Well-being
Labour Participation,
Productivity
Empowerment
Access, Service
Quality
Stigma
Reducing stigma
Peer education
Peer interventions
Behaviour change interventions for women
Prevention in Latin America
Couples-focused interventions
Behaviour Change
Interventions
Behaviour interventions for prevention
Prevention in heterosexual men
Prevention in occupational settings
Behaviour interventions for prevention
School based interventions for youth
Influence of social agents
Peer interventions
Prevention in Latin America
Prevention in occupational settings
Interventions
School based interventions for youth
Condom Promotion,
Distribution
Prevention for youth in Africa
Parent-child communication in
Africa
Educating traditional healers
Educating traditional healers
Prevention for youth in Africa
School-based sexual health in Africa
Prevention in African youth
Life skills education for youth
Parent-child communication in Africa
Girls' education
Peer-led sexual health education for youth
Prevention for youth in Africa
Peer interventions for HIV positive
women
ICT for youth
Information, Education
and Communication
Increasing youth's use of health
services
Peer interventions for HIV positive
women
Peer interventions for HIV positive women
Educating traditional healers
Peer-based interventions
for HIV positive women
Peer interventions for
HIV positive women
Reducing stigma
ICT for youth
Prevention in African youth
Life skills education for youth
Parent-child communication in Africa
Peer-led sexual health education for
youth
Girls' education
Peer interventions for HIV positive
women
ICT for youth
Mass communication programmes
Mass Communication
Increasing youth's use of health
services
Mass media for young people
Community Mobilisation
Reducing stigma
Behaviour interventions for prevention
Counselling for testing of pregnant women
Routine vs. voluntary testing
HIV Testing and
Counselling
Family planning
Home-based VCT
VCT
Routine vs. voluntary testing
Counselling for testing of pregnant
women
Family planning
Integrating PMTCT with other health
services
Family planning
Counselling for testing of pregnant
women
Routine vs. voluntary testing
Integrating PMTCT with other health
services
Counselling for testing of pregnant women
Prevention of Mother to
Child Transmission
Counselling for testing of pregnant
women
Population based STI control
Biomedical Interventions
Challenges in HIV prevention research
Male circumcision for prevention of
homosexual acquisition
Male Circumcision
Impact of treatment on risk behaviour
Antiretroviral Therapy
Children's adherence to ART
Nurses for ART
management
Non-clinical outcomes of ART
Nurses for ART management
Family support
Patient adherence
Palliative care
Treatment and Care
Palliative care
Psychosocial well-being of HIV affected children
Family-centred treatment for HIV positive children
Self-management
interventions
Task shifting in Africa
Self-management
interventions
Integrated HIV and TB Service delivery
Health Systems
Peer-education
Harm reduction for involuntary
detainees
Key populations
Harm reduction for involuntary
detainees
Integrating PMTCT with other health
services
Increasing youth's use of health
services
Task shifting in Africa
Palliative care
Family-centred
treatment for HIV
positive children
Task shifting in Africa
Task shifting in Africa
Integrated HIV and TB
Service delivery
Integrated HIV and TB Service delivery
Peer-education
Prevention interventions for female sex
workers
Male circumcision for prevention of
homosexual acquisition
Harm reduction for involuntary detainees
Prevention interventions for female sex
workers
Behaviour interventions for sex workers
Behaviour interventions for prevention
Harm reduction for involuntary
detainees
Behaviour interventions for sex workers
Interventions to Reduce
HIV/AIDS Stigma
Reducing stigma
Reducing stigma
Reducing stigma
Reducing stigma
Structural Interventions
Economic Interventions
Economic interventions for prevention
Challenges in HIV prevention research
Economic interventions for prevention
Philip Davies
www.3ieimpact.org
Economic interventions for
prevention
Evidence gap map of interventions
HIV/AIDS
Philip Davies
www.3ieimpact.org
Philip Davies
www.3ieimpact.org
Interactive Evidence Gap Maps
(Latest Hi-Tech Interactive Platform)
Philip Davies
www.3ieimpact.org
Philip Davies
www.3ieimpact.org
Philip Davies
www.3ieimpact.org
Philip Davies
www.3ieimpact.org
Evidence Gap Maps
• Agricultural Innovation
• Climate Change Adaptation
• Climate Change Mitigation
• EGMs continue to be in high
demand
• As a stand-alone product
• And as an integral part of SRs
• A new high-tech, interactive
platform for presenting EGMs
• Conservation
• Education (Primary And
Secondary)
• Evidence For Peace Prograsms
• HIV/AIDS
• Integration Of HIV Services
• Maternal Health
• Productive Safety Net Programs
• REDD+ Initiatives
• Social Protection
• Water, Sanitation And Hygiene
Philip Davies
www.3ieimpact.org
Thank you
Philip Davies
Email: [email protected]
+44 (0)207 958 8350
Visit www.3ieimpact.org
Philip Davies
www.3ieimpact.org