Use of Social Media to Improve
Engagement, Retention, and
Health Outcomes along the HIV
Care Continuum
Evaluation and Technical
Assistance Center (ETAC)
University of California, Los Angeles
Purpose
Recap, solidify timelines, address issues related to
assessment tools
• Multi-site evaluations (ACASI surveys)
– Baseline
– Six-month
• Intervention exposure
– REDCap
– Backend data
• Medical chart data
• Costing information
2
Multi-site evaluation (ACASI)
Baseline
– In the field
– Chance for commentary in a few minutes
Six-month
– First draft presented this afternoon (open forum)
– Further discussion during future webinar
– ETAC deliverable: 6M ACASI ready February, 2017
3
Multi-site evaluation (ACASI)
Assessment schedule
• Recruitment / enrollment began Oct 2016
• Time points: Baseline, 6, 12, and 18 months) up to 18
months
• Follow-up scheduling
– Ideal: one month before / after designated follow-up
– Allowable: 2 weeks before / 4-weeks after designated
follow-up
• Upload to ETAC web portal: weekly for several
iterations, then monthly
• Data collection will end 6 months before the end of the
study period (February 2019)
4
Multi-site evaluation (ACASI)
ACASI notes
Sites with local evaluations
• Store local evaluation in same folder as multi-site
evaluation if you want interviews to be linked (multi-site
evaluation to transition to local evaluation upon
completion)
MSE
MSE
Local eval
Local eval
5
Multi-site evaluation (ACASI)
ACASI notes
Incomplete interviews
• Normal procedures: End of each day, Rename / move
interview data (.QAD file) and move text files of interview
responses (.RTF files).
• Problems related to restarting incomplete interview
– Renamed / relocated .QAD file: ACASI program will
look for .QAD file in original location and with original
name.
– .RTF file in original location: ACASI program will
overwrite .RTF file with data from point where
incomplete interview is restarted.
6
Multi-site evaluation (ACASI)
ACASI notes
Incomplete interview solutions
• Don’t rename .QAD file that contains incomplete
interview. Okay to move at end of day and move back to
original location to finish incomplete interview.
• Move .RTF file for participant with incomplete interview
before restarting. You will have two .RTF files for that
participant and will need to rename one of them.
7
Multi-site evaluation (ACASI)
ACASI notes
Incomplete interview solution example
• Mon: Complete interview for participant 1 and have
incomplete interview for participant 2
• At the end of the day, move the .QAD and .RTF files as
you normally would but do not rename the .QAD file.
Monday
.QAD, .RTF files
(Don’t rename)
1, 2i
8
Multi-site evaluation (ACASI)
ACASI notes
Incomplete interview solution example
• Tues: Complete interview for participant 3. Participant 2
returns to finish interview.
• (1) Move the Tues .QAD file but do not rename (can
leave .RTF file in place).
Tuesday
.QAD file
(Don’t rename)
3
9
Multi-site evaluation (ACASI)
ACASI notes
Incomplete interview solution example
• (2) Move the Mon .QAD file back to original folder.
Complete interview for participant 2.
Monday
.QAD file
1, 2i
10
Multi-site evaluation (ACASI)
ACASI notes
Incomplete interview solution example
• (3) Rename / move the Mon .QAD and .RTF files (don’t
normally rename .RTF files but do so here so one is not
overwritten if they are all stored in the same location).
Monday
.QAD, .RTF files
(Rename)
1, 2
11
Multi-site evaluation (ACASI)
ACASI notes
Incomplete interview solution example
• Still Tues: Participant 4 comes in to be interviewed.
• (4) Move the Tues .QAD file back to original folder.
Complete interview for participant 4 so that Tues .QAD
file now contains data for participant’s 3 and 4. At the
end of the day, follow usual procedures: rename .QAD
file and move .QAD / .RTF files.
Tuesday
.QAD file
3, 4
12
A Brief History of ETAC Time
Year 2
Sept 2016
Oct 2016
Recruitment / baseline data collection began –
ACASI, intervention exposure (monthly upload)
Feb 2017
6M ACASI ready for sites
Mar-April
6M data collection begins
Mar 2017
1st backend data upload (monthly)
Mar 2017
1st cost data upload (annual, same for all sites)
Oct 2017
1st medical chart data upload (every 6m)
Aug 2017
Year 3
Sept 2017
Aug 2018
Year 4
Sept 2018
13
Multi-site evaluation (ACASI)
Comments / questions?
14
Intervention Exposure
Human engagement (social media / in-person)
Individual encounters with participants recorded daily,
either by
• Using REDCap form provided by ETAC
• Uploading data from site-specific forms (weekly for a few
iterations, then monthly)
– Same as ACASI upload schedule
15
Intervention Exposure
REDCap data elements for individual encounters
• Interviewer ID
• Participant ID
• Date
• Type of contact
– In-person, e-mail, Facebook, text messaging, Kik, WhatsApp,
A4A/Radar, Badoo, Grindr, Jack’d, SCRUFF, PHone/voice,
other
• Location of in-person contact (skipped if not in person)
– Medical office, non-medical office, outside
• Who initiated contact
– Staff, participant
16
Intervention Exposure
REDCap data elements for individual encounters
• Total # of messages sent today
• Total # of messages received today
• Topics discussed
– Regular check-in, following up on previous conversation,
appointment reminder, missed appointment, retention in care,
viral suppression
– Prescription reminder, medication adherence
– Participant seeking information, problem-solving / overcoming
barriers to care, utilization of support services, health literacy,
skills building, social support, enrollment in project, other
• Other notes
17
Intervention Exposure
Comments / questions?
18
Intervention Exposure
Social media component
• Personalized
– Backend data
• Entire sample (not personalized)
– Partly captured by typology
– ETAC will need short write-up on details for
publication
• e.g., How many messages were sent on a daily basis, etc.
19
Backend Data
Client
•
•
•
•
•
•
•
Site
Date
Participant ID
Sender (Provider vs client)
Recipient (Provider vs client)
Content
Healthscore
Wish list
ETAC realizes backend
data will vary across
sites. We welcome
additional variables not
listed here.
Platform (App / website)
• Time log - # times logging in
• Deletion of app
20
Backend Data
Activities
•
•
•
•
•
•
•
Time spent in app / site
Number of activities engaged in on app / site
Time spent in each activity
# hits per function / page
# posts (activity in social part of app / site)
# private messages (activity in social part of app / site)
Reminders confirmed / ignored
21
Backend Data
Next steps / deliverables
January 2017
– Sites to finalize what data can be collected / shared
with ETAC
March 2017
– Begin uploading backend data through ETAC web
portal (weekly for a few iterations, then monthly)
• Same as ACASI / individual participant contact
upload schedule
22
A Brief History of ETAC Time
Year 2
Sept 2016
Oct 2016
Recruitment / baseline data collection began –
ACASI, intervention exposure (monthly upload)
Feb 2017
6M ACASI ready for sites
Mar-April
6M data collection begins
Mar 2017
1st backend data upload (monthly)
Mar 2017
1st cost data upload (annual, same for all sites)
Oct 2017
1st medical chart data upload (every 6m)
Aug 2017
Year 3
Sept 2017
Aug 2018
Year 4
Sept 2018
23
Backend Data
Comments / questions?
24
Costing
Annual cost of planning and implementation of
demonstration site interventions including:
• Infrastructure (facility costs)
• Capital investment (one-time costs)
• Recurring costs
• Personnel
All costs reported separately by funding source
– SPNS versus non-SPNS funds
Local / cross-site evaluation costs not included in the cost
of demonstration site intervention implementation
25
Costing
A little more on each costing category
– Infrastructure (facility costs)
• Facility space (square footage) and rental cost,
space allocation for project
– Capital investment (one-time costs)
• ≥ $100 and expected to last longer than a year
• Description, Date acquired, how (purchased,
rented, free), new / used, item value, price paid
– Recurring costs
• Description, average price per month or unit,
quantity purchased, total amount
26
Costing
A little more on each costing category
Personnel
• Initials, job title, salary+benefits, hours on project
• Hours broken down by
– Time period (pre-implementation, implementation,
management / oversight / other activities)
– Activity (community engagement, testing, patient
navigation, case management)
– Intervention target (identification, linkage, retention,
etc.)
Further details during future webinar
27
Costing
Web portal upload schedule (same for all sites)
– Annually one month after FFR
• FFR due Jan 31
– Begin: March 2017
– End: March 2019 (Year 4)
Costing data
• Entered into forms to be provided by ETAC
28
A Brief History of ETAC Time
Year 2
Sept 2016
Oct 2016
Recruitment / baseline data collection began –
ACASI, intervention exposure (monthly upload)
Feb 2017
6M ACASI ready for sites
Mar-April
6M data collection begins
Mar 2017
1st backend data upload (monthly)
Mar 2017
1st cost data upload (annual, same for all sites)
Oct 2017
1st medical chart data upload (every 6m)
Aug 2017
Year 3
Sept 2017
Aug 2018
Year 4
Sept 2018
29
Costing
Comments on costing data?
30
Medical Chart Data Abstraction
Abstraction of routinely collected data from:
–
–
–
–
HIV testing
Patient care
HRSA Ryan White Services Report (RSR)
Variables based on prior SPNS initiative
• Variables should be available for extraction from
patient data
• ETAC to finalize variable list by Dec, 2016
31
Medical Chart Data Abstraction
Web portal upload schedule (every 6m)
– Begin: 6m after 1st 6m of recruitment
– e.g., Begin recruitment Oct, 2016 → upload Oct,
2017
– Every 6m after that through Feb 2019 (Year 4)
Data options
• Abstract data directly from medical files and upload
– Sites needs to ensure that list of requested variables
are contained in data file
• Data entry in ETAC forms
32
A Brief History of ETAC Time
Year 2
Sept 2016
Oct 2016
Recruitment / baseline data collection began –
ACASI, intervention exposure (monthly upload)
Feb 2017
6M ACASI ready for sites
Mar-April
6M data collection begins
Mar 2017
1st backend data upload (monthly)
Mar 2017
1st cost data upload (annual, same for all sites)
Oct 2017
1st medical chart data upload (every 6m)
Aug 2017
Year 3
Sept 2017
Aug 2018
Year 4
Sept 2018
33
Medical Chart Data Abstraction
Comments / questions?
34
Thank You
Final comments / questions?