Integrated Data Systems
and Program Evaluation
University of South Florida
Diane Haynes
Louis de la
Parte Florida
Mental Health
Institute
PSRDC stands for Policy and Services Research Data
Center
Louis de la
Parte Florida
Mental Health
Institute
PSRDC is a technical section within the Department of
Mental Health Law & Policy, which is a part of the
Louis de la Parte Florida Mental Health Institute at the
University of South Florida, Tampa FL
Data Sources (secondary and primary)
Secondary
Houses data for Pinellas Data Collaborative (County),
Criminal Justice Mental Health & Substance Abuse
Technical Assistance Centers (Statewide)
Louis de la
Parte Florida
Mental Health
Institute
Statewide Agency Administrative data (AHCA Medicaid
Claims, DCF SAMHIS & SMH, Baker Act Initiations,
DCF Child Welfare)
Primary
Faculty obtained external funded projects (survey’s,
evaluations)
Various Type of Administrative Data
Criminal Justice
♦ Florida Dept. of Corrections
♦ Florida Dept. of Law Enforcement
♦ Florida Dept. of Juvenile Justice
Louis de la
Parte Florida
Mental Health
Institute
Behavioral Health
♦ Substance Abuse
♦ Mental Health
Physical Health
Pharmacy
Other Types of Administrative Data
♦ County EMS
♦ County HHS
♦ County CJIS
♦ County JWB
Louis de la
Parte Florida
Mental Health
Institute
♦ County Mental Health Court
♦ County Drug Court
Types of Studies/Analysis
• Mental health, substance abuse, criminal justice
• Adults, Youths, Children
Subpopulation of those in the
Criminal Justice System (Jail/Prison)
Mental
Health
Louis de la
Parte Florida
Mental Health
Institute
Substance
Abuse
Criminal
Justice
They cycle in and
out of the criminal
justice system
More likely to use
costly crisis
behavioral health
services rather
than lower cost
outpatient services
More likely to end
up homeless
Mental Health Courts
Focus on diversion of this sub-population
from the normal criminal justice system path
Through coordination by case management
allows access to appropriate, comprehensive,
targeted, integrated services
Louis de la
Parte Florida
Mental Health
Institute
Is voluntary option
Create an integrated collaboration of
community providers to provide services
Integrated Access to Services
Mental
Health
Services
Other
Community
Support
Louis de la
Parte Florida
Mental Health
Institute
Social
Services
Access to
Appropriate
Services
Jails,
Courts
Substance
Abuse
Services
Sharing of Administrative Data
Allowing access to administrative data
through MOUs, & Data Agreements
♦ Mental Health
♦ Substance Abuse
♦ Criminal Justice
Louis de la
Parte Florida
Mental Health
Institute
♦ Health & Human Services
♦ Homeless Coalition
Program Evaluations
Using administrative secondary data
Initial Baseline
Formative or process (Also Uses Primary
Survey Data)
Louis de la
Parte Florida
Mental Health
Institute
Outcome
Cost Benefit Analysis
Initial Baseline Results
Estimated number of individuals who are
incarcerated and would meet the criteria to
enter the mental health court program
(MHCP) was found to be 3% or 423 of the
individuals being arrested (14,072)
Louis de la
Parte Florida
Mental Health
Institute
Of those 423, 152 are also dealing with a
substance abuse problem
Re-arrest rate after being released from jail
was 33.9% within 6 months and 44.3% within
12 months after released.
Informative or Process Evaluation
Results
Implementation was as planned, with strong
commitment on the part of key stakeholders,
management, and staff.
Part of the satisfaction is the ability of the program to
be flexible to meeting each individual client’s needs.
Louis de la
Parte Florida
Mental Health
Institute
There is an increased need of awareness of the
program, especially for private attorneys was
identified
The number of clients surpassed the estimations, to
the point of the case manager / client ratio has passed
what was set in the manual which was 20 clients per
case manager.
Outcome Evaluation Results
The re-arrest rate for 6 months after the
program for those who completed the
program was 17% compared to the baseline
of 33.9%, and the rate for 12 months after
the program was 22% compared to 44.3%.
Louis de la
Parte Florida
Mental Health
Institute
The average number of days to re-arrest for
those in the study group who were rearrested was 96 days, while for the
comparison group the average number of
days to re-arrest was 52 days.
Cost Analysis Evaluation Results
The average cost per individual who was in
the program and graduated was $792.38.
The cost of incarceration for the study group
in the prior year was $61,932.40 compared
to this year was $19,919.00
Louis de la
Parte Florida
Mental Health
Institute
Even if you include the cost of the MHC
program ($32,020.76), there is still a cost
savings of $9,992.64 for 40 individuals
Cost Table Example 1
Per Client
Average
Number
Per Ind.
Average
Total Cost
Number
of Clients
Cost Per Year
Court Hearing
10
$397.24
60
$17,528.79
Group After Court
1
$15.80
2
$31.60
In Person
3
$75.19
45
$2,823.59
Placement Review
1
$31.60
1
$31.60
Survey Answer
1
$3.95
1
$3.95
Telephone
16
$260.70
59
$11,593.33
Caretaker/Guardian
1
$7.90
1
$7.90
Contact Type
Louis de la
Parte Florida
Mental Health
Institute
Per Year
Total Average Cost
$792.38
$32,020.76
Cost Table Example 2
Type of Service Received
Number of Individuals and Costs
1 Year Before Program (N = 22)
Average Cost &
Days of Svc Per
Nbr Ind. & Total
Per Year
Client
Louis de la
Parte Florida
Mental Health
Institute
1 Year After Starting Program ( N = 38)
Average Cost &
Days of Svc Per
Nbr. Ind. & Total Per
Year
Client
Non Crisis Services
61
$2,537.04
14
$35,518.60
20
$3,104.62
35
$108,661.70
Crisis Services
3
$921.14
18
$15,769.59
14
$5,209.62
24
$124,595.83
MH outpatient
MH Inpatient
8
1
$230.72
$538.90
5
8
$1,153.58
$4,311.20
4
0
$878.61
$0.00
22
0
$19,329.37
$0.00
MH Emergency
2
$461.25
1
$461.25
5
$2,532.27
21
$53,177.65
MH Case Management
SA Outpatient
SA Inpatient
SA Emergency
SA Case Management
25
12
2
0
0
$1,609.04
$202.97
$538.02
$0.00
$0.00
3
5
1
0
0
$4,827.12
$1,014.86
$538.02
$0.00
$0.00
18
4
1
0
12
$2,656.39
$282.14
$52,808.91
$0.00
$903.81
31
3
1
0
5
$82,348.14
$846.34
$52,808.91
$0.00
$4,519.05
PH Outpatient
PH Inpatient
PH Emergency
PH Case Management
52
6
3
0
$2,194.08
$3,511.70
$531.63
$0.00
13
2
9
0
$28,523.04
$7,023.40
$4,784.64
$0.00
6
1
2
0
$809.40
$17,573.00
$490.42
$0.00
2
1
3
0
$1,618.80
$17,573.00
1,417,24
$0.00
Conclusion
Access to Administrative data from multiple
sources can bring added benefit to
evaluations
Administrative data is already collected
Louis de la
Parte Florida
Mental Health
Institute
Across multiple sources can give a more
complete picture of individuals in the
program and the program itself.
Any Questions?
Louis de la
Parte Florida
Mental Health
Institute
Contact
Diane Haynes. MA, MPA
Statistical Data Analyst
13301 Bruce B. Downs Blvd., MHC 2621
Florida Mental Health Institute (FMHI)
Department of Mental Health Law & Policy
College of Behavioral and Community Sciences
Louis de la
Parte Florida
Mental Health
Institute
University of South Florida
Tampa, FL 33612
Voice: 813 974-2056
Fax: 813 974-6411
[email protected]