A Family of Algorithms for Global Optimization with Continuous and

Global Optimization of Complex Healthcare Systems
Zelda B. Zabinsky
Industrial and Systems Engineering
University of Washington
Seattle, WA
April 18, 2017
Institute for Disease Modeling (IDM) Symposium
1
Global Optimization of Complex
Healthcare Systems

Often need numerical simulations to describe a
complex healthcare system:
−
−
−

Natural progression, spread and management of disease
New technologies becoming available
Allocation of scarce resources
Global optimization (or simulation-optimization):
−
−
−
Problem may be non-convex, black-box, discontinuous,
involve integer and real-valued decision variables
Uncertainties may be present
Multiple objectives
2
Several Random Search
Algorithms for Global Optimization

Sequential random search algorithms:
−
−

Simulated annealing
Cross-entropy
Population-based:
−
−
−
Genetic algorithms (cross-over, mutation)
Particle swarm (position, velocity)
Interacting particle algorithm with hit-and-run
[Zabinsky, Stochastic Adaptive Search in Global Optimization, 2003]
[Zabinsky, Stochastic Search Methods for Global Optimization, a book chapter in the
Wiley Encyclopedia of Operations Research and Management Science, 2011]
[Zabinsky, Random Search Algorithms for Simulation Optimization, a
book chapter in the Handbook on Simulation Optimization, 2015]
3
Improving Hit and Run (IHR)
IHR: choose a random direction and a random point
180
160
140
120
100
x2

80
60
40
20
x2
x1
20
40
60
80
100
120
140
160
180
x1
[Zabinsky and Smith, Hit-and-Run Methods, a book chapter in Springer’s
Encyclopedia of Operations Research & Management Science, 2013]
4
Optimization: What Do We
Really Want?





Do we really just want the optimum?
What about sensitivity?
Do we want to approximate the entire
surface? Or just a region of interest?
Multiple objectives? Role of objective
function and constraints?
How to account for uncertainty?
5
Probabilistic Branch and Bound
(PBnB)




Approximate a set of “good” solutions
(quantile, level set approximation)
Handles black-box, noisy functions, including
both integer and real-valued variables
Single or multiple objective functions
Provide probability bounds assuring the
quality of solution set
[Huang and Zabinsky, “Adaptive Probabilistic Branch and Bound with Confidence Intervals for
Level Set Approximation,” Proceedings of the 2013 Winter Simulation Conference, 2013. ]
[Huang and Zabinsky, “Multiple Objective Probabilistic Branch and Bound for Pareto Optimal
Approximation,” Proceedings of the 2014 Winter Simulation Conference, 2014. ]
6
Approximated Level Set
(Best 10%)
Three test functions with contours:
(A) Rosenbrock
(B) Sinusoidal function (centered)
(C) Sinusoidal function (shifted)
Bold contour is target level set
pruned
maintained
undecided
7
Parameter Estimation


Given m=10,000 data points that have been
randomly generated from the density
with undisclosed parameters
Determine the parameters by solving a maximum
likelihood problem
8
Parameter Estimation

PBnB finds the optimal solution (2,5) in
seven iterations with 285 sample points
9
Allocation of Portable Ultrasound
Machine to Orthopedic Clinics


Simulate costs: (MRI expensive, ultrasound
relatively low cost) and benefits (less travel
time, less wait time)
Diagnosis quality: Experience and training
on using portable ultrasound machines may
influence the diagnosis quality
−
−
MRI accurate
Ultrasound as accurate if well-trained
10
Allocation of Portable Ultrasound
Machine to Orthopedic Clinics


Simulate costs (MRI
expensive, ultrasound
relatively low cost) and
benefits (less travel
time, less wait time)
Diagnosis quality:
−
−
MRI accurate
Uncertain accuracy of
portable ultrasound
Current Specialty Centers/Radiology
Current Major Primary Care Clinics
(Potential locations for orthopedic care)
11
Simulation-Optimization for
Medical Imaging Resources



Multiple
objectives
Tradeoff health
utility and cost
Efficient
frontier
[Huang, et al., 2015]
12
Results with 0.9 Accuracy




Four Pareto optimal
designs
Solutions ranged from
11 to 5 portable
ultrasound machines
Varying amounts of
reserved MRI capacity
Burien and Northshore
in all four designs
13
Hepatitis C Screening and
Treatment Policies


Chronic hepatitis C virus (HCV) infection is the
most common blood-borne infection in the
United States (~ 2.7 million are HCV infected)
Policy decisions for HCV care:
−
−
Determine the optimal HCV birth-cohort screening
and treatment allocation strategies under spending
budget constraints
Analyze the impact of screening and treatment
allocation strategies for each cohort group by
decision time periods
14
Markov Chain of Health Status

Three population groups:
−
−
−

Group A: HCV unknown
A: HCV Unknown
B: HCV Positive
C: HCV Negative
Group B: HCV+
Severity of disease
−
−
−
−
−
Healthy: H
Fibrosis: F0, F1, F2, F3, F4
Untreatable: UT
Recovered: R1, R2, R3
Dead: M
Group C: HCV-
15
Optimization Model
Maximize the discounted quality-adjusted life years (QALYs)
Dynamic constraints based on the Markov model
Budget constraint for each year:
Cost for screening
Cost for treatment
Percentage of
the budget for
screening
16
Analysis and Policy Decisions

17
Analysis Approach

Use grid search to identify time periods with obvious
dominant strategy
[Li, Huang, Zabinsky, and Liu, accepted in Medical Decision Making
(MDM) Policy & Practice, Dec. 2016]
18
PBnB Analysis

First look at low budget (LB) scenarios
−
−


Maximize discounted QALYs
Subject to yearly budget constraint
Decision variables – first two time periods
Identify a set of solutions in the top 10
percent of QALYs
19
Approximated 0.1 Level Set for
50-59, Low Budget pruned

maintained
undecided
20
Approximated 0.1 Level Set for
50-59, High Budget pruned

maintained
undecided
21
Conclusions

Many applications are non-linear, include uncertainty,
and have multiple objectives

Probabilistic Branch and Bound provides a set of
solutions and enables trade-offs to be made

Many possible simulation models

On-going research into extensions of PBnB
22