Problem of Small Probability

Problem of Small Probability
The Telescope Problem
N N Taleb © 2008
3
Two Domains
Type 1- CLT in
real time
Type 2- No CLT
in real time
N N Taleb © 2008
5
N N Taleb © 2008
6
Temporal Instability
N N Taleb © 2008
7
N N Taleb © 2008
8
Sampling Error & Pareto
Tails
•  Shortfall EXTREMELY
sensitive to α
N N Taleb © 2007
“Measurability”
•  Norm L-2 :
“variance” (STD),
Least-Square
methods, etc.
•  Power Laws /
scalable
theoretically
better, but NONCALIBRATABLE
where it matters
10
“Measurability”
•  Old distinction
“Knightian”,
“measurable risk
v/s
nonmeasurable
uncertainty” •  Conflation of
“measure” &
“estimate”
•  Nonmeasurability
a function of
remoteness of the
event
•  Lack of rigor at the
foundations
•  Lack of empirical
rigor 11
Past & Future
N N Taleb © 2008
12
Regular is predictive of
regular
N N Taleb © 2008
13
Fallacy of Volatility
N N Taleb © 2008
Two Processes
15
“The
Great
Modera-on”
17
Left Tail
Invisible Left Tail
Left Tail & Silent
Evidence (Diagoras problem)
“conditional on my being
here, I didn’t need
health insurance”
Bill Fung
N N Taleb © 2008
Survival Conditioning
19
Consequence
•  Forecasting
•  Deficits
•  Portfolio theory
20
Sub-Problems with Small
Probabilities
•  HARD: Inverse
problem (or nonobservability of a
generator of a
random process,
degrees of freedom
fitting nonlinearities)
•  Correcting for
survival-conditioned
probability
•  Preasymptotics (Classical Problem of
Induction)
•  Correcting for the
Ludic Fallacy
(strong or weak)
•  “Atypicality” of Moves
21
Central Problem
•  HARD: Non
measurability of
small probability,
neither
empirically, nor
theoretically
22
Use & Moment
Mo
“True/False
M m = ∑ π i λi
M1
Expectations
m
M2+
Medicine
Finance (Investments)
Derivative payoffs
Psychology
Insurance
Calibration of nonlinear
models
Bets (prediction markets)
General risk management
Kurtosis-based
positioning (“volatility
trading”)
Binary/Digital
derivatives
Climate
Cubic payoffs (strips of
out of the money
options)
Life/Death
Economics (Policy)
What Else?
Security: Terrorism,
Natural catastrophes
…About
EVERYTHING !
23
M m = ∫ 1A p(λ ) λ d λ
m
Simple payoffs
Complex payoffs
M0
(m=0)
M1+
(M ≥1)
Distribution 1
(“thin tailed”)
Extremely Robust
Robust
Distribution 2
(no or unknown
characteristic
scale)
Extremely Robust
LIMITS of
Statistics
(Black Swan
Domain)
APPLICATION
DOMAIN
24
More Modest Problem
Proposed
•  Define boundaries
of the Black Swan
Domain.
•  Program of
Robustness in the
Black Swan
Domain
25
Explicit
Tacit 26