Brigham Young University
BYU ScholarsArchive
International Congress on Environmental
Modelling and Software
7th International Congress on Environmental
Modelling and Software
Jun 17th, 9:00 AM - 10:20 AM
W(h)ither the Oracle? Cognitive Biases and Other
Human Challenges of Integrated Environmental
Modeling
Pierre D. Glynn
National Research Program, U.S. Geological Survey, [email protected]
Follow this and additional works at: http://scholarsarchive.byu.edu/iemssconference
Part of the Civil Engineering Commons, Data Storage Systems Commons, Environmental
Engineering Commons, Hydraulic Engineering Commons, and the Other Civil and Environmental
Engineering Commons
Pierre D. Glynn, "W(h)ither the Oracle? Cognitive Biases and Other Human Challenges of Integrated Environmental Modeling"
( June 17, 2014). International Congress on Environmental Modelling and Software. Paper 22.
http://scholarsarchive.byu.edu/iemssconference/2014/Stream-F/22
This Event is brought to you for free and open access by the Civil and Environmental Engineering at BYU ScholarsArchive. It has been accepted for
inclusion in International Congress on Environmental Modelling and Software by an authorized administrator of BYU ScholarsArchive. For more
information, please contact [email protected].
,QWHUQDWLRQDO(QYLURQPHQWDO0RGHOOLQJDQG6RIWZDUH6RFLHW\L(06V
WK ,QWO&RQJUHVVRQ(QY0RGHOOLQJDQG6RIWZDUH 6DQ'LHJR&$86$
'DQLHO 3 $PHV 1LJHO:7 4XLQQ DQG$QGUHD(5L]]ROL(GV
KWWSZZZLHPVVRUJVRFLHW\LQGH[SKSLHPVVSURFHHGLQJV
:KLWKHUWKH2UDFOH"
&RJQLWLYH%LDVHVDQG2WKHU+XPDQ&KDOOHQJHVRI
,QWHJUDWHG(QYLURQPHQWDO0RGHOLQJ
3LHUUH'*O\QQ
%UDQFK&KLHI1DWLRQDO5HVHDUFK3URJUDP86*HRORJLFDO6XUYH\1DWLRQDO&HQWHU5HVWRQ9$
86$SJO\QQ#XVJVJRY
$EVWUDFW,QWHJUDWHGHQYLURQPHQWDOPRGHOLQJ,(0FDQRUJDQL]H DQGLQFUHDVHRXUNQRZOHGJHRIWKH
FRPSOH[ G\QDPLF HFRV\VWHPV WKDW KRXVH RXU QDWXUDO UHVRXUFHV DQG FRQWURO WKH TXDOLW\ RI RXU
HQYLURQPHQWV +XPDQ EHKDYLRU KRZHYHU PXVW EH WDNHQ LQWR DFFRXQW +XPDQ ELDVHVKHXULVWLFV
UHIOHFW DGDSWDWLRQ RYHU RXU HYROXWLRQDU\ SDVW WR IUHTXHQWO\ H[SHULHQFHG VLWXDWLRQV WKDW DIIHFWHG RXU
VXUYLYDO DQG WKDW SURYLGHG VKDUSO\ GLVWLQJXLVKHG IHHGEDFNV DW WKH OHYHO RI WKH LQGLYLGXDO
8QIRUWXQDWHO\ KXPDQ EHKDYLRU LV QRW DGDSWHG WR WKH PRUH GLIIXVHO\ H[SHULHQFHG OHVV IUHTXHQWO\
HQFRXQWHUHG SUREOHPV DQG LVVXHV WKDW ,(0 W\SLFDOO\ VHHNV WR DGGUHVV LQ WKH VLPXODWLRQ RI QDWXUDO
UHVRXUFHVDQGHQYLURQPHQWV:KLOHVHHNLQJLQVSLUDWLRQIURPWKHSURSKHWLFWUDGLWLRQVRIWKH2UDFOHRI
'HOSKL VHYHUDO KXPDQ ELDVHV DUH LGHQWLILHG WKDW PD\ DIIHFW KRZ WKH VFLHQFH EDVH RI ,(0 LV
DVVHPEOHGDQGKRZ,(0UHVXOWVDUHLQWHUSUHWHGDQGXVHG7KHVHELDVHVDUHVXSSRUWHGE\SHUVRQDO
REVHUYDWLRQVDQGE\WKHILQGLQJVRIEHKDYLRUDOVFLHQWLVWV$SURFHVVIRUFULWLFDODQDO\VLVLVSURSRVHG
WKDWVROLFLWVH[SOLFLWDFFRXQWLQJDQGFRJQL]DQFHRISRWHQWLDOKXPDQELDVHV$QXPEHURIVXJJHVWLRQV
DUH PDGH WR DGGUHVV WKH KXPDQ FKDOOHQJHV RI ,(0 LQ DGGLWLRQ WR PDLQWDLQLQJ DWWLWXGHV RI ZDWFKIXO
KXPLOLW\ RSHQPLQGHGQHVV KRQHVW\ DQG WUDQVSDUHQW DFFRXQWDELOLW\ 7KHVH LQFOXGH FUHDWLQJ D QHZ
DUHDRIVWXG\LQWKHEHKDYLRUDOELRJHRVFLHQFHVXVLQJVWUXFWXUHGSURFHVVHVIRUHQJDJLQJWKHPRGHOLQJ
DQG VWDNHKROGHU FRPPXQLW\ LQ ,(0 DQG XVLQJ ³UHG WHDPV´ WR LQFUHDVH UHVLOLHQFH RI ,(0 FRQVWUXFWV
DQGXVH
.H\ZRUGV &RJQLWLYH ELDVHV KHXULVWLFV QDWXUDO UHVRXUFHV PDQDJHPHQW HQYLURQPHQWDO V\VWHPV
2UDFOHRI'HOSKL ,1752'8&7,21
7KH 2UDFOH RI 'HOSKL ZDV D UHOLJLRXV LQVWLWXWLRQ WKDW ODVWHG IRU RYHU FHQWXULHV IURP DW OHDVW %&(WR&(WKH2UDFOHDOVRNQRZQDVWKH3ULHVWHVVRI'HOSKLRUWKH3\WKLD )LJVHUYHGDQ
LPSRUWDQWVRFLHWDOIXQFWLRQ4XHVWLRQVZHUHSRVHGWRKHU DIWHUFDUHIXOWULDJHDQGSUHSDUDWLRQE\KHU
SULHVWV DQG DFRO\WHV E\ VHOHFW PHPEHUV RI WKH FRPPXQLW\ WKRVH ZKR FRXOG DIIRUG KHU VHUYLFHV
$OPRVW LQYDULDEO\ WKH DQVZHUV SURYLGHG ZHUH DPELJXRXV DQG UHTXLUHG WUDQVODWLRQ RU H[SODQDWLRQ E\
SULHVWV DIWHU ZKLFK WKH\ RIWHQ VWLOO UHPDLQHG FORXGHG E\ XQFHUWDLQW\ 3DUW RI WKH YDOXH RI WKH 3\WKLD
FDPH IURP WKH SDUVLPRQ\ RI KHU DGYLFH VKH ZRUNHGRQO\ GXULQJ WKH QLQH ZDUPHVW GD\V RI WKH \HDU
DQG KHU SURQRXQFHPHQWV ZHUH VKRUW 7KHUH ZDV DOVR VLJQLILFDQW ILQDQFLDO FRVW WR VHHNLQJ DGYLFH
ZKLFK DGGHG WR LWV SHUFHLYHG YDOXH DV GLG WKH DVVRFLDWHG ULWXDO SURFHVVHV ,PSRUWDQWO\ WKH HIIRUWV
UHTXLUHGWRIUDPHDQGDVNWKHULJKWTXHVWLRQVKHOSHGWKHFRQVXOWDQWVWRWKH3\WKLDFRPHXSZLWKVRPH
RIWKHDQVZHUVWKH\VRXJKW
+RZ GRHV WKH 2UDFOH RI 'HOSKL UHODWH WR ,QWHJUDWHG (QYLURQPHQWDO 0RGHOLQJ ,(0" 7KLV DUWLFOH
VXJJHVWV WKDWWKH2UDFOH KDVOHVVRQVWKDWFDQKHOSXVDGGUHVVVRPHRIWKHKXPDQFKDOOHQJHVRI,(0
7KH FKDOOHQJHV FRQVLGHUHG SULPDULO\ UHIHU WR WKH LQKHUHQW KXPDQ ELDVHV DQG KHXULVWLFV PHQWDO
VKRUWFXWV IRU UHDVRQLQJ DQG SUREOHP VROYLQJ WKDW DIIHFW KXPDQ MXGJHPHQW DQG GHFLVLRQV DQG WKDW
KDYH WKH SRWHQWLDO WR DIIHFW ,(0 DVVHPEO\ LQWHUSUHWDWLRQ DQG XVH $ IHZ RI WKHVH ELDVHV DUH
GLVFXVVHGLQWKLVSDSHU DORQJZLWKSRVVLEOHVROXWLRQVWKDWPD\KHOSDGYDQFHWKHVFLHQFHDQGXVHRI
3DJH
3*O\QQ :KLWKHUWKH2UDFOH&RJQLWLYH%LDVHVDQGRWKHU+XPDQ&KDOOHQJHVRI,(0
,(0 %H\RQG ,(0WKHUHFRJQLWLRQRIRXUKXPDQELDVHVDQG KHXULVWLFV LV HVVHQWLDO WR LPSURYLQJWKH
FRQGXFW RI VFLHQFH DQG XOWLPDWHO\ WKH VFLHQFHLQIRUPHG PDQDJHPHQW RI RXU UHVRXUFHV DQG
HQYLURQPHQWV 7KHELDVHVDQGKHXULVWLFVGLVFXVVHGKHUHDUHLQKHUHQWWRDOO KXPDQEHLQJVUHJDUGOHVV
RIHGXFDWLRQVRFLDOSRVLWLRQRUHPSOR\PHQWDVVXFKWKH\SURYLGHH[DPSOHVRI ZKDW)UDQFLV%DFRQ
FDOOHG³WKHLGROVRIWKHWULEH´ %DFRQ
+RZGRZHGHILQH,(0IRUWKHSXUSRVHVRIWKLVSDSHU"$FFRUGLQJWR/DQLDNHWDOµ,QWHJUDWHG
(QYLURQPHQWDO0RGHOLQJ,(0LVDGLVFLSOLQH¶WKDWµSURYLGHVDVFLHQFHEDVHGVWUXFWXUHWRGHYHORSDQG
RUJDQL]HPXOWLGLVFLSOLQDU\NQRZOHGJH,WSURYLGHVDPHDQVWRDSSO\WKLVNQRZOHGJHWRH[SODLQH[SORUH
DQG SUHGLFW HQYLURQPHQWDOV\VWHP UHVSRQVH WR QDWXUDO DQG KXPDQLQGXFHG VWUHVVRUV¶ 7KLV SDSHU
H[SDQGV WKDW GHILQLWLRQ WR H[SOLFLWO\ LQFOXGH QRW RQO\ VWXGLHV RI HQYLURQPHQWDO V\VWHPV EXW DOVR
VWXGLHV RI WKH QDWXUDO UHVRXUFHV HJ K\GURORJLFDO ELRORJLFDO PLQHUDORJLFDO HQHUJHWLF DQGRU RI WKH
KXPDQDFWLYLWLHVWKDWDUHOLQNHGWRWKHVWDWHRIQDWXUDODQGEXLOWHQYLURQPHQWV
/(66216)5207+(25$&/(
+XPDQ MXGJHPHQW DQG GHFLVLRQPDNLQJ UHIOHFW KXPDQ
HYROXWLRQDU\ KLVWRU\ DQG FXOWXUDO GHYHORSPHQW RYHU
WKRXVDQGV RI JHQHUDWLRQV DV ZHOO DV LQGLYLGXDO
H[SHULHQFHV DQG PRGHUQ VRFLDO LQIOXHQFHV
2XU
FRQVFLRXV UDWLRQDO WKLQNLQJ ZKHQ HPSOR\HG DW
VLJQLILFDQWHQHUJHWLFFRVWFDQPDNHXVHRIH[SHULHQFHV
LQGLYLGXDOO\ DFFXPXODWHG RYHU \HDUV WR GHFDGHV ,Q
FRQWUDVW RXU LQWXLWLYH UHVSRQVHV RXU PHQWDO VKRUWFXWV
DQG FRJQLWLYH ELDVHV DUH HQHUJHWLFDOO\ OHVV FRVWO\ DQG
FRQVHTXHQWO\ DUH SUHGRPLQDQW .DKQHPDQ 7KH\ JHQHUDOO\ UHIOHFW KXPDQ DGDSWDWLRQ DQG ULWXDOV
GHYHORSHG RYHU PLOOHQQLD²DW D WLPH ZKHQ KXPDQ
SRSXODWLRQ ZDV PXFK ORZHU a WR PLOOLRQ GXULQJ
WKH 2UDFOH¶V WLPH WKDQ DW SUHVHQW a ELOOLRQ :K\ LV
WKLV UHOHYDQW" )LUVW EHFDXVH ZH KDYH QRW LQGLYLGXDOO\
H[SHULHQFHG RU LQFRUSRUDWHG LQWR UDWLRQDO FRQVFLRXV
WKRXJKW ZLWK WKH IUHTXHQF\ RI IHHGEDFNV UHTXLUHG WKH
IXOO DUUD\ RI HFRV\VWHP DQG VRFLDO G\QDPLFV WKDW KDYH
DIIHFWHG KXPDQ VXUYLYDO DQG FXOWXUDO GHYHORSPHQW RYHU
RXU HYROXWLRQDU\ SDVW 2XU LQWXLWLYH MXGJPHQWV DQG
DFWLRQV LHWKH³IDVWDQGIUXJDOKHXULVWLFV´GHVFULEHG E\
*HUG *LJHUHQ]HU DQG KLV FROOHDJXHV *LJHUHQ]HU DQG
*ROGVWHLQ 0DUHZVNL HW DO KDYH
FRQGLWLRQHG XV ZHOO WR DGGUHVV WKH H[SHULHQFHV WKDW
DIIHFWHGRXUKLVWRULFDO VXUYLYDODQGVRFLDOIDEULF 6HFRQG
LQ SDUW EHFDXVH RI SRSXODWLRQ JURZWK PDQ\ IDFWRUV
DIIHFWLQJ SUHVHQWGD\
QDWXUDO UHVRXUFHV DQG
HQYLURQPHQWVGLIIHUIURPWKRVHRIWKHSDVWLQLQWHQVLW\LI
QRWLQFKDUDFWHU DQGKDYHQRW EHHQLQFRUSRUDWHGLQWRRXU
LQWXLWLYH DGDSWLYH UHVSRQVHV (QHUJ\LQWHQVLYH
FRQVFLRXV ORJLFDO WKLQNLQJ LV UHTXLUHG IRU XV WR
VXFFHVVIXOO\ PHHW RXU IXWXUH ,(0 FDQ SRWHQWLDOO\ KHOS
ZLWK WKLV WDVN DV LW SURYLGHV D VWUXFWXUHG IUDPHZRUN IRU
DVVHPEOLQJ WUDQVIRUPLQJ DQG H[DPLQLQJ LQIRUPDWLRQ
UHODWHG WR WKH PDQDJHPHQW RI QDWXUDO UHVRXUFHV DQG
HQYLURQPHQWV 2XU LQVWLQFWLYH UHVSRQVHV DQG DFWLRQV
PD\ DOVR EH XVHIXO²HVSHFLDOO\ LI ZH FDQ GLVWLQJXLVK
WKHP XQGHUVWDQG WKHP DQG SRVVLEO\ LQFRUSRUDWH WKHP
)LJXUH/HVVRQVIURPWKH2UDFOH"-RKQ
&ROOLHU %ULWDLQ ± 3ULHVWHVV RI
'HOSKL /RQGRQ *LIW RI WKH 5W
+RQRXUDEOH WKH (DUO RI .LQWRUH $UW
*DOOHU\ RI 6RXWK $XVWUDOLD $GHODLGH
SXEOLVKHGKHUHE\SHUPLVVLRQ
7KURXJKRXWWKLVDUWLFOHLWDOLFVDUHXVHGWRLQGLFDWHHPSKDVLVRULPSRUWDQFHRIWKHZRUGVRU
VHQWHQFH
1
3DJH
3*O\QQ :KLWKHUWKH2UDFOH&RJQLWLYH%LDVHVDQGRWKHU+XPDQ&KDOOHQJHVRI,(0
DOEHLWFRQVFLRXVO\ LISRVVLEOHLQWRRXUVFLHQWLILFSURFHVVHVDQG LQWRRXUPDQDJHPHQWDFWLRQV
:K\LVLW LPSRUWDQWWR DVVHVVWKHELDVHVDQGKHXULVWLFVWKDWDIIHFWRXUUHDVRQLQJDQGWKHUHIRUH,(0
DVVHPEO\ LQWHUSUHWDWLRQ DQG XVH" )LUVW EHFDXVH ,(0 LV D KXPDQ HQWHUSULVH WKDW LQYROYHV PXOWLSOH
SHRSOHZLWKGLIIHUHQWEDFNJURXQGVHJWHFKQLFDOH[SHUWVUHVRXUFHPDQDJHUVUHJXODWRUVPHPEHUVRI
WKH SXEOLF EXW ZLWK FRPPRQDOLWLHV RI WKLQNLQJ DQG UHDVRQLQJ 6HFRQG EHFDXVH DV 6WDQRYLFK DQG
:HVW VWDWH ³SHRSOH DVVHVV SUREDELOLWLHV LQFRUUHFWO\ WKH\ GLVSOD\ FRQILUPDWLRQ ELDV WKH\ WHVW
K\SRWKHVHV LQHIILFLHQWO\ WKH\ YLRODWH WKH D[LRPV RI XWLOLW\ WKHRU\ WKH\ GR QRW SURSHUO\ FDOLEUDWH
GHJUHHV RI EHOLHI WKH\ RYHUSURMHFW WKHLU RZQ RSLQLRQV RQWR RWKHUV WKH\ GLVSOD\ LOORJLFDO IUDPLQJ
HIIHFWV WKH\ XQHFRQRPLFDOO\ KRQRU VXQN FRVWV WKH\ DOORZ SULRU NQRZOHGJH WR EHFRPH LPSOLFDWHG LQ
GHGXFWLYH UHDVRQLQJ DQG WKH\ GLVSOD\ QXPHURXV RWKHU LQIRUPDWLRQ SURFHVVLQJ ELDVHV´ $FFHVVLEOH
SXEOLFDWLRQV LQ WKLV DUHD RI EHKDYLRXUDO UHVHDUFK LQFOXGH $ULHO\ .DKQHPDQ DQG
7YHUVN\DQG.DKQHPDQ
7KH6RFUDWLF3DUDGR[ DQGWKH&RQILUPDWLRQ%LDV
$FFRUGLQJWR3ODWR
VDSRORJ\ %&(WKH*UHHNSKLORVRSKHU6RFUDWHVDWWULEXWHGWKHEDVLVRI
KLV SKLORVRSK\ DQG KLV PDQ\ HQHPLHV WR D VLPSOH SDUDGR[LFDO WUXWK KLV NQRZOHGJH WKDW KH NQHZ
QRWKLQJ 7KLV UHDOL]DWLRQ ZDV SURYRNHG E\ D IULHQG ZKR DVNHG WKH 3\WKLD LI DQ\RQH ZDV ZLVHU WKDQ
6RFUDWHVXSRQZKLFKVKHUHVSRQGHGWKDWQRRQHZDV7KHDQVZHUFDXVHG6RFUDWHVWRVHHNSHRSOH
ZKRPKHWKRXJKW ZHUH ZLVHUWKDQ KLPVHOI+HRQO\IRXQG SHRSOH ZKR WKRXJKWWKDWWKH\ ZHUH ZLVH
EH\RQGWKHUDQJHRIWKHLUDFWXDOH[SHULHQFHV7KH3\WKLD¶VDQVZHUFDXVHG6RFUDWHVWREHOLHYHWKDW
KLVJUHDWHUNQRZOHGJHDQGZLVGRPFRXOGRQO\FRPHIURPKLVUHDOL]DWLRQWKDWKHNQHZQRWKLQJ
+RZ GRHV WKH 6RFUDWLF 3DUDGR[ UHODWH WR ,(0" 6FLHQWLVWV DQG LQGHHG PRVW KXPDQ EHLQJV
H[SHULHQFHVXFFHVVWKURXJKWKHLUDELOLWLHVWRIRFXVDQGEXLOGXSRQH[LVWLQJNQRZOHGJH7KH\DGYDQFH
WKHLU NQRZOHGJH PRVW TXLFNO\ E\ VHHNLQJ FRQILUPDWLRQ RI K\SRWKHVHV ,Q DUWLVWLF WHUPV WKH\ DUH
IRFXVHGRQDGGLQJWRWKHSRVLWLYHVSDFH RIWKHLUPHQWDOFRQVWUXFWVDQGNQRZOHGJHEDVH7KH\UDUHO\
VHHN WR LQYDOLGDWH WKHVH FRQVWUXFWV RU QHJDWHGLVSURYH WKHLU K\SRWKHVHV WKH PRVW REMHFWLYH ZD\ RI
DGYDQFLQJVFLHQWLILFNQRZOHGJHDFFRUGLQJWR3RSSHU,QVWHDGWKH\VHHNFRQILUPDWLRQRIWKHLU
EHOLHIV %DFRQ DSKRULVP ;/9, 1LFNHUVRQ D PHFKDQLVP WKDW SRWHQWLDOO\ DOORZV TXLFN
GHFLVLRQV ZKLOH PLQLPL]LQJ HIIRUW ³&RQILUPDWLRQ ELDV´ LV D VXFFHVVIXO VWUDWHJ\ ZKHQ LW LV XVHG WR
FRQIURQW HYHU\GD\VLWXDWLRQVWKDWZHKDYHSUHYLRXVO\H[SHULHQFHGRUWKDWRXUDQFHVWRUVH[SHULHQFHG
DQGIRU ZKLFKWKH\ LPSODQWHGHIIHFWLYHUHVSRQVHVLQ RXUJHQHWLFFRGH DQGLQRXUVRFLDOPRUHV,WLV
JHQHUDOO\ QRW D VXFFHVVIXO VWUDWHJ\ IRU PDQDJLQJ QHZ H[SHULHQFHV RU VLWXDWLRQV 7R WKH H[WHQW WKDW
,(0GHDOVZLWKQHZLVVXHVDQGSUREOHPVFRQIURQWLQJQDWXUDOUHVRXUFHDYDLODELOLW\DQGHQYLURQPHQWDO
TXDOLW\,(0PXVWILQGPHWKRGVWRDFWLYHO\FRQIURQWRXULQQDWH³FRQILUPDWLRQELDV´ :HPXVWILQGZD\V
WR DFWLYHO\ DQG FRPSUHKHQVLYHO\ WHVW RXU LQWHJUDWHG PRGHOV DQG GHVWUR\ WKHP RU VRPH RI WKHLU
FRPSRQHQWVZKHQQHHGHG7KHZRUG³GHVWUR\´PD\XSVHW\RXHYLGHQFLQJD ³FRQVWUXFWLRQLVW´ELDVD
ELDVUHODWHGWRWKHFRQILUPDWLRQELDVEXWDVVRFLDWHGPRUHZLWKSK\VLFDOFRQVWUXFWV
7KH³9LVLEOHLV&UHGLEOH´%LDV
-RKQ &ROOLHU ILJ SRUWUD\V WKH 3\WKLD¶V H[SDQGHG FRJQLWLRQ JDLQHG E\ FORVLQJ KHU H\HV :K\ LV
WKDW" 2QH DQVZHU PLJKW EH WKDW YLVLRQ LV VXFK DQ DFWLYH VHQVH WKDW LW PD\ RYHUZKHOP RXU RWKHU
FRJQLWLYH LQSXWV DQG SRVVLEO\ DOVR GLPLQLVK RXU DELOLW\ IRU FRQVFLRXV ORJLFDO WKRXJKW 2XU VHQVHV
LQFOXGHIRXURWKHU³FODVVLF´UHFHSWRUVHQVHVKHDULQJVPHOOWDVWHWRXFKRUVNLQVHQVDWLRQDVZHOODV
PDQ\RWKHU LQWHUQDOVHQVHVHJ EDODQFHWLPHSDLQ9LVLRQLVDSULYLOHJHGVHQVH WKDW DOORZVQHDU
LPPHGLDWH KXPDQ UHVSRQVH WR LPSDFWIXO HYHQWV ,W DOORZV TXLFN DVVHVVPHQWV RI VLWXDWLRQV 3HRSOH
QHDU XV DUH DEOH WR LPPHGLDWHO\ VKDUH RXU YLVXDO SHUFHSWLRQV ,Q FRQWUDVW RWKHU VHQVHV LQYROYH
LQWHUQDO SHUFHSWLRQV WKDW DUH QRW DV HDVLO\ VKDUHG DQGRU DUH DVVRFLDWHG ZLWK JUHDWHU WUDQVPLWWDO
GHOD\VEHWZHHQHPLVVLRQDQGUHFHSWLRQRIWKHVHQVRU\VLJQDOHJKHDULQJDQGRUUHTXLUHJUHDWHU
WLPHIRUUHFHSWLRQDQGKXPDQSURFHVVLQJEHIRUHDFWLRQFDQEHWDNHQHJVPHOO ,WLVQRFRLQFLGHQFH
WKDWYLVLRQLVDPRVWLPSRUWDQWVHQVHHVSHFLDOO\ZKHQLWFRPHVWRWKHVKDSLQJRIKXPDQEHOLHIV ³7R
VHHLVWREHOLHYH´LVDFRPPRQKXPDQH[SUHVVLRQ&RQYHUVHO\WKHLQYLVLEOHUHTXLUHVDJUHDWHUHIIRUW
RIEHOLHIRURIHGXFDWLRQDQGFRQVHTXHQWO\RIWHQHQGVXSXQUHSUHVHQWHGLQRXUPHQWDOPRGHOVLQRXU
FRQFHSWXDO PRGHOV DQG WKHUHIRUH LQ RXU QXPHULFDO PRGHOV 7KHUH DUH PDQ\ H[DPSOHV RI RXU
GLVFRXQWLQJ RI LPSRUWDQW\HWUHODWLYHO\LQYLVLEOHHFRV\VWHPSURFHVVHV RUUHVRXUFHV 7KHVHSURFHVVHV
RU UHVRXUFHV PD\ EH ³LQYLVLEOH´ WR XV EHFDXVH WKH\ XVXDOO\ DUH LQYLVLEOH RU RXW RI VLJKW HJ
3DJH
3*O\QQ :KLWKHUWKH2UDFOH&RJQLWLYH%LDVHVDQGRWKHU+XPDQ&KDOOHQJHVRI,(0
JURXQGZDWHU PLFUREHV RU ZH SHUFHLYH WKHP DV XQFKDQJLQJ DQG WKHUHIRUH LJQRUH WKHP LQ RXU
PHQWDOPRGHOV ZKLFKWHQGWREHWUDQVLWRU\
)RU H[DPSOH ODFN RI DFFRXQWLQJ RI JURXQGZDWHU SURFHVVHV DQG WKH UHJXODWLRQ DQG PDQDJHPHQW RI
JURXQGZDWHUDQGVXUIDFHZDWHUUHVRXUFHVDVLIWKH\ZHUHVHSDUDWHUHVRXUFHVLVDSHUYDVLYHSUREOHP
:LQWHU HW DO WKDW DFFRUGLQJ WR *OHQQRQ KDV FRQWULEXWHG WR SRRU PDQDJHPHQW RI
JURXQGZDWHU UHVRXUFHV LQ VHYHUDO UHJLRQV RI WKH 8QLWHG 6WDWHV 6LPLODUO\ LQWHJUDWHG HQYLURQPHQWDO
ZDWHUVKHG PRGHOV RI ZDWHU VHGLPHQW DQG QXWULHQW LQSXWV WR WKH &KHVDSHDNH %D\ KDYH JHQHUDOO\
UHSUHVHQWHGJURXQGZDWHUSURFHVVHVRQO\PLQLPDOO\7KHPRGHOVKDYHQRWSURSHUO\DFFRXQWHGIRUWKH
ODUJH UHVHUYRLU RI QLWUDWH LQ JURXQGZDWHU $GGLWLRQDOO\ WKH PRGHOV KDYH JHQHUDOO\ QRW DFFRXQWHG IRU
WKH GHFDGDO WLPH VFDOHV RI JURXQGZDWHU SURFHVVHV 6DQIRUG DQG 3RSH RU IRU WKH GHFDGDO WR
PLOOHQQLDO WLPHVFDOHVRIVHGLPHQWSURFHVVHV3L]]XWRHWDO $VDUHVXOWWKH,(0 ZDWHUVKHG
PRGHOV IRU WKH &KHVDSHDNH %D\ ZDWHUVKHG KDYH IRU WKH PRVW SDUW LJQRUHG WKH UHVSRQVH WLPHV
UHTXLUHGIRUPDQDJHPHQWRUSROLF\HIIRUWVWROLPLWVHGLPHQWDQGQXWULHQWWUDQVSRUWWRWKH%D\/LNHWKH
3\WKLDRFFDVLRQDOO\FORVLQJRXU H\HV WRWKHPRVWREYLRXV³YLVLEOH´SURFHVVHV PD\ KHOS XVRSHQ RXU
PLQGV DQGFRQVLGHUWKHOHVVYLVLEOH
3UHVHQW)XWXUH3DVWD+XPDQ 2UGHU RI &RQVLGHUDWLRQ
6LPSOLILFDWLRQ DQG D ³VWHDG\VWDWH´ SUHVHQW FRPH ILUVW 0RVW LI QRW DOO RI RXU LQWXLWLYH UHVSRQVHV
ELDVHV DQG KHXULVWLFV KHOS XV GHDO ZLWK SUHVHQW RU QHDUWHUP VLWXDWLRQV :H DUH PRVW DFWLYHO\
FRQFHUQHG DQG SURJUDPPHG WR WDNH DFWLRQ IRU SUHVHQW RU QHDUWHUP UHVRXUFH RU VHFXULW\ QHHGV
7KLQNLQJ DERXW WKH SDVW RU DERXW WKH IXWXUH UHTXLUHV JUHDWHU HQHUJ\ DQG KDV D JUHDWHU FORXG RI
XQFHUWDLQW\ WKDQ GHDOLQJ ZLWK WKH SUHVHQW :H KDYH GLIILFXOW\ LQYHVWLQJ LQ WKH IXWXUH EH\RQG RU JHQHUDWLRQV\HDUV $GGLWLRQDOO\ZHDUHSURJUDPPHGWRVHHNVLPSOLILFDWLRQVLQRXUUHDVRQLQJ
VR DV WR VDYH HQHUJ\ PRUH HDVLO\ FRPPXQLFDWH ZLWK RWKHUV WKURXJK D FRPPRQ EDVH RI
XQGHUVWDQGLQJDQG DYRLGDGLYHUVLW\ RI³LQIRUPDWLRQSDWKRORJLHV´%DZGHQDQG5RELQVRQ
VXFKDV³LQIRUPDWLRQRYHUORDG´³SDUDO\VLVE\DQDO\VLV´DQGWKH³SDUDGR[RIFKRLFH´6FKZDUW] :HRIWHQ DVVXPH WKDWFXUUHQWUHVRXUFHHQYLURQPHQWV\VWHPFRQGLWLRQVDUHVWDWLFDQGWKDWVXFKVWDVLV
VKRXOG EH GHVLUHG RU DW OHDVW QRW GHVWUR\HG 7KLV ELDV GHULYHV IURP RXU QHHG IRU VLPSOLFLW\ LQ
DGGUHVVLQJ SUHVHQWGD\ SUREOHPV DQG SHUKDSV DOVR VRPHZKDW LUUDWLRQDOO\ IURP RXU FRQVWUXFWLRQLVW
ELDV
:HVWLOOVHHNWKHIXWXUH&RQVXOWDQWVWRWKH 3\WKLD ZHUHIRUFHGWRVKRUWHQFODULI\DQGVLPSOLI\WKHLU
TXHVWLRQV 7KH\ ZHUH VHHNLQJ KHOS IRU FRQFUHWH LVVXHV RI LQGLYLGXDO RU FRPPXQLW\ FRQFHUQ LH WKH
QHDUSUHVHQW EXW ZHUH LQWHUHVWHG LQ WKH 3\WKLD¶V SURSKHWLF DELOLWLHV KHU DELOLWLHV WR WHOO WKHP DERXW
SRVVLEOHIXWXUHV7KHJHQHUDODPELJXLW\RIWKH3\WKLD¶VDQVZHUVSURYRNHGWKLQNLQJ DERXWZKDWVKH
PD\ KDYH PHDQW DQG H[SORUDWLRQ RI GLIIHUHQW OLQHV RI UHDVRQLQJ VRPHWKLQJ XQGRXEWHGO\ XVHIXO
+XPDQ LQWHOOLJHQFH LV FKDUDFWHUL]HG QRW VR PXFK E\ RXU LQVWLQFWLYH UHVSRQVHV DV E\ RXU FRQVFLRXV
DELOLW\ WR DQWLFLSDWH WKH IXWXUH 1H[W WR WKH SUHVHQW WKH IXWXUH LV ZKDW DIIHFWV RXU VHFXULW\ DQG RXU
DFFHVVWRUHVRXUFHV
7KH SDVW LV NH\ WR WKH IXWXUH DQG \HW ZH VHHN LW ODVW DQG OHVV RIWHQ 7DNLQJ SURSHU DFWLRQV IRU WKH
IXWXUHUHTXLUHVXQGHUVWDQGLQJWKHOHVVRQVRIWKHSDVW 'RH )ROORZLQJ WKHSKLORVRSK\RI+XWWRQ
DQG +XPH KRZFDQ ZHPDQDJHRXUUHVRXUFHVDQGHQYLURQPHQWVIRUWKHIXWXUHLI ZH
GRQ¶W NQRZ DQG XQGHUVWDQG WKH G\QDPLFV RI WKH SURFHVVHV WKDW DIIHFWHG WKHP LQ SDVW²HYHQ ZKLOH
FRQVLGHULQJWKDWWKH SDVWPD\QRWUHSHDWLWVHOI"*HWWLQJHYLGHQFHDQGXQGHUVWDQGLQJDERXWWKHSDVW LV
PRUH GHPDQGLQJ RI RXU UHVRXUFHV WKDQ DGGUHVVLQJ D VLPSOLILHG SUHVHQW RU WKDQ WKLQNLQJ DERXW RXU
SRVVLEOHIXWXUHV\HWLWLVHVVHQWLDO5LWXDOVDQGFXOWXUDOWUDGLWLRQVVXFKDVWKRVHUHSUHVHQWHGE\WKH
2UDFOH RI 'HOSKL DUH VRPH RI WKH ZD\V PRVWO\ XQFRQVFLRXV WKURXJK ZKLFK ZH VHHN WR PDLQWDLQ
OHVVRQV IURP WKH SDVW 6FLHQFHEDVHG LQYHVWLJDWLRQV DQG ,(0 KRZHYHU UHTXLUH PRUH IDFWXDO
REVHUYDWLRQEDVHG HYLGHQFH DQG FRQVFLRXV XQGHUVWDQGLQJ RI SDVW HFRV\VWHP G\QDPLFV 7KLV
UHTXLUHVJUHDWHQHUJ\DQGUHVRXUFHVDQGWKHUHIRUHVXIIHUVQHJOHFWUHODWLYHWRLWVLPSRUWDQFH
6FKZDUW]¶³SDUDGR[RIFKRLFH´WKHRU\VWDWHVWKDWKDYLQJWRRPDQ\FKRLFHVFDQOHDGWRGHFLVLRQ
PDNLQJSDUDO\VLVDQ[LHW\DQGVWUHVV8QGHUVRPHFRQGLWLRQVZHPLJKWIHHOIUHHUDQGKDSSLHUZLWK
IHZHUFKRLFHV
2
3DJH
3*O\QQ :KLWKHUWKH2UDFOH&RJQLWLYH%LDVHVDQGRWKHU+XPDQ&KDOOHQJHVRI,(0
:K\GRRXUEHKDYLRUVLQWKLQNLQJRUQRWDERXWWHPSRUDOFKDQJH PDWWHUWR,(0SUDFWLFH"6RFLHW\KDV
JHQHUDOO\ QRW XQGHUVWRRG RU DSSOLHG WKH IXQGDPHQWDO UHDOLW\ WKDW RXU HQYLURQPHQWDO V\VWHPV DQG
UHVRXUFHV HJ ZDWHUVKHGV IRUHVWV JURXQGZDWHU V\VWHPV KDYH D GLYHUVLW\ RI ODJJHG RU GHOD\HG
UHVSRQVHV WKDW UDQJHV IURP GD\V WR PRQWKV \HDUV GHFDGHV FHQWXULHV PLOOHQQLD DQG PRUH 7KH
ZLGHO\YDU\LQJWLPHVFDOHVRIHFRV\VWHPSURFHVVHVGRQRW JHQHUDOO\KDUPRQL]HZLWKSROLWLFDOF\FOHV
RUZLWKWLPHVFDOHVRIVRFLHWDOGHFLVLRQPDNLQJDQGIHHGEDFN8QIRUWXQDWHO\WKLVGRHVQRWPHDQWKDW
ZH FDQ DYRLG FRQVLGHULQJ ORQJWHUP HFRV\VWHP G\QDPLFV HVSHFLDOO\ ZKHQ PDNLQJ PDMRU VRFLHWDO
LQYHVWPHQWV:HDWKHUSUHGLFWLRQVDUH LPSRUWDQWWRXVRQDGDLO\ EDVLVEHFDXVHWKH\ KHOS XVGUHVV
DSSURSULDWHO\ RU WHOO XV RI H[WUHPH ZHDWKHU HYHQWV WKDW PD\ DIIHFW RXU VHFXULW\ &RQVLGHULQJ
K\GURORJLF DQG FOLPDWLF YDULDELOLW\ RU WKH ULVN RI H[WUHPH HYHQWV RQ WKH WLPH VFDOH RI GHFDGHV WR
FHQWXULHVRUPLOOHQQLDLVDOVRLPSRUWDQWLIZHZDQWWRPDNHVPDUWLQYHVWPHQWVLQFRVWO\LQIUDVWUXFWXUH
HJLQVWDOOLQJRUUHPRYLQJGDPVDQGUHVHUYRLUVLQVWDOOLQJWVXQDPLSURWHFWLRQEDUULHUVRIDSSURSULDWH
KHLJKW RU LI ZH ZDQW WR HVWDEOLVK UHODWLYHO\ ULJLG OHJDO FRPSDFWV EHWZHHQ FRPPXQLWLHV RU FRXQWULHV
HJ WKH &RORUDGR 5LYHU FRPSDFW ,PSURYHG PDQDJHPHQW RI RXU HFRV\VWHPV LQFUHDVLQJO\
UHTXLUHV G\QDPLF PRGHOV :KLOH ZH QDWXUDOO\ SUHIHU VWDVLV WKH UHDOLW\ LV WKDW GLVWXUEDQFHV
SHUWXUEDWLRQV DQG YDULDELOLW\ DUH LQWULQVLF WR HFRV\VWHPV %RWNLQ $OWKRXJK ZH GRQ¶W OLNH WR
FRQVLGHU LW HVSHFLDOO\ ZKHQ SLWWHG DJDLQVW FRVWO\ KXPDQ LQIUDVWUXFWXUH LQYHVWPHQWV VRPH GHJUHH RI
HFRV\VWHP GLVWXUEDQFH PD\ EH EHQHILFLDO HVSHFLDOO\ ZKHQ FRQVLGHUHG DW ORQJHU WLPH IUDPHV RU DW
ODUJHU VFDOHV )RU H[DPSOH D PRGHUDWH OHYHO RI GLVWXUEDQFH PD\ KHOS VXSSRUW ELRGLYHUVLW\ HJ
WKURXJKFUHDWLRQUHHVWDEOLVKPHQWRIHFRORJLFDOKDELWDWVRUIRRGZHEVRUWKURXJKSHULRGLFGHVWUXFWLRQ
RI LQYDVLYH VSHFLHV RU SDUDVLWHV RU PD\ KHOS FUHDWH DQG PDLQWDLQ G\QDPLF EXIIHULQJ FDSDFLW\ IRU
ODUJHU V\VWHPLF FKDQJHV HJ E\ DOORZLQJ IORRGSODLQV RU ZHWODQGV WR H[LVW G\QDPLFDOO\ DQG DEVRUE
IORRGV³1RQVWDWLRQDULW\´DQGWKHUHDOL]DWLRQWKDWHFRV\VWHP G\QDPLFV FDQHDVLO\H[FHHGSUHYLRXVO\
FRQVLGHUHG ³KLVWRULFDO UDQJHV RI YDULDWLRQ´ KDV LPSRUWDQW LPSOLFDWLRQV IRU WKH PDQDJHPHQW RI RXU
HQYLURQPHQW DQG QDWXUDO UHVRXUFHV %HWDQFRXUW +LUVFK $QG \HW OLNH &ROOLHU¶V 3\WKLD
VLWWLQJLQVHOIDEVRUEHG VWLOOQHVVRQKHUVWRRO DERYHDPDMRUIUDFWXUHZHVHHPZLUHGWRGLVFRXQWWKH
G\QDPLFV RI QDWXUH DQG WR EHOLHYH WKDW VWDWLF KXPDQ VWUXFWXUHV FDQ SUHYDLO DJDLQVW WKRVH G\QDPLFV
ZLWKRXWVHULRXVLPSDFWVRQUHVRXUFHVDQG HQYLURQPHQWDOSURFHVVHV
0DVORZ DQGWKH³5HVRXUFH:DVWH´'HFRXSOLQJ%LDV
0DVORZ.ROWNR5LYHUD0DVORZ VXJJHVWHGWKDWWKHUHDUHIXQGDPHQWDOXQLYHUVDOKXPDQ
QHHGV WKDW PRWLYDWH SHRSOH WKDW ZKHQ PHW ZLOO KHOS WKHP UHDOL]H WKHLU IXOO SRWHQWLDO DQG DFKLHYH D
IHHOLQJRIZHOOEHLQJVHOIDFWXDOL]DWLRQ%URDGO\WKHVHPRWLYDWLQJIDFWRUVLQFOXGH LQ JHQHUDORUGHURI
LPSRUWDQFH ELRORJLFDO RU SK\VLRORJLFDO QHHGV VDIHW\ QHHGV VRFLDO QHHGV UHODWLQJ WR
EHORQJLQJQHVV ORYH DQG HVWHHP SHUVRQDO GHYHORSPHQW FRJQLWLYH DQG DHVWKHWLF QHHGV DQG WKH
GHVLUHWRDFKLHYHRQH¶VSRWHQWLDODQGODVWO\WKHGHVLUHWRKHOSRWKHUVDQGWKHJUHDWHUFRPPXQLW\
$FFHVV WR QDWXUDO UHVRXUFHV DQG WKHLU GHULYDWLYHV IRRG ZDWHU DLU HQHUJ\ PLQHUDOV WHFKQRORJ\ LV
SDUWRI0DVORZ¶VKLHUDUFK\ RIQHHGV5HVRXUFHV UHODWHGLUHFWO\WRELRORJLFDOSK\VLRORJLFDODQGVDIHW\
QHHGVDQGLQGLUHFWO\WRVRFLDOFRJQLWLYHDQGGHYHORSPHQWQHHGV:KHUHGRWKHE\SURGXFWVRIKXPDQ
H[WUDFWLRQ DQG WUDQVIRUPDWLRQ RI UHVRXUFHV LH HQYLURQPHQWDO LPSDFWV ILW LQ 0DVORZ¶V OLVW"
(QYLURQPHQWDOLPSDFWVILWRQO\LQGLUHFWO\ZKHQWKH\UHFRJQL]DEO\ DWWKHOHYHORIWKHLQGLYLGXDODIIHFW
VDIHW\ KXPDQ KHDOWK DQG QHDUWHUP DFFHVV WR QDWXUDO UHVRXUFHV 0DQ\ RI WKH HQYLURQPHQWDO
VWUHVVHV SUHVHQW LQ WKH 2UDFOH¶V WLPH DQG HDUOLHU GLIIHUHG LQ W\SH DQG LQWHQVLW\ IURP WKH VWUHVVHV
SUHVHQWWRGD\:HDUHZHOODGDSWHGDQGKLJKO\PRWLYDWHGWRVHHNDQGH[WUDFWQDWXUDOUHVRXUFHV:H
DUH QRW DV ZHOO DGDSWHG DQG PRWLYDWHG WR GHDO ZLWK HQYLURQPHQWDO LPSDFWV DW OHDVW QRW XQOHVV WKH\
GLUHFWO\LPPHGLDWHO\ORFDOO\DIIHFWRXULQGLYLGXDOVDIHW\0DQ\ FXOWXUHVH[SOLFLWO\NHHSKXPDQZDVWH
DZD\ IURPIRRG DQG ZDWHU UHVRXUFHV UHFRJQL]LQJ WKH KXPDQ KHDOWK FRQVHTXHQFHV RI QRW GRLQJ VR
%XW IXQGDPHQWDOO\ ZH DUH PXFK PRUH PRWLYDWHG WR VHHN UHVRXUFHV WKDQ WR GHDO ZLWK WKH LQGLUHFW
³GRZQVWUHDP´LPSDFWV RIRXUUHVRXUFHVHHNLQJDQGRXUKXPDQHQWHUSULVH0RUHLPSRUWDQWO\ZH WHQG
WR GHFRXSOH LPPHGLDWHDQGORFDOUHVRXUFHQHHGVIURPWKH ORQJHUWHUPODUJHUVFDOHEURDGFRPPXQLW\
QHHGVWRPDQDJH RXUHQYLURQPHQWV,(0DQGWKH,(0FRPPXQLW\VHHPWRUHIOHFWWKLVELDV8VH DQG
PDQDJHPHQW RI QDWXUDO UHVRXUFHV VRPHWKLQJ FULWLFDO WR HQYLURQPHQWDO TXDOLW\ VHHPV JHQHUDOO\
GHFRXSOHGIURPWKHVLPXODWLRQRIHQYLURQPHQWDOVWUHVVHVWKHKHDUWRI,(0
3DJH
3*O\QQ :KLWKHUWKH2UDFOH&RJQLWLYH%LDVHVDQGRWKHU+XPDQ&KDOOHQJHVRI,(0
&21&/8',1*7+28*+76 $1'68**(67,216
,QVSLUHG E\ WKH 2UDFOH RI 'HOSKL IRXU KXPDQ ELDVHV KDYH EHHQ GLVFXVVHG WKDW DIIHFW WKH ZD\ ZH
FRQGXFW VFLHQFH DQG WKDW UHODWH WR KRZ ZH DVVHPEOH LQWHUSUHW DQG XVH ,(0 IRU WKH LPSURYHG
PDQDJHPHQW RI QDWXUDO UHVRXUFHV DQG HQYLURQPHQWV 7KH ELDVHV GHVFULEHG LQFOXGH RXU
³FRQILUPDWLRQFRQVWUXFWLRQLVWELDV´SUHIHUUHGDWWHQWLRQWRZKDWLVYLVLEOHUDWKHUWKDQWRZKDWLV QRW
SULRULWL]HGDWWHQWLRQWRLPPHGLDWHUDWKHUWKDQIXWXUHV\VWHPVWUHVVHVDQGWRIXWXUHUDWKHUWKDQSDVW
V\VWHP VWUHVVHV DQG RXU GHFRXSOLQJ RI QDWXUDO UHVRXUFH QHHGV IURP HQYLURQPHQWDO LPSDFWV
0DQ\ RWKHU KXPDQ ELDVHV DQG FKDOOHQJHV H[LVW WKDW FRXOG QRW EH GLVFXVVHG KHUH GXH WR VSDFH
OLPLWDWLRQV DQG SULRU GLVFXVVLRQ DQG VXEPLWWDO HOVHZKHUH 7KH\ LQFOXGH LQKHUHQW WHQGHQFLHV WR ³PDQDJHH[SHFWDWLRQV´ FXOWLYDWH³KXPDQH[FHSWLRQDOLVP´DQGGHFRXSOHRXUVHOYHVIURPQDWXUH
UHODWH WR FRPSXWHUV DQG DQLPDOV DV LI WKH\ ZHUH KXPDQ VLPSOLI\ LQWULFDWH IRRG ZHEV DQG WURSKLF
FDVFDGHVE\IRFXVLQJRQVLQJOHRURQO\DIHZVSHFLHVUHDFWWR GUDPDWLFRUXQXVXDOFKDQJHVUDWKHU
WKDQ WR FKDQJHV RFFXUULQJ WKURXJK ³FUHHSLQJ QRUPDOLW\´ DQG VHHN VFLHQWLILF VHFXULW\ E\ VWLFNLQJ
ZLWKLQGLVFLSOLQDU\VFLHQWLILFFRPPXQLWLHVRU E\IROORZLQJGRPLQDQWOHDGHUVEHKDYLRUVVLPLODU WRWKRVH
VHHQLQZROISDFNVRU XQJXODWHKHUGV 7KHVHELDVHVUHIOHFWVRPHRIWKHZD\VWKDWZHXVHWRVLPSOLI\
DQGDGDSWWRWKHFRPSOH[LW\ RI1DWXUH 7KHGLVFXVVLRQ EHORZVXJJHVWVKRZZHPLJKWDGGUHVVWKHVH
ELDVHVDQGWKHLUUHODWHGKXPDQFKDOOHQJHVWR,(0
7KH ³EHKDYLRUDO ELRJHRVFLHQFHV´ D QHZ DUHD RI VWXG\ 2XU FRQGLWLRQHG VLPSOLILHG UHVSRQVHV ZRUN
ZHOO LQ VRPH EXW QRW LQ DOO VLWXDWLRQV :H DUH QRW ZHOO DGDSWHG WR DGGUHVV UHVRXUFHHQYLURQPHQW
LVVXHV WKDW GLIIHU IURP WKRVH H[SHULHQFHG LQ RXU KXPDQ HYROXWLRQDU\ SDVW DQGRU WKDW KDYH QRW
SURYLGHG IUHTXHQW VKDUSO\ H[SHULHQFHG IHHGEDFNV DW WKH OHYHO RI WKH LQGLYLGXDO RU RI D ORFDO
FRPPXQLW\ 7KHEHKDYLRUDOVFLHQFHVFDQKHOSXVXQGHUVWDQGWKHH[WHQWWRZKLFKRXUELDVHVDUHWKH
UHVXOWRIRXUHYROXWLRQDU\DGDSWDWLRQWRWKUHDWVDQGRSSRUWXQLWLHV7KH\FDQDOVR WHOO XV ZKHQWKRVH
DGDSWDWLRQV PD\ QRW SURYLGH WKH EHVW VROXWLRQV WR PDQDJLQJ RXU HFRV\VWHPV LQFOXGLQJ RXUVHOYHV
SHUKDSV EHFDXVH WKH WHPSRUDO DQG VSDWLDO VFDOHV RI UHIHUHQFH RU WKH G\QDPLFV RI FKDQJH DUH
RXWVLGH RI RXU QDWXUDO DGDSWLYH FDSDELOLWLHV 5HFRJQL]LQJ RXU KXPDQ ELDVHV DQG ZKHQ WKH\ PD\
LQWHUIHUHRUQRWZLWKVFLHQFHLQIRUPHGPDQDJHPHQWRIQDWXUDOUHVRXUFHVDQGHQYLURQPHQWVLVFULWLFDO
6RLVKDYLQJDQDSSURSULDWHXQGHUVWDQGLQJRIWKHELRJHRSK\VLFDODQGHFRORJLFDOSURFHVVHVDQGWKHLU
UHOHYDQW WLPH DQG VSDWLDO VFDOHV ,(0 FDQ SURYLGH WRROV WR KHOS XV RUJDQL]H DQG PD[LPL]H RXU
NQRZOHGJHRIWKHELRJHRVFLHQFHVZKLOHDOVRWDNLQJLQWRH[SOLFLWDFFRXQWRXUKXPDQQHHGVUHVSRQVHV
DQGELDVHV 6WXG\RIWKH³EHKDYLRUDOELRJHRVFLHQFHV´QHHGVWREHFRPHDQLQWHJUDOSDUWRI,(0
$GDSWLYHPDQDJHPHQWDQ DSSURDFK IRUPDQDJLQJFRPSOH[LW\DQGXQFHUWDLQW\7KHVXFFHVVRI,(0
GHSHQGVRQLWVDELOLW\WRVLPXODWHDQGXQGHUVWDQG FRPSOH[DQGPXOWLSOHSURFHVVHV,WLVDOVRVWURQJO\
GHSHQGHQW RQ EHLQJ DEOH WR UHGXFH WKDW FRPSOH[LW\ LQWR VLPSOH HQRXJK GHVFULSWLRQV DQG SURFHVVHV
WKDW FDQ EH XQGHUVWRRG E\ D ODUJH FRPPXQLW\ VR DV WR OHDG WR UHDVRQDEOH PDQDJHPHQW DQG SROLF\
DFWLRQV $GDSWLYH PDQDJHPHQW RIIHUV D SRWHQWLDOO\ XVHIXO VWUDWHJ\ IRU WKH PDQDJHPHQW RI RXU
HQYLURQPHQWDQGLWVUHVRXUFHV,WRIIHUV DQLWHUDWLYHDSSURDFKWKDWGHSHQGVRQ PRGHOLQJDQGLPSDFW
PRQLWRULQJ RI PDQDJHPHQW DFWLRQV DQG FRQVHTXHQW UHYLVLRQV ZKHQ QHHGHG :LOOLDPV DQG %URZQ
$GDSWLYHPDQDJHPHQWKRZHYHULVQRWDSDQDFHDVXLWDEOHWRDOOW\SHVRI VLWXDWLRQV&UDLJDQG
5XKO 1RUWRQ DQG 5HFNKRZ (WKLFDO UHDVRQV DQGRU OHJDO UHDVRQV DQGRU ODFN RI
IROORZWKURXJKPD\SUHYHQWLWVDSSOLFDWLRQ$GDSWLYHPDQDJHPHQWPD\DOVRIDLOLQPDQDJLQJV\VWHPV
WKDW KDYH ODJJHG RU KLJKO\ QRQOLQHDU UHVSRQVHV RU WKDW KDYH WKUHVKROG UHVSRQVHV IURP ZKLFK WKHUH
PD\EHQRUHFRYHU\
3DUWLFLSDWRU\ PRGHOLQJ VWUXFWXUHG FRPPXQLW\ LQWHUDFWLRQV DQG ³UHGWHDPLQJ´ 7R EH XVHIXO ,(0
DVVHPEO\DQGUHVXOWVPXVWEHVLPSOHHQRXJKWREHXQGHUVWRRG DQGXVHGE\DEURDGFRPPXQLW\/LNH
WKH 2UDFOH RI 'HOSKL ,(0 PXVW KHOS LWV PRWLYDWHG FRQVXOWDQWV H[SHUWV DQG PHPEHUV RI WKH SXEOLF
DOLNHH[SORUHTXHVWLRQVDQGSRVVLEOHDQVZHUV LQVLPSOHVWUXFWXUHGZD\V ,(0SRWHQWLDOO\GLIIHUVIURP
WKH2UDFOH RU3\WKLDEHFDXVHRIWKHQXPEHURIH[SHUWVLQYROYHGLQDVVHPEO\RILWVFRPSRQHQWFRGHV
DQGEHFDXVHRIWKHGLYHUVLW\RISHRSOHDQGVWDNHKROGHUSHUVSHFWLYHVLQYROYHGLQWKHLQWHUSUHWDWLRQDQG
SRWHQWLDO DSSOLFDWLRQ RI ,(0 ,PDJLQH D PXOWLKHDGHG PXOWLWUDQFHG 3\WKLD VSHDNLQJ LQ D GLYHUVLW\ RI
WRQJXHVWRDJURXSRIFRQVXOWDQWSDUWLHV ZLWKSRWHQWLDOO\DGYHUVDULDOSHUVSHFWLYHV« (IIHFWLYHVROXWLRQV
$QXSFRPLQJVSHFLDOSXEOLFDWLRQRIWKH*HRORJLFDO6RFLHW\RI/RQGRQGHYRWHGWR³0RGHO)XVLRQ´DQG
HGLWHGE\$QGUHZ5LGGLFN+ROJHU.HVVOHUDQG-HUHP\*LOHVRIWKH%ULWLVK*HRORJLFDO6XUYH\H[SORUHV
WKHVHDQGPDQ\RWKHUUHODWHGWRSLFV
3
3DJH
3*O\QQ :KLWKHUWKH2UDFOH&RJQLWLYH%LDVHVDQGRWKHU+XPDQ&KDOOHQJHVRI,(0
UHTXLUHWKDWDOOUHOHYDQW SDUWLHVEHKHDUGLHQRWMXVWWKHRQHVEHDULQJWKHULFKHVWJLIWVDQGWKDWDOO
UHOHYDQW KHDGV RI WKH 3\WKLD EH DOORZHG WR DQVZHU EXW SUHIHUDEO\ LQWHOOLJLEO\ LQWHOOLJHQWO\ DQG ZLWK
VRPHFRKHUHQFHRIWKRXJKW DQGH[SUHVVLRQ ,QQDWHKXPDQEHKDYLRXUVKRZHYHU PD\PDNHLWGLIILFXOW
WRGHWHUPLQHZKDWSDUWLHVDQGRU ZKDWKHDGVDUHPRVWUHOHYDQWHVSHFLDOO\LIWKHV\VWHPVFRQVLGHUHG
DUH FRPSOH[ DQG FDUU\ VLJQLILFDQW XQFHUWDLQW\ 6LPSOLILFDWLRQ LV UHTXLUHG DV LV WKH HVWDEOLVKPHQW RI
VWUXFWXUHG WUDQVSDUHQWSURFHVVHVHQDEOLQJDQGUHFRUGLQJ FRPPXQLW\DQGH[SHUWLQWHUDFWLRQV$FWLYH
FRJQL]DQFH RI EHKDYLRXUDO FKDOOHQJHV DQG ELDVHV LV HVVHQWLDO 9LJRURXV WHVWLQJ RI ,(0 DVVHPEO\
XVHDQGDSSOLFDWLRQVLV QHHGHG WRFRPSHQVDWHIRURXUFRQILUPDWLRQDQGFRQVWUXFWLRQLVWELDVHV³5HG
WHDPLQJ´LHWKHHVWDEOLVKPHQWRILQQRYDWLYHLQGHSHQGHQWWHVWLQJFKDOOHQJLQJWHDPVRIIHUV RQHZD\
WR VHHN ,(0 ZHDNQHVVHV DQGRU WR SRVVLEO\ ³GHVWUR\´ FRQVWUXFWHG PRGHOV FRPSRQHQWV RU
LQWHUSUHWDWLRQV &RPSDULVRQV RI ,(0 SURFHVV NQRZOHGJH DQG SUHGLFWLRQV ZLWK PRQLWRULQJ GDWD DQG
REVHUYDWLRQV IURP WKH SDVW DQG FRQWLQXLQJ LQWR WKH IXWXUH DUH DOVR FULWLFDOO\ LPSRUWDQW 7KLV LV
HVSHFLDOO\ WUXH LI ZH EHFRPH DZDUH RI RXU EHKDYLRXUDO ELDVHV LQ PDNLQJ REVHUYDWLRQV DQG VHHNLQJ
GDWD
$&.12:/('*0(176
5HYLHZV E\ . %UHHQ / .RQLNRZ DQG 5 6FKXVWHU RI WKH 86*6 DQG E\ WZR RWKHU DQRQ\PRXV
UHYLHZHUV KHOSHG FODULI\ DQG LPSURYH WKLV PDQXVFULSW 7KH DXWKRU UHWDLQV IXOO UHVSRQVLELOLW\ IRU DQ\
UHPDLQLQJ HUURUV RI IDFW H[SUHVVLRQ RU MXGJPHQW $Q\ XVH RI WUDGH SURGXFW RU ILUP QDPHV LQ WKLV
SXEOLFDWLRQLVIRUGHVFULSWLYHSXUSRVHVRQO\DQGGRHVQRWLPSO\HQGRUVHPHQWE\WKH86*RYHUQPHQW
5()(5(1&(6
$ULHO\'3UHGLFWDEO\,UUDWLRQDO7KH+LGGHQ)RUFHVWKDW6KDSHRXU'HFLVLRQV+DUSHU
3HUHQQLDO
%DFRQ)7KH1HZ2UJDQRQRU7UXH'LUHFWLRQV&RQFHUQLQJWKH,QWHUSUHWDWLRQRI1DWXUH
H%RRNV#$GHODLGHIURP7DJJDUGDQG7KRPSVRQHGLWLRQ
%DZGHQ'5RELQVRQ/7KHGDUNVLGHRILQIRUPDWLRQRYHUORDGDQ[LHW\DQGRWKHUSDUDGR[HV
DQGSDWKRORJLHV-,QI6FL±
%HWDQFRXUW-/5HIOHFWLRQVRQWKHUHOHYDQFHRIKLVWRU\LQDQRQVWDWLRQDU\ZRUOGLQ:LHQV
-$+D\ZDUG*'6DIIRUG+'*LIIHQ&(GV+LVWRULFDO(QYLURQPHQWDO9DULDWLRQLQ
&RQVHUYDWLRQDQG1DWXUDO5HVRXUFH0DQDJHPHQW:LOH\%ODFNZHOOSS±
%RWNLQ'7KH0RRQLQ WKH1DXWLOXV6KHOO'LVFRUGDQW+DUPRQLHV5HFRQVLGHUHG2[IRUG
8QLYHUVLW\3UHVV
&UDLJ5.5XKO-%'HVLJQLQJ$GPLQLVWUDWLYH/DZIRU$GDSWLYH0DQDJHPHQW9DQGHUELOW
8QLYHUVLW\/DZ6FKRRO3XEOLF/DZDQG/HJDO7KHRU\:RUNLQJ3DSHU1XPEHU
'RH%57KHSDVWLVWKHNH\WRWKHIXWXUH*HRFKLP&RVPRFKLP$FWD±
*LJHUHQ]HU**ROGVWHLQ'*5HDVRQLQJWKHIDVWDQGIUXJDOZD\PRGHOVRIERXQGHG
UDWLRQDOLW\3V\FKRO5HY±
*OHQQRQ5:DWHU)ROOLHV*URXQGZDWHU3XPSLQJDQGWKH)DWHRI$PHULFD¶V)UHVK:DWHUVW
HG,VODQG3UHVV:DVKLQJWRQ'&
+LUVFK50$3HUVSHFWLYHRQ1RQVWDWLRQDULW\DQG:DWHU0DQDJHPHQW-$P:DWHU5HVRXU
$VVRF±
+XPH'$Q(QTXLU\&RQFHUQLQJ+XPDQ8QGHUVWDQGLQJH%RRNV#$GHODLGH
+XWWRQ-7KHRU\RIWKH(DUWKZLWK3URRIVDQG,OOXVWUDWLRQV9ROXPH3URMHFW*XWHQEHUJ
.DKQHPDQ'7KLQNLQJ)DVWDQG6ORZ)DUUDU6WUDXVDQG*LURX[
.ROWNR5LYHUD0(5HGLVFRYHULQJWKHODWHUYHUVLRQRI0DVORZ¶VKLHUDUFK\RIQHHGV6HOI
WUDQVFHQGHQFHDQGRSSRUWXQLWLHVIRUWKHRU\UHVHDUFKDQGXQLILFDWLRQ5HY*HQ3V\FKRO
±
3DJH
3*O\QQ :KLWKHUWKH2UDFOH&RJQLWLYH%LDVHVDQGRWKHU+XPDQ&KDOOHQJHVRI,(0
/DQLDN*)2OFKLQ**RRGDOO-9RLQRY$+LOO0*O\QQ3:KHODQ**HOOHU*4XLQQ1
%OLQG03HFNKDP65HDQH\6*DEHU1.HQQHG\5+XJKHV$,QWHJUDWHG
HQYLURQPHQWDOPRGHOLQJ$YLVLRQDQGURDGPDSIRUWKHIXWXUH(QYLURQ0RGHO6RIWZ±
0DUHZVNL-1*DLVVPDLHU:*LJHUHQ]HU**RRGMXGJPHQWVGR QRWUHTXLUHFRPSOH[
FRJQLWLRQ&RJQ3URFHVV±
0DVORZ$+$WKHRU\RIKXPDQPRWLYDWLRQ3V\FKRO5HY±
1LFNHUVRQ56&RQILUPDWLRQELDV$XELTXLWRXVSKHQRPHQRQLQPDQ\JXLVHV5HY*HQ
3V\FKRO±
1RUWRQ -35HFNKRZ.+0RGHOOLQJDQG0RQLWRULQJ(QYLURQPHQWDO2XWFRPHVLQ$GDSWLYH
0DQDJHPHQWLQ-DNHPDQ$-9RLQRY$$5L]]ROL$(&KHQ6+(GV'HYHORSPHQWVLQ
,QWHJUDWHG(QYLURQPHQWDO$VVHVVPHQW9RO(QYLURQPHQWDO0RGHOOLQJ6RIWZDUHDQG'HFLVLRQ
6XSSRUW(OVHYLHU%9SS±
3L]]XWR-6FKHQN(5+XSS&5*HOOLV$1RH*:LOOLDPVRQ(.DUZDQ'/2¶1HDO0
0DUTXDUG-$DOWR51HZEROG'&KDUDFWHULVWLFOHQJWKVFDOHVDQGWLPHDYHUDJHG
WUDQVSRUWYHORFLWLHVRIVXVSHQGHGVHGLPHQWLQWKHPLG$WODQWLFUHJLRQ86$:DWHU5HVRXU5HV
±
3ODWR%&( 6RFUDWHV7KH$SRORJ\E\3ODWR3URMHFW*XWHQEHUJ%-RZHWWWUDQVODWLRQ
3RSSHU.57KH/RJLFRI6FLHQWLILF'LVFRYHU\+DUSHU5RZRULJLQDOO\SXEOLVKHGLQDV
/RJLNGHU)RUVFKXQJ1HZ<RUN
6DQIRUG:(3RSH-34XDQWLI\LQJJURXQGZDWHU¶VUROHLQGHOD\LQJLPSURYHPHQWVWR
&KHVDSHDNH%D\ZDWHUTXDOLW\(QYLURQ6FL7HFKQRO±
6FKZDUW]%7KH3DUDGR[RI&KRLFH+DUSHU&ROOLQV
6WDQRYLFK.:HVW5(YROXWLRQDU\YHUVXVLQVWUXPHQWDOJRDOV+RZHYROXWLRQDU\SV\FKRORJ\
PLVFRQFHLYHVKXPDQUDWLRQDOLW\LQ2YHU'((G(YROXWLRQDQGWKH3V\FKRORJ\RI7KLQNLQJ
7KH'HEDWH3V\FKRORJLFDO3UHVV6HULHVRQ&XUUHQW,VVXHVLQ7KLQNLQJDQG5HDVRQLQJSS
±
7YHUVN\$.DKQHPDQ'-XGJPHQWXQGHU8QFHUWDLQW\+HXULVWLFVDQG%LDVHV6FLHQFH
±
:LOOLDPV%.%URZQ('$GDSWLYH0DQDJHPHQW7KH86'HSDUWPHQWRIWKH,QWHULRU
$SSOLFDWLRQV*XLGH$GDSWLYH0DQDJHPHQW:RUNLQJ*URXS86'HSDUWPHQWRIWKH,QWHULRU
:DVKLQJWRQ'&
:LQWHU7+DUYH\-:)UDQNH2/$OOH\:0*URXQGZDWHUDQGVXUIDFHZDWHUDVLQJOH
UHVRXUFH86*HRORJLFDO6XUYH\&LUFXODU
3DJH