Who Should Be a Designer? Controlling Admission Into Schools of

:KR6KRXOG%HD'HVLJQHU"&RQWUROOLQJ$GPLVVLRQ,QWR
6FKRROVRI$UFKLWHFWXUH
*DEULHOD*ROGVFKPLGW5DFKHO6HEED
7HFKQLRQ,VUDHO,QVWLWXWHRI7HFKQRORJ\)DFXOW\RI$UFKLWHFWXUHDQG7RZQSODQQLQJ
&DUPHO2UHQ$\HOHW&RKHQ
1DWLRQDO,QVWLWXWHIRU7HVWLQJDQG(YDOXDWLRQ
:KR6KRXOG%HD'HVLJQHU"&RQWUROOLQJ$GPLVVLRQ,QWR
6FKRROVRI$UFKLWHFWXUH
$EVWUDFW
7KLV SDSHU LQWURGXFHV WKH LVVXH RI FULWHULD IRU DGPLVVLRQ LQWR
VFKRROV RI DUFKLWHFWXUH )ROORZLQJ D KLVWRULFDO GHVFULSWLRQ RI
DGPLVVLRQ LQWR VFKRROV VLQFH WKH LQVWLWXWLRQDOL]DWLRQ RI
DUFKLWHFWXUDO HGXFDWLRQ ZH SUHVHQW GDWD IURP DQ LQWHUQDWLRQDO
VXUYH\ FRQGXFWHG RYHU WKH SDVW \HDU $ TXDOLWDWLYH DQDO\VLV RI
WKHVH GDWD UHYHDOV D QXPEHU RI DGPLVVLRQ FULWHULD XVHG LQ
GLIIHUHQWFRPELQDWLRQVDQGZLWKGLYHUVHHPSKDVHVLQDOOVFKRROV
HYHU\ZKHUH7KHGLIIHUHQWDGPLVVLRQSROLFLHVWKDWHPHUJHIURP
WKHDQDO\VLVUHIOHFWWKHVWDWHRIWKHDUWDQGSUHYDOHQWSULRULWLHVLQ
WKHGLIIHUHQWVRFLDOVHWWLQJVLQZKLFKVFKRROVRSHUDWH
$UFKLWHFWVUHFHLYHWKHLUSURIHVVLRQDOHGXFDWLRQDQGWUDLQLQJLQKXQGUHGVRIVFKRROVRI
DUFKLWHFWXUHWKHZRUOGRYHU3UDFWLFHLVXVXDOO\ORFDOO\UHJXODWHGVRPHWLPHVOLFHQVHG
+RZHYHUWKHSUDFWLFHRIDUFKLWHFWXUDOGHVLJQDVZHOODVRWKHUGHVLJQGLVFLSOLQHV
DSSHDUVWREHUHPDUNDEO\VLPLODUHYHU\ZKHUHDWOHDVWHQRXJKVRWRHQDEOHVLJQLILFDQW
PRELOLW\RIDUFKLWHFWVDPRQJILUPVDUHDVRIH[SHUWLVHDQGORFDOHVHYHQZKHUH
FXOWXUDOGLIIHUHQFHVDUHTXLWHUHVWULFWLYHRWKHUZLVH
6LPLODULWLHVDQGGLIIHUHQFHVDPRQJVFKRROVRIDUFKLWHFWXUHDUHZLGHO\
GRFXPHQWHGEXWLWLVVWLOOIDUIURPFOHDUKRZVXFKVLPLODULWLHVDQGGLIIHUHQFHVDIIHFW
WKHH[SHULHQFHDQGSHUIRUPDQFHRIJUDGXDWHV:HNQRZOLWWOHDERXWDUFKLWHFWXUDO
VWXGHQWVDQGHYHQOHVVDERXWZD\VLQZKLFKVFKRROVH[HUFLVHFRQWURORYHUWKHLULQWDNH
RIVWXGHQWVYLDWKHDGPLVVLRQFULWHULDWKH\LPSRVH6XFKFULWHULDUHIOHFWLQVWLWXWLRQDO
DQGVRFLHWDOYDOXHVDQGQRUPVUHJDUGLQJGHVLJQDQGLWVFRQWH[WDQGDUHWKHUHIRUHRI
JUHDWLQWHUHVWWRXV
,QSUDFWLFDOO\DOOVFKRROVRIDUFKLWHFWXUHWKHQXPEHURIDSSOLFDWLRQVH[FHHGVWKH
QXPEHURISODFHVWKDWFDQEHRIIHUHGDQGLQRUGHUWRDVVXUHFRPSHWHQF\VFKRROVVFUHHQ
DSSOLFDWLRQVWRGRVRWKH\XVHDYDULHW\RISURFHGXUHVDQGFULWHULD6WXG\LQJ
DGPLVVLRQFULWHULDRIIHUVDZHDOWKRILQIRUPDWLRQDQGLQVLJKWVRQV\VWHPVRIEHOLHIV
QRUPVYDOXHVDQGELDVHVRIGLIIHUHQWPLFURDQGPDFURFXOWXUHVUHJDUGLQJGHVLJQ,Q
WKLVSDSHUZHSUHVHQWDQLQLWLDOUHSRUWRIDVWXG\LQSURJUHVVRQFULWHULDIRUDGPLVVLRQ
RIVWXGHQWVLQWRVFKRROVRIDUFKLWHFWXUH2XUVXUYH\LQFOXGHVDERXWVFKRROVRI
DUFKLWHFWXUHLQFRXQWULHVDOPRVWKDOIRIWKHPLQWKH8QLWHG6WDWHV7KHDGPLVVLRQ
FULWHULDWKDWKDYHEHHQLGHQWLILHGLQFOXGHKLJKVFKRROUHFRUGVVFRUHVLQJHQHUDO
VFKRODVWLFDSWLWXGHWHVWVVXFKDVYDULRXVSV\FKRPHWULFWHVWVUHVXOWVRIVSHFLDO
DSWLWXGHWHVWVIRUDUFKLWHFWXUHSRUWIROLRVLQWHUYLHZVUHFRPPHQGDWLRQVVWDWHPHQWVRI
LQWHQWDQGZULWWHQHVVD\V(DFKRIWKHVHFULWHULDKDVQXPHURXVYDULHWLHVDQGPD\
DVVXPHDGLIIHUHQWZHLJKWLQWKHRYHUDOODVVHVVPHQWV\VWHPVXVHGE\YDULRXVVFKRROV
7KHSDSHUSUHVHQWVWKHGDWDDQDO\VHVWKHPDQGFRPPHQWVRQWKHLUVLJQLILFDQFH
IROORZLQJDEULHIORRNDWSURPLQHQWKLVWRULFDOH[HPSODUV
6FKRROVRIDUFKLWHFWXUH
7KHKLVWRU\RIXQLYHUVLW\OHYHOSURIHVVLRQDOHGXFDWLRQLQDUFKLWHFWXUHLVUHODWLYHO\
VKRUW%HIRUH:RUOG:DU,WKHJUHDWPDMRULW\RIVFKRROVRIDUFKLWHFWXUHLQWKH
ZHVWHUQZRUOGZHUHPRGHOHGDIWHUWKH)UHQFK(FROH1DWLRQDOHHW6SpFLDOHGHV%HDX[
$UWVZKLFKZDVIRXQGHGLQE\WKH$FDGHPLH5R\DOHG¶$UFKLWHFWXUH(DUOLHU
WUDLQLQJKDGEHHQSURYLGHGE\WKH$FDGHPLHLWVHOIHVWDEOLVKHGLQXQGHUWKH
DXVSLFHVRI/RXLV;,9,WVPDLQSXUSRVHZDVWRVHUYHWKHQHHGVRI)UHQFKDULVWRFUDF\
&DUOKLDQ(JEHUW7KURXJKRXWLWVORQJH[LVWHQFH%HDX[$UWVHGXFDWLRQ
SURPRWHGWKHYDOXHRIKLVWRULFDOSUHFHGHQWVDQGWKHSULPDF\RIWKHJUHDWFODVVLFDO
WUDGLWLRQVQDPHO\*UHHN5RPDQDQG,WDOLDQ5HQDLVVDQFHDUFKLWHFWXUH7KH%HDX[
$UWVHGXFDWLRQDOV\VWHPZDVH[WUHPHO\LQIOXHQWLDODQGPDQ\DVFKRROLQPDQ\
FRXQWULHVIROORZHGLWVWUDGLWLRQDQGZHUHKHQFHLGHQWLILHGDV%HDX[$UWVVFKRROVWR
GLVWLQJXLVKWKHPIURPVFKRROVRIRWKHUµGHQRPLQDWLRQV¶/HDGLQJWKFHQWXU\
$PHULFDQDUFKLWHFWVZHQWWR3DULVWRVWXG\DWWKH(FROHGHV%HDX[$UWV&XII$
%HDX[$UWVGLSORPDZDVLQJRRGFXUUHQF\LQWKH86$ZHOOLQWRWKHWKFHQWXU\
(VKHULFN(XURSHDQ%HDX[$UWVVFKRROVRIDUFKLWHFWXUHZHUHZLGHVSUHDGXQWLO
ZHOOLQWRWKHVDQGHYHQEH\RQGDORQJVLGHRWKHUW\SHVRIVFKRROVQRWDEO\WKH
µ3RO\WHFKQLF¶LQVWLWXWHVDQGVFKRROVWKDWUHIOHFWHGWKHLGHRORJ\RIWKH0RGHUQ
0RYHPHQW,Q)UDQFHWKH%HDX[$UWVV\VWHPZDVDEDQGRQHGRQO\DIWHUWKHHYHQWVRI
$QDOWHUQDWLYHPRGHORIDUFKLWHFWXUDOHGXFDWLRQZDVODXQFKHGLQWKHVLQ
(XURSHLQWZRDYDQWJDUGHLQVWLWXWLRQVWKH%DXKDXVLQ*HUPDQ\HVWDEOLVKHGLQ
DQGWKH9NKXWHPDV+LJKHU6WDWH$UWLVWLFDQG7HFKQLFDO:RUNVKRSVLQ5XVVLD
FRQVROLGDWHGLQ,QERWKLQVWLWXWLRQVDUFKLWHFWXUHZDVDXQLWDORQJVLGHRWKHU
XQLWVGHYRWHGWRWKHDUWVDQGWRFUDIWV>@7KHIRXQGDWLRQRIWKHQHZVFKRROVUHVXOWHG
IURPQRYHOFXOWXUDODWWLWXGHVDQGIURPUHIRUPVLQHGXFDWLRQSUHYDOHQWLQFRQWHPSRUDU\
DUWVGHVLJQDQGDUFKLWHFWXUHLQWKHDIWHUPDWKVRI:RUOG:DU,DQGWKH5XVVLDQ
5HYROXWLRQ7KHVHUHIRUPVZKLFKUHMHFWHGFODVVLFLVPZHUHVWURQJO\PRWLYDWHGE\D
VRFLDODQGSROLWLFDODJHQGDDQGE\DZLVKWRHPSRZHUWKHDUWVWKHFUDIWVDQGGHVLJQ
WKURXJKWKHXVHRILQGXVWULDODQGWHFKQRORJLFDODGYDQFHV([SHULPHQWDWLRQDQG
FUHDWLYHLQLWLDWLYHZHUHFHQWUDOWRWKHHGXFDWLRQDOSKLORVRSK\RIWKH%DXKDXVDQGWKH
9NKXWHPDVDVRSSRVHGWRWKHFRQVHUYDWLYHDSSURDFKRIWKHDFDGHPLHVHPERGLHGLQ
%HDX[$UWVHGXFDWLRQWKDWHPSKDVL]HGFODVVLFLVPDQGWUDLQHGVWXGHQWVE\WHDFKLQJ
WKHPSULPDULO\WRPDVWHUVW\OHVRIWKHSDVW$OWKRXJKWKHDYDQWJDUGH%DXKDXVDQG
9NKXWHPDVZHUHVKXWGRZQSUHPDWXUHO\GXHWRWKHSROLWLFDOFLUFXPVWDQFHVRIWKH
VLQ(XURSHWKH9NKXWHPDVZDVGLVVROYHGLQLQSDUWGXHWRLQWHUQDO
GLIILFXOWLHVWKH%DXKDXVZDVFORVHGE\WKH1D]LDXWKRULWLHVLQWKH\HQMR\HGD
ODVWLQJLQIOXHQFHRQDUFKLWHFWXUHDQGDUFKLWHFWXUDODQGGHVLJQHGXFDWLRQ,QIDFWWKH
QDPHµ%DXKDXV¶KDVEHFRPHDQHPEOHPRIWKHPRGHUQPRYHPHQWLQGHVLJQDQG
DUFKLWHFWXUHVWLOOLQZLGHXVHWRGD\>@
7KHVHFRQGKDOIRIWKHWKFHQWXU\KDVVHHQDSKHQRPHQDOJURZWKLQKLJKHU
HGXFDWLRQIRUZKLFKWKHXQLYHUVLW\KDVEHFRPHWKHSULPHYHKLFOH0DQ\QHZ
XQLYHUVLWLHVZHUHIRXQGHGDURXQGWKHJOREH7KHJUHDWPDMRULW\RIVFKRROVRI
DUFKLWHFWXUHZKRVHQXPEHUKDVVXUJHGSURSRUWLRQDOO\>@RSHUDWHWRGD\DVDFDGHPLF
GHSDUWPHQWVZLWKLQXQLYHUVLWLHVVRPHWLPHVLQGHSHQGHQWO\EXWRIWHQLQSDUWQHUVKLS
ZLWKRWKHUGHSDUWPHQWVHJSODQQLQJFRQVWUXFWLRQHQYLURQPHQWDOVWXGLHV
HQJLQHHULQJRUDUW'HVSLWHWKHPDQ\GLIIHUHQFHVDPRQJVFKRROVRIDUFKLWHFWXUHDQG
WKHLULQVWLWXWLRQDOFRQWH[WVDOPRVWDOORIWKHPVKDUHVLPLODUJRDOVDQGWKHSURJUDPV
WKH\RIIHUDUHEDVHGRQWUDLQLQJSULQFLSOHVWKDWZHUHWRDVLJQLILFDQWH[WHQWLQKHULWHG
IURPWKH%HDX[$UWVDQGWKH%DXKDXV9NKXWHPDVWUDGLWLRQV7KHRPQLSUHVHQWGHVLJQ
VWXGLRFHQWUDOWRWKHFXUULFXOXPRIHYHU\VFKRRORIDUFKLWHFWXUHLVDGLUHFWGHVFHQGDQW
RIWKH%HDX[$UWV¶DWHOLHU$VWULYHIRURULJLQDOLW\DQGLQQRYDWLRQDQGWKH
OHJLWLPL]DWLRQRIH[SORUDWLRQDQGVHDUFKE\WULDODQGHUURUKDYHEHHQKDQGHGGRZQ
IURPWKH%DXKDXVDQG9NKXWHPDV1HHGOHVVWRVD\QHZFXUULFXODUFRPSRQHQWVKDYH
EHHQDGGHGWRSURIHVVLRQDOHGXFDWLRQWRFDWFKXSZLWKWHFKQRORJLFDODQGVFLHQWLILF
GHYHORSPHQWVDVZHOODVG\QDPLFVRFLDOVHQVLWLYLWLHVDQGDZDUHQHVV6FKRROVRI
DUFKLWHFWXUHKDYHGHYHORSHGWKUHHEDVLFW\SHVRISURJUDPVOHDGLQJWRGLIIHUHQW
GHJUHHVDQRQSURIHVVLRQDOGHJUHHDSURIHVVLRQDOGHJUHHDQGDKLJKHUJUDGXDWH
GHJUHH7KHPRVWFRPPRQGHJUHHLVWKHSURIHVVLRQDOGHJUHHLQPRVWDUFKLWHFWXUH
VFKRROVILYH\HDUVRIVWXG\DUHUHTXLUHGWRHDUQLW,QWKLVVWXG\ZHIRFXVRQSURJUDPV
WKDWOHDGWRDSURIHVVLRQDOGHJUHHLQDUFKLWHFWXUH
3URIHVVLRQDODUFKLWHFWXUDOHGXFDWLRQKDVUHFHQWO\DWWUDFWHGWKHDWWHQWLRQRIVHYHUDO
UHVHDUFKHUVHJ%R\HU0LWJDQJ3RUWHU.LOEULGJHDQXPEHURI
WKHVHVDQGGLVVHUWDWLRQVKDYHEHHQGHYRWHGWRLWVFRUHHOHPHQWWKHVWXGLRHJ%DU(OL
6DODPD6FK|Q7KHTXHVWLRQRIZKRVKRXOGWHDFKGHVLJQZKDW
TXDOLILFDWLRQVDUHQHHGHGRUGHVLUDEOHDQGKRZDUHWKH\WREHDVVHVVHGLVOLNHZLVHRQ
WKHDJHQGDRIPDQ\VFKRROVRIDUFKLWHFWXUH,QFRQWUDVWWKHTXHVWLRQRIZKRVKRXOG
VWXG\DUFKLWHFWXUHLVKDUGO\HYHUDVNHGPXFKOHVVGHEDWHG,QDVIDUDVVWXGHQWVDUH
DGGUHVVHGLQSXEOLVKHGVWXGLHVWKRVHZKRDUHDOUHDG\HQUROOHGDUHUHIHUUHGWRVWXGLHV
WKDWSHUWDLQWRSRWHQWLDOVWXGHQWVDQGDGPLVVLRQFULWHULD'REOH3DOPHU
'RONH$VKRN6KDUPD5DMLYDUHH[WUHPHO\VFDUFH<HWRQDVRFLHWDOOHYHO
WKLVLVDPDMRUTXHVWLRQQRWRQO\EHFDXVHLWUHYHDOVVRFLDOQRUPVDQGELDVHVUHODWHGWR
VRFLDOPRELOLW\EXWDOVREHFDXVHWKHFKDUDFWHULVWLFVRIWKHVWXGHQWERG\DUHODWHU
HPEHGGHGLQWKHSURIHVVLRQDQGLQWKHSK\VLFDOHQYLURQPHQWSURGXFHGE\JUDGXDWHVRI
DUFKLWHFWXUDOVFKRROV
$GPLVVLRQLQWRWKH(FROHGHV%HDX[$UWVWKH%DXKDXVDQGWKH9NKXWHPDV
(FROHGHV%HDX[$UWV
7KH(FROHGHV%HDX[$UWVZDVUXQOLNHDFRQIHGHUDWLRQRI$WHOLHUV(DFK$WHOLHU
KHDGHGE\D3DWURQXVXDOO\DQDFFRPSOLVKHGDUFKLWHFWKDGLWVGLVWLQFWFKDUDFWHU
$VSLULQJVWXGHQWVMRLQHGWKH$WHOLHURIWKHLUFKRLFHZKHUHWKH\WUDLQHGWRZDUGVWKH
(QWUDQFH&RPSHWLWLRQXVXDOO\IRUORQJPRQWKV7KHFRPSHWLWLRQFRQVLVWHGRIWKUHH
SDUWV7ZRZHUHµ(VTXLVVH¶6NHWFKSUREOHPVWKDWLVWKHH[HFXWLRQRIGHVLJQDQG
UHQGHULQJWDVNVLQWKHDWHOLHUZLWKLQDOLPLWHGSHULRGRIWLPH,QWKHILUVWSUREOHP
FDQGLGDWHVZHUHDVNHGWRGHVLJQDVLPSOHDUFKLWHFWXUDOVWUXFWXUHXVLQJFODVVLFDOPRWLIV
,QWKHVHFRQG(VTXLVVHSUREOHPFDQGLGDWHVZHUHWRSURGXFHDODUJHVFDOHDFFXUDWH
GUDZLQJRIDGHFRUDWLYHDUFKLWHFWXUDOHOHPHQWHJDFDSLWDORIDFROXPQ7KHWKLUG
SDUWRIWKHFRPSHWLWLRQZDVDFRPSUHKHQVLYHZULWWHQWHVWWKDWH[DPLQHGWKHVFLHQWLILF
NQRZOHGJHRIWKHFDQGLGDWH&DUOKLDQ,IVXFFHVVIXOWKHFDQGLGDWHZDV
RIILFLDOO\DGPLWWHGWRWKH$WHOLHUZHUHKLVVWXGLHVQRUPDOO\ODVWHGIRUTXLWHDQXPEHU
RI\HDUV'UDIWLQJDQGUHQGHULQJFRPSHWHQFHZDVDNH\WRVXFFHVVLQPRVWWDVNVWKH
VWXGHQWZDVIDFHGZLWKWKURXJKRXWKLVWUDLQLQJ
%DXKDXV
:KHQWKH6WDDWOLFKH%DXKDXVZDVRSHQHGLQ:HLPDULQLWVWDWHGWKDW³$Q\
SHUVRQRIJRRGUHSXWHZLWKRXWUHJDUGWRDJHRUVH[ZKRVHSUHYLRXVHGXFDWLRQLV
GHHPHGDGHTXDWHE\WKH&RXQFLORI0DVWHUVZLOOEHDGPLWWHGDVIDUDVVSDFH
SHUPLWV´*URSLXVTXRWHGLQ:LQJOHUS3URRIRIDGHTXDWHSUHYLRXV
HGXFDWLRQZDVIRUWKRVHZKRZLVKHGDGPLWWDQFHDVDSSUHQWLFHVWREHFRPSOHPHQWHG
ZLWKZKDWZRXOGWRGD\EHFDOOHGDSRUWIROLR³2ULJLQDOZRUNGUDZLQJSDLQWLQJ
VFXOSWXUHFUDIWZRUNGHVLJQVSKRWRJUDSK\HWF´LELGS&DQGLGDWHVZLWKPRUH
H[SHULHQFHFRXOGDSSO\IRUDGPLWWDQFHDVMRXUQH\PHQRUMXQLRUPDVWHUVLQZKLFKFDVH
WKH\ZHUHUHTXLUHGWRVXEPLW³FHUWLILFDWHVRISUHYLRXVO\FRPSOHWHGWUDLQLQJLQWKH
FUDIWV´LELGS6XFFHVVIXODSSOLFDQWVRIDOOVWDQGLQJVZHUHILUVWDGPLWWHGIRUD
WULDOSHULRGRIVL[PRQWKVGXULQJZKLFKWKH\KDGWRWDNHWKHµSUHOLPLQDU\FRXUVH¶
9RUNXUV6XFFHVVLQWKLVREOLJDWRU\FRXUVHDQGDKLJKOHYHORILQGHSHQGHQWZRUN
GXULQJWKRVHVL[PRQWKVZHUHWKHFULWHULDIRUILQDODGPLVVLRQDIWHUZKLFKWKHVWXGHQW
ZDVDOORZHGWR³MRLQWKHZRUNVKRSRIKLVFKRLFHDQGIUHHO\VHOHFWKLVDUWLVWLFPDVWHU
IURPDPRQJWKHPHPEHUVKLSRIWKH&RXQFLORI0DVWHUV´:LQJOHULELGS
$GPLVVLRQZDVVHYHUHO\FRQVWUDLQHGE\DYDLODEOHUHVRXUFHVDQGLQWKH%DXKDXV¶ODWHU
\HDUV³7KHVWXGHQWHQUROOPHQWLQFUHDVHGVRWKDWHQWUDQFHUHTXLUHPHQWVKDGWREH
PDGHPRUHVWULQJHQWWRNHHSWKHVWXGHQWSRSXODWLRQZLWKLQWKHQHFHVVDU\OLPLWV´
)RUJiFVS7KHVHDGPLVVLRQFULWHULDZHUHLQHIIHFWXQWLOWKH%DXKDXV
PRYHGWR%HUOLQLQVKRUWO\EHIRUHLWZDVFORVHGGRZQ>@7KH%HUOLQ
HVWDEOLVKPHQWKDGOHVVVWULQJHQWUHTXLUHPHQWV:LQJOHUS
9NKXWHPDV
)ROORZLQJWKH5HYROXWLRQDUWHGXFDWLRQWKURXJKRXWWKH6RYLHW8QLRQZDVHQWLUHO\
UHRUJDQL]HG&RQVHTXHQWO\WKHYDULRXVDUWVFKRROVDQGFROOHJHVZHUHUHSODFHGE\
)UHH6WDWH$UW6WXGLRV.DKQ0DJRPHGRYZKHUHLQDFFRUGDQFHZLWKWKHVSLULW
RIWKH5HYROXWLRQWKHLQWHQWLRQZDVWRDGPLWDOODSSOLFDQWVZKRZHUHLQWHUHVWHGLQ
UHFHLYLQJDUWLVWLFHGXFDWLRQLUUHVSHFWLYHRIWKHLUSUHYLRXVHGXFDWLRQ/RGGHU
7KH9NKXWHPDVZDVFUHDWHGDVDIXVLRQRIWZRVXFK)UHH6WXGLRVLQ0RVFRZDQGLW
ZDVHQYLVLRQHGWKDWWKHWUDGLWLRQRIDFFHSWLQJDOOLQWHUHVWHGSHUVRQVZRXOGSHUVLVW
+RZHYHUHQWHULQJVWXGHQWVZHUHIDFHGZLWKWKHGHPDQGVRIWKHKLJKO\DFFODLPHG
%DVLF&RXUVHZKLFKRULJLQDOO\ODVWHGWZR\HDUVDQGZDVODWHUVKRUWHQHGWRRQH\HDU
DQGILQDOO\WRRQHWHUPUHTXLULQJPRUHNQRZOHGJHWKDQPRVWVWXGHQWVZHUHDEOHWR
GHPRQVWUDWH,QWKH5DEIDF:RUNHUV¶3UHSDUDWRU\)DFXOW\ZDVHVWDEOLVKHGLQ
RUGHUWRSURYLGHQHFHVVDU\DGYDQFHHGXFDWLRQ6XFFHVVZDVSDUWLDOEHFDXVHGLYHUVLW\
DPRQJWKRVHZKRFRPSOHWHGWKH5DEIDFWUDLQLQJZDVVWLOOWRRJUHDW,WZDVWKHUHIRUH
GHFLGHGWRDGPLQLVWHUHQWUDQFHH[DPLQDWLRQVWKDWZHUHKHOGIURP$FFRUGLQJWR
/RGGHUWKHDGPLVVLRQH[DPLQDWLRQWHVWHGWKHSURVSHFWLYHVWXGHQWV¶DELOLWLHVLQ
GUDZLQJSDLQWLQJPRGHOLQJDQGWHFKQLFDOGUDZLQJ
7KH9NKXWHPDVZDVDPXFKODUJHUVFKRROWKDQWKH%DXKDXVQXPEHULQJDQ
DYHUDJHRIDERXWVWXGHQWVDWDQ\JLYHQWLPH%RMNRDVRSSRVHGWRDWRWDO
RIVWXGHQWVZKRDWWHQGHGWKH%DXKDXVWKURXJKRXWLWVOLIHVSDQRIDOPRVW\HDUV
)RUJiFV7KH(QWUDQFH([DPLQDWLRQVZHUHQRWPDQGDWHGE\FRQVWUDLQWVRQWKH
VFKRRO¶VLQWDNHFDSDFLW\EXWUDWKHUZHUHPHDQWWRHQVXUHDQDGHTXDWHWKUHVKROGRI
SUHSDUHGQHVV>@
6XUYH\$UFKLWHFWXUHVFKRROV¶DGPLVVLRQSROLFLHV±VWDWHRIWKHDUW
,QYHVWLJDWLRQRI7HFKQLRQDGPLVVLRQFULWHULD
7KH7HFKQLRQ,VUDHO,QVWLWXWHRI7HFKQRORJ\)DFXOW\RI$UFKLWHFWXUHDQGWRZQ
3ODQQLQJRQHRIWKHWZR)DFXOWLHVZLWKZKLFKLWRSHQHGLWVJDWHVLQDGPLWVLQWR
LWVILUVW\HDURIXQGHUJUDGXDWHVWXGLHVHDFK\HDUDERXWVWXGHQWVZKRDUHW\SLFDOO\
VHOHFWHGIURPDPRQJVWWRDSSOLFDQWV$GPLVVLRQLVGHWHUPLQHGRQWKHEDVLV
RIDFRPSRVLWHVFRUHFRPSRVHGRIWKUHHFRPSRQHQWVWKH0DWULFXODWLRQH[DPV
DGPLQLVWHUHGE\WKH0LQLVWU\RI(GXFDWLRQXSRQFRPSOHWLRQRIKLJKVFKRRO
3V\FKRPHWULFWHVWVDGPLQLVWHUHGMRLQWO\E\WKHXQLYHUVLWLHVDQGDµVSHFLDO
DUFKLWHFWXUHH[DP¶DGPLQLVWHUHGE\WKH)DFXOW\RI$UFKLWHFWXUHDW7HFKQLRQ7KLV
H[DPKDVEHHQLQXVHIRUVRPH\HDUV5HFHQWO\ZHKDYHXQGHUWDNHQDQ
H[DPLQDWLRQRIRXUDGPLVVLRQFULWHULDDQGLQSDUWLFXODUWKHDELOLW\RIWKHVSHFLDOH[DP
WRSUHGLFWVXFFHVVLQDUFKLWHFWXUDOVWXGLHV,WLVLQWKLVFRQWH[WWKDWZHKDYHGLVFRYHUHG
WKDWDOPRVWQRVWXGLHVKDYHEHHQSXEOLVKHGUHJDUGLQJWKHSROLFLHVSURFHGXUHVDQG
FULWHULDJRYHUQLQJDGPLVVLRQLQWRVFKRROVRIDUFKLWHFWXUH2XUUHVHDUFKSURJUDPLV
TXLWHHODERUDWHDQGLQFOXGHVDQLQGHSWKVWXG\RIFRUUHODWLRQEHWZHHQDGPLVVLRQ
VFRUHVDQGDFDGHPLFJUDGHVZKLFKLVQRWUHSRUWHGLQWKLVSDSHU,QWKHIROORZLQJ
VHFWLRQVZHUHSRUWWKHUHVXOWVRIDQLQWHUQDWLRQDOVXUYH\ZHFRQGXFWHGLQRUGHUWRJDLQ
LQVLJKWLQWRSUHYDOHQWQRUPVRIDGPLVVLRQDURXQGWKHZRUOG
6XUYH\UHVXOWV
,Q-XO\ZHVHQWOHWWHUVWRVFKRROVRIDUFKLWHFWXUHUHTXHVWLQJLQIRUPDWLRQ
DERXWSUDFWLFHVSROLFLHVDQGSURFHGXUHVSHUWDLQLQJWRDGPLVVLRQRIVWXGHQWV7KH
PDLOLQJOLVWZDVGHULYHGIURPWKHZHEVLWHRIWKH$PHULFDQ$VVRFLDWLRQRI&ROOHJLDWH
6FKRROVRI$UFKLWHFWXUH$&6$DQGLQFOXGHGIXOODQGDIILOLDWHPHPEHUVFKRROV>@
$UHPLQGHUZDVPDLOHGLQ'HFHPEHU7KHODVWUHVSRQVHZDVUHFHLYHGLQ0D\
EULQJLQJWKHWRWDOQXPEHURIUHSOLHVWR2IWKRVHDUHUHOHYDQWWRWKH
VXUYH\WKHUHVWLQFOXGLQJQRUHOHYDQWLQIRUPDWLRQRUEHORQJLQJWRDFDWHJRU\RI
VFKRROVWKDWLVQRWFRPSDWLEOHZLWKWKHVWXG\¶VREMHFWLYHVHJSURJUDPVZLWK
JUDGXDWHVWXGLHVRQO\$OOVFKRROVLQFRXQWULHVRIIHUSURIHVVLRQDOGHJUHHVLQ
DUFKLWHFWXUHWKHSURJUDPVDUHYDULHGLQWKHLUVWUXFWXUHDQGGXUDWLRQRIVWXGLHV
EHWZHHQDQG\HDUVDQGVRDUHWKHGHJUHHVDZDUGHG
0RVWUHSOLHVFRQVLVWHGRIDFRYHUOHWWHUDQGSULQWHGPDWHULDOVXFKDVFDWDORJXHV
QHZVOHWWHUVDQGUHSRUWV,QVRPHFDVHVSULQWHGPDWWHUDUULYHGZLWKRXWDFRYHUOHWWHULQ
DVLQJOHFDVHRXULQIRUPDWLRQLVEDVHGRQDVFKRRO¶VZHEVLWHRQO\7KHUHVSRQVHV
PRVWZRUWK\RIQRWHKRZHYHUZHUHWKRVHLQZKLFKDKHDGRIVFKRRORUDQRWKHU
FRQFHUQHGLQGLYLGXDODOVRZURWHDSHUVRQDOOHWWHUGHVFULELQJDQGHYDOXDWLQJWKH
SUDFWLFHVRIWKHVFKRRODQGLQDQXPEHURIFDVHVDOVRRIIHULQJJHQHUDOYLHZVDQG
FULWLFLVP:HVKDOOTXRWHH[WHQVLYHO\IURPWKRVHOHWWHUVWRLQVWDQWLDWHRXUGDWDDQG
DUJXPHQWV
:HKDYHH[WUDFWHGDQH[KDXVWLYHOLVWRIHLJKWGLIIHUHQWFULWHULDIRUDGPLVVLRQLQWR
VFKRROVRIDUFKLWHFWXUH$OOWKHVFKRROVLQRXUVXUYH\XVHRQHRUPRUHRIWKRVHFULWHULD
WRVFUHHQFDQGLGDWHVQRVFKRRODGPLWVDSSOLFDQWVZLWKRXWDQ\VFUXWLQ\,QVRPHFDVHV
VFUHHQLQJDFFRUGLQJWRVRPHRIWKHFULWHULDLVQRWLPSOHPHQWHGWRGHWHUPLQHLQWDNH
LQWRILUVW\HDUEXWVHUYHVWRFRQWURODGPLVVLRQWRDVXEVHTXHQWVWDJHRIVWXGLHV7KH
FULWHULDDUHJHQHUDODQGHDFKLQFOXGHVPDQ\YDULDWLRQVWKDWFDQQRWEHUHSRUWHGKHUHLQ
GHWDLO7KHIROORZLQJLVDVKRUWGHVFULSWLRQRIWKHFULWHULD
+LJKVFKRROUHFRUGV$FFRUGLQJWRWKHQRUPVLQHDFKFRXQWU\KLJKVFKRRO
UHFRUGVPD\FRQVLVWRIDYHUDJHJUDGHVVXFKDVWKH*3$*UDGH3RLQW$YHUDJHLQWKH
86$DVWDWHDGPLQLVWHUHGILQDOH[DPVXFKDVWKH0DWULFXODWLRQRUD%DFFDODXUHDWH
WKHUHHYHQH[LVWVDQ,QWHUQDWLRQDO%DFFDODXUHDWHFHUWLILFDWH
3V\FKRPHWULFWHVWV*HQHUDOVFKRODVWLFDSWLWXGH,QPDQ\FRXQWULHVXQLYHUVLW\
HQWU\DSSOLFDWLRQVUHTXLUHWKDWWKHFDQGLGDWHVXEPLWUHFRUGVRIDJHQHUDOVFKRODVWLF
DQGRUSV\FKRPHWULFWHVW6XFKWHVWVH[DPLQHYDULRXVFRJQLWLYHDQGVFKRODVWLF
DELOLWLHVWRHVWLPDWHIXWXUHVXFFHVVLQDFDGHPLFVWXGLHV7KHVHWHVWVDUHQRUPDOO\
DGPLQLVWHUHGE\WKHVWDWHRUE\WKHXQLYHUVLWLHVH[DPSOHVDUHWKH6$76FKRODVWLF
$VVHVVPHQW7HVWDQG$&7$PHULFDQ&ROOHJH7HVWVVFRUHVLQWKH86$
6SHFLDODUFKLWHFWXUHDSWLWXGHWHVW6RPHVFKRROVXVHVSHFLDOWHVWVWKDWDUH
EHOLHYHGWRUHYHDOFDQGLGDWHV¶DSWLWXGHIRUDUFKLWHFWXUDOVWXGLHV7DVNVJLYHQLQWKRVH
WHVWVSHUWDLQWRYLVXDOPHPRU\VSDWLDORUJDQL]DWLRQGUDZLQJVLPSOHGHVLJQVDQGVR
RQ,QPRVWFDVHVWKHVHWHVWVDUHDGPLQLVWHUHGE\WKH$UFKLWHFWXUH'HSDUWPHQWV
WKHPVHOYHV
,QWHUYLHZ,QWHUYLHZVRIFDQGLGDWHVE\IDFXOW\PHPEHUVDQGVRPHWLPHVDOVR
DGYDQFHGVWXGHQWVDUHFRQGXFWHGLQVHYHUDOVFKRROV7KHZHLJKWRIWKHLQWHUYLHZ
UHVXOWVYDULHVODUJHO\DPRQJVFKRROV6RPHWLPHVWKHLQWHUYLHZLQFOXGHVWKH
SUHVHQWDWLRQRIDSRUWIROLRRIFUHDWLYHGHVLJQZRUN,QVRPHFDVHVLQWHUYLHZVDUHQRW
KHOGDWWKHSRLQWRIHQWU\LQWRWKHVFKRROEXWDVSDUWRIWKHSURFHVVRIFRQWUROOLQJ
DGPLVVLRQLQWRDKLJKHUSKDVHRIVWXGLHV
3RUWIROLR$SRUWIROLRRIGHVLJQZRUNZKHUHDSSOLFDEOHRURWKHUFUHDWLYHZRUNLV
UHYLHZHGLQTXLWHDQXPEHURIVFKRROVDVSDUWRIWKHUHTXLUHPHQWVIRUDGPLVVLRQLQWR
ILUVW\HDURUDVXEVHTXHQW\HDU,QVRPHFDVHVDSRUWIROLRLVUHTXLUHGDWPRUHWKDQRQH
SRLQWDORQJWKHZD\WRJUDGXDWLRQ6RPHWLPHVDSRUWIROLRLVSUHVHQWHGDVSDUWRIDQ
LQWHUYLHZ,QVRPHVFKRROVWKHVXEPLVVLRQRIDSRUWIROLRLVYROXQWDU\DQGLV
HQFRXUDJHGLQERUGHUFDVHV
(VVD\$IHZVFKRROVUHTXLUHHVVD\V±IRUWKHPRVWSDUWVKRUWRQHV
DSSUR[LPDWHO\ZRUGVLQRWKHUFDVHVDORQJHUZULWLQJDVVLJQPHQWLVJLYHQ7KH
SXUSRVHLVWRWHVWWKHFDQGLGDWH¶VDELOLW\WRFOHDUO\FRPPXQLFDWHLGHDVDQGUHDVRQ
DERXWWKHP
:ULWWHQVWDWHPHQW6RPHVFKRROVUHTXLUHSHUVRQDOVWDWHPHQWVH[SODLQLQJZK\WKH
FDQGLGDWHZLVKHVWRVWXG\DUFKLWHFWXUH
/HWWHUVRIUHFRPPHQGDWLRQ/HWWHUVRIUHFRPPHQGDWLRQIURPIRUPHURUSUHVHQW
WHDFKHUVRUSHUVRQVZKRDUHDFTXDLQWHGZLWKWKHFDQGLGDWH¶VZRUNDQGSHUVRQDOLW\
PD\DOVREHUHTXLUHGVRPHWLPHVLQFRQMXQFWLRQZLWKDSHUVRQDOVWDWHPHQW
7DEOHSUHVHQWVWKHIUHTXHQF\GLVWULEXWLRQRIFULWHULDEURNHQGRZQE\FRXQWU\
:HKDYHLGHQWLILHGPLOGUHJLRQDORQDJOREDOVFDOHWHQGHQFLHVWRDSSO\VLPLODU
DGPLVVLRQVWUDWHJLHVDQGKDYHWKHUHIRUHOLVWHGFRXQWULHVE\UHJLRQVPRUHGHWDLOHG
LQIRUPDWLRQRQLQGLYLGXDOVFKRROVLVQHHGHGWRGLVFHUQWKLVWHQGHQF\FOHDUO\,W
VKRXOGEHVWUHVVHGWKDWWKHQXPEHURIVFKRROVSHUFRXQWU\LVDUELWUDU\DVSHUWKH
UHVSRQVHVZHKDYHREWDLQHG
$VLVHYLGHQWIURP7DEOHVRPHDGPLVVLRQFULWHULDDUHPRUHSUHYDOHQWWKDQRWKHUV
+LJKVFKRROUHFRUGVILJXUHLQDOPRVWHYHU\FDVH*RRGVWDQGLQJLQ
SV\FKRPHWULFVFKRODVWLFDSWLWXGHWHVWVLVUHTXLUHGE\DSSUR[LPDWHO\KDOIWKHVFKRROV
ZHVXUYH\HG$VLPLODUSURSRUWLRQRIVFKRROVFKRVHWRUHYLHZ
FDQGLGDWHV¶SRUWIROLRVDOWKRXJKWKLVLVRIWHQDUHTXLUHPHQWRQO\IRUODWHUDGYDQFHPHQW
UDWKHUWKDQIRUDGPLVVLRQLQWRILUVW\HDU/HVVZLGHVSUHDGDUHLQWHUYLHZV
VSHFLDODUFKLWHFWXUDODSWLWXGHH[DPVHVVD\VSHUVRQDOVWDWHPHQWV
DQGOHWWHUVRIUHFRPPHQGDWLRQ7KHDYHUDJHQXPEHURIFULWHULDXVHGDFURVV
VFKRROVLV
3RUWIROLR
(VVD\
6WDWHPHQW
5HFRPPHQGDWLRQV
$PHULFD
&DQDGD
$XVWUDOLD
1HZ=HDODQG
%HOJLXP
'HQPDUN
)LQODQG
1HWKHUODQGV
6SDLQ
6ZHGHQ
6ZLW]HUODQG
8.
3RODQG
6ORYDNLD
%ROLYLD
&RVWD5LFD
*XDWHPDOD
,QGLD
7KDLODQG
,VUDHO
6RXWK$IULFD
7RWDO
2FHDQLD
:(XURSH
((XURSH
6$PHULFD
$VLD
5
&RXQWU\
(
$UFK 6SHFLDO
G
3V\FKRPHWULF
+LJK6FKRRO
86$
1R 6FKRROV
1
*OREDO5HJLRQ
,QWHUYLHZ
*HQHUDO$SWLW7HVWV
7DEOH&ULWHULDIRUDGPLVVLRQLQWRVFKRROVRIDUFKLWHFWXUH
'DWD IURP ,VUDHO DQG 6RXWK $IULFD FRXOG QRW EH ILW LQWR D UHJLRQDO SDWWHUQ
/HWXVQRZHQJDJHLQPRUHLQGHSWKDQDO\VLVRIWKHFULWHULDDQGWKHUHDVRQVIRUWKHLU
XVH7KHQDWXUHRIRXUVDPSOHZKLFKLVZLGHEXWQRWQHFHVVDULO\UHSUHVHQWDWLYHFDOOV
IRUDTXDOLWDWLYHUDWKHUWKDQDTXDQWLWDWLYHDQDO\VLV
$QDO\VLVRIDGPLVVLRQFULWHULD
+LJKVFKRROUHFRUGVDUHLQPRVWFRXQWULHVWKHSUHYDOHQWPHDQVXVHGWRFRQWURO
DGPLVVLRQWRKLJKHUHGXFDWLRQVLQFHWKH\UHIOHFWVFKRODVWLFDELOLW\UHDVRQDEO\
REMHFWLYHO\WKH\DUHHDVLO\REWDLQDEOHDQGERWKXQGHUVWRRGDQGDFFHSWHGE\VRFLHW\DW
ODUJH+LJKVFKRRODFKLHYHPHQWVDUHDFFHSWHGDVRQHRIWKHEHVWLQGLFDWLRQVRID
\RXQJSHUVRQ¶VDELOLW\DQGPRWLYDWLRQWRVWXG\
2XUVXUYH\VKRZVWKDWDQRYHUZKHOPLQJQXPEHURIVFKRROVRIDUFKLWHFWXUHXVH
FDQGLGDWHV¶VXFFHVVLQKLJKVFKRRODVDVFUHHQLQJPHDVXUHVRPHVFKRROVXVHLWDVWKH
VROH\DUGVWLFNIRUDGPLVVLRQRIWKRVHXVLQJDVLQJOHFULWHULRQ$VFKRRORI
$UFKLWHFWXUHLQ3HUWK$XVWUDOLDVWDWHVWKDWVHYHUDOVFUHHQLQJPHWKRGVKDYHEHHQWULHG
RXWRYHUWKH\HDUVEXWQRZWKH\³«WDNHVWXGHQWVVWULFWO\RQDFDGHPLFPHULWXQOHVV
WKH\DUHDZDUGHGDGYDQFHGVWDQGLQJLQZKLFKFDVHDIROLRUHYLHZDQGLQWHUYLHZDUH
LQFOXGHG´$SSO\LQJGLIIHUHQWFULWHULDIRUDGYDQFHGRUWUDQVIHUVWXGHQWVLVDFRPPRQ
SUDFWLFHWKDWZHVKDOOQRWGLVFXVVKHUH6LPLODUYLHZVKDYHEHHQH[SUHVVHGE\VFKRROV
LQ&DQDGDDQG6ZLW]HUODQG
$GPLVVLRQE\KLJKVFKRROVFRUHVLVQRWXQLIRUP0DQ\VFKRROVUHTXLUHLQ
DGGLWLRQWRDQDGHTXDWHDYHUDJHDERYHDYHUDJHJUDGHVLQSDUWLFXODUSUHUHTXLVLWHV
GHSHQGLQJRQWKHVFKRRO¶VRULHQWDWLRQ(QJOLVKODQJXDJHRUDFOXVWHURIVFLHQWLILF
VXEMHFWVDUHFDVHVLQSRLQW,Q7KH1HWKHUODQGVSURVSHFWLYHVWXGHQWVPXVWGHPRQVWUDWH
VXFFHVVIXOKLJKVFKRRODFKLHYHPHQWVLQDQDSSURSULDWHµSURILOH¶FOXVWHURIVXEMHFWV
EHIRUHWKH\FDQEHDGPLWWHGWRWKH)DFXOW\RIWKHLUFKRLFH
1RWHYHU\RQHDJUHHVWKDWSUHUHTXLVLWHVLQSDUWLFXODUDQGKLJKVFKRRODFKLHYHPHQWV
LQJHQHUDODUHUHOHYDQWDVZHFDQOHDUQIURPWKHYLHZH[SUHVVHGE\D8.VFKRRO
³7KHUHDSSHDUVWREHYHU\OLWWOHFRUUHODWLRQEHWZHHQSUHYLRXVVFKRROTXDOLILFDWLRQVDQG
ODWHUVXFFHVV´,QDQ$ODEDPD86$VFKRROWKH\DJUHHDQGD:HOVKVFKRROUHSRUWV
³:HKDYHH[DPLQHGWKHVWDWLVWLFVWRVHHZKHWKHUWKHUHLVDQ\FRUUHODWLRQEHWZHHQKLJK
DFKLHYHPHQWLQVFKRROH[DPVDQGHYHQWXDOVXFFHVVLQDUFKLWHFWXUHDW8QLYHUVLW\
)URPWKHOLPLWHGVDPSOHRIVWDWLVWLFVWKDWZHORRNHGDWLWDSSHDUHGWKDWWKHUHZDVQR
FRUUHODWLRQEHWZHHQWKHWZR«´$'HSDUWPHQWRI$UFKLWHFWXUHLQ4XHHQVODQG
$XVWUDOLDUHSRUWVDPL[HGH[SHULHQFH³,QJHQHUDOVXFFHVVGRHVVHHPWRFRUUHODWHZLWK
KLJKPDWULFXODWLRQVFRUHV«7KH\>VWXGLHVRIJUDGXDWHV@VKRZHGQRSDUWLFXODU
FRUUHODWLRQEHWZHHQSDUWLFXODUVHFRQGDU\VXEMHFWVDQGVXFFHVVLQWKHDUFKLWHFWXUH
SURJUDPPH´
6RPHREVHUYHUVKDYHFRQGXFWHGGHWDLOHGVWXGLHVRIFRUUHODWLRQEHWZHHQKLJK
VFKRROJUDGHVDQGSHUIRUPDQFHLQGLIIHUHQWSKDVHVRIDUFKLWHFWXUDOHGXFDWLRQ$
VFKRROLQ$XFNODQG1HZ=HDODQGIRXQGWKDW³2YHUDOOSHUIRUPDQFHLQWKH
PDWULFXODWLRQH[DPLQDWLRQFRUUHODWHVVWURQJO\ZLWKRYHUDOOSHUIRUPDQFHLQWKHILUVW
WZR\HDUVRIWKHSURJUDPDQGSUREDEO\LQWKHVXEVHTXHQW\HDUV´
3HUIRUPDQFHLQVHFRQGDU\HGXFDWLRQWKHQLVXVHGE\DOPRVWDOOVFKRROVWRKHOS
DVVHVVFDQGLGDWHVIRUWKHPRVWSDUWEHFDXVHWKH\EHOLHYHLQLWVSUHGLFWLYHSRZHUDQG
VRPHWLPHVIRUODFNRIEHWWHUPHDQVRIVFUHHQLQJ,Q$KPHGDEDG,QGLDIRUH[DPSOH
WKHFXUUHQWZHLJKWRIKLJKVFKRROUHFRUGVLQDGPLVVLRQUDQNLQJLVEXWWKH\ZRXOG
KDYHSUHIHUUHGDUHGXFHGZHLJKWRI:HKDYHHQFRXQWHUHGDVPDOOQXPEHURI
FDVHVLQZKLFKKLJKVFKRROVFRUHVDUHDSULPHFULWHULRQIRUDGPLVVLRQDQGWKH
XQLYHUVLW\UXQVDSUHSDUDWRU\UHPHGLDOSURJUDPIRULQDGHTXDWHO\SUHSDUHGSRWHQWLDO
VWXGHQWVWRKHOSWKHPUHDFKWKHUHTXLUHGVWDQGDUGV$6RXWK$IULFDQVFKRROUHSRUWVLWV
IUXVWUDWLRQGXHWRODFNRIVXFFHVVZLWKWKHVHNLQGVRISURJUDPV³7KHUHDUHDQXPEHU
RIPHFKDQLVPVLQSODFHDWRXUXQLYHUVLW\WRKHOSSUHYLRXVO\GLVDGYDQWDJHGVWXGHQWV
SUHGRPLQDQWO\EODFNWRUHDFKWKHUHTXLUHGVWDQGDUG7KHVHSURJUDPVKDYHEHHQ
VXFFHVVIXOLQRWKHUILHOGVEXWIDLOHGGLVPDOO\LQEULQJLQJLQDQ\VWXGHQWVLQWRWKH
%$UFK6WXGSURJUDP«7KHUHTXLUHGEDFNJURXQGIRU$UFKLWHFWXUHVHHPVWREHWRR
VXEVWDQWLDOWRIDOOZLWKLQWKHVFRSHRIDQ\SROLWLFDOO\FRUUHFWµ4XLFN)L[3URJUDP¶´
:HVKDOOFRQFOXGHZLWKDQLQVLJKWIXOUHPDUNWKDWFRPHVIURP9LUJLQLD86$³:H
KDYHKDGRYHUWKH\HDUVVRPHVXFFHVVLQKDYLQJWKH8QLYHUVLW\GHWHUPLQHDGPLVVLRQ
GHFLVLRQV7KH\VLPSO\ILQGWKHEHVWKLJKVFKRROVWXGHQWVLQDJHQHUDOVHQVHUDWKHU
WKDQORRNIRUVSHFLILFLQGLFDWRUVRISRWHQWLDOLQDUFKLWHFWXUH,NQRZWKHUHLVPXFK
GHEDWHRQWKLVSRLQW2XUEHOLHILVWKDWHGXFDWLRQKDVWRGRZLWKSRWHQWLDOUDWKHUWKDQ
PDNLQJSHUKDSVDSUHPDWXUHGHWHUPLQDWLRQRISURIHVVLRQDODELOLW\´
$OLWWOHPRUHWKDQKDOIWKHVFKRROVLQRXUVDPSOHLQWKH86$UHYLHZ
FDQGLGDWHV¶VFRUHVLQWHVWVRIJHQHUDOVFKRODVWLFDVVHVVPHQWRUDSWLWXGHVRPHWLPHV
UHIHUUHGWRDVSV\FKRPHWULFWHVWV7KHFRPPHQWDU\RQVXFKWHVWVLVYHU\VFDUFHLQRXU
GDWD$SULYDWH%ROLYLDQVFKRROWHOOVXVWKDWLWOLNHPRVWRWKHUSULYDWHXQLYHUVLWLHVLQ
%ROLYLDGRHVQRWXVHVXFKWHVWV,QFRQWUDVWDJHQHUDODSWLWXGHWHVWLVWKHEDVLVIRU
DGPLVVLRQWRDOOSXEOLFXQLYHUVLWLHVLQ%ROLYLD,Q,VUDHOZKHUHVFRUHVLQWKH
3V\FKRPHWULF7HVWDUHUHYLHZHGE\DOPRVWDOOLQVWLWXWLRQVRIKLJKHUHGXFDWLRQDVSDUW
RIDGPLVVLRQSURFHGXUHVWKLVWHVWLVSUHVHQWO\GHEDWHGDQGHYHQDVZHZULWHWKH
3DUOLDPHQWLVGLVFXVVLQJDSURSRVDOVHHQE\PDQ\DVSUREOHPDWLFWRHOLPLQDWHLW
7KHPDLQDUJXPHQWDJDLQVWWKHWHVWVWDWHVWKDWLWLVPHDQWWRWHVWDSWLWXGHVWKDWDUHWRD
ODUJHH[WHQWQRQFXUULFXOXPEDVHGZKHUHDVLQUHDOLW\PDQ\SURVSHFWLYHVWXGHQWV
DWWHQGH[SHQVLYHSULYDWHSUHSDUDWRU\FODVVHVWKDWVXFFHHGLQWUDLQLQJWKHPWRZDUGV
DWWDLQLQJKLJKVFRUHV,WLVWKHUHIRUHWKRXJKWWKDWWKHV\VWHPLVHFRQRPLFDOO\DQG
FXOWXUDOO\XQIDLU
2IPRUHLQWHUHVWDUHWKHVSHFLDODSWLWXGHIRUDUFKLWHFWXUHWHVWVWKDWDUHXVHGE\
VFKRROVLQFRXQWULHV6XFKWHVWVYDU\FRQVLGHUDEO\DFFRUGLQJWRWKHDLPVRIWKH
VFKRROVWKDWDGPLQLVWHUWKHP,QVRPHFDVHVDOODSSOLFDQWVWDNHWKHWHVWLQRWKHUFDVHV
ZKHUHDGPLVVLRQLVVWDJHGRQO\WKRVHZKRUHDFKDVHFRQGRUWKLUGVWDJHWDNHWKHP
$OOWHVWVORRNIRUHYLGHQFHRIQRQYHUEDORU9LVLR6SDWLDOLQWHOOLJHQFH7KHRQO\
VFKRROLQWKH86$WRXVHVXFKWHVWVHODERUDWHV³7KHSXUSRVHRIWKLVWHVWLVWRSURYLGH
WKH&ROOHJH$GPLVVLRQV&RPPLWWHHZLWKWKHPHDQVWRLGHQWLI\WKRVHFDQGLGDWHVZKR
H[KLELWWKHVWURQJHVWPRWLYDWLRQDQGWKHJUHDWHVWWDOHQWIRUDUFKLWHFWXUH7KH
$GPLVVLRQ7HVWFRQVLVWVRIDQXPEHURIH[HUFLVHVGHVLJQHGWRFDOOIRUWKWKH
FDQGLGDWH¶VYLVXDOPHPRU\DQGORJLFDQGDELOLW\WRRUGHUVSDFHIRUPSDWWHUQDQG
FRORU´2WKHUVFKRROVKDYHVLPLODUPRWLYDWLRQVLQXVLQJVSHFLDOµDUFKLWHFWXUDO¶WHVWV
DOWKRXJKWKH\GRQRWQHFHVVDULO\VKDUHWKHRYHUZKHOPLQJLPSRUWDQFHDWWDFKHGWRWKHP
E\WKHVFKRROTXRWHGDERYH,QRQH6ORYDNVFKRROWKHWHVWVUHTXLUHDQDGYDQFHGOHYHO
RISUHSDUDWLRQ³$SSOLFDQWVPXVWSDVVDQ(QWUDQFH([DPLQDWLRQZKHUHWKHLUDELOLWLHV
DQGNQRZOHGJHDUHH[DPLQHGLQWKHIROORZLQJGUDZLQJKLVWRU\RIDUFKLWHFWXUH
GHVLJQDVHFRQGODQJXDJHFUHDWLYHDELOLWLHVFRQFHSWVRIVSDWLDOSURSRUWLRQSOXV
PDWKHPDWLFVDQGPRGHOLQJIRUWKHGHVLJQSURJUDPPH´,QDWOHDVWRQHFDVHLQ,QGLD
DVFKRROWHVWLILHVWRGHVLULQJVSHFLDOWHVWVIRUDUFKLWHFWXUHWKDWDUHFXUUHQWO\ODFNLQJ
7KH6ZHGLVKVFKRROVRIDUFKLWHFWXUHKDYHDYHU\LQWHUHVWLQJFRPSRVLWHV\VWHPRI
DGPLVVLRQ&RPSHWLWLRQWRHQWHUDUFKLWHFWXUHVFKRROLVKHOGLQWKUHHSDUDOOHOWUDFNV
EDVHGRQHLWKHUKLJKVFKRRODFKLHYHPHQWVRUDJHQHUDO+LJKHU(GXFDWLRQ$SWLWXGH
7HVWRUDVSHFLDO$UFKLWHFWXUH7HVW'HSHQGLQJRQRQH¶VVWUHQJWKVRQHFDQFRPSHWH
LQHLWKHURIWKHVHWUDFNVRULQDOORIWKHPRIWKHDGPLWWHGVWXGHQWVHQWHUYLDWKH
+LJK6FKRRO*UDGHVWUDFNHQWHUWKDQNVWRYHU\KLJKVFRUHVLQWKH$SWLWXGH7HVWV
DQGDUHFKRVHQEDVHGRQH[FHOOHQWUHVXOWVLQWKH$UFKLWHFWXUH7HVW³7KH
EDFNJURXQGRIWKH$UFKLWHFWXUDOWHVWLVWKDWWKHVFKRROVEHOLHYHGWKDWQHLWKHUWKH
J\PQDVLXPJUDGHVQRUWKHDSWLWXGHWHVWZHUHUHOHYDQWIRUDUFKLWHFWVDUWLVWLF
PHULWHWFGLGQRWVKRZWKDWZD\7KH$UFKLWHFWXUDOWHVWKDVQRZEHHQXVHGIRU
\HDUVDQGKDVEHHQDVXFFHVV´,Q'HQPDUNWRRDFDGHPLFDFKLHYHPHQWVDUHQRW
EHOLHYHGWREHDJRRGHQRXJK\DUGVWLFNIRUDGPLVVLRQ2QO\RIWKHLQFRPLQJ
VWXGHQWV³4XRWD´DUHDGPLWWHGEDVHGRQWKHLUKLJKVFKRROUHFRUGV7KHEDODQFH
³4XRWD´JDLQHQWU\RQWKHEDVLVRIZRUNH[SHULHQFHRUDUFKLWHFWXUDOO\UHODWHG
TXDOLILFDWLRQV7KH'DQHVWRRDUHVDWLVILHG³*HQHUDOO\VSHDNLQJWKHV\VWHPZRUNV
UHDVRQDEO\ZHOO,WVHHPVOLNHWKHTXRWDV\VWHPVHFXUHVDQLQWDNHRIVWXGHQWVWKDW
FRSHZHOOLQWKHLUVWXGLHVDOWKRXJKWKH\JRWUDWKHUORZPDUNVDWWKHLUVHFRQGDU\
H[DPLQDWLRQV´
$WWKH,VUDHOL7HFKQLRQZKHUHDQ$UFKLWHFWXUH7HVWKDVEHHQLQSUDFWLFHIRUPDQ\
\HDUVFRQFHUQKDVEHHQYRLFHGEHFDXVHJUDGLQJWKHVHWHVWVRIWHQUHYHDOSRRU
LQWHUUDWHUDJUHHPHQWDQGEHFDXVHFRUUHODWLRQZLWKVWXGHQWV¶VXEVHTXHQWSHUIRUPDQFH
LVTXLWHORZ$VLPLODUILQGLQJFRPHVIURP$KPHGDEDGLQ,QGLD
(VVD\VDUHUHTXLUHGH[FOXVLYHO\LQWKH86$DQG&DQDGDVHH7DEOHEXWVRPH
RIWKHVFKRROVWKDWUHTXHVWWKHPDWWDFKJUHDWLPSRUWDQFHWRWKHP7\SLFDOO\WKH
GHPDQGLVIRUDVKRUWHVVD\H[SODLQLQJZK\WKHDSSOLFDQWZLVKHVWRVWXG\DUFKLWHFWXUH
,QWKHVHFDVHVLWLVWKHFDQGLGDWH¶VJRDOVUDWKHUWKDQKLVRUKHUZULWLQJVNLOOVWKDWDUHDW
VWDNH:KHUHORQJHUHVVD\VDUHUHTXHVWHGWKHGHSDUWPHQWVLQTXHVWLRQDUHLQWHUHVWHGLQ
WKHSURVSHFWLYHVWXGHQW¶VLQWHOOHFWXDODQGORJLFWKLQNLQJSRZHUV7KHLPSRUWDQFHRI
JRRGZULWLQJUHDVRQLQJVNLOOVLVFRUURERUDWHGE\WKHLPSRUWDQFHWKDWVHYHUDOVFKRROV
DWWDFKWRWKHODQJXDJHFRPSRQHQWRIWKH0DWULFXODWLRQDQGRU$SWLWXGHWHVW(YLGHQFH
LVRIIHUHGIRUH[DPSOHE\DQ$XVWUDOLDQVFKRRO³«RXUH[SHULHQFHDQGVXUYH\V
LQGLFDWHWKDWWKHUHLVQRFRUUHODWLRQEHWZHHQVFKRROVXEMHFWVDQGDFKLHYHPHQWLQWKH
XQGHUJUDGXDWHDUFKLWHFWXUHFRXUVHRWKHUWKDQDVWURQJWHQGHQF\IRUWKRVHZLWKJRRG
(QJOLVKZULWLQJVNLOOVWRSHUIRUPEHWWHURYHUDOOLQWKHDUFKLWHFWXUHFRXUVHWKDQWKRVH
ZLWKOHVVHU(QJOLVKVNLOOV´2WKHUVFKRROVUHSRUWVVLPLODUILQGLQJV
3HUVRQDOVWDWHPHQWVRILQWHQWDQGOHWWHUVRIUHFRPPHQGDWLRQDUHUHTXLUHGLQVRPH
86$DQG8.VFKRROVLQWKH8.DVWDWHPHQWLVSDUWRIDVWDQGDUGDSSOLFDWLRQIRUP
QRUHYHDOLQJFRPPHQWDU\RQWKHLUXVHIXOQHVVLVRIIHUHGLQRXUGDWD
,QWHUYLHZVDUHPDQGDWRU\RUHQFRXUDJHGLQTXLWHDQXPEHURIVFKRROVZKHUHDV
RWKHUVIRUHJRWKHPRXWRIFRQYLFWLRQRUSHUQHFHVVLW\WUDYHOGLVWDQFHVDUHWRRJUHDW
7KHGHEDWHRYHUWKHFUHGLELOLW\RILQWHUYLHZVWKDWLVSUHYDOHQWLQWKHRFFXSDWLRQDO
SV\FKRORJ\OLWHUDWXUHLVUHIOHFWHGLQWKHGLIIHUHQFHVRIRSLQLRQWKDWZHILQGLQRXUGDWD
2QWKHRQHKDQGZHKDYHWKRVHZKROLNHRQHVFKRROLQ$XVWUDOLDILUPO\RSSRVH
LQWHUYLHZVRQSURIHVVLRQDOJURXQGV³,QWHUYLHZLQJVWXGHQWVZDVQRWDJRRGLQGLFDWRU
RIVXFFHVVXQOHVVWKHLQWHUYLHZVZHUHFDUULHGRXWFRQVLVWHQWO\E\DSURSHUO\WUDLQHG
VPDOOWHDP´5HMHFWLRQPD\DOVRUHIOHFWJRDOVDVLQWKHFDVHRID1HZ=HDODQG
VFKRRO³$VDUXOHZHGRQRWLQWHUYLHZZHEULHIO\WULHGLWDQGIRXQGLWXQKHOSIXODQG
DWRGGVZLWKRXU8QLYHUVLW\¶VHPSKDVLVRQDFDGHPLFSHUIRUPDQFH´
$SRVLWLYHDSSURDFKWRZDUGVLQWHUYLHZVLVH[SUHVVHGE\WKRVHZKRXVHLW
SULPDULO\DVDVHWWLQJIRUWKHSUHVHQWDWLRQRIDSRUWIROLRDVLQRQH&DQDGLDQFDVH³2XU
DQDO\WLFDOVWXGLHVVKRZWKDWWKHLQWHUYLHZSRUWIROLRUHYLHZLVDYHU\JRRGSUHGLFWRURI
VXFFHVVLQWKHGHVLJQVWXGLR,QGHHG³$´LQWHUYLHZVDVDJURXSVKRZWKHPVHOYHVWREH
WKHOHDGHUVLQWKHVWXGLR´,QRQH8.VFKRRODQLQWHUYLHZLVVHHQDVDXVHIXOWRROWR
GLVFRYHUWDOHQWWKDWLVQRWWHVWDEOHZKLFKWKH\UHJUHWQRWXVLQJUHJXODUO\EHFDXVHLWLV
WRRODERULQWHQVLYH
7KHVXEPLVVLRQRISRUWIROLRVLVUHTXHVWHGE\DOPRVWKDOIWKHVFKRROVZHVXUYH\HG
7KRVHZKRUHTXHVWDSRUWIROLRDWWKHRXWVHWDVSDUWRIWKHLQLWLDODGPLVVLRQVFUHHQLQJ
XVHLWIRUSXUSRVHVVLPLODUWRWKRVHGHVFULEHGE\VFKRROVWKDWKDYHVSHFLDODUFKLWHFWXUH
DSWLWXGHWHVWV2QH,VUDHOLVFKRROWKDWDGPLQLVWHUVDVSHFLDOWHVWDQGDOVRUHTXHVWVD
SRUWIROLRVWDWHVWKDWWKURXJKERWKPHDQVLWKRSHVWRDVVHVV³FUHDWLYLW\DEVWUDFW
WKLQNLQJH[SUHVVLRQRILGHDVXQGHUVWDQGLQJRIVXEMHFWVDQGPRUH´,QD1HZ
=HDODQGWKHSRUWIROLRLVUHJDUGHGDVDYHU\VXFFHVVIXOVFUHHQLQJPHDQVDQGRQH1HZ
<RUN6WDWHVFKRRODGYLVHVLWVDSSOLFDQWV³$GHVLJQSRUWIROLRZLOOEHDQHVVHQWLDO
HOHPHQWRI\RXUDSSOLFDWLRQ´,QFRQWUDVWRWKHU86$VFKRROVREMHFWWRSRUWIROLRVDV
RQHRIWKHPVWDWHV³2XUVFKRROGRHVQRWUHTXLUHDSRUWIROLRRIYLVXDOZRUNRUDQ
LQWHUYLHZ$PHULFDQKLJKVFKRRODUWHGXFDWLRQLVLQFRQVLVWHQWLQDYDLODELOLW\DQG
TXDOLW\DSRUWIROLRUHTXLUHPHQWZRXOGEHXQIDLUWRRXUDSSOLFDQWV´2WKHUVFKRROV
DFFHQWXDWHWKLVSRLQWDVZHOO
3RUWIROLRVKRZHYHUVHUYHDVLQGLVSHQVDEOHPHDQVIRUFRQWUROOLQJDGPLVVLRQLQWR
DGYDQFHGSKDVHVRIVWXG\DIWHUWKHILUVWRUVHFRQG\HDURUDVSDUWRIDIRUPDO
DSSOLFDWLRQWRHQWHUWKHIRXUWKRUILIWK\HDURIDSURIHVVLRQDOSURJUDPIROORZLQJ
UHFHLSWRIDQRQSURIHVVLRQDO%DFKHORUGHJUHHLQDUFKLWHFWXUH0DQ\VFKRROVEHOLHYH
WKDWSHUIRUPDQFHLQDUFKLWHFWXUHFDQQRWEHDFFXUDWHO\SUHGLFWHGDKHDGRIWLPHDQG
WKHUHIRUHWKHEHVWSROLF\LVWRDOORZDVPDQ\VWXGHQWVDVSRVVLEOHWREHJLQDUFKLWHFWXUDO
VWXGLHVZLWKFRQWUROSRLQWVDWSUHHVWDEOLVKHGSRLQWVDORQJWKHZD\6WXGHQWVFDQ
SURFHHGEH\RQGWKRVHµFKHFNSRLQWV¶SURYLGHGWKH\UHDFKDFHUWDLQJUDGHDYHUDJHDQG
LIWKHLUSRUWIROLRVDUHGHHPHGVDWLVIDFWRU\,QRQH$XVWUDOLDQVFKRROWKHEHOLHILVWKDW
µWKHSURRIRIWKHSXGGLQJLVLQWKHHDWLQJ¶DQGVWXGHQWVPXVWSDVVPRUHWKDQRQH
FKHFNSRLQWDORQJWKHZD\7KHILUVWLVDIWHUWKHILUVW\HDU³«HYLGHQFHVXJJHVWVWKDW
WKHEHVWLQGLFDWRURIVXFFHVVZDVVXFFHVVDWWKHHQGRIILUVW\HDU´$VHFRQGDQG
FUXFLDOVFUHHQLQJRFFXUVDWWKHHQGRIWKHUG\HDU³RXUVROXWLRQWRHQVXULQJDKLJK
VWDQGDUGJUDGXDWHLVWRSODFHDEDUULHURIPLQLPXPDYHUDJHLQUG\HDUEHIRUH
VWXGHQWVFDQSURJUHVVWRWK\HDU´
0DQ\RWKHUVFKRROVXVHSHUIRUPDQFHGXULQJWKHILUVW\HDUDVDVFUHHQLQJJXLGH$
VFKRROLQ7KDLODQGUHSRUWVWKDWWKLVKDSSHQVQDWXUDOO\³ZLWKLQWKHILUVWRQHRUWZR
\HDUVLQVFKRROVWXGHQWVZKRKDYHQRWDFKLHYHGWKHPLQLPXPUHTXLUHG*3$PD\GURS
RXWRIVFKRRORUVKLIWWRRWKHUGLVFLSOLQHV´$WRQH$ODEDPD86$VFKRROD
VWUXFWXUHGSUHUHTXLVLWHFRXUVHLVRIIHUHGSULRUWRWKHILUVW\HDU³$SUHDUFKLWHFWXUH
VHPHVWHULVUHTXLUHGGXULQJZKLFKVHOIVHOHFWLRQQRUPDOO\WDNHVFDUHRIDGPLVVLRQ
SUREOHPV´,QDQRWKHU86$VFKRROWKHHQWLUHILUVW\HDUZRUNLVXVHGWRUHJXODWH
VXEVHTXHQWVWXGLHV³:HKDYHGHYHORSHGDILUVW\HDU'(6,*1VWXGLRZKLFKLV
GHVLJQHGDVDµVXSHUVWXGLR¶«2XUILUVW\HDUHQUROOPHQWLQGHVLJQLV8SRQ
FRPSOHWLRQRIILUVW\HDUDSRUWIROLRLVUHTXLUHG«7REHFRQVLGHUHGIRUWKH6HFRQG
<HDU$//ILUVW\HDUFRXUVHZRUNPXVWEHFRPSOHWHG«$OOJUDGHSRLQWDYHUDJHVDUH
WKHQDGGHGWRWKHSRUWIROLRJUDGHVZLWKWKHSRUWIROLRKDYLQJWZLFHWKHZHLJKWRI
JUDGHVDQGWKHVWXGHQWVDUHWKHQUDQNHG7KHWRSVL[W\VWXGHQWVDUHWKHQDGPLWWHGWR
RXU6HFRQG<HDU´<HWDQRWKHUVFKRROLQWKH86$DFFHSWVWRLWVILUVW\HDUDQ\
LQWHUHVWHGVWXGHQWZKRKDVJDLQHGDFFHSWDQFHWRWKHXQLYHUVLW\6FUHHQLQJRFFXUVDIWHU
WKHVHFRQG\HDU
$KDQGIXORIVFKRROVORRNIRUHYLGHQFHRIVSHFLDODFWLYLWLHVLQWKHFRPPXQLW\
KREELHVDGYHQWXURXVWUDYHODQGWKHOLNH
$VFDQEHVXUPLVHGIURPWKHFRPSLOHGHYLGHQFHDERYHWKHUHLVQRFRQVHQVXV
RYHUWKHEHVWFULWHULDIRUDGPLVVLRQLQWRDUFKLWHFWXUDOVWXG\SURJUDPV&OHDUO\DOO
VFKRROVZLVKWRDGPLWWKRVHVWXGHQWVZKRVHSRWHQWLDOWRVXFFHHGLVWKHJUHDWHVWEXW
YHU\IHZVFKRROVPDNHDQHIIRUWWRYHULI\WKDWWKHLUFULWHULDLQGHHGUHVXOWLQDQRSWLPDO
LQWDNHRIVWXGHQWV:HVKDOOQRZEULHIO\VXPPDUL]HRXUILQGLQJVLQWKHIRUPRIDIHZ
DGPLVVLRQSURILOHVWKDWFDQEHLQIHUUHGIURPWKHGDWDZHKDYHFRPSLOHG
6XPPDU\
7KHIROORZLQJFRQVROLGDWHVRXUUHDGLQJRIWKHPDMRUVWUHQJWKVVRXJKWE\VFKRROVRI
DUFKLWHFWXUHDVWKHEDVLVIRUWKHLUDGPLVVLRQFULWHULD'LIIHUHQWVFKRROVKDYHGLIIHUHQW
SULRULWLHVUHJDUGLQJWKHVHVWUHQJWKV
6FKRODVWLFDFKLHYHPHQWV$ODUJHQXPEHURIXQLYHUVLWLHVUHJDUGWKHSHUIRUPDQFH
RI\RXQJVWHUVLQWKHLUSUHYLRXVDFDGHPLFVHWWLQJVLHKLJKVFKRRODVWKHPDMRU
\DUGVWLFNIRUSUHGLFWLQJVXFFHVVLQDQ\ILHOGDQGWKHUHIRUHIRUDGPLVVLRQLQWRDQ\
GHSDUWPHQW&RQVHTXHQWO\0DWULFXODWLRQJUDGHVRIWHQLQFRQMXQFWLRQZLWK
LQGHSHQGHQWJHQHUDOVFKRODVWLFDSWLWXGHVFRUHVDUHWKHEDVLVIRUDGPLVVLRQLQWRWKH
XQLYHUVLW\LQJHQHUDODQGDOVRLQWRLWVVFKRRORIDUFKLWHFWXUH,QVRPHFDVHVZULWLQJ
VNLOOVDUHSDUWLFXODUO\VLJQLILFDQWLQWKLVVFUXWLQ\
&UHDWLYHDFKLHYHPHQWV0DQ\VFKRROVSUHIHUVWXGHQWVZKRKDYHDOUHDG\KDG
H[SHULHQFHLQFUHDWLYHSXUVXLWVDQGWKH\LQVSHFWWKHUHVXOWVRIWKRVHSXUVXLWVVXEPLWWHG
LQWKHIRUPRISRUWIROLRV
&UHDWLYHSRWHQWLDO$FRQVLGHUDEOHQXPEHURIVFKRROVDUHVRPHZKDWVXVSLFLRXV
RIIRUPDODFDGHPLFDFKLHYHPHQWVRIWHHQDJHUVDQGSUHIHUWRUHO\VXEVWDQWLDOO\RQ
VSHFLDODSWLWXGHWHVWVGHVLJQHGWRUHYHDOVXLWDELOLW\WRDUFKLWHFWXUDOGHVLJQ
3HUVRQDOLPSUHVVLRQ,QWHUYLHZVDUHDUJXDEO\PHDQWWRSURYLGHWKHVFKRROVZLWK
DFFXUDWHLPSUHVVLRQVUHJDUGLQJDSSOLFDQWV¶SHUVRQDOLWLHVDQGGHWDLOVRQWKHLU
QRQWHVWDEOHVWUHQJWKV
&RPSRVLWHIDFWRUV:KHUHDVDOPRVWDOOVFKRROVXVHPRUHWKDQRQHFULWHULRQLQ
WKHLUDGPLVVLRQSURFHGXUHVVRPHVFKRROVJRWRH[WUHPHSDLQLQRUGHUWRHQVXUHWKDW
FDQGLGDWHVRIGLYHUVHEDFNJURXQGVDQGDELOLWLHVDUHLGHQWLILHGDQGRIIHUHGSODFHV
0HWKRGVGLIIHUIURPWKHDSSOLFDWLRQRIPXOWLSOHVFUHHQLQJGHYLFHVWRWKH
LPSOHPHQWDWLRQRIVHSDUDWHDSSOLFDWLRQWUDFNVIRUFDQGLGDWHVRIGLIIHULQJVWUHQJWKV
,WLVSRVVLEOHWKDWWHQGHQFLHVWRZDUGVDGPLVVLRQSROLFLHVHPDQDWHDWOHDVWLQSDUW
IURPVZHHSLQJFXOWXUDODWWLWXGHVWRZDUGVDUFKLWHFWXUHDQGWRZDUGVKLJKHUHGXFDWLRQ
+RZHYHURXUVDPSOHLVQRWUHSUHVHQWDWLYHDQGZHDUHQRWTXDOLILHGWRFDUU\RXW
FRPSDUDWLYHFXOWXUDOVWXGLHV:HFHUWDLQO\UHIUDLQIURPHQJDJLQJLQVWDWLVWLFDO
DQDO\VHV:HEHOLHYHWKDWWKHRULHQWDWLRQVRIWKHVFKRROVDQGWKHLQVWLWXWLRQVRIZKLFK
WKH\DUHSDUWDUHVWURQJO\PDQLIHVWLQDGPLVVLRQFULWHULD5HVHDUFKXQLYHUVLWLHVIRUWKH
PRVWSDUWWHQGWRHPSKDVL]HJHQHUDODFDGHPLFDFKLHYHPHQWVDQGVXFFHVVLVPHDVXUHG
LQVWXGHQWV¶RYHUDOOSHUIRUPDQFH,QVRPHRIWKHRWKHUVFKRROVGHVLJQVNLOOVDUHWKH
VLQJOHPRVWLPSRUWDQWPDUNRIDFFRPSOLVKPHQWPHDVXUHGLQVWXGLRSHUIRUPDQFH
$GPLVVLRQFULWHULDUHIOHFWWKHVHGLIIHUHQFHVDOWKRXJKLQFRQJUXHQFHEHWZHHQ
GHSDUWPHQWDQGLQVWLWXWLRQLVQRWXQKHDUGRI
,QFRQFOXVLRQ
7KHTXHVWLRQRIDGPLVVLRQFULWHULDLQWRVFKRROVRIDUFKLWHFWXUHKDVLQRXUYLHZWZR
VLGHV2QWKHRQHKDQGHDFKLQVWLWXWHRIKLJKHUHGXFDWLRQDQGHYHU\VFKRRORI
DUFKLWHFWXUHZLWKLQLWPDQLIHVWDOHJLWLPDWHDVSLUDWLRQWRDGPLWWKHEHVWSRVVLEOH
VWXGHQWVLWFDQDWWUDFW 2QWKHRWKHUKDQGVRFLHW\ZKLFKVSRQVRUVPRVWRILWV
LQVWLWXWHVRIKLJKHUHGXFDWLRQVKDUHVWKDWDVSLUDWLRQEXWLVQRUPDOO\DOVRFRPPLWWHGWR
VRFLDOPRELOLW\DQGFXOWXUDOGLYHUVLW\$GPLVVLRQFULWHULDWRXQLYHUVLWLHVDWODUJHDQG
WRDUFKLWHFWXUDOSURJUDPVLQSDUWLFXODUDUHDIIHFWHGE\WKHRULHQWDWLRQRIWKRVHZKR
KDYHWKHSRZHUWRGHWHUPLQHDGPLVVLRQSROLFLHV(TXDORSSRUWXQLW\DQGH[FHOOHQFHRI
SHUIRUPDQFHPLJKWEHFRQWUDGLFWRU\DWOHDVWLQWKHVKRUWUDQJHDQGWKHGLIIHUHQFHLQ
DGPLVVLRQFULWHULDLQWRSXEOLFDQGSULYDWHXQLYHUVLWLHVHJLQ%ROLYLDH[HPSOLI\WKLV
GLFKRWRP\
$KLVWRULFDOSHUVSHFWLYHUHYHDOVWKDWQRWPXFKKDVFKDQJHGDVIDUDVDFFHVVLELOLW\
WRDUFKLWHFWXUDOHGXFDWLRQLVFRQFHUQHGVFKRROVKDYHDOZD\VEHHQVHOHFWLYHDVWRZKR
WKH\DGPLWGXHWRFRQVWUDLQHGUHVRXUFHVDVZHOODVDQHHGWRVHWDQDSSURSULDWH
WKUHVKROGIRUTXDOLW\RISHUIRUPDQFH:KDWKDVFKDQJHGLVWKHGLYHUVLW\DQG
FRPSOH[LW\RI\DUGVWLFNVXVHGWRGHWHUPLQHVXLWDELOLW\DQGDSSURSULDWHSHUIRUPDQFH
,Q\HVWHU\HDUVGHVLJQVNLOOV±PRVWO\WHFKQLFDOSUHVHQWDWLRQVNLOOV±ZHUHDQRYHUULGLQJ
PHDVXUHRIDGHTXDF\%HDX[$UWVWUDGLWLRQ7RGD\FUHDWLYLW\IROORZLQJWKH%DXKDXV
DQG9NKXWHPDVKHULWDJHDVZHOODVUHDVRQLQJSRZHUDQGKLJKJHQHUDODSWLWXGH
SUHYDOHQWLQKLJKHUHGXFDWLRQLQJHQHUDOSOD\DPXFKPRUHLPSRUWDQWUROHLQ
GHWHUPLQLQJZKRZLOOEHDOORZHGWRDFTXLUHDUFKLWHFWXUDOHGXFDWLRQ2OLYHU
+D\ZDUG
1RWPXFKLVNQRZQDERXWWKHVXFFHVVRISUHYDOHQWDGPLVVLRQFULWHULDWRSURYLGH
VFKRROVRIDUFKLWHFWXUHZLWKWKHVWXGHQWVWKH\GHVLUHWRHQUROO(YHQOHVVLVNQRZQ
DERXWWKHLPSDFWRIVHOHFWLRQPHWKRGVRQWKHEXLOWHQYLURQPHQWHYHU\ZKHUHLQWKH
ZRUOG,WLVRXUKRSHWKDWIXUWKHUVWXGLHVE\RWKHUVDQGE\RXUVHOYHVZLOOVKHGPXFK
QHHGHGOLJKWRQWRWKHVHDOOLPSRUWDQWLVVXHV
$FNQRZOHGJPHQWV
7KHUHVHDUFKUHSRUWHGLQWKLVSDSHUZDVVXSSRUWHGE\7HFKQLRQ935*UDQWQR
IURPWKH(DQG-%LVKRS5HVHDUFK)XQG7KHDXWKRUVZLVKWRWKDQN
(NDWHULQD.OHYLWVN\IRUKHUDVVLVWDQFHLQUHVHDUFKLQJWKH%DXKDXVDQG9NKXWHPDV
DGPLVVLRQFULWHULD
1RWHV
7KHDUFKLWHFWXUHGHSDUWPHQWRSHQHGRQO\LQDIWHUWKH%DXKDXVPRYHGIURP
:HLPDUWR'HVVDX+RZHYHULQIRUPDODUFKLWHFWXUDOH[SHULPHQWDWLRQDQG
GLVFXVVLRQJURXSVZHUHDFWLYHLQWKH%DXKDXVDOUHDG\HDUOLHU
7KH9NKXWHPDVZDVQRWOHVVLQIOXHQWLDOWKDQWKH%DXKDXVLQVKDSLQJWKHPRGHUQ
PRYHPHQWPDLQO\WKURXJK&RQVWUXFWLYLVP7KH,URQ&XUWDLQOLPLWHGWKH
H[SRVXUHRIWKH:HVWHUQZRUOGWR6RYLHWFXOWXUHDQGWKH9NKXWHPDVLVWRWKLVGD\
E\IDUOHVVNQRZQWKDQLWV:HVWHUQFRXQWHUSDUWWKH%DXKDXV
7RJHWDQLGHDRIWKHH[WHQWRIJURZWKZHPLJKWORRNDWWKHSUROLIHUDWLRQRI
VFKRROVLQWKH86$'UDSHUTXRWHVDOLVWSUHSDUHGE\:HDWKHUKHDG
RIVFKRROVRIDUFKLWHFWXUHLQWKH86$SULRUWRWKHHQGRI:RUOG:DU,$W
SUHVHQWPRUHWKDQVFKRROVRIDUFKLWHFWXUHRSHUDWHLQWKH86$PRVWRIZKLFK
ZHUHIRXQGHGVLQFH:RUOG:DU,,
,WVDUFKLWHFWXUHSURJUDPWKHQPRYHGWR&KLFDJRZKHUHLWEHFDPHSDUWRIWKH
,OOLQRLV,QVWLWXWHRI7HFKQRORJ\
,QIRUPDWLRQUHJDUGLQJDGPLVVLRQFULWHULDDQGSURFHGXUHVWRWKH%DXKDXVDQGWKH
9NKXWHPDVFRQFHUQVDOOGHSDUWPHQWVRIWKRVHVFKRROVDQGQRWVSHFLILFDOO\
DUFKLWHFWXUH1RVSHFLILFFULWHULDZHUHIRUJHGIRUDQ\RIWKHILHOGVRIVWXG\
2WKHUVRXUFHVRILQIRUPDWLRQZHUHDWWHPSWHGLQFOXGLQJWKH(XURSHDQ$VVRFLDWLRQ
IRU$UFKLWHFWXUDO(GXFDWLRQ($$(EXWQROLVWVRIVFKRROVZHUHDYDLODEOHRQWKH
ZHEDWWKDWWLPH
5HIHUHQFHV
%DU(OL63HGDJRJLFDO$SSURDFKHVLQWKH$UFKLWHFWXUDO'HVLJQ6WXGLR
8QSXEOLVKHG0DVWHUWKHVLV7HFKQLRQ
%RMNR69NKXWHPDV,Q%DUURQ67XFKPDQ0HGV7KH$YDQW*DUGH
LQ5XVVLD1HZ3HUVSHFWLYHV/RV$QJHOHV/RV$QJHOHV&RXQW\0XVHXP
RI$UWSS
%R\HU(/0LWJDQJ/'%XLOGLQJ&RPPXQLW\$1HZ)XWXUHIRU
$UFKLWHFWXUDO(GXFDWLRQDQG3UDFWLFH3ULQFHWRQ1-7KH&DUQHJLH)RXQGDWLRQIRU
WKH$GYDQFHPHQWRI7HDFKLQJ
&DUOKLDQ-37KH(FROHGHV%HDX[$UWV-RXUQDORI$UFKLWHFWXUDO(GXFDWLRQ
SS
&XII'$UFKLWHFWXUH7KH6WRU\RI3UDFWLFH&DPEULGJH0$7KH0,7
3UHVV
'REOH&63DOPHU-)3UHGLFWLQJ6WXGHQW6XFFHVVLQ/DQGVFDSH
$UFKLWHFWXUH7KH$SSOLFDWLRQRI1HZ&ULWHULDDQG0HDVXUHV3URFHHGLQJV
($$($5&&&RQIHUHQFHRQ5HVHDUFKLQ'HVLJQ(GXFDWLRQ1&6WDWH8QLYHUVLW\
$SULO$UL]RQD+HUEHUJHU&HQWHUIRU'HVLJQ([FHOOHQFH&ROOHJHRI
$UFKLWHFWXUHDQG(QYLURQPHQWDO'HVLJQ$UL]RQD6WDWH8QLYHUVLW\SS
'RONH$VKRN06KDUPD5DMLY6*HQHUDO$SWLWXGH7HVW%DWWHU\*$7%
DVD3UHGLFWRURI$FDGHPLF6XFFHVVLQ$UFKLWHFWXUDO&RXUVHV,QGLDQ-RXUQDORI
3V\FKRORJ\SS
'UDSHU-7KH(FROHGHV%HDX[$UWVDQGWKH$UFKLWHFWXUDO3URIHVVLRQLQWKH
8QLWHG6WDWHV7KH&DVHRI-RKQ*DOHQ+RZDUG,Q.RVWRI6HG7KH$UFKLWHFW
&KDSWHUVLQWKH+LVWRU\RIWKH3URIHVVLRQ%HUNHOH\7KH8QLYHUVLW\RI&DOLIRUQLD
3UHVVSS
(JEHUW''%HDX[$UWV7UDGLWLRQVLQ)UHQFK$UFKLWHFWXUH3ULQFHWRQ1-
3ULQFHWRQ8QLYHUVLW\3UHVV
(VKHULFN-$UFKLWHFWXUDO(GXFDWLRQLQWKH7KLUWLHVDQG6HYHQWLHV$3HUVRQDO
9LHZ,Q.RVWRI6HG7KH$UFKLWHFW&KDSWHUVLQWKH+LVWRU\RIWKH3URIHVVLRQ
%HUNHOH\7KH8QLYHUVLW\RI&DOLIRUQLD3UHVVSS
)RUJiFV(7KH%DXKDXVDQG%DXKDXV3ROLWLFV/RQGRQ&(8&HQWUDO
(XURSHDQ8QLYHUVLW\3UHVV
/RGGHU&5XVVLDQ&RQVWUXFWLYLVP1HZ+DYHQ<DOH8QLYHUVLW\3UHVV
2OLYHU3+D\ZDUG5$UFKLWHFWXUH$Q,QYLWDWLRQ2[IRUG%DVLO
%ODFNZHOO
3RUWHU:/.LOEULGJH0HGV$UFKLWHFWXUH(GXFDWLRQ6WXG\1HZ<RUN
$QGUHZ:0HOORQ)RXQGDWLRQ
6DODPD$1HZ7UHQGVLQ$UFKLWHFWXUDO(GXFDWLRQ'HVLJQLQJWKH'HVLJQ
6WXGLR5DOHLJK1&7DLORUHG7H[W8QOLPLWHG3RWHQWLDO3XEOLVKLQJ3K'
GLVVHUWDWLRQ1RUWK&DUROLQD8QLYHUVLW\
6FK|Q'$7KH'HVLJQ6WXGLR$Q([SORUDWLRQRILWV7UDGLWLRQVDQG
3RWHQWLDOV/RQGRQ5,%$3XEOLFDWLRQV/LPLWHG
:HDWKHUKHDG$&7KH+LVWRU\RI&ROOHJLDWH(GXFDWLRQLQ$UFKLWHFWXUHLQWKH
8QLWHG6WDWHV3K'GLVVHUWDWLRQ&ROXPELD8QLYHUVLW\
:LQJOHU+07KH%DXKDXV&DPEULGJH0$0,73UHVV