Modeling with citizen scientists: Using community

Brigham Young University
BYU ScholarsArchive
International Congress on Environmental
Modelling and Software
7th International Congress on Environmental
Modelling and Software
Jun 17th, 2:00 PM - 3:20 PM
Modeling with citizen scientists: Using
community- based modeling tools to develop
citizen science projects
Steven Gray
University of Massachusetts, [email protected]
David Mellor
Virginia Polytechnic Institute and State University, [email protected]
Rebecca Jordan
Rutgers University - New Brunswick/Piscataway, [email protected]
Alycia Crall
Virginia Polytechnic Institute and State University, [email protected]
Greg Newman
Colorado State University, [email protected]
Follow this and additional works at: http://scholarsarchive.byu.edu/iemssconference
Part of the Civil Engineering Commons, Data Storage Systems Commons, Environmental
Engineering Commons, Hydraulic Engineering Commons, and the Other Civil and Environmental
Engineering Commons
Steven Gray, David Mellor, Rebecca Jordan, Alycia Crall, and Greg Newman, "Modeling with citizen scientists: Using communitybased modeling tools to develop citizen science projects" ( June 17, 2014). International Congress on Environmental Modelling and
Software. Paper 27.
http://scholarsarchive.byu.edu/iemssconference/2014/Stream-F/27
This Event is brought to you for free and open access by the Civil and Environmental Engineering at BYU ScholarsArchive. It has been accepted for
inclusion in International Congress on Environmental Modelling and Software by an authorized administrator of BYU ScholarsArchive. For more
information, please contact [email protected].
,QWHUQDWLRQDO(QYLURQPHQWDO0RGHOOLQJDQG6RIWZDUH6RFLHW\L(06V
WK,QWHUQDWLRQDO&RQJUHVVRQ(QYLURQPHQWDO0RGHOOLQJDQG6RIWZDUH
6DQ'LHJR&DOLIRUQLD86$'3$PHV14XLQQDQG$(5L]]ROL(GV
KWWSZZZLHPVVRUJVRFLHW\LQGH[SKSLHPVVSURFHHGLQJV
0RGHOLQJZLWKFLWL]HQVFLHQWLVWV8VLQJFRPPXQLW\
EDVHGPRGHOLQJWRROVWRGHYHORSFLWL]HQVFLHQFH
SURMHFWV
D
E
F
E
G
6WHYHQ*UD\ 'DYLG0HOORU 5HEHFFD-RUGDQ $O\FLD&UDOO *UHJ1HZPDQ
D
8QLYHUVLW\RI0DVVDFKXVHWWV6FKRROIRUWKH(QYLURQPHQW0RUULVVH\%OYG
%RVWRQ0$(PDLOVWHYHQDOODQJUD\#JPDLOFRP
E
9LUJLQLD3RO\WHFKQLF,QVWLWXWHDQG6WDWH8QLYHUVLW\'HSDUWPHQWRI)RUHVW
5HVRXUFHVDQG(QYLURQPHQWDO&RQVHUYDWLRQ:HVW&DPSXV'ULYH
%ODFNVEXUJ9$(PDLOPHOORU#YWHGX DQG(PDLOFUDOO#YWHGX
F
5XWJHUV8QLYHUVLW\'HSDUWPHQWRI(FRORJ\(YROXWLRQDQG1DWXUDO5HVRXUFHV
&ROOHJH)DUP5RDG1HZ%UXQVZLFN1-(PDLOUFMRUGDQ#UXWJHUVHGX
G
1DWXUDO5HVRXUFH(FRORJ\/DERUDWRU\&RORUDGR6WDWH8QLYHUVLW\
)RUW&ROOLQV&2(PDLO*UHJRU\1HZPDQ#FRORVWDWHHGX
$EVWUDFW $OWKRXJK PRGHOEDVHG UHDVRQLQJ LV RIWHQ DW WKH FHQWHU RI HQYLURQPHQWDO VFLHQFH DQG
PDQDJHPHQW WKH SURFHVVRI FRQVWUXFWLQJ UHILQLQJ DQG HPSLULFDOO\ YDOLGDWLQJ VFLHQWLILF PRGHOV LV QRW
RIWHQ PDGH H[SOLFLW WR SDUWLFLSDQWV LQ PDQ\ FLWL]HQ VFLHQFH SURJUDPV 7KH ODFN RI DWWHQWLRQ WKDW
PRGHOLQJUHFHLYHVLQFLWL]HQVFLHQFHSURJUDPVLVOLNHO\DWWULEXWDEOHWRUHVRXUFHFRQVWUDLQWVJLYHQWKDW
VFLHQWLILF PRGHOLQJ RIWHQ UHTXLUHV FRQVLGHUDEOH WUDLQLQJ DQG VFLHQWLILF VRIWZDUH WRROV DUH QRW HDVLO\
DFFHVVLEOH WR PHPEHUV RI WKH JHQHUDO SXEOLF 7R DGGUHVV WKHVH FRQVWUDLQWV ZH GHVFULEH WKH
GHYHORSPHQW DQG XVH RI D IX]]\ORJLF FRJQLWLYH PDSSLQJ VRIWZDUH FDOOHG 0HQWDO 0RGHOHU
KWWSZZZPHQWDOPRGHOHURUJ HPEHGGHG ZLWKLQ D FLWL]HQ VFLHQFH ZHE SRUWDO ZZZFLWVFLRUJ DQG
FXUULFXOXPWKDWDOORZVVFLHQWLVWVHQYLURQPHQWDOPDQDJHUVDQGFLWL]HQVFLHQWLVWVWRFROODERUDWLYHO\
GHILQHHQYLURQPHQWDOLVVXHVRIVKDUHGFRQFHUQPRGHODQGUHSUHVHQWDVVXPSWLRQVHYLGHQFHDQG
H[LVWLQJ LQIRUPDWLRQ DERXW WKHVH LVVXHV UXQ VFHQDULRV WR GLVFXVV SRWHQWLDO UHVHDUFK RU
PDQDJHPHQW RSWLRQV DQG XOWLPDWHO\ FRGHYHORS FLWL]HQ VFLHQFH UHVHDUFK DQG HQYLURQPHQWDO
PDQDJHPHQW SODQV ZLWK VFLHQFH SURIHVVLRQDOV 2XU SURJUDP XVHV DQ DGDSWLYH PDQDJHPHQW
IUDPHZRUN WR IDFLOLWDWH GLVFXVVLRQ EHWZHHQ SURMHFW PDQDJHUV DQG YROXQWHHUV RQ WKH FXUUHQW DQG
GHVLUHG VWDWH RI WKH QDWXUDO UHVRXUFH V\VWHP EHLQJ PDQDJHG WKHLU SODQ IRU D PDQDJHPHQW DFWLRQ
SURMHFWLPSOHPHQWDWLRQDQGHYDOXDWLRQDQGFRPPXQLFDWLRQRIUHVXOWV8VLQJGDWDFROOHFWHGIURP RQH
FRPPXQLW\ JURXS ZKR ZRUNHG ZLWK SURIHVVLRQDO VFLHQWLVWV DQG ODQG PDQDJHUV RQ D ORFDO SURMHFW LQ
9LUJLQLD DV D FDVH VWXG\ ZH RXWOLQH WKH DUFKLWHFWXUH RI WKH PRGHOLQJ VRIWZDUH GHVFULEH SDUWLFLSDQW
LQWHUDFWLRQZLWKWKHPRGHOLQJWRRODQGZHEVLWHDQGUHYLHZWKHSURMHFWJHQHUDWHG
.H\ZRUGV SDUWLFLSDWRU\PRGHOOLQJFLWL]HQVFLHQFHIX]]\ORJLFFRJQLWLYHPDSSLQJSXEOLFSDUWLFLSDWLRQ
LQVFLHQWLILFUHVHDUFK
%$&.*5281'
,QFOXGLQJWKHSXEOLFLQHQYLURQPHQWDOPRQLWRULQJUHVHDUFKDQGGHFLVLRQPDNLQJKDVEHHQDQDUHDRI
JURZLQJUHVHDUFKDPRQJHQYLURQPHQWDOUHVHDUFKHUVWKDWVSDQVWKHQDWXUDODQGVRFLDOVFLHQFHV5HHG
7KHLQWHUHVW LQWKLV DUHDKDVJLYHQULVHWR VHYHUDOSDUDGLJPV UHODWHGWR SXEOLFSDUWLFLSDWLRQLQ
HQYLURQPHQWDO GHFLVLRQPDNLQJ LQFOXGLQJ FLWL]HQ VFLHQFH DQG SDUWLFLSDWRU\ PRGHOLQJ $OWKRXJK WKHVH
DUHDV RI UHVHDUFK VKDUH VLPLODU JRDOV DQG SURYLGH D VSDFH IRU LQWHJUDWLQJ WKH JHQHUDO SXEOLF DQG
VSHFLILFVWDNHKROGHUVLQWRHQYLURQPHQWDOPDQDJHPHQWWKH\HDFKKDYHVWUHQJWKVWKDWFDQEHPHUJHG
&LWL]HQ VFLHQFH RIIHUV WKH RSSRUWXQLW\ WR HQJDJH LQ DXWKHQWLF HQYLURQPHQWDO UHVHDUFK ZKLOH
SDUWLFLSDWRU\PRGHOLQJHQJDJHVLQGLYLGXDOVLQFRPPXQLW\OHYHOHQYLURQPHQWDOPDQDJHPHQW+HUHZH
FRQWHQG WKDW LQGLYLGXDOV FDQ KDYH D JUHDWHU UROH LQ HQYLURQPHQWDO GHFLVLRQPDNLQJ LI DIIRUGHG WKH
3DJH
6*UD\HWDO0RGHOLQJZLWK&LWL]HQ6FLHQWLVWV
RSSRUWXQLW\WRGLUHFWO\FROOHFWLQIRUPDWLRQDQGGDWDWRLQIRUPUHVRXUFHPDQDJHPHQWPRGHOV%HORZZH
GHVFULEH FLWL]HQ VFLHQFH DQG SDUWLFLSDWRU\ PRGHOLQJ DQG VKDUH RXU GHVLJQ IRU D PRGHOEDVHG FLWL]HQ
VFLHQFHDQGSDUWLFLSDWRU\PDQDJHPHQWSURJUDP
7REHJLQWhe term ‘citizen science’ IDOOVXQGHUWKHXPEUHOODRISXEOLFSDUWLFLSDWLRQLQVFLHQWLILFUHVHDUFK
3365 VHH %RQQH\ HW DO DQG KDV EHHQ VKRZQ WR UHVXOW LQ GLIIHUHQW RXWFRPHV EDVHG RQ WKH
VWUXFWXUH RI WKH SURMHFW LQFOXGLQJ FRQWULEXWLRQV WR VFLHQWLILF UHVHDUFK HJ LQFUHDVLQJ UHVHDUFK
ILQGLQJV DQG SXEOLFDWLRQV HQYLURQPHQWDO GHFLVLRQPDNLQJ HJ DFWLRQ OHJLVODWLRQ DQG SRVLWLYH
VRFLDO UHODWLRQVKLSV DQG WKH LQGLYLGXDOV SDUWLFLSDWLQJ LQ WKHVH SURJUDPV WKURXJK LQFUHDVHG
SHUVRQDOVNLOOVDQGNQRZOHGJH6KLUNHWDO$OWKRXJKWKHWHUPFLWL]HQVFLHQFHJHQHUDOO\UHIHUVWR
SXEOLFFRQWULEXWLRQWRVFLHQWLILFUHVHDUFKWKHW\SH DQGGHJUHH RISDUWLFLSDWLRQ DFURVVGLIIHUHQWFLWL]HQ
VFLHQFH SURJUDPV YDU\ $ UHFHQW 16)IXQGHG UHSRUW %RQQH\ HW DO GHILQHG WKUHH PDMRU
FDWHJRULHVRISURMHFWVLQFOXGLQJFRQWULEXWRU\SURMHFWVWKDWDUHXVXDOO\VFLHQWLVWGHVLJQHGZKHUHWKH
SXEOLF LV LQFOXGHG PDLQO\ LQ GDWD FROOHFWLRQ FROODERUDWLYH SURMHFWV WKDW DUH SURMHFWV WKDW DUH
VWUXFWXUHGE\VFLHQWLVWVEXWFLWL]HQVDUHSURYLGHGRSSRUWXQLWLHVWRSURYLGHVRPHLQSXWRQSURMHFWGHVLJQ
DQGLQGDWDFROOHFWLRQDQGFRFUHDWHGSURMHFWVZKLFKDUHPRUHGHPRFUDWLFSDUWQHUVKLSVZKHUHWKH
SXEOLF LV DFWLYHO\ HQJDJHG ZLWK DOO VWHSV RI WKH VFLHQWLILF SURFHVV 1RW VXUSULVLQJO\ WKH PDMRULW\ RI
FLWL]HQ VFLHQFH SURMHFWV IDOO LQWR WKH ILUVW FDWHJRU\ ZKHUH WKH YROXQWHHUV DUH XVHG PDLQO\ WR LQFUHDVH
GDWDFROOHFWLRQFDSDFLW\$OWKRXJKVRPHQRWDEOHH[DPSOHVRIFRFUHDWHGSURMHFWVGRH[LVWVHH1LFRVLD
HWDOWKHODVWGHFDGHRIUHVHDUFKRQFLWL]HQVFLHQFHSURJUDPVLQGLFDWHWKDWFXUUHQWO\VFLHQWLVWV
SUDFWLWLRQHUV DQG SDUWLFLSDQWV ODFN WKH WRROV DQG IUDPHZRUNV UHTXLUHG WR HQDEOH WKH SXEOLF DQG
VFLHQWLVWVWRDVNDQGDQVZHUTXHVWLRQVRIPXWXDOLQWHUHVWRUFRQFHUQ*UD\HWDO
'XULQJWKHVDPHWLPHWKDWFLWL]HQVFLHQFHKDVFRPHWRSURPLQHQFH SDUWLFLSDWRU\PRGHOLQJ KDVDOVR
EHHQDJURZLQJDUHDRIUHVHDUFK7KHMXVWLILFDWLRQIRULQFOXGLQJVWDNHKROGHUVLQSDUWLFLSDWRU\PRGHOLQJ
LV EDVHG RQ WKH DFNQRZOHGJHPHQW WKDW PRGHOEDVHG UHDVRQLQJ LV D SUHGRPLQDQW DQG SUHIHUUHG
EDVLV RI HQYLURQPHQWDO GHFLVLRQPDNLQJ LQ FRQWHPSRUDU\ HQYLURQPHQWDO PDQDJHPHQW SXEOLF
SDUWLFLSDWLRQ LV DQ HVVHQWLDO FRPSRQHQW WR LQIRUPHG HQYLURQPHQWDO GHFLVLRQPDNLQJ DQG VWDNHKROGHU JURXSV RIWHQ KROG XQLTXH DQG FRPSOH[ NQRZOHGJH WKDW LV XVHIXO IRU XQGHUVWDQGLQJ WKH
G\QDPLFVRIVRFLDOHFRORJLFDOV\VWHPV7KLVLQFUHDVHGDFDGHPLFDQGDSSOLHGLQWHUHVWLQSDUWLFLSDWRU\
PRGHOOLQJKDVJLYHQULVHWRDUDQJHRIVWDNHKROGHUFHQWHUHGPRGHOLQJWRROVSUDFWLFHVDQGJXLGHOLQHV
WKDW DLP WR SURYLGH GHFLVLRQ VXSSRUW LQ SDUWLFLSDWRU\ SODQQLQJ FRQWH[WV *UD\ HW DO +RZHYHU
HYHQZLWKWKLVLQFUHDVHLQWRRODQGVRIWZDUHGHYHORSPHQWVRPHFULWLFVKDYHFDXWLRQHGWKDWGLYHUVLW\RI
PRGHOLQJSUDFWLFHVGRHVQRWQHFHVVDULO\LQGLFDWHGLYHUVLW\LQIXQFWLRQ-RQHVHWDODQGWKDWWKH
PRVW VLJQLILFDQW FRQWULEXWLRQ RI LQFOXGLQJ VWDNHKROGHUV LQ PRGHOOLQJ LV FRPPXQLW\ OHDUQLQJ IDFLOLWDWHG
E\VWUXFWXUHGNQRZOHGJHVKDULQJ9RLQRYDQG%RXVTXHW
$OWKRXJKERWKFLWL]HQVFLHQFHDQGSDUWLFLSDWRU\PRGHOLQJKDYHSURYLGHGXVHIXOIUDPHZRUNVPHWKRGV
DQG WRROV IRU HQJDJLQJ WKH SXEOLF ZLWK HQYLURQPHQWDO UHVHDUFK PRQLWRULQJ DQG GHFLVLRQPDNLQJ
VRIWZDUH WRROV DQG SURJUDPPDWLF JXLGHOLQHV WKDW FRXSOH WKHVH DSSURDFKHV DUH XQDYDLODEOH
$GGLWLRQDOO\ ZKLOHPDQ\UHVHDUFKHUVKDYH LQGLFDWHGWKDWFLWL]HQVFLHQFHKROGVFRQVLGHUDEOHSURPLVH
IRU LQFUHDVLQJ WKH TXDOLW\ RI HQYLURQPHQWDO GHFLVLRQV DQG VRFLDOHFRORJLFDO UHVLOLHQFH 6KLUN HW DO
HPSLULFDOUHYLHZVRIFLWL]HQVFLHQFHSURJUDPVLQGLFDWHWKDWFLWL]HQSDUWLFLSDWLRQLQWKHVFLHQWLILF
SURFHVVLVODUJHO\OLPLWHGWRGDWDFROOHFWLRQ%RQQH\HWDODQGWKDWWKHPDMRULW\RIWKHVHSURMHFWV
GRQRWFRQWULEXWHGLUHFWO\WRPDQDJHPHQWGHFLVLRQPDNLQJ&RQUDGDQG+LFNH\
7RDGGUHVVWKHVHLVVXHVZHSUHVHQWWKHDUFKLWHFWXUHRIDFLWL]HQVFLHQFHSURJUDPZLWKDZHEEDVHG
FXUULFXOXP DQ HPEHGGHG IX]]\ORJLF FRJQLWLYH PDSSLQJ PRGHOLQJ VRIWZDUH FDOOHG 0HQWDO 0RGHOOHU
ZZZPHQWDOPRGHOHURUJDQGDZHEEDVHGLQWHUIDFHIRUGDWDFROOHFWLRQZZZFLWVFLRUJWRGUDZRQ
WKHVWUHQJWKVRIERWKRIWKHVHILHOGVWRLQFUHDVHVWDNHKROGHUFRQWULEXWLRQWRHQYLURQPHQWDOVFLHQFHDQG
PDQDJHPHQW 6SHFLILFDOO\ RXU SURJUDP VHHNV WR LQFUHDVH WKH GHJUHH RI SDUWLFLSDWLRQ IURP FLWL]HQ
JURXSV DV ZHOO DV WKH UHSUHVHQWDWLRQ RI ORFDO VWDNHKROGHU NQRZOHGJH WR LQFUHDVH WKH TXDOLW\ RI
HQYLURQPHQWDOGHFLVLRQPDNLQJE\DOORZLQJVFLHQWLVWVHQYLURQPHQWDOPDQDJHUVDQGFLWL]HQVFLHQWLVWV
WR FROODERUDWLYHO\ GHILQH HQYLURQPHQWDO LVVXHV RI VKDUHG FRQFHUQ PRGHO DQG UHSUHVHQW
DVVXPSWLRQV HYLGHQFH DQG H[LVWLQJ LQIRUPDWLRQ DERXW WKHVH LVVXHV UXQ VFHQDULRV WR GLVFXVV
SRWHQWLDOUHVHDUFKRUPDQDJHPHQWRSWLRQVDQGXOWLPDWHO\FRGHYHORSFLWL]HQVFLHQFHUHVHDUFKDQG
HQYLURQPHQWDOPDQDJHPHQWSODQVZLWKVFLHQFHSURIHVVLRQDOV
3DJH
6*UD\HWDO0RGHOLQJZLWK&LWL]HQ6FLHQWLVWV
352*5$062)7:$5('(6,*1$1':(%722/'(6,*1
:HSUHVHQWWKHDUFKLWHFWXUHRIDFLWL]HQVFLHQFH SURJUDPZLWKDQHPEHGGHGPRGHOLQJVRIWZDUHDQG
ZHEEDVHG WRRO GHVLJQHG WR GUDZ RQ WKH VWUHQJWKV RI ERWK RI WKHVH ILHOGV WR LQFUHDVH VWDNHKROGHU
FRQWULEXWLRQ WR HQYLURQPHQWDO PDQDJHPHQW 2XU WRROV LQFOXGH HFRORJLFDO DQG DGDSWLYH
PDQDJHPHQW WUDLQLQJ FXUULFXOXP D IX]]\ORJLF FRJQLWLYH PDSSLQJ VRIWZDUH ZKLFK DOORZV FLWL]HQ
JURXSVWRGHILQHDSUREOHPFRQWH[WWKDWUHSUHVHQWWKHLUNQRZOHGJHDQGUXQVFHQDULRVDQGDZHE
EDVHG SRUWDO ZKLFK DOORZV FLWL]HQ JURXSV WR YDOLGDWH WKHLU PRGHO HPSLULFDOO\ WKURXJK GDWD FROOHFWLRQ
DQG DQDO\VLV:HEHJLQE\SURYLGLQJDQRYHUYLHZ RIWKHVHWKUHHFRPSRQHQWVDQGWKHQ GHPRQVWUDWH
WKH GHSOR\PHQW RI WKH WRROV ZRUNLQJ ZLWK RQH FLWL]HQ JURXS LQ 9LUJLQLD LQ RXU FROODERUDWLYH VSDFH WR
GHYHORS DQ HQYLURQPHQWDO PDQDJHPHQW SURMHFW FRGHYHORSHG E\ D YROXQWHHU JURXS ZRUNLQJ ZLWK
SURIHVVLRQDOODQGPDQDJHUVWKDWDGGUHVVHVDQHQYLURQPHQWDOLVVXHRIORFDOFRQFHUQ
&ROODERUDWLYH&RQVHUYDWLRQ7UDLQLQJ
7KHILUVWFRPSRQHQWRIRXUSURJUDPLVDXQLILHGWUDLQLQJPRGXOHWKDWLQFOXGHVERWKFRQWHQWDUHDDQG
SUDFWLFHRULHQWHGLQVWUXFWLRQJLYHQWKURXJKDQRQOLQHDV\QFKURQRXVOHDUQLQJHQYLURQPHQW HPEHGGHG
ZLWK PRGHOOLQJ DQG FROODERUDWLYH OHDUQLQJ WRROV 7KH JRDO RI WKH RQOLQH OHDUQLQJ HQYLURQPHQW LV WR
SUHSDUHSDUWLFLSDQWVWRHQJDJHLQFROODERUDWLYHRUFRFUHDWHGFLWL]HQVFLHQFHSURMHFWVVHH%RQQH\HW
DOIRUDQRYHUYLHZRI3365SURMHFWPRGHOV:HFKRVHWRIRFXVRQHQJDJHPHQWLQFRFUHDWHG
DQG FROODERUDWLYH FLWL]HQ VFLHQFH SURMHFWV EHFDXVH RI WKH SRWHQWLDO IRU VFLHQFH DQG HQYLURQPHQWDO
OHDUQLQJWKDWVXFKSURMHFWVRIIHUDQGEHFDXVHWKH\PD\FUHDWHRSSRUWXQLWLHVWRLQFUHDVHWKHGHJUHHRI
YROXQWHHU SDUWLFLSDWLRQ LQ PXOWLSOH VWHSV RI WKH VFLHQWLILF SURFHVV %HFDXVH RI WKH LQFUHDVHG
FRPPLWPHQW UHTXLUHG RI VXFK SURMHFWV ZH FKRVH WR IRFXV RQ D SRSXODWLRQ WKDW ZDV PRWLYDWHG WR
SDUWLFLSDWHLQWKLVW\SHSURMHFWZKRZHUHDOVRVXIILFLHQWO\ZLOOLQJDQGLQWHUHVWHGLQLQFUHDVLQJWKHLUOHYHO
RISDUWLFLSDWLRQLQORFDOHQYLURQPHQWDOPDQDJHPHQW
7KH IRFXV SRSXODWLRQ IRU WKH RQOLQH OHDUQLQJ WRRO LV WKH 9LUJLQLD 0DVWHU 1DWXUDOLVWV D JURXS RI
volunteers tasked with assisting in citizen science, stewardship, and education in Virginia’s natural
resources. Like other states’ MaVWHU 1DWXUDOLVW SURJUDPV SDUWLFLSDQWV DUH UHTXLUHG WR XQGHUJR DQ
LQLWLDOEDVLFWUDLQLQJSURJUDPKRXUVRIFODVVURRPDQGILHOGZRUNDQGFRQGXFWYROXQWHHUZRUNDQG
DGYDQFHG WUDLQLQJ HYHU\ \HDU IRU UHFHUWLILFDWLRQ $OVR VLPLODU WR RWKHU PDVWHU QDWXUDOLVW SURJUDPV
SDUWLFLSDQWVLQWKH9LUJLQLDSURJUDPWHQGWREHROGHUPRUHHGXFDWHGDQGZHDOWKLHUWKDQWKHJHQHUDO
SRSXODWLRQXQSXEOLVKHGGDWD0DQ\ DUHUHWLUHG ZLWK DWOHDVWVRPHSUHYLRXV H[SHULHQFH ZLWKQDWXUDO
UHVRXUFHFRQVHUYDWLRQ
&ROODERUDWLYH&RQVHUYDWLRQ7UDLQLQJ&RQWHQW$UHD,QVWUXFWLRQ
7KH FXUULFXODU FRQWHQW GHVLJQ LQFOXGHV DQ RQOLQH DV\QFKURQRXV SURJUDP IRFXVHG RQ SURYLGLQJ
LQIRUPDWLRQ RQ HFRORJ\ FRQVHUYDWLRQ WKH XVH RI PRGHOV LQ VFLHQWLILF UHDVRQLQJ EDVLF VWDWLVWLFV WKH
XVH RI WKH 0HQWDO 0RGHOHU VRIWZDUH WRRO GHVFULEHG LQ GHWDLO VHFWLRQ DQG DQ RYHUYLHZ RI WKH
SURFHVVRIDGDSWLYHODQGPDQDJHPHQW7KLVFRQWHQWLVJLYHQLQDVHULHVRIQDUUDWHGYLGHRVIURP
PLQXWHVHDFKHDFKDFFRPSDQLHGE\KDQGRXWVWRGRZQORDGDQRXWOLQHDQGDVKRUWTXL]WKDWKDV
WKUHHWRILYHPXOWLSOHFKRLFHTXHVWLRQVIRULQVWDQWIHHGEDFN DQGWKUHHWRILYHVKRUWDQVZHUTXHVWLRQV
GHVLJQHGWRHQJDJHSDUWLFLSDQWVLQWKHPDWHULDO$VLGHIURPXVLQJWKHVHTXHVWLRQVDVVHOIDVVHVVPHQW
WR SDUWLFLSDQWV WKH\ DUH DOVR XVHG DV GDWD WR WUDFN LQGLYLGXDO DQG JURXSOHYHO OHDUQLQJ 7KH WUDLQLQJ
SDJHDOVRFRQWDLQVDGLVFXVVLRQIRUXPIRULQWHUDFWLRQEHWZHHQVWXGHQWVDQGDSURMHFWFRRUGLQDWRU
7KH HFRORJ\ FRQWHQW IRFXVHV RQ HQHUJ\ DQG IRRG ZHEV QXWULHQW F\FOHV SRSXODWLRQ G\QDPLFV
LQWHUDFWLRQVFRPPXQLW\VWUXFWXUHDQGHFRV\VWHPVHUYLFHV7KHVHDUHDVZHUHFKRVHQLQRUGHUWRJLYH
D UHODWLYHO\ EURDG RYHUYLHZ RI FRQFHSWV VXIILFLHQW WR IXUWKHU VHOIGLUHFWHG OHDUQLQJ 7KH DGDSWLYH
PDQDJHPHQW FRQWHQW RQ WKH RWKHU KDQG ZDV VHOHFWHG WR IRFXV WKH JURXS LQWR GHYHORSLQJ D
FRQVHUYDWLRQ VWUDWHJ\ EDVHG RQ WKH QHHGV DQG LQWHUHVWV RI LWV PHPEHUV ,W FRYHUV GLVFXVVLQJ WKH
FXUUHQW DQG GHVLUHG VWDWHV RI DQ HFRV\VWHP FUHDWLQJ D PDQDJHPHQW SODQ IRU FRQVHUYDWLRQ SODQ
LPSOHPHQWDWLRQ HYDOXDWLRQ DQG VKDULQJ PDQDJHPHQW SODQ UHVXOWV (DFK OHVVRQ LQ WKH DGDSWLYH
PDQDJHPHQW VHFWLRQ FRQVLVWV RI UHVRXUFHV WKDW PD\ EH XVHIXO WR WKH JURXS LQ WKDW VWDJH LQ WKH
FXUULFXOXPIRUH[DPSOHWKHSURMHFWHYDOXDWLRQVWDJHKDVVHYHUDOKDELWDWHYDOXDWLRQWRROVWRPHDVXUH
WKHHIIHFWVRIDSRVVLEOHHQYLURQPHQWDOLQWHUYHQWLRQ
3DJH
6*UD\HWDO0RGHOLQJZLWK&LWL]HQ6FLHQWLVWV
&ROODERUDWLYH&RQVHUYDWLRQ7UDLQLQJ3UDFWLFH2ULHQWHG,QVWUXFWLRQ
7KH SUDFWLFHRULHQWHG LQVWUXFWLRQ IRFXVHV RQ XVLQJ WKH VRIWZDUH 0HQWDO 0RGHOHU VHFWLRQ DQG
ZHEEDVHGWRROV&LW6FLRUJVHFWLRQLQWKHGHYHORSPHQWRIDQDGDSWLYHPDQDJHPHQWSODQ(DFK
VWDJH RI WKH DGDSWLYH PDQDJHPHQW SODQ GLVFXVV SODQ LPSOHPHQW HYDOXDWH DQG VKDUH LV JLYHQ D
VLQJOH SDJH DQG FRQVLVWV RI LQGLYLGXDO GLVFXVVLRQ IRUXPV ZLWK TXHVWLRQ SURPSWV DSSURSULDWH WR WKH
stage and a collaborative “wiki” space to enter the group consensus for each stage. In addition, the
“discuss” page has space for individuals to create, upload, and discuss their individual or group
PRdels, and the “implement” tab has the CitSci.org project information page embedded. The
&LW6FLRUJ SURMHFW LQIRUPDWLRQ SDJH GHVFULEHG LQ PRUH GHWDLO EHORZ HQDEOHV LQGLYLGXDOV WR FUHDWH
SURMHFWGDWDVKHHWVXSORDGREVHUYDWLRQVYLHZGDWDDQGVKDUHUHVRXUFHVDSSURSULDWHWRWKHWDVNHJ
identification guides, tutorials, maps, etc.). Finally, the “share” page compiles the plans entered into
HDFKZLNLDQGSURYLGHVDVWUXFWXUHIRUVKDULQJWKHUHVXOWVRIWKHSURMHFWZLWKUHOHYDQWVWDNHKROGHUVDQG
LQIRUPLQJ WKH QH[W URXQG RI FRQVHUYDWLRQ PDQDJHPHQW EDVHG RQ SUHYLRXV ILQGLQJV 7KURXJKRXW WKH
FXUULFXOXP SDUWLFLSDQWV DOVR KDYH DFFHVV WR FRQWDFW LQIRUPDWLRQ IRU VFLHQWLILF DQG PDQDJHPHQW
H[SHUWV LQ WKHLU ORFDO DUHD ZKR FDQ SURYLGH IHHGEDFN DV WKH JURXS VWUXFWXUHV WKH HQYLURQPHQWDO
SUREOHP GHILQHV WKH TXHVWLRQV WR EH DGGUHVVHG DQG FUHDWHV D UHODWHG SURMHFW WKDW GHDOV ZLWK WKHVH
LVVXHV
0HQWDO0RGHOHU6RIWZDUH
(PEHGGHG DV SDUW RI WKH WUDLQLQJ LV D FRJQLWLYH PDSSLQJ VRIWZDUH FDOOHG 0HQWDO 0RGHOHU 7KH
VRIWZDUHZDVGHVLJQHGWRHQDEOHFLWL]HQVFLHQWLVWVDQGHQYLURQPHQWDOSURIHVVLRQDOVWRFRQVWUXFWD
TXDOLWDWLYH FRQFHSWXDO PRGHO RI D SUREOHP FRQWH[W SURYLGH HYLGHQFH RI WKHVH K\SRWKHVL]HG RU
NQRZQ UHODWLRQVKLSV GHILQHG ZLWKLQ WKH PRGHO GHILQH WKH XQLW RI PHDVXUHPHQW WR VXSSRUW WKH
UHODWLRQVKLSV GHILQHG GHYHORS VFHQDULRV DQG HYDOXDWH V\VWHP FKDQJH XQGHU SODXVLEOH
PDQDJHPHQW RU HQYLURQPHQWDO FKDQJH FRQGLWLRQV DQG UHYLVH WKHLU PRGHO EDVHG RQ WKH PRGHO
RXWSXW DQG XVH WKLV LQIRUPDWLRQ WR GHYHORSHG GHWDLOHG GDWD FROOHFWLRQ DQG DQDO\VLV SODQV 7KH
DUFKLWHFWXUH RI WKH SURJUDP LV GHVLJQHG WR DOORZ VWDNHKROGHUV D IOH[LEOH ZD\ WR WUDQVLWLRQ WKHLU
GLVSDUDWH ORRVHO\FRQQHFWHG DQG ODUJHO\ TXDOLWDWLYH NQRZOHGJH DERXW DQ HQYLURQPHQWDO LVVXH LQWR D
WUDFWDEOH IRUPDW ZKLFK FDQ EH YDOLGDWHG WKURXJK WKH JHQHUDWLRQ RI HPSLULFDO HYLGHQFH *UD\ HW DO
0HQWDO0RGHOHULVEDVHGRQ)X]]\ORJLF&RJQLWLYH0DSSLQJ)&0VHH.RVNRDQG2]HVPLDQG
2]HVPL DQGFRPSULVHGRI WKUHHPDLQ XVHU LQWHUIDFHVDWKHFRQFHSWPDSSLQJ LQWHUIDFHWKDW
SURYLGHVDVSDFHIRUPRGHOEXLOGLQJDQGSDUDPHWHUL]HVPRGHOFRQVWUXFWLRQLQWKHIRUPDWUHTXLUHGIRU
)&0 DQDO\VLV E WKH PDWUL[ LQWHUIDFH WKDW DOORZV WKH VWUXFWXUDO SURSHUWLHV RI WKH FRJQLWLYH PDS WR
EHFRPH FOHDU E\ H[DPLQLQJ SDLUZLVH UHODWLRQVKLSV DQG F WKH VFHQDULR LQWHUIDFH ZKLFK DOORZV
VWDNHKROGHUV WR UXQ DQG FRPSDUH FKDQJH ZLWKLQ WKH V\VWHP XQGHU GLIIHUHQW SRWHQWLDO VFHQDULRV DQG
UHYLVLWDQGUHYLVHWKHLUPRGHOVLQWKHFRQFHSWPDSSLQJLQWHUIDFHLQOLJKWRIWKLVQHZLQIRUPDWLRQ
&RQFHSW0DSSLQJ,QWHUIDFH
7KH FRQFHSW PDSSLQJ LQWHUIDFH DOORZV VWDNHKROGHUV WR VWUXFWXUH WKH G\QDPLFV RI DQ HQYLURQPHQWDO
SUREOHP XVLQJ D FRQFHSWXDO VSDFH E\ GHILQLQJ FRPSRQHQWV LH YDULDEOHV RU QRGHV WKDW FRPSULVH
QDWXUDO UHVRXUFH V\VWHPVDQG GHILQLQJ WKH UHODWLRQVKLSV EHWZHHQ WKHVH FRPSRQHQWV %\ ILUVW DGGLQJ
FRPSRQHQWV XVLQJ D SOXV VLJQ DQG WKHQ ODEHOOLQJ HDFK FRPSRQHQW WKDW LV DGGHG LQGLYLGXDOV RU
JURXSVFDQEHJLQPRGHOGHYHORSPHQWE\EUDLQVWRUPLQJDOORIWKHLPSRUWDQWFRPSRQHQWVK\SRWKHVL]HG
WKDWDUHUHODWHGWRXQGHUVWDQGLQJWKHV\VWHPRUSUREOHPWKDWLVEHLQJDGGUHVVHG
$IWHUFRPSRQHQWVKDYHEHHQGHILQHGWKHUHODWLRQVKLSVEHWZHHQFRPSRQHQWVFDQEHDGGHGE\XVLQJ
GLUHFWLRQDODUURZVZKLFKLQGLFDWHWKHDPRXQWRILQIOXHQFHRQHFRPSRQHQWFDQKDYHRQDQRWKHUFDOOHG
HGJHUHODWLRQVKLSV&RPSRQHQWVLQFOXGHGLQWKHPRGHOFDQKDYHSRVLWLYHKLJKPHGLXPRU
ORZQHJDWLYHKLJKPHGLXPRUORZRUQRQRUHODWLRQVKLSGHILQHGHGJHUHODWLRQVKLSV
7KH VRIWZDUH LV GHYHORSHG WR SDUDPHWHUL]H WKHVH TXDOLWDWLYH UHODWLRQVKLSV LQ WKH PDQQHU WKDW LV
UHTXLUHGIRU)&0EDVHGVFHQDULRDQDO\VHVDQGUHSUHVHQWHGLQWKHVRIWZDUHXVLQJGLUHFWHGDUURZVRI
GLIIHUHQWFRORUVUHGDUURZVIRUQHJDWLYHDQGEOXHDUURZVIRUSRVLWLYHDQGOLQHWKLFNQHVVIRUGHJUHHRI
LQIOXHQFH WKH WKLFNHU WKH OLQH WKH PRUH LQIOXHQFH $V FLWL]HQ VFLHQFH JURXSV LQGLYLGXDOO\ RU
FROODERUDWLYHO\ GHILQH TXDOLWDWLYH ZHLJKWV RI HGJH UHODWLRQVKLSV EHWZHHQ FRPSRQHQWV WKH VRIWZDUH
3DJH
6*UD\HWDO0RGHOLQJZLWK&LWL]HQ6FLHQWLVWV
WUDQVODWHVWKHVHTXDOLWDWLYHYDOXHV(i.e. “fuzzy” approximation of influence) LQWRWKHTXDQWLWDWLYHYDOXHV
EHWZHHQKLJKQHJDWLYHWRKLJKSRVLWLYHXVHGLQWKHPDWUL[LQWHUIDFH
7KHFRQFHSWPDSSLQJLQWHUIDFHDOVRLQFOXGHVDGGLWLRQDOIXQFWLRQDOLW\HQDEOLQJWKHFRQFHSWPDSWREH
OD\HUHG ZLWK DGGLWLRQDO LQIRUPDWLRQ EDVHG RQ WKH NQRZOHGJH RI WKH VWDNHKROGHUV FUHDWLQJ WKH PRGHO
6SHFLILFDOO\DVWKHFRQFHSWPDSLVGHYHORSHGQRGHVHGJHVDQGHGJHZHLJKWVSDUWLFLSDQWVFDQDOVR
GHILQHZHEOLQNVRUTXDOLWDWLYHGHVFULSWLRQVRIWKHHYLGHQFHXVHGZKLFKOHDGWRWKHUHSUHVHQWDWLRQRID
QRGH RU HGJH WKH GHJUHH RI FRQILGHQFH DERXW WKH H[LVWHQFH RI WKH UHODWLRQVKLS RQ D SRLQW /LNHUW
VFDOHIURP1RW&RQILGHQWWR9HU\&RQILGHQWDVZHOODVGHILQHWKHXQLWRIPHDVXUHPHQWWKDWPLJKWEH
XVHG WR FROOHFW GDWD WR YDOLGDWH SHUFHLYHG UHODWLRQVKLSV EHWZHHQ FRPSRQHQWV 7KHVH IHDWXUHV DUH
LQWHQGHG WR HQFRXUDJH XVHUV WR VXSSRUW WKHLU FODLPVZLWK HYLGHQFH GHILQH WKH GHJUHH RI XQFHUWDLQW\
ZLWKLQWKHLUFODLPVDQGXOWLPDWHO\XVHGWR HQDEOHXVHUVWRWUDQVODWHWKHLUPRGHOVLQWRGDWDFROOHFWLRQ
SODQV)LJXUH
$
&
%
'
)LJXUH6FUHHQVKRWRI0HQWDO0RGHOHUVRIWZDUH&RQFHSW0DSSLQJLQWHUIDFHWKDWLQFOXGHV$GHILQHG
FRPSRQHQWV % GLUHFWLRQDO HGJH UHODWLRQVKLSV DQG ZHLJKWV GHILQHG EHWZHHQ FRPSRQHQWV & QRWHV
DERXW FRPSRQHQWV DQG UHODWLRQVKLSV WR EH LQFOXGHG DV HYLGHQFH IRU LQFOXVLRQ LQ WKH PRGHO DQG '
SURSRVHGXQLWRIPHDVXUHPHQWVIRUFRPSRQHQWV
0DWUL[,QWHUIDFH
0HQWDO 0RGHOHU DOVR LQFOXGHV D 0DWUL[ LQWHUIDFH WKDW FRQYHUWV WKH FRQFHSW PDS EXLOW LQ WKH &RQFHSW
0DSSLQJ LQWHUIDFH LQWR D VWUXFWXUDO PDWUL[ 7KH PDWUL[ LQWHUIDFH OLVWV DOO FRPSRQHQWV LQFOXGHG LQ WKH
PRGHORQWKHL DQG M D[HV DQGWUDQVODWHVWKH DPRXQWDQGGLUHFWLRQRIUHODWLRQVKLSV7KLVLQWHUIDFHLV
VLPSO\ D GLIIHUHQW UHSUHVHQWDWLRQ RI WKH FRQFHSWXDO PRGHO SODFLQJ WKH FRQFHSW PDS LQ WKH IRUP
UHTXLUHG IRU WKH PDWUL[ DOJHEUD FDOFXODWLRQ XVHG IRU WKH 6FHQDULR LQWHUIDFH VHH .RVNR 7KH
0DWUL[ LQWHUIDFHFDQ HDVLO\ EHUHYLVHG EDVHGRQWKH RULJLQDO FRQFHSWPDSRQFHWKH XVHUVIDPLOLDUL]H
WKHPVHOYHV ZLWK WKH VWUXFWXUH RI WKH WRRO DQG FKDQJHV PDGH WKH PDWUL[ LQWHUIDFH ZLOO FKDQJH LQ WKH
FRQFHSWPDSSLQJLQWHUIDFHDQGYLFHYHUVD
6FHQDULR,QWHUIDFH
7KHWKLUGLQWHUIDFHLQRXUVRIWZDUHLVWKH6FHQDULRLQWHUIDFHZKHUHDUWLILFLDOVFHQDULRVFDQEHUXQDQG
FRPSDUHG7KHVFHQDULRLQWHUIDFHLQGLFDWHVWKHDPRXQWRIUHODWLYHFKDQJHLQWKHFRPSRQHQWVLQFOXGHG
LQWKHPRGHOEDVHGRQWKHHGJHUHODWLRQVKLSVGHILQHGLQWKH&RQFHSW0DSSLQJLQWHUIDFHIRUWKHFKRVHQ
VFHQDULR 8VHUV FDQ GHFLGH ZKDW VFHQDULR WR UXQ EDVHG RQ SUREDEOH LPSUREDEOH JUDGXDO DQG
3DJH
6*UD\HWDO0RGHOLQJZLWK&LWL]HQ6FLHQWLVWV
H[WUHPH FKDQJHV WR WKH V\VWHP 7R UXQ D VFHQDULR HDFK YDULDEOH FDQ EH VHW DW D YDOXH EHWZHHQ
TXDOLWDWLYHO\GHILQHGVWDWHVRIVWURQJQHJDWLYHFKDQJHDQGVWURQJSRVLWLYHFKDQJH5HODWLYH
FKDQJH LQ WKH V\VWHP LV GLVSOD\HG DV D EDU JUDSK WR LQGLFDWH KRZ FRPSRQHQWV PLJKW UHDFW XQGHU D
JLYHQVFHQDULRZKLFKLVYLHZHGFRPSUHVVLYHO\DVDV\VWHPVWDWHFKDQJH
&LW6FLRUJ
)LQDOO\DIWHUFLWL]HQVDUHWUDLQHGDQGFLWL]HQVFLHQWLVWDQGSURIHVVLRQDOVKDYHDZRUNLQJUHSUHVHQWDWLRQ
RI WKHLU K\SRWKHVL]HG UHODWLRQVKLSV EHWZHHQ LQGHSHQGHQW DQG GHSHQGHQW YDULDEOHV HPSLULFDO
YDOLGDWLRQDQGRUUHMHFWLRQRIWKHLUV\VWHPPRGHOFDQEHFRQGXFWHGWKURXJKILHOGGDWDFROOHFWLRQXVLQJ
WKH HPEHGGHG &LW6FLRUJ GDWD PDQDJHPHQW DQG YLVXDOL]DWLRQ SODWIRUP 1HZPDQ HW DO 7KH
&LW6FLRUJ F\EHULQIUDVWUXFWXUH LV D ZHE DSSOLFDWLRQ ZKHUH FLWL]HQ VFLHQWLVW SURMHFW PDQDJHUV FDQ
DSSURYH PHPEHUV DQG VWUXFWXUH FLWL]HQ VFLHQFH FRPPXQLW\ ZKR LQ WXUQ FDQ FROOHFW DQG VXEPLW
HQYLURQPHQWDOPRQLWRULQJGDWDWRYDOLGDWHFODLPVLQWKHLUPRGHOV'DWDFDQEHVXEPLWWHGWKURXJKXVH
RIFXVWRPL]DEOHGDWDVKHHWVFUHDWHGE\SURMHFWPDQDJHUVWRVXLWKHUKLVSURMHFWQHHGV'DWDVKHHWVFDQ
EHFRQVWUXFWHGWRPHDVXUHDQ\RUJDQLVPDQGDVVRFLDWHGDWWULEXWHVRUVLWHFKDUDFWHULVWLFVE\VHOHFWLQJ
IURPH[LVWLQJPHDVXUHPHQWVHJVWUHDPS+KHLJKWOHQJWKVH[ZHLJKWFORXGFRYHUHWFRUFUHDWLQJ
WKHLU RZQ QXPEHU RI VSRWV RQ OHDI HWF %HFDXVH &LW6FLRUJ LV D VKDUHG FRPPRQ RSHQ GDWD
UHSRVLWRU\DQGPDQDJHPHQWVLWHIRUFLWL]HQVFLHQFHSURMHFWVJOREDOO\HIIRUWVDUHPDGHWRVWDQGDUGL]H
PHDVXUHPHQWV DQG SURWRFROV XVHG DFURVV SURMHFWV 'DWD DUH WKHQ VXEPLWWHG E\ DSSURYHG SURMHFW
PHPEHUVXVLQJWKHGDWDVKHHWVFUHDWHGE\SURMHFWPDQDJHUVDQGWKHQUHSUHVHQWHGDVERWKWDEOHVDQG
PDSV IRU HYHU\RQH WR H[SORUH $GGLWLRQDO IHDWXUHV LQFOXGH DQ HDV\ LQYLWH PHPEHUV WRRO SUHGHILQHG
PRQLWRULQJORFDWLRQVVXSSRUWEXONXSORDGIRUPDQDJHUVRIOHJDF\GDWDDQGUHDOWLPHG\QDPLFFKDUWV
IRUWUHQGYLVXDOL]DWLRQ
&$6(678'<(;$03/( 7R GHPRQVWUDWH WKH XVH RI RXU WRROV WRJHWKHU ZH SUHVHQW GDWD FROOHFWHG IURP RQH FKDSWHU RI WKH
9LUJLQLD 0DVWHU 1DWXUDOLVWV ZRUNLQJ ZLWK SURIHVVLRQDO ODQG PDQDJHUV LQ 9LUJLQLD WR GHILQH D
UHVHDUFKTXHVWLRQRIORFDOLQWHUHVWUHODWHGWRDQLQYDVLYHVSHFLHVDQGHFRV\VWHPLQWHJULW\GHYHORS
D PRGHO RI WKH HFRV\VWHP EDVHG RQ WKHLU XQGHUVWDQGLQJ RI WKH SUREOHP DQG LPSOHPHQW D
FRQVHUYDWLRQ SURMHFW E\ VWUXFWXULQJ GDWD FROOHFWLRQ LQ FLWVFLRUJ WR EHWWHU XQGHUVWDQG WKH G\QDPLFV RI
WKHLVVXHDQGGHILQHSRVVLEOHPDQDJHPHQWDFWLRQV%DVHGRQORFDOLQWHUHVWLQDQGYDOXHRID1DWXUH
&RQVHUYDQF\RZQHG SURSHUW\ WKDW FRQWDLQHG D UDUH ILUHPHGLDWHG SLQH VDYDQQDK KDELWDW DQG WKH
HQGDQJHUHG 5HG FRFNDGHG ZRRGSHFNHU PHPEHUV RI WKH ORFDO 0DVWHU 1DWXUDOLVW FKDSWHU FKRVH WKLV
FRQFHUQ 7KH\ PHW ZLWK D ORFDO ODQG PDQDJHU WR DVN TXHVWLRQV DERXW FXUUHQW WKUHDWV WR HFRV\VWHP
KHDOWKDQGVWDELOLW\LQWKHUHJLRQ7KHODQGPDQDJHUZKRZDVDQHPSOR\HHRIWKHVWDWHLGHQWLILHGD
JURZLQJFRQFHUQRYHUWKHHVWDEOLVKPHQWRI-DSDQHVHVWLOWJUDVV0LFURVWHJLXPYLPLQHXPZKLFKKDG
MXVW UHFHQWO\ EHHQ LGHQWLILHG LQ WKH DUHD ,W LV IHDUHG WKDW WKH ILUHPDQDJHG ODQG PD\ EH HVSHFLDOO\
VHQVLWLYH WR WKLV LQYDVLYH JUDVV EHFDXVH RI LWV LQFUHDVHG JHUPLQDWLRQ SRVW ILUH DQG EHFDXVH RI WKH
LQFUHDVHGLQWHQVLW\RIILUHVEHFDXVHWKHVSHFLHVZDVDVVRFLDWHGZLWKKLJKHUIXHOORDGV)U\HU
)LJXUH 6FUHHQVKRW RI 0HQWDO 0RGHOHU VRIWZDUH &RQFHSW 0DSSLQJ LQWHUIDFH WKDW VKRZV UHILQHG
PRGHORIVWLOWJUDVVLVVXHFROOHFWHGIURPSDUWLFLSDQWV
3DJH
6*UD\HWDO0RGHOLQJZLWK&LWL]HQ6FLHQWLVWV
:KLOH SDUWLFLSDQWV FRQWLQXHG WR ZRUN WKURXJK WKH FXUULFXOXP DQG DIWHU PHHWLQJ ZLWK WKH ODQG
PDQDJHUV JURXS PHPEHUV EHJDQ PRGHOLQJ WKHLU XQGHUVWDQGLQJ RI WKH LVVXH LQ WHUPV RI HFRORJLFDO
G\QDPLFVUHODWHGWRILUHDQGGLIIHUHQWPDQDJHPHQWWHFKQLTXHV$IWHUYROXQWHHUVGHYHORSHGLQGLYLGXDO
PRGHOV WKH PRGHOV ZHUH PHUJHG DQG UHYLHZHG E\ WKH JURXS )LJXUH 7KH PHUJHG PRGHO
(sometimes called the ‘community model’ (Ozesmi and Ozesmi 2004)) ZDV UHILQHG WKURXJK
FROODERUDWLYHGLVFXVVLRQ7KHFRPPXQLW\PRGHOZDVWKHQXVHGWRGHILQHDUHDVZLWKLQWKHPRGHOZKHUH
WKHUHZDVDJUHHPHQWFRPSRQHQWVDQGUHODWLRQVKLSVDERXWZKLFKWKHSDUWLFLSDQWVZHUHFRQILGHQWDQG
LGHQWLILHG XQFHUWDLQ DUHDV LQ WKH PRGHO $IWHU SDUWLFLSDQWV ZHUH FRQWHQW ZLWK WKHLU PRGHO SRWHQWLDO
system states (‘futures’) with no management and withFRPSHWLQJSRWHQWLDOPDQDJHPHQWRSWLRQVZHUH
WKHQ GHYHORSHG )LJXUH 7KHVH VFHQDULRV DQG WKH GLVFXVVLRQV WKDW IROORZHG LGHQWLILHG DUHDV
FRPSRQHQWV DQG UHODWLRQVKLSV WKDW FRXOG EH YDOLGDWHG WKURXJK HPSLULFDO PHDVXUHPHQW YLD GDWD
FROOHFWLRQ
)LJXUH 6FUHHQVKRW RI 0HQWDO 0RGHOHU VRIWZDUH 6FHQDULR LQWHUIDFH WKDW LQFOXGHV HFRV\VWHP VWDWH
XQGHUEXVLQHVVDVXVXDOOHIWDQGZLWKDPDQDJHPHQWRSWLRQLQSODFHULJKW
$IWHUFRQGXFWLQJWKHLUOLWHUDWXUHUHYLHZDQGUHFHLYLQJIHHGEDFNIURPDVFLHQWLVWDQGVWLOWJUDVVH[SHUW
SDUWLFLSDQWV UHYLVHG WKHLU PRGHOV DQG KDYH GHYHORSHG DQ H[SHULPHQWDO GHVLJQ WR PHDVXUH WKH FRVW
HIIHFWLYHQHVV RI YDULRXV WUHDWPHQW UHJLPHV %DVHG RQ WKLV LQIRUPDWLRQ SDUWLFLSDQWV FKRVH WR XVH D
UDQGRPL]HG EORFN GHVLJQ WR PHDVXUH WKH HIIHFW RI IRXU GLIIHUHQW WUHDWPHQWV WKUHH H[SHULPHQWDO DQG
RQHFRQWURODPRQJSORWVDPRQJILYHVLWHVZLWKLQWKH ODQGDUHDVEHLQJPDQDJHG7KHWUHDWPHQWV
LQFOXGH GLIIHUHQW FRPELQDWLRQV RI D SRVWHPHUJHQW KHUELFLGH DQG SURSDQH KHDW SXOVHV WR UHSHDWHGO\
WUHDWHDFKVLWH
',6&866,21
,QWKLVSDSHUZHGLVFXVVHGDFLWL]HQVFLHQFHSURJUDPWKDWHQJDJHGSDUWLFLSDQWVLQPRGHOLQJWRKHOS
PHHWQDWXUDOUHVRXUFHJRDOV2XUDSSURDFKLQYROYHGXVLQJVRIWZDUHGHVLJQHGIRUSDUWLFLSDQWVDVZHOO
LQWHJUDWLQJ HGXFDWLYH FROODERUDWLYH DQG VHOISDFHG OHDUQLQJ WRROV 8VLQJ WKLV DSSURDFK UHTXLUHG
UHVRXUFHV LQ WHUPV RI WLPH DQG PRQH\ ZHUH H[SHQGHG XSIURQW DQG SULRU WR SDUWLFLSDQW HQJDJHPHQW
7KLV DOORZHG IRU UHDG\PDGH DQG XVHUIULHQGO\ WRROV ZKLFK KHOSHG XV WR UHGXFH IUXVWUDWLRQ ZLWK WKH
RQOLQHOHDUQLQJHQYLURQPHQW$OWKRXJKWKHLUGDWDFROOHFWLRQLVVWLOORQJRLQJZHPHDVXUHGDVLJQLILFDQW
increase in participants’ confidence in the potential effectiveness of WKHLU FRQVHUYDWLRQ SODQ 0DQQ
:KLWQH\ 8 7HVW 8 S SUH DQG SRVW WKH OHDUQLQJ DQG SODQQLQJ SURFHVV )XUWKHU DOO
SDUWLFLSDQWVUHSRUWHGWKDWWKH\ZRXOGHQJDJHLQDSURMHFWOLNHWKLVDJDLQ
&21&/86,216$1'5(&200(1'$7,216
,QWKLVSURMHFWZHGHPRQVWUDWHGWKDWPHUJLQJSDUWLFLSDWRU\PRGHOLQJDQGFLWL]HQVFLHQFHFRXOGSURYLGH
LPSURYHPHQWV WR PDQDJHPHQW JRDOV ZKLOH PDLQWDLQLQJ SDUWLFLSDQW VDWLVIDFWLRQ DQG HQJDJHPHQW LQ
VFLHQFH)RURWKHUVVHHNLQJWRGRVRZHVWUHVVWKDWWKH SURFHVVRIPRGHOLQJQHHGVWREHFHQWUDOWR
WKH SURMHFWV LQ ZKLFK SDUWLFLSDQWV DUH HQJDJHG 7KLV LV WR DYRLG SDUWLFLSDQW DPELYDOHQFH DERXW
PRGHOLQJ ZKLFK FDQ IHHO DW WLPHV HVRWHULF ,Q DGGLWLRQ RWKHUVPXVW KDYH WKH QHFHVVDU\ UHVRXUFHV
HVWDEOLVKHG SULRU WR SDUWLFLSDQW HQJDJHPHQW DQG DOORZ IRU RQJRLQJ VXSSRUW HVSHFLDOO\ HDUO\ LQ WKH
SURMHFWSODQQLQJSURFHVV:KLOHZHDUHVWLOOHDUO\LQWKHSURFHVVRIZRUNLQJZLWKSDUWLFLSDQWVZHKDYH
HQRXJK HYLGHQFH WR VXJJHVW WKDW FLWL]HQ VFLHQFH DQG SDUWLFLSDWRU\ PRGHOLQJ DUH QRW RQO\ VLPLODU LQ
JRDOVEXWFDQEHVLPLODULQSUDFWLFH
3DJH
6*UD\HWDO0RGHOLQJZLWK&LWL]HQ6FLHQWLVWV
$&.12:/('*0(176
:H ZRXOG OLNH WR WKDQN WKH 9LUJLQLD 0DVWHU 1DWXUDOLVW DQG VRIWZDUH GHYHORSHUV IURP .LII &RQVXOWLQJ
6WHYH :DOVK DQG -RQDWKDQ (OERP )XQGLQJ IRU WKLV VWXG\ ZDV SURYLGHG E\ WKH 1DWLRQDO 6FLHQFH
)RXQGDWLRQ$ZDUG,QLWLDOIXQGLQJIRU0HQWDO0RGHOHUZDVSURYLGHGE\86'$
5()(5(1&(6
%RQQH\5%DOODUG+-RUGDQ50F&DOOLH(3KLOOLSV76KLUN-:LOGHUPDQ&&3XEOLF
3DUWLFLSDWLRQ LQ 6FLHQWLILF 5HVHDUFK 'HILQLQJ WKH )LHOG DQG $VVHVVLQJ ,WV 3RWHQWLDO IRU ,QIRUPDO
6FLHQFH(GXFDWLRQ&HQWHUIRU$GYDQFHPHQWRI,QIRUPDO6FLHQFH(GXFDWLRQ&$,6(,QTXLU\*URXS
5HSRUW
&RQUDG&&+LOFKH\.*$UHYLHZRIFLWL]HQVFLHQFHDQGFRPPXQLW\EDVHGHQYLURQPHQWDO
PRQLWRULQJLVVXHVDQGRSSRUWXQLWLHV(QYLURQ0RQ$VVHVV
)U\HU-/0LFURVWHJLXPYLPLQHXP,Q)LUH(IIHFWV,QIRUPDWLRQ6\VWHP>2QOLQH@86
'HSDUWPHQW RI $JULFXOWXUH )RUHVW 6HUYLFH 5RFN\ 0RXQWDLQ 5HVHDUFK 6WDWLRQ )LUH 6FLHQFHV
/DERUDWRU\3URGXFHU$YDLODEOHKWWSZZZIVIHGXVGDWDEDVHIHLV>0DUFK@
*UD\61LFRVLD.-RUGDQ5&/HVVRQVOHDUQHGIURPFLWL]HQVFLHQFHLQWKHFODVVURRP
'HPDQG(G
*UD\6*UD\6&R[/+HQO\6KHSDUG60HQWDOPRGHOHU$IX]]\ORJLFFRJQLWLYHPDSSLQJ
PRGHOLQJ WRRO IRU DGDSWLYH HQYLURQPHQWDO PDQDJHPHQW 3URFHHGLQJV RI WKH WK ,QWHUQDWLRQDO
&RQIHUHQFHRQ&RPSOH[6\VWHPV
-RQHV1$3HUH]30HDVKDP7*.HOO\*-'
$TXLQR3'DQLHOO.'UD\$)HUUDQG1
(YDOXDWLQJSDUWLFLSDWRU\PRGHOLQJ'HYHORSLQJDIUDPHZRUNIRUFURVVFDVHDQDO\VLV
6RFLR(FRQRPLFVDQGWKH(QYLURQPHQWLQ'LVFXVVLRQ6((':RUNLQJ3DSHU6HULHV1XPEHU
&6,52&DQEHUUD
.RVNR%)X]]\NQRZOHGJHFRPELQDWLRQ,QWHUDWLRQDO-,QWHO6\VW
1HZPDQ*=LPPHUPDQ'&UDOO$:/DLWXUL0*UDKDP-6WDSHO/8VHUIULHQGO\
ZHEPDSSLQJ/HVVRQVIURPDFLWL]HQVFLHQFHZHEVLWH,QWHUQDW-*HRJ,QIR6\V
1LFRVLD.'DDUDP6(GHOPDQ%*HGULFK/+H(0F1HLOO\66KHQR99HODJDSXGL$:X
:=KDQJ/%DUYDOLD$%RNND9&KDQ%&KLX-'KXOLSDOOD6+HUQDQGH]9-HRQ-
.DQXNROOX 3 .UDYHWV 3 0DQWKD $ 0LUDQGD &1LJDP 9 3DWHO 0 3UDYHHQ 66DQJ 7
8SDGK\D\69DUPD7;X&<DODPDQFKL%=KDURYD0=KHQJ$9HUPD59DVVOLGHV
-0DQGHUVRQ - -RUGDQ 5& *UD\ 6$ ,Q SUHVV 'HWHUPLQLQJ WKH ZLOOLQJQHVV WR SD\ IRU
HFRV\VWHPVHUYLFHUHVWRUDWLRQLQDGHJUDGHGFRDVWDOZDWHUVKHG$QLQWKJUDGHLQYHVWLJDWLRQ(FRO
(FRQ
g]HVPL8g]HVPL6/$SDUWLFLSDWRU\DSSURDFKWRHFRV\VWHPFRQVHUYDWLRQIX]]\FRJQLWLYH
PDSVDQGVWDNHKROGHUJURXSDQDO\VLVLQ8OXDEDW/DNH7XUNH\(QYLURQ0DQ–
5HHG066WDNHKROGHUSDUWLFLSDWLRQIRUHQYLURQPHQWDOPDQDJHPHQWDOLWHUDWXUHUHYLHZ%LR
&RQV–
6KLUN-/%DOODUG+:LOGHUPDQ&&3KLOOLSV7:LJJLQV$-RUGDQ5&0F&DOOLH(
0LQDUFKHN0/HZHQVWHLQ%9.UDVQ\0(%RQQH\53XEOLFSDUWLFLSDWLRQLQVFLHQWLILF
UHVHDUFKDIUDPHZRUNIRUGHOLEHUDWHGHVLJQ(FRO6RF
9LRQRY$%RVTXHW)0RGHOLQJZLWKVWDNHKROGHUV(QYLURQ0RGHOO6RIWZ
3DJH