Brigham Young University
BYU ScholarsArchive
International Congress on Environmental
Modelling and Software
7th International Congress on Environmental
Modelling and Software
Jun 16th, 3:40 PM - 5:20 PM
Integrating NEON data with existing models: An
example with the Community Land Model
Edmund M. Hart
National Ecological Observatory Network, [email protected]
Andrew Fox
National Ecological Observatory Network, [email protected]
Steve Berukoff
National Ecological Observatory Network, [email protected]
T. J. Hoar
IMAGE, CISL, National Center for Atmospheric Research, [email protected]
Follow this and additional works at: http://scholarsarchive.byu.edu/iemssconference
Part of the Civil Engineering Commons, Data Storage Systems Commons, Environmental
Engineering Commons, and the Other Civil and Environmental Engineering Commons
Edmund M. Hart, Andrew Fox, Steve Berukoff, and T. J. Hoar, "Integrating NEON data with existing models: An example with the
Community Land Model" ( June 16, 2014). International Congress on Environmental Modelling and Software. Paper 1.
http://scholarsarchive.byu.edu/iemssconference/2014/Stream-A/1
This Event is brought to you for free and open access by the Civil and Environmental Engineering at BYU ScholarsArchive. It has been accepted for
inclusion in International Congress on Environmental Modelling and Software by an authorized administrator of BYU ScholarsArchive. For more
information, please contact [email protected].
,QWHUQDWLRQDO(QYLURQPHQWDO0RGHOOLQJDQG6RIWZDUH6RFLHW\L(06V
WK,QWO&RQJUHVVRQ(QY0RGHOOLQJDQG6RIWZDUH6DQ'LHJR&DOLIRUQLD86$
'DQLHO3$PHV1LJHO:74XLQQDQG$QGUHD(5L]]ROL(GV
KWWSZZZLHPVVRUJVRFLHW\LQGH[SKSLHPVVSURFHHGLQJV
,QWHJUDWLQJ1(21GDWDZLWKH[LVWLQJPRGHOV
$Q H[DPSOHZLWKWKH&RPPXQLW\/DQG0RGHO
(GPXQG0+DUW a $QGUHZ)R[a6WHYH%HUXNRIIa7 -+RDU b
a1DWLRQDO(FRORJLFDO2EVHUYDWRU\1HWZRUNWK6W%RXOGHU&2
86$WKDUW#QHRQLQFRUJ DIR[#QHRQLQFRUJVEHUXNRII#QHRQLQFRUJ
b,0$*(H&,6/1DWLRQDO&HQWHUIRU$WPRVSKHULF5HVHDUFK7DEOH0HVD'U%RXOGHU&2
WKRDU#XFDUHGX
$EVWUDFW
$ FHQWUDO FKDOOHQJH WR HQYLURQPHQWDO IRUHFDVWLQJ LQ K\GURORJLFDO DQG ODQG VXUIDFH PRGHOLQJ LV KRZ
WR LQWHJUDWH PXOWLSOH GDWD VRXUFHV RYHU D ZLGH UDQJH RI VSDWLDO VFDOHV )XUWKHUPRUH KRZ FDQ WKLV
FRPSOH[ WDVN EH DFKLHYHG LQ WKH PRVW SURGXFWLYH DQG UHSURGXFLEOH ZD\ ZLWK D UREXVW LQIRUPDWLFV
DUFKLWHFKXUH" $WWKH1DWLRQDO(FRORJLFDO2EVHUYDWRU\1HWZRUN1(21ZHDUHFROOHFWLQJDYDULHW\RI
ELRSK\VLFDO DQG ELRJHRFKHPLFDO PHDVXUHPHQWV ZKLFK FDQ EH XVHG ZLWK PRGHOV WR SHUIRUP
WHPSRUDO IRUHFDVWLQJ RQ GHFDGDO WLPHVFDOHV 7R WDNH DGYDQWDJH RI WKLV GDWD ZH DUH GHYHORSLQJ D
GDWD DVVLPLODWLRQ IUDPHZRUN 8VLQJ WKLV IUDPHZRUN 1(21 GDWD FDQ EH FRPELQHG ZLWK WKH
&RPPXQLW\/DQG0RGHO ZKLFKIHDWXUHVD IXOO\ FRXSOHG FDUERQ DQG QLWURJHQ F\FOH &/0&1 2XU
JRDO LV WR SURGXFH RSWLPDO VROXWLRQV IRU PRGHO VWDWHV IOX[HV DQG SDUDPHWHU YDOXHV ZLWK WKHLU
DVVRFLDWHG XQFHUWDLQWLHV DW UHJLRQDO WR FRQWLQHQWDO VFDOHV +HUH ZH GHVFULEH RXU LQLWLDO WULDOV RI
SURJUDPPDWLFDOO\ LQWHJUDWLQJ 1(21 GDWD VWUHDPV ZLWK WKH &/0 XVLQJ WKH 'DWD $VVLPLODWLRQ
5HVHDUFK7HVWEHG'$57DFRPPXQLW\WRROIRUHQVHPEOHGDWDDVVLPLODWLRQ '$:HZLOOSURYLGHDQ
RYHUYLHZ RI WKH 1(21 LQIRUPDWLFV DUFKLWHFWXUH WKH ZRUNIORZ ZH HPSOR\ DQG RXWOLQH KRZ RXU
HPSKDVLVRQPHWDGDWDDQGVHPDQWLFLQIUDVWUXFWXUHIURPWKH1(21SURMHFWZLOOHQDEOH RWKHUVWRXVH
WKHVHGDWDZLWKLQWKHLURZQGDWDDVVLPLODWLRQIUDPHZRUNV
.H\ZRUGVLQIRUPDWLFVGDWDLQWHJUDWLRQPHWDGDWD
3DJH
( 0 +DUW HW DO ,QWHJUDWLQJ 1(21 GDWD ZLWK H[LVWLQJ PRGHOV $Q H[DPSOH ZLWK WKH &RPPXQLW\ /DQG 0RGHO
, 1752'8&7,21
7KH 1DWLRQDO (FRORJLFDO 2EVHUYDWRU\ 1HWZRUN 1(21 LV D FRQWLQHQWDO VFDOH \HDU REVHUYDWRU\
WKDW ZLOO SURYLGH VWDQGDUGL]HG REVHUYDWLRQV IRU KXQGUHGV RI GLIIHUHQW HQYLURQPHQWDO YDULDEOHV DQG
SURYLGH RYHUGDWDSURGXFWVIRUXVHUV>6FKLPHOHWDO@ ,WZLOOKDYHVLWHVORFDWHGDFURVV
WKH86DQG 3XHUWR5LFRLQFOXGLQJ$ODVNDDQGHawai’i,ZLWKLQHDFKRIHFRUHJLRQVGHOLQHDWHG
E\DPXOWLYDUL DWHJHRJUDSKLFFOXVWHULQJDOJRULWKP0*&>6FKLPHOHWDO@It’sLQWHQWLRQLVWR
SURYLGH GHFDGDO DQG FRQWLQHQWDO VFDOH REVHUYDWLRQV WR EHWWHU XQGHUVWDQG KRZ HFRV\VWHPV ZLOO
UHVSRQGWRDQWKURSRJHQLF IRUFLQJV DQG IHHGEDFNV DW D EURDG WHPSRUDO DQG VSDWLDO VFDOH >.HOOHU HW
DO @ 1(21 ZLOO FROOHFW WKLV GDWD WKURXJK WKUHH PDMRU DYHQXHV WRZHU PRXQWHG VHQVRUV
VHDVRQDOILHOGFUHZVFROOHFWLQJREVHU YDWLRQDOPHDVXUHPHQWVDQGK\SHUVSHFWUDODQGOLGDUGDWDYLD
DQDLUERUQHREVHUYDWLRQSODWIRUP>6FKLPHO HWDO@ 7KHVHYDULHGFROOHFWLRQDFWLYLWLHVFUHDWHD
KHWHURJHQHRXVDUUD\RIGDWDSURGXFWVDWYDU\LQJ VSDWLDODQGWHPSRUDOUHVROXWLRQV 7KXVRQHRIWKH
JUHDW FKDOOHQJHV RI 1(21 LV KRZ FDQ ZH EXLOG D UREXVW LQIRUPDWLFV LQIUDVWUXFWXUH WKDW
HQFRPSDVVHVWKHVHGLIIHUHQWGDWDSURGXFWVIRUXVHE\WKHPRGHOLQJ FRPPXQLW\" )XUWKHUPRUHKRZ
FDQZHHQVXUHWKDWWKLVPDVVLYHDPRXQWRIGDWDLVXVHIXOWRPRGHOOHUV DQGWKHEURDGHUFRPPXQLW\
RI GDWD FRQVXPHUV" %XLOGLQJ WKLV LQIUDVWUXFWXUH WR IDFLOLWDWH HFRORJLFDO DQG K\GURORJLFDOPRGHOLQJ
VHUYHVERWKLQWHUQDO1(21GDWDSURGXFWFUHDWLRQDV ZHOODVSURYLGLQJDZRUNIORZ IRUWKHEURDGHU
FRPPXQLW\
(QDEOLQJ FRXSOHG HFRORJLFDO DQG K\GURORJLFDO PRGHOLQJ XVLQJ WKHVH GDWD LQ (DUWK 6\VWHP
0RGHOV (60VLVFHQWUDOWRWKHRSHUDWLRQVRI1(21ZLWKD JRDOWRTXDQWLWDWLYHO\ SUHGLFW QRWMXVW
UHWURDFWLYHO\ H[SODLQ ODQG VXUIDFH SURFHVVHV >&RPPLWWHH RQ WKH 1DWLRQDO (FRORJLFDO 2EVHUYDWRU\
1HWZRUN .HOOHU HW DO @ :KHWKHU SUHGLFWLQJ WKH IXWXUH VWDWH RI D FDWFKPHQW RU
DVVHVVLQJ WKH OLNHO\ LPSDFW RI D SDUWLFXODU FOLPDWH VFHQDULRIRUHFDVWLQJ KDV JUHDW VRFLHWDO EHQHILW
DQG FDQ KHOS DGYDQFH WKHRU\ E\ IRUFLQJ K\SRWKHVHV DV WKHRU\ FRGLILHG LQ WKH PRGHO WR EH
FRQIURQWHG ZLWK REVHUYDWLRQV 3UHGLFWLQJ WKH HIIHFWV RI GULYHUV WKDW RFFXU RYHU GHFDGHV RU ORQJHU
FOLPDWH FKDQJH ODQG XVH DQG ODQG FRYHU FKDQJH UHTXLUHV LQIRUPDWLRQ RQPHFKDQLVPV WKDW DFW
RYHUDUDQJHRIWLPHVFDOHVDVZHOODVWKHSDUDPHWHUVWKDW LQIOXHQFHWKHLUEHKDYLRU 7KHFRYDULDQFH
EHWZHHQ HQYLURQPHQWDO GULYHUV DQG UHVSRQVHV LOOXVWUDWHV WKH VWUHQJWK RI XQGHUO\LQJ PHFKDQLVPV
%\ H[DPLQLQJ KRZ LW YDULHV RYHU WLPH DQG VSDFH ZH FDQ SURYLGH WKH EDVLV IRU VSDWLDO
H[WUDSRODWLRQ DQG WHPSRUDO IRUHFDVWLQJ 1(21 ZLOO SURYLGH FRQVLVWHQW REVHUYD WLRQV WKDW DUH
FRPSDUDEOH ZLWK PDQ\LPSRUWDQW SURJQRVWLF DQGGLDJQRVWLF (60 YDULDEOHV VXFK DVVRLO PRLVWXUH
DQG VRLO WHPSHUDWXUH OHDI DUHD DQG ELRPDVV DQG IOX[HV RI ZDWHU DQG FDUERQ 7R VXSSRUW WKH
LQWHJUDWLRQ RI 1(21 GDWD ZLWK H[LVWLQJ PRGHOV ZH DUH GHYHORSLQJ DQ LQIRUPDWLFV LQIUDVWUXFWXUH WR
ZRUN ZLWK H[LVWLQJ ESM’s. 2QH H[DPSOH LV WKH LQFRUSRUDWLRQ RI 1(21 GDWD LQWR WKH &RPPXQLW\
/DQG 0RGHO &/0 >/DZUHQFH HW DO @ YLD D 'DWD $VVLPLODWLRQ 5HVHDUFK 7HVWEHG '$57
>$QGHUVRQ HW DO @ ,QWHJUDWLQJ 1(21 GDWD LQWR WKH &/0 YLD '$57 ZLOO DOORZ XV WR FUHDWH
LPSRUWDQWJULGGHGGDWDSURGXFWV VXFKDVVRLOPRLVWXUHHYDSRUDWLRQDQGWUDQVSLUDWLRQIRUDUHDRIWKH
ODQGVFDSHZKHUHWKHUHDUHQRGLUHFW REVHUYDWLRQV %HORZZHZLOORXWOLQHKRZWKH&/0DQG'$57
ZRUNDQGKRZWKH\FDQZRUNZLWK1(21 GDWD )XUWKHUPRUHZKLOHZHDUHVWLOOLQFRQVWUXFWLRQZH
ZLOO GHWDLO KRZ WKH GHYHORSLQJ LQIRUPDWLFV LQ IUDVWUXFWXUH ZLOOKHOSIDFLOLWDWHGDWD LQWHJUDWLRQLQWKH
&/0DQGFDQVHUYHDVDQH[DPSOHIRUKRZRWKHU PRGHOVFDQLQWHJUDWH1(21GDWDSURGXFWV
&/0$1' 1(21
7KH ORQJWHUP QDWXUH RI WKH REVHUYDWRU\ ZLOO HQDEOH LWHUDWLYH FRPSDULVRQV RI SUHGLFWLRQV DQG
REVHUYD WLRQV DV ZHOO DV DQDO\VHV RI IDFWRUV WKDW PRVW VWURQJO\ LQIOXHQFH IRUHFDVW HUURUV 7KLV
H[SHULHQFHZLOODOVR HQDEOHWKHPHDVXUHPHQWVPDGHE\1(21WREHHYDOXDWHGRYHUWLPHHQVXULQJ
WKH\UHPDLQUHOHYDQWHI IHFWLYHDQGHIILFLHQWLQDFKDQJLQJHQYLURQPHQW%\REVHUYLQJSURFHVVHVDW
GLIIHUHQW VFDOHV IURP VLQJOH RUJDQLVPV WR WKH FRQWLQHQW 1(21 DQG QRQ1(21 GDWD VXFK DV
UHPRWHO\VHQVHG SURGXFWV LQFOXGLQJ 02',6 /$, DQG 02',6 VQRZ FRYHU DQG JULGGHG ELRPDVV
HVWLPDWHV GHULYHG IURP UHPRWH VHQVLQJ DQG IRUHVW LQYHQWRU\ DQDO\VLV SURYLGH GHWDLOHG VLWH
VSHFLILF LQIRUPDWLRQ DQG VSDWLDO PHDVXUHV RI SDWWHUQV RI ZDWHU VWRUDJH DQG IOX[HV LQ QDWXUH )RU
H[DPSOH ORQJWHUP HGG\ FRYDULDQFH IOX[ PHDVXUHPHQWV PDGHRYHUDYDULHW\RIHFRV\VWHPW\SHV
DQG JOREDO SURGXFWV GHULYHG IURP WKHP KDYH EHFRPH FULWLFDO LQ JXLGLQJ WKH HYDOXDWLRQ DQG
GHYHORSPHQW RI ODQG VXUIDFH PRGHOV 0RGHOV FDQ EH LQIRUPHG E\ IOX[ WRZHU UHFRUGV DW 1(21
VLWHV WKDW ZLOO FRPSOHPHQW VLWH FKDUDFWHUL]DWLRQ GDWD DQG PHDVXUHPHQWV RI VRLO SURSHUWLHV
3DJH
REVHUYDWLRQVRIYHJHWDWLRQSURSHUWLHVDQGG\QDPLFVWKDWFRQWUROHYDSRWUDQVSLUDWLRQVXFKDV
( 0+DUWHWDO,QWHJUDWLQJ1(21GDWDZLWKH[LVWLQJPRGHOV$QH[DPSOHZLWKWKH&RPPXQLW\/DQG0RGHO
DLUERUQHGHULYHGHVWLPDWHVRIOHDIDUHDLQGH[DQGVRLOPRLVWXUHDQGJURXQGZDWHUG\QDPLFV,QIUDVWUXF
WXUHWRKHOSH[SORUHVRPHNH\PRGHOLQJTXHVWLRQVLVEHLQJGHYHORSHGDW1(21WKHVHHIIRUWVLQFOXGH
HPSOR\LQJFRPPXQLW\WRROVIRUODQGVXUIDFHPRGHOLQJDQGDGYDQFHGGDWDDVVLPLODWLRQDVZHOODVLGHQWL
I\LQJGDWDVWUHDPVDQGHVWDEOLVKLQJSURFHVVLQJSLSHOLQHVWRFRQQHFWWKHVHWRROVWR1(21REVHUYDWLRQV
7KLVDELOLW\ZLOOEHXVHIXOIRUGHYHORSLQJDQGWHVWLQJESM’s,RYHUFRPLQJWKHOLPLWDWLRQVRIVKRUWWHUPRU
HSLVRGLFGDWDFROOHFWLRQVWRGHVFULEHLQKHUHQWO\QRQVWDWLRQDU\HFRORJLFDOV\VWHPV ,WHUDWLYHIRUHFDVWV
WKURXJKWLPHHQDEOHPXFKODUJHU DUHDVRIWKHVROXWLRQVSDFHWREHH[SORUHGRYHUDGLYHUVHUDQJHRI
FRQGLWLRQVOHDGLQJWRDQRUGHUO\IRUHFDVWHYDOXDWLRQXSGDWHLPSURYHPHQWF\FOH
7R SURYLGH D QXPEHU RI UHTXLUHG KLJK OHYHO HFRK\GURORJLFDO DQG ELRJHRFKHPLFDO GDWD SURGXFWV ZH
DUHGHYHORSLQJDGDWDDVVLPLODWLRQIUDPHZRUNWKDWFRXSOHV1(21VDQGUHPRWHO\VHQVHGVDWHOOLWHGDWD
SURGXFWVWRWKH&/07KH&/0LVXVHGDVWKHODQGFRPSRQHQWLQWKH&RPPXQLW\(DUWK6\VWHP0RGHO
&(60DFROODERUDWLYHHIIRUWEHWZHHQWKH1DWLRQDO&HQWHUIRU$WPRVSKHULF5HVHDUFK1&$5WKH'H
SDUWPHQWRI(QHUJ\'2(DQGPDQ\XQLYHUVLW\UHVHDUFKHUVZLWKWKHDLPRISUHGLFWLQJDQGXQGHUVWDQG
LQJWKHFRXSOHFOLPDWHV\VWHP &/0VLPXODWHVWHUUHVWULDOHFRV\VWHPSURFHVVHVLQFOXGLQJWKHF\FOLQJRI
HQHUJ\ZDWHUFDUERQDQGQLWURJHQDQGLVGULYHQE\DOLPLWHGVHWRIFOLPDWHYDULDEOHVZKLFKPD\FRPH
IURPVLWHREVHUYDWLRQVUHDQDO\VLVRUDFRXSOHGDWPRVSKHULFPRGHOZKLOHWKHVHQVLWLYLW\RIHFRV\VWHP
SURFHVVHVWRFOLPDWHLVFRQWUROOHGE\WKHLQLWLDOVWDWHVDQGSDUDPHWHUVHWVRIWKHPRGHO,QSULQFLSOHHV
WLPDWHVRILQLWLDOFRQGLWLRQVDQGSDUDPHWHUVGRQRWUHTXLUHORQJWHUPVWDQGDUGL]HGREVHUYDWLRQV:LWKLQ
WKHVFRSHRI DVKRUWWHUPUHVHDUFK SURMHFW LQLWLDOFRQGLWLRQVDW DVLWH FDQ EHVXUYH\HG IRUH[DPSOH
ELRPDVVRUSRSXODWLRQGDWDNH\UDWHFRQVWDQWVFDQEHPHDVXUHGDQGDPRGHOFDQEHGHYHORSHGDQG
H[HUFLVHG([DPSOHVRIVXFKUHVHDUFKDERXQGEXWWKLVW\SHRIIRUHFDVWLQJLVOLPLWHGE\DGHDUWKRIORQJ
HFRORJLFDOWLPHVHULHV>&ODUNHWDO0DJXUUDQHWDO@
7KHPHDVXUHPHQWVPDGHE\1(21ZLOOJUDGXDOO\FKDQJHRYHUWLPHDVH[SHULHQFHLVJDLQHGWKURXJK
F\FOLFSUHGLFWLRQREVHUYDWLRQFRPSDULVRQDQGWKHDQDO\VLVRIIDFWRUVWKDWPRVWVWURQJO\GULYHIRUHFDVW
HUURUV2XU JRDO LV WR SURGXFH RSWLPDO VROXWLRQV IRU PRGHO VWDWHV IOX[HV DQG SDUDPHWHU YDOXHV ZLWK
WKHLUDVVRFLDWHGXQFHUWDLQWLHVDWUHJLRQDOWRFRQWLQHQWDOVFDOHV 7KHVHJULGGHGODQGVXUIDFHSURGXFWV
ZLOOEHVRPHZKDWDQDORJRXVWRDWPRVSKHULFUHDQDO\VHVZKHUHE\DIL[HGPRGHODQGGDWDDVVLPLODWLRQ
VFKHPHLQJHVWPDQ\YDU\LQJREVHUYDWLRQVWRSURGXFHDG\QDPLFDOO\FRQVLVWHQWHVWLPDWHRIKXQGUHGV
RI VWDWH YDULDEOHV ZLWK FRQVLVWHQW VSDWLDO DQG WHPSRUDO UHVROXWLRQV7KLV UHPRYHV WKH UHTXLUHPHQW RI
WKHHQGXVHUWRXQGHUVWDQGDQGDQDO\]HVHSDUDWHO\DOOWKHPDQ\GLIIHUHQWREVHUYDWLRQVDQGPDNHVWKH
UHDQDO\VLVGDWDVHWVHDV\WRKDQGOHIURPDSURFHVVLQJVWDQGSRLQWDOWKRXJKWKHILOHVVL]HVFDQEHFRPH
ODUJH 7KH GRZQVLGH RI WKLV DSSURDFK LV WKDW FKDQJLQJ PL[HV RI REVHUYDWLRQV DQG REVHUYDWLRQ DQG
PRGHOELDVFDQLQWURGXFHVSXULRXVYDULDELOLW\DQGWUHQGVLQWRWKHUHDQDO\VLV 7KXVUHDQDO\VLVUHOLDELOLW\
FDQ YDU\ FRQVLGHUDEO\ GHSHQGLQJ RQ ORFDWLRQ WLPHSHULRG DQG WKH YDULDEOHV FRQVLGHUHG2QH ZD\ WR
DGGUHVVVRPHRIWKHVHFRQFHUQVLVZLWKDUREXVWGDWDDVVLPLODWLRQIUDPHZRUN
'DWDDVVLPLODWLRQLVDJHQHUDOWHUPIRUPHWKRGVWKDWV\VWHPDWLFDOO\FRPELQHLQIRUPDWLRQIURPREVHUYD
WLRQVZLWKLQIRUPDWLRQIURPDPRGHOWRDFKLHYHDQXQGHUVWDQGLQJRIWKHV\VWHPWKDWLVPRUHDFFXUDWH
WKDQWKHREVHUYDWLRQVRUWKHPRGHOLQGHSHQGHQWO\7KHGDWDDVVLPLODWLRQDSSURDFKDGRSWHGE\VFLHQWLVWV
ZRUNLQJZLWKODQGVXUIDFHPRGHOVGUDZVRQWRROVGHYHORSHGLQPHWHRURORJ\DQGDSSOLHGPDWKHPDWLFVWR
VXSSRUWQXPHULFDOZHDWKHUSUHGLFWLRQ7KHJRDORIODQGVXUIDFHGDWDDVVLPLODWLRQLVRIWHQSDUDPHWHUDV
ZHOODVVWDWHHVWLPDWLRQSDUWLFXODUO\IRUGHVFULELQJSURFHVVHVUHODWHGWRWKHWHUUHVWULDOZDWHUDQGFDUERQ
F\FOHV2XUDSSURDFKKDVEHHQWRXVHHQVHPEOHILOWHUWHFKQLTXHVDSSUR[LPDWH0RQWH&DUORVROXWLRQVWR
WKH'$SUREOHPWKDWKDYHJURZQUDSLGO\LQSRSXODULW\VLQFHWKHLUILUVWGHVFULSWLRQLQWKHV>(YHQVHQ
@ %\XVLQJFDUHIXOVRIWZDUHHQJLQHHULQJLWLVSRVVLEOHWRGHYHORSDVWDWHRIWKHDUWHQVHPEOHILO
WHULQJV\VWHPWKDWLVPRVWO\LQGHSHQGHQWRIWKHJHRSK\VLFDOPRGHODQGREVHUYDWLRQVEHLQJDVVLPLODWHG
6XFKDV\VWHPLVWKH'$57>$QGHUVRQHWDO@DFRPPXQLW\IDFLOLW\WKDWHPSOR\VDPRGXODUSUR
JUDPPLQJDSSURDFKIRUHQVHPEOH'$GHYHORSHGDQGPDLQWDLQHGDWWKH1&$5WKDWSURYLGHVDQXPEHURI
HQKDQFHPHQWVWREDVLFILOWHULQJDOJRULWKPV)LJXUH :HGHYHORSHGDPXOWLLQVWDQFHYHUVLRQRI&(60
WKDWPRUHHDVLO\IDFLOLWDWHVHQVHPEOHEDVHGGDWDDVVLPLODWLRQWHFKQLTXHVWKDWLVQRZUHOHDVHGDVSDUWRI
WKHQRUPDO&(60GLVWULEXWLRQ $NH\FRPSRQHQWWRIDFLOLWDWHDVVLPLODWLQJ1(21GDWDLQWRWKH&/0YLD
'$57LVDVWURQJLQIRUPDWLFVDUFKLWHFWXUH
3DJH
( 0 +DUW HW DO ,QWHJUDWLQJ 1(21 GDWD ZLWK H[LVWLQJ PRGHOV $Q H[DPSOH ZLWK WKH &RPPXQLW\ /DQG 0RGHO
)LJXUH '$57PRGHOFRXSOLQJDQGH[HFXWLRQ
, 1)250$7,&6,1)5$6758&785(
7KH &(60 DQG '$57 KDYH ODUJH DQG FRPSOH[ FRGH EDVHV$V VFLHQWLVWV DW 1(21 GHYHORSLQJ KLJK
OHYHOGDWDSURGXFWVZHUHO\XSRQWKLVH[LVWLQJFRGHEDVHDQGWKHEURDGHU community’sH[SHULHQFHLQ
XVLQJWKHPRGHODQGHQVHPEOHILOWHUWRROV $FULWLFDODFWLYLW\DW1(21WKHQLQDGGLWLRQWRFRQWULEXWLQJ
WR GHYHORSPHQW DQG WHVWLQJ HIIRUWV LV LGHQWLI\LQJ ZKLFK 1(21 REVHUYDWLRQV DUH XVHIXO WR FRQVWUDLQ
PRGHOV DQG SURFHVVLQJ WKHP LQWR REVHUYDWLRQ VHTXHQFH ILOHV VXLWDEOH IRU LQJHVWLRQ E\ '$ VFKHPHV
OLNH'$572EVHUYDWLRQVHTXHQFHVDUHFRPSOLFDWHGDQGWU\LQJWRDXWRPDWLFDOO\DFFRPPRGDWHDP\ULDG
RI REVHUYDWLRQ ILOH IRUPDWV VWUXFWXUH DQG PHWDGDWD LV D GLIILFXOW WDVN)RU WKLV UHDVRQ '$57 KDV LWV
RZQIRUPDWIRUREVHUYDWLRQVDQGDVHWRISURJUDPVWRFRQYHUWREVHUYDWLRQVIURPWKHLURULJLQDOIRUPDWV
WRDART’s. 7KH'$57IUDPHZRUNHQIRUFHVDFOHDQVHSDUDWLRQEHWZHHQREVHUYDWLRQVDQGWKHPRGHOV
XVHGIRUDVVLPLODWLRQ)LJXUH 7KHVDPHREVHUYDWLRQVFDQEHXVHGLQDQ\PRGHOZKLFKXQGHUVWDQGV
KRZ WR JHQHUDWH D YDOXH IRU WKH UHTXHVWHG W\SH RI REVHUYDWLRQ IURP WKH models’ VWDWHVSDFH YDOXHV
LH WKH IRUZDUG REVHUYDWLRQ RSHUDWRU PXVW H[LVW '$57 SURYLGHV PDQ\ IRU WKH PRVW FRPPRQ VWDWH
YDULDEOHV ,QPDQ\FDVHVWKHRULJLQDOGDWDVHWVDUHLQDVWDQGDUGVFLHQWLILFIRUPDWOLNHQHW&')+')
RU%8)5DQGOLEUDU\URXWLQHVIRUWKRVHIRUPDWVFDQEHXVHGWRUHDGLQWKHRULJLQDOREVHUYDWLRQGDWD
7KH'$57VRIWZDUHGLVWULEXWLRQLQFOXGHV)RUWUDQVXEURXWLQHVDQGIXQFWLRQVWRKHOSFUHDWHDVHTXHQFH
RIREVHUYDWLRQVLQPHPRU\DQGWKHQDFDOOWRWKH'$57REVHUYDWLRQVHTXHQFHZULWHURXWLQHZLOOFUHDWH
DQ HQWLUH REVHUYDWLRQ ILOH LQ WKH FRUUHFW IRUPDW,QPDQ\ FDVHV D VLQJOH VHOIFRQWDLQHG SURJUDPFDQ
FRQYHUW GLUHFWO\ IURP WKH REVHUYDWLRQ ORFDWLRQ WLPH YDOXH DQG HUURU LQWR WKH '$57 IRUPDW ,Q RWKHU
FDVHV HVSHFLDOO\ WKRVH OLQNLQJ ZLWK D FRPSOLFDWHG H[WHUQDO OLEUDU\ HJ %8)5 WKHUH LV D WZRVWHS
SURFHVVZLWKWZRSURJUDPVDQGDQ$6&,,LQWHUPHGLDWHILOH
*LYHQWKHFRPSOLFDWLRQVRILQJHVWLQJH[WHUQDOGDWDLQWR'$57DZHOOWKRXJKWRXWDQGUREXVWLQIRUPDWLFV
LQIUDVWUXFWXUHFDQVHUYHWRIDFLOLWDWHWKLVSURFHVV $W1(21ZHDUHWDNLQJDPXOWLVWHSSHGDSSURDFKWR
3DJH
( 0 +DUW HW DO ,QWHJUDWLQJ 1(21 GDWD ZLWK H[LVWLQJ PRGHOV $Q H[DPSOH ZLWK WKH &RPPXQLW\ /DQG 0RGHO
)LJXUH $GDWDDVVLPLODWLRQVFKHPHIRU&/0EURZQER[HVUHSUHVHQWGDWDWKDW1(21FDQSURYLGH
EXLOGLQJWKLVLQIUDVWUXFWXUH 2XUILUVWVWHSLVWRDGRSWVDPHEDVLFJXLGHOLQHVWKDWPDNHXVLQJRXUGDWD
LQWHUQDOO\DQGH[WHUQDOO\VLPSOHU>:KLWHHWDO@ 7KHVHLQFOXGHGHYHORSLQJQDPLQJFRQYHQWLRQV
DGRSWLQJ ILOH IRUPDW VWDQGDUGV DFURVV KHWHURJHQHRXV GDWD VRXUFHV FUHDWLQJ FRQWUROOHG YRFDEXODULHV
DQGLPSOHPHQWLQJFRPPXQLW\PHWDGDWDVWDQGDUGV8VLQJVWDQGDUGQDPLQJFRQYHQWLRQVDQGILOHIRUPDWV
DOORZVIRUHDV\SURJUDPPDWLFLQJHVWLRQRI1(21GDWDLQWR'$57,IILOHVDUHDOOVWUXFWXUHGZLWKVLPLODU
QDPHVSURJUDPPDWLFWRROVEXLOWIRUDVLQJOHGDWDW\SHXVHFDVHDOORZHDV\H[WHQVLELOLW\WRRWKHUGDWXP
7KLVLVHVSHFLDOO\LPSRUWDQWJLYHQWKHFRPSOH[LW\PRYLQJIURPIRUPDWVOLNH+')WRWKH'$57)LJXUH
:KLOHLQWHUQDOZRUNIORZVDUHIDFLOLWDWHGWKLVZD\H[WHUQDOXVHUVZLOOEHQHILWIURPVWUXFWXUHGYRFDEXODULHV
DQGVWDQGDUGL]HGPHWDGDWD0HWDGDWDIRUPRVWPHDVXUHPHQWVWUHDPVZLOOEH,62>,62
@FRPSOLDQW DOORZLQJIRUDXWRPDWHGLQJHVWLRQRIPXOWLSOHILOHV 2QFHZHGHYHORSHGILOHIRUPDW
VWDQGDUGVDFURVVDOOGDWDSURGXFWVZHFDQGHYHORSWRROVWRLQWHUIDFHZLWKH[LVWLQJFRPPXQLW\VWDQGDUGV
2QHH[DPSOHLVWKDWPXFKRIRXUELRSK\VLFDOGDWDZLOOEHVHUYHGDV+')ZLWKVHOIGHVFULEHGPHWDGDWD
IRULQWHURSHUDELOLW\DFURVV1(21GDWDSURGXFWV +RZHYHUXVHUVPD\ZDQWWKHVDPHGDWDSURGXFWLQD
1HW&')IRUPDWZLWKVHOIGHVFULELQJPHWDGDWDWKDWPHHWV&OLPDWHDQG)RUHFDVW&)FRQYHQWLRQV 7R
VHUYHWKHJRDOVRILQWHURSHUDELOLW\ERWKDFURVV1(21GDWDDQGH[LVWLQJGDWDSURYLGHUVDQRWKHUFRPSR
QHQWRIRXULQIUDVWUXFWXUHLVWKHGHYHORSPHQWRIPDSSLQJVWRH[LVWLQJFRPPXQLW\VWDQGDUGVHJ &)
DQGWKHWRROVWRHDVLO\FRQYHUWEHWZHHQIRUPDWV 7KHGHYHORSPHQWRIFRQVLVWHQWILOHIRUPDWVWDQGDUGV
DFURVVSURGXFWVSURYLGLQJPHWDGDWDLQH[LVWLQJVWDQGDUGVDQGGHYHORSLQJWRROVIRUWKHFRPPXQLW\LV
WKHILUVWSKDVHRIRXULQIRUPDWLFVVWUDWHJ\ $ORQJWHUPJRDOLVWKHGHYHORSPHQWRID1(21VHPDQWLF
ontology’sDQGVWUHDPLQJAPI’sWRLQWHJUDWHRXUGDWDLQWR&/0
6HPDQWLFRQWRORJLHVSURYLGHDIRUPDOZD\RIGHVFULELQJUHODWLRQVKLSVDQGWKHLUORJLFEHWZHHQUHVRXUFHV
>0DGLQ HW DO @,Q WKH FDVH RI 1(21 D IRUPDORQWRORJ\ ZRXOG GHVFULEH WKH ZD\ LQ ZKLFK GDWD
VWUHDPVUHODWHWRHDFKRWKHUDVZHOODVWRVHQVRUVORFDWLRQVDQGRWKHUGDWDW\SHV 2XUFXUUHQWSODQ
IRUWKHGHYHORSPHQWRIDQRQWRORJ\LVWRFUHDWHVHPDQWLFVWKDWGHVFULEHWKH1(21REVHUYDWLRQSURFHVV
+RZHYHUJLYHQWKHKHWHURJHQHLW\RI1(21GDWDSURGXFWVDQGFRPPXQLW\HIIRUWVDWRQWRORJ\GHYHORS
PHQWRXUJRDOLVWKDWWKHLQWHUQDOREVHUYDWLRQRQWRORJ\FDQWKHQEHLQWHJUDWHGZLWKH[LVWLQJFRPPXQLW\
VWDQGDUGV ([DPSOHVRIH[LVWLQJRQWRORJLHVWKDWZHSRWHQWLDOO\ZDQWWRDGRSWIRUGDWDSURGXFWVRXWVLGH
WKH REVHUYDWLRQ SURFHVV LQFOXGH 6HPDQWLF :HE IRU (DUWK DQG (QYLURQPHQWDO 7HUPLQRORJ\ 6:((7
>5DVNLQDQG3DQ@IRURXUELRSK\VLFDOGDWDDQGWKH%LRORJLFDO&ROOHFWLRQV2QWRORJ\%&2>:DOOV
HWDO@IRURXURUJDQLVPDOGDWD $ZHOOGHYHORSHG1(21RQWRORJ\WKDWLQWHJUDWHVZLWKRWKHURQ
WRORJLHVZRXOGVHUYHWZRSULPDU\IXQFWLRQVLQWKHLQWHJUDWLRQLQWR'$57)LUVWLWDOORZVIRULPSURYHGGDWD
GLVFRYHU\>%HUNOH\HWDO@ 8VHUVFRXOGGLVFRYHUOLQNDJHVEHWZHHQGDWDVWUHDPVWKDWWKH\PLJKW
QRWRWKHUZLVHKDYHFRQVLGHUHG )RULQVWDQFH1(21ZLOOFROOHFWVLQJOHDVSLUDWHGDLUWHPSHUDWXUHIURP
REVHUYDWLRQDOWRZHUVEXWZLOODOVRKDYHPLFURPHWHRUORJLFDOVWDWLRQVDWFHUWDLQDTXDWLFVLWHVZLWKERWK
GDWDSRWHQWLDOO\EHLQJXVHIXOLQWKH&/06HFRQGO\LWDOORZVIRUWKHLPSURYHGDXWRPDWLRQRIGDWDLQJHVW
LQWR'$57DQGRWKHUHQYLURQPHQWDOPRGHOV>9LOODHWDO@ $IRUPDOVHPDQWLFRQWRORJ\ZLOOSURYLGH
OLQNDJHVEHWZHHQKHWHURJHQRXVGDWDVRXUFHVIURPWHPSHUDWXUHUHFRUGHGRQDWRZHUWRYHJHWDWLRQVXU
YH\VDQGVRLOW\SHVDWWKHVLWH7RROVFDQEHGHYHORSHGWKDWGHSHQGRQWKHVHUHODWLRQVKLSV DQGFDQ
LQWHJUDWHWKHVHGDWDVRXUFHVEHIRUHWKHLULQFOXVLRQLQWR'$57)XUWKHUPRUHRQFHZHKDYHDVWDEOH$3,
XSWKHVHVHPDQWLFUHODWLRQVKLSVEHWZHHQUHVRXUFHVFDQEHXVHGWRFRQWLQXRXVO\VWUHDPGDWDDQGLQ
WHJUDWHLWEHIRUHLQFRUSRUDWLRQLQWR'$577KHFXUUHQWSODQIRUWKHGHYHORSPHQWRID1(21RQWRORJ\LV
WRGHYHORSDVHPDQWLFIUDPHZRUNWKDWLQWHUQDOO\GHVFULEHV
3DJH
( 0 +DUW HW DO ,QWHJUDWLQJ 1(21 GDWD ZLWK H[LVWLQJ PRGHOV $Q H[DPSOH ZLWK WKH &RPPXQLW\ /DQG 0RGHO
& 21&/86,216
:HKDYHSURYLGHGGHWDLOVDERXWKRZWKH&/0DQG1(21GDWDFDQZRUNWRJHWKHUWRLPSURYHPRGHOSUH
GLFWLRQVYLDWKH'$577KHWRROVZHGHYHORSKDYHDSSOLFDELOLW\EH\RQGRXURZQLQWHUQDOPRGHOLQJQHHGV
0DQ\RWKHUPRGHOVDUHDOVRFRXSOHGWRERWKWKH&/0DQG'$57)RULQVWDQFHWKH1RDKODQGVXUIDFH
PRGHODOVRXVHV'$57>(NHWDO@DVGRHVWKH$XVWUDOLDQJRYHUQPHQWV&RPPXQLW\$WPRVSKHUH
%LRVSKHUH/DQG([FKDQJH&$%/(PRGHO 7KHLQWHJUDWLRQRI1(21GDWDLQWR'$57FDQVHUYHDVDQ
H[DPSOH RI KRZ LQIRUPDWLFV LQIUDVWUXFWXUH IDFLOLWDWHV GDWD DVVLPLODWLRQ ZLWK PRGHOV:H KDYH DOUHDG\
DFFRPSOLVKHGVRPHRIWKHVLPSOHUSDUWVRIEXLOGLQJRXWDQLQIRUPDWLFVLQIUDVWUXFWXUH2XUQH[WVWHSVDUH
WREXLOGRXWWKHVXLWHRIRSHQVRXUFHWRROVIRUFRPELQLQJ1(21GDWDZLWK'$57DQGGHYHORSDVHPDQWLF
RQWRORJ\*LYHQWKDWWKLVLVDQRQJRLQJSURFHVVZHFDQOHYHUDJHWKLVWLPHGXULQJRXUFRQVWUXFWLRQSKDVH
WREXLOGRXWWKHRQWRORJ\WKDWVSHFLILFDOO\PHHWVWKHQHHGVRIGDWDDVVLPLODWLRQ ,WZLOODOORZIRUDQLWHUD
WLYHDJLOHGHYHORSPHQWRIRXURQWRORJ\DQGKHOSRSHUDWLRQDOL]HWKHSURFHVVRIGDWDDVVLPLODWLRQEHWZHHQ
1(21DQGWKH&/0
3DJH
( 0 +DUW HW DO ,QWHJUDWLQJ 1(21 GDWD ZLWK H[LVWLQJ PRGHOV $Q H[DPSOH ZLWK WKH &RPPXQLW\ /DQG 0RGHO
5 ()(5(1&(6
$QGHUVRQ-+RDU75DHGHU./LX+&ROOLQV17RUQ5DQG$YHOODQR$ 7KH'DWD$V
VLPLODWLRQ5HVHDUFK7HVWEHG$&RPPXQLW\)DFLOLW\ %XOOHWLQRIWKH$PHULFDQ0HWHRURORJLFDO6RFLHW\
–
%HUNOH\&%RZHUV6-RQHV0%0DGLQ-6DQG6FKLOGKDXHU0,PSURYLQJ'DWD'LVFRY
HU\IRU0HWDGDWD5HSRVLWRULHVWKURXJK6HPDQWLF6HDUFK,QWHUQDWLRQDO&RQIHUHQFHRQ&RPSOH[
,QWHOOLJHQWDQG6RIWZDUH,QWHQVLYH6\VWHPVSDJHV–
&ODUN-6/HZLV00F/DFKODQ-6DQG+LOOH5LV/DPEHUV-(VWLPDWLQJSRSXODWLRQVSUHDG
:KDWFDQZHIRUHFDVWDQGKRZZHOO" (FRORJ\–
&RPPLWWHHRQWKH1DWLRQDO(FRORJLFDO2EVHUYDWRU\ 1HWZRUN 15&1HRQ $GGUHVVLQJWKH
Nation’s(QYLURQPHQWDO&KDOOHQJHV7KH1DWLRQDO$FDGHPLHV3UHVV
(N0%0LWFKHOO.(/LQ<5RJHUV(*XQQPDQQ3.RUHQ9*D\QR*DQG7DUSOH\-'
,PSOHPHQWDWLRQRI1RDKODQGVXUIDFHPRGHODGYDQFHVLQWKH1DWLRQDO&HQWHUVIRU(QYLURQ
PHQWDO3UHGLFWLRQRSHUDWLRQDOPHVRVFDOH(WDPRGHO-RXUQDORI*HRSK\VLFDO5HVHDUFK'
(YHQVHQ*6HTXHQWLDOGDWDDVVLPLODWLRQZLWKDQRQOLQHDUTXDVLJHRVWURSKLFPRGHOXVLQJ0RQWH
&DUORPHWKRGVWRIRUHFDVWHUURUVWDWLVWLFV-RXUQDORI*HRSK\VLFDO5HVHDUFK2FHDQV&
,62*HRJUDSKLFLQIRUPDWLRQ–0HWDGDWD–3DUW([WHQVLRQVIRULPDJHU\DQGJULGGHG
GDWD
.HOOHU06FKLPHO'+DUJURYH:DQG+RIIPDQ) $FRQWLQHQWDOVWUDWHJ\IRUWKH1DWLRQDO
(FRORJLFDO2EVHUYDWRU\1HWZRUN)URQWLHUVLQ(FRORJ\SDJHV–
/DZUHQFH'02OHVRQ.:)ODQQHU0*7KRUQWRQ3(6ZHQVRQ6&/DZUHQFH3-=HQJ
; <DQJ =/ /HYLV 6 6DNDJXFKL . %RQDQ *% DQG6ODWHU $*3DUDPHWHUL]DWLRQ
LPSURYHPHQWVDQG IXQFWLRQDO DQGVWUXFWXUDO DGYDQFHV LQ9HUVLRQ RIWKH &RPPXQLW\ /DQG0RGHO
-RXUQDORI$GYDQFHVLQ0RGHOLQJ(DUWK6\VWHPV–
0DGLQ-%RZHUV66FKLOGKDXHU0.ULYRY63HQQLQJWRQ'DQG9LOOD) $QRQWRORJ\IRU
GHVFULELQJDQGV\QWKHVL]LQJHFRORJLFDOREVHUYDWLRQGDWD(FRORJLFDO,QIRUPDWLFV–
0DJXUUDQ $ ( %DLOOLH 6 5 %XFNODQG 6 7 'LFN - 0 (OVWRQ ' D 6FRWW ( 0 6PLWK 5 ,
6RPHUILHOG3-DQG:DWW$'/RQJWHUPGDWDVHWVLQELRGLYHUVLW\UHVHDUFKDQGPRQLWRULQJ
DVVHVVLQJFKDQJHLQHFRORJLFDOFRPPXQLWLHVWKURXJKWLPH7UHQGVLQHFRORJ\HYROXWLRQ–
5DVNLQ 5 * DQG 3DQ 0 - .QRZOHGJH UHSUHVHQWDWLRQ LQ WKH VHPDQWLF ZHE IRU HDUWK DQG
HQYLURQPHQWDOWHUPLQRORJ\VZHHW&RPSXWHUV*HRVFLHQFHV–
6FKLPHO'.HOOHU0%HUXNRII6.DR%/RHVFKHU+3RZHOO+.DPSH70RRUH'DQG*UDP
: 7KHQDWLRQDOHFRORJLFDOREVHUYDWRU\QHWZRUNVFLHQFHVWUDWHJ\HQDEOLQJFRQWLQHQWDO
VFDOHIRUHFDVWLQJ7HFKQLFDOUHSRUW1DWLRQDO(FRORJLFDO2EVHUYDWRU\1HWZRUN
9LOOD)$WKDQDVLDGLV,1DQG5L]]ROL$( 0RGHOOLQJZLWKNQRZOHGJH$UHYLHZRIHPHUJLQJ
VHPDQWLFDSSURDFKHVWRHQYLURQPHQWDOPRGHOOLQJ (QYLURQPHQWDO0RGHOOLQJ6RIWZDUH–
:DOOV5'HFN-*XUDOQLFN5%DVNDXI6%HDPDQ5%OXP6%RZHUV6%XWWLJLHJ3'DYLHV
1 (QGUHVHQ ' *DQGROIR 0 +DQQHU 5 -DQQLQJ $ .ULVKWDOND / 0DWVXQDJD $ 0LGIRUG
3 0RUULVRQ 1 27XDPD ( 6FKLOGKDXHU 0 6PLWK % 6WXFN\ % 7KRPHU $:LHF]RUHN -
:KLWDFUH-DQG:RROH\- 6HPDQWLFVLQ6XSSRUWRI%LRGLYHUVLW\.QRZOHGJH'LVFRYHU\$Q
,QWURGXFWLRQWRWKH%LRORJLFDO&ROOHFWLRQV2QWRORJ\DQG5HODWHG2QWRORJLHV3/R621(H
:KLWH(%DOGULGJH(%U\P=/RFH\.0F*OLQQ'DQG6XSS6 1LQHVLPSOHZD\VWR
PDNHLWHDVLHUWRUHXVH\RXUGDWD,GHDVLQ(FRORJ\DQG(YROXWLRQ–
3DJH