0355HIHUHQFH1R
7HDFKHU
/LFHQVXUH
([DPV+RZ'R
7KH\&RPSDUH"
0DUFK
'XQFDQ&KDSOLQ
6WHYHQ*OD]HUPDQ
*DLO%D[WHU
(OL]DEHWK6HLI
6XEPLWWHGWR
$PHULFDQ%RDUGIRU&HUWLILFDWLRQRI
7HDFKHU([FHOOHQFH
6WUHHW1:6XLWH
:DVKLQJWRQ'&
7HOHSKRQH
3URMHFW2IILFHU
-RVKXD%RRWV
WK
6XEPLWWHGE\
0DWKHPDWLFD3ROLF\5HVHDUFK,QF
0DU\ODQG$YH6:6XLWH
:DVKLQJWRQ'&
7HOHSKRQH )DFVLPLOH 3URMHFW'LUHFWRU
6WHYHQ*OD]HUPDQ
$&.12:/('*0(176
7KH DXWKRUV ZRXOG OLNH WR DFNQRZOHGJH WKH PDQ\ SHRSOH ZKR PDGH LPSRUWDQW
FRQWULEXWLRQV WR WKLV UHSRUW )LUVW -RVKXD %RRWV DQG 5HEHFFD .LPSRUW DW WKH $PHULFDQ
%RDUG IRU WKH &HUWLILFDWLRQ RI 7HDFKHU ([FHOOHQFH $%&7( JDYH XV GHWDLOHG LQIRUPDWLRQ
GHVFULELQJWKHLUSURJUDPGDWDRQWKHLUSDUWLFLSDQWVDQGWKHLQGHSHQGHQFHDQGIOH[LELOLW\WR
IDFLOLWDWHDULJRURXVVWXG\7KH\DOVRSURYLGHGXVHIXOIHHGEDFNRQDQHDUO\GUDIW6HFRQGZH
FRXOGQRWKDYHFRQGXFWHGWKHVWXG\ZLWKRXWWKHZLOOLQJQHVVRIPDQ\LQGLYLGXDOVZKRDJUHHG
WRSDUWLFLSDWHLQWKHVWXG\DQGFRPSOHWHOHQJWK\H[DPVIRUXV
:H DUH JUDWHIXO WR VHYHUDO FROOHDJXHV DW 0DWKHPDWLFD 3ROLF\ 5HVHDUFK 035 %ULDQ
5RII 3K\OOLV6FKDQFN-HVV\1D]DULR&KDUORWWH +DQVRQ7LP6LOPDQDQG -RKQ 4XLQODQDOO
FRQWULEXWHGWRUHFUXLWLQJSDUWLFLSDQWVDQGFROOHFWLQJDQGSURFHVVLQJGDWD.DWKHULQH%HQFLR
SURYLGHG H[FHOOHQW SURJUDPPLQJ DVVLVWDQFH $OOHQ 6FKLUP DQG &KULVWLQD 7XWWOH UHYLHZHG
GUDIWVRIWKHUHSRUW$QQH+LPPHOIDUE&DURO6REOHDQG'DU\O+DOOHGLWHGWKHUHSRUWDQG
WKHILQDOSURGXFWZDVSURIHVVLRQDOO\IRUPDWWHGE\'RQQD'RUVH\
&217(176
6HFWLRQ
$
%
&
'
(
3DJH
,1752'8&7,21 '$7$$1'0(7+2'6 5(68/76 ,6$%&7(3(5)250$1&($/,*1(':,7+35$;,63(5)250$1&(" D
E
F
6FDWWHU3ORWV 3DVV5DWHV 6FRUH&RUUHODWLRQV $5(7+($%&7((;$06025(',)),&8/7723$66" (;3/$,1,1*7+(5(68/76 :+$7(;3/$,167+(&255(/$7,216" D 7HVW7DNHU%DFNJURXQG E ([DP&RQWHQW F 7HVW)DWLJXHDQG0RWLYDWLRQ :+$7(;3/$,167+(5(/$7,9(',)),&8/7<2)7+((;$06" &21&/86,21 5()(5(1&(6 $33(1',;$35$;,6&876&25(6%<67$7( $33(1',;%68%*5283$1$/<6,62)3$665$7(6 $ ,1752'8&7,21
7HDFKHUOLFHQVXUHLVDPDMRULVVXHLQHGXFDWLRQUHIRUP'DUOLQJ+DPPRQGHWDO
%DOORXDQG3RGJXUVN\'HFNHUHWDO*ROGKDEHUDQG%UHZHU$WWKHKHDUW
RIPDQ\GHEDWHVRYHUOLFHQVXUHLVWKHXVHRIH[DPVWRFHUWLI\LQGLYLGXDOVWRWHDFK*ROGKDEHU
)RUPDQ\\HDUVVWDWHHGXFDWLRQDJHQFLHVDQGORFDOVFKRROGLVWULFWVKDYHXVHGH[DPV
WR PHDVXUH SURVSHFWLYH WHDFKHUV· NQRZOHGJH RI SHGDJRJ\ DQG VXEMHFW DUHDV EXW WKH\ KDYH
UDUHO\XVHGH[DPVFRUHVDVWKHVROHFULWHULRQLQOLFHQVXUHRUKLULQJGHFLVLRQV
$UHFHQWHQWU\LQWRWKHILHOGRIWHDFKHUWHVWLQJWKDWVHHNVWRSURYLGHDOWHUQDWLYHVWRWKH
FXUUHQW OLFHQVXUH SURFHVV LV WKH $PHULFDQ %RDUG IRU &HUWLILFDWLRQ RI 7HDFKHU ([FHOOHQFH
$%&7( $%&7(·V QRYHO SURSRVDO XVHV WHDFKHU H[DPV DV WKH FHQWHUSLHFH RI OLFHQVXUH
UHTXLULQJWKHVDPHSDVVLQJVFRUHFXWVFRUHQDWLRQZLGHWRFUHDWHDSRUWDEOHFUHGHQWLDONQRZQ
DV WKH 3DVVSRUW WR 7HDFKLQJ $%&7( KDV GHYHORSHG H[DPV LQ SHGDJRJ\ DQG VHYHUDO
VXEMHFWV EXW WKH H[DPV DUH VWLOO UHODWLYHO\ QHZ WKH\ ZHUH ILUVW UHOHDVHG LQ 6L[ VWDWHV
UHFRJQL]H $PHULFDQ %RDUG FHUWLILFDWLRQ DQG RWKHUV DUH FRQVLGHULQJ UHFRJQL]LQJ WKH
FUHGHQWLDO IRU DOWHUQDWLYH RU UHJXODU OLFHQVXUH EXW SROLF\PDNHUV ZLOO OLNHO\ UHTXLUH VROLG
HYLGHQFHRQYDOLGLW\DQGUHOLDELOLW\EHIRUHDGRSWLQJ$%&7(FHUWLILFDWLRQVPRUHZLGHO\
,Q VXPPHU $%&7( VHOHFWHG 0DWKHPDWLFD 3ROLF\ 5HVHDUFK ,QF 035 WR
FRQGXFWORQJLWXGLQDOUHVHDUFKRQWKHFHUWLILFDWLRQ SURJUDP·V HIIHFWLYHQHVV $VSDUW RI WKDW
HIIRUWZHFRQGXFWHGDVWXG\FRPSDULQJLQGLYLGXDOV·SHUIRUPDQFHRQWKH$%&7(H[DPV
ZLWKWKHLUSHUIRUPDQFHRQWKHPRUHZLGHO\XVHG3UD[LV,,WHDFKHUDVVHVVPHQWVDGPLQLVWHUHG
E\WKH(GXFDWLRQDO7HVWLQJ6HUYLFH(76ZKLFKZHUHIHUWRVLPSO\DVWKH3UD[LVWKURXJKRXW
WKLVUHSRUW :H IRFXVHG RQ WKUHH H[DPV RQH LQ SHGDJRJ\ DQG WZR LQ VXEMHFW DUHDV LQFOXGLQJ
´HOHPHQWDU\HGXFDWLRQµZKLFKLQFOXGHVPXOWLSOHVXEMHFWVVXFKDVPDWKUHDGLQJKLVWRU\DQG
VFLHQFH DQG VHFRQGDU\ PDWK 0DQ\ VWDWHV UHTXLUH WKDW WHDFKHU FDQGLGDWHV SDVV WKH 3UD[LV
YHUVLRQVRIWKHVHH[DPVDVSDUWRIFHUWLILFDWLRQ7KLUW\VHYHQVWDWHVUHTXLUHWKDWWHDFKHUVSDVV
DWOHDVWRQHRIWKH3UD[LVWHVWVFRYHUHGLQRXUVWXG\LQRUGHUWREHFHUWLILHGLQWKRVHVXEMHFWV
$OPRVW DOO RI WKHVH VWDWHV UHTXLUH WKH FRQWHQW H[DP IRU VHFRQGDU\ PDWK PRUH WKDQ KDOI
UHTXLUH WKH SHGDJRJ\ H[DP WKH 3ULQFLSOHV RI /HDUQLQJ DQG 7HDFKLQJ DQG UHTXLUH WKH
(OHPHQWDU\(GXFDWLRQ&RQWHQW([DP,QDOOFDVHVHDFKVWDWHVHWVWKH3UD[LVSDVVLQJVFRUH
ZKLFKYDULHVZLGHO\DFURVVVWDWHV
:HFRPSDUHGSHUIRUPDQFHRQHDFKRIWKHDERYH3UD[LVH[DPVWRSHUIRUPDQFHRQWKH
FRUUHVSRQGLQJ$%&7(H[DPV3URIHVVLRQDO7HDFKLQJ.QRZOHGJH(OHPHQWDU\(GXFDWLRQLQ
0XOWLSOH6XEMHFWVDQG6HFRQGDU\0DWK:HSDLGVSHFLDODWWHQWLRQWRWKHSHUIRUPDQFHOHYHOV
7KH 3UD[LV VHULHV RI WHDFKHU DVVHVVPHQWV LQFOXGHV 3UD[LV , ZKLFK FRYHUV EDVLF DFDGHPLF VNLOOV DQG LV
W\SLFDOO\ WDNHQ E\ WKRVH HQWHULQJ WHDFKHU SUHSDUDWLRQ SURJUDPV 3UD[LV ,, XVHG LQ WKLV VWXG\ ZKLFK FRYHUV
JHQHUDO DQG VXEMHFWVSHFLILF NQRZOHGJH DQG WHDFKLQJ VNLOOV DQG LV W\SLFDOO\ WDNHQ E\ WKRVH DERXW WR HQWHU WKH
WHDFKLQJSURIHVVLRQDQG3UD[LV,,,ZKLFKDVVHVVHVFODVVURRPSHUIRUPDQFHE\GLUHFWREVHUYDWLRQDQGLVW\SLFDOO\
JLYHQWRSUDFWLFLQJWHDFKHUV
UHODWLYHWRWKHFXWVFRUHVQHHGHGIRUSDVVLQJWKHVHH[DPV%HFDXVH3UD[LVFXWVFRUHVYDU\E\
VWDWH ZH H[DPLQHG WKH ORZHVW FXW VFRUH LQ WKH QDWLRQ OHDVW VWULQJHQW DQG WKH KLJKHVW FXW
VFRUHLQWKHQDWLRQPRVWVWULQJHQW 7KHJRDORIWKLVVWXG\LVWRXQGHUVWDQGWKHUHODWLRQVKLSEHWZHHQWKH3UD[LVDQG$%&7(
H[DPV6SHFLILFDOO\ZHVRXJKWWRDQVZHUWKHIROORZLQJUHVHDUFKTXHVWLRQV
,V SHUIRUPDQFH RQ WKH $%&7( H[DPV IRU PDWK HOHPHQWDU\ HGXFDWLRQ DQG
SHGDJRJ\ DOLJQHG ZLWK SHUIRUPDQFH RQ WKH FRUUHVSRQGLQJ 3UD[LV H[DPV" 7R
DGGUHVVWKLVTXHVWLRQZHH[DPLQHWKHVWDWLVWLFDODVVRFLDWLRQEHWZHHQWKHWZRVHWV
RIVFRUHV
$UHWKH$%&7(H[DPVPRUHGLIILFXOWWKDQWKHFRUUHVSRQGLQJ3UD[LVH[DPV"7R
DGGUHVVWKLVTXHVWLRQZHFRPSDUHSDVVUDWHVLHWKHSHUFHQWDJHVRIWKHVWXG\
VDPSOHWKDWVFRUHGDERYHHDFKRIWKHFXWVFRUHVVHWE\VWDWHVIRU3UD[LVDQGE\
$%&7(QDWLRQDOO\
:HIRXQGWKDWWKRVHZKRVFRUHGKLJKHURQ$%&7(H[DPVDOVRWHQGHGWRVFRUHKLJKHU
RQWKHFRUUHVSRQGLQJ3UD[LVH[DPV,QDGGLWLRQWHVWWDNHUVZKRSDVVHGWKH$%&7(H[DPV
ZHUHPRUHOLNHO\WRSDVVWKHFRUUHVSRQGLQJ3UD[LVH[DPVWKDQWKRVHZKRIDLOHGWKH$%&7(
H[DPV DOWKRXJK WKH DVVRFLDWLRQ ZDV QRW HTXDOO\ VWURQJ IRU DOO WKUHH WHVW VXEMHFWV 7KH
FRUUHODWLRQVEHWZHHQ$%&7(DQG3UD[LVVFRUHVZHUHIRUERWKWKHPDWKDQGHOHPHQWDU\
HGXFDWLRQVXEMHFWH[DPV7KHFRUUHODWLRQIRUSHGDJRJ\VFRUHVZDV
:HDOVRIRXQGWKDWIRUDWOHDVWVRPHVWDWHVWKH$%&7(H[DPVZHUHKDUGHUWRSDVVWKDQ
WKRVHWKHFRUUHVSRQGLQJ3UD[LVH[DPV)RUWKHHOHPHQWDU\VXEMHFWH[DPVQHDUO\DOORIRXU
VWXG\YROXQWHHUVSDVVHGWKH3UD[LVEDVHGRQWKHFXWVFRUHIRUWKHPRVWVWULQJHQWVWDWHEXW
RQO\DERXWSHUFHQWRIWKHPSDVVHGWKH$%&7(H[DPZKLFKVXJJHVWVWKDWWKH$%&7(
H[DPLVPRUHGLIILFXOWWRSDVV2QWKHPDWKDQGSHGDJRJ\H[DPVWKHSDVVUDWHVIRU$%&7(
WHVWV ZHUH LQ EHWZHHQ WKRVH IRU WKH 3UD[LV EDVHG RQ WKH FXW VFRUHV IRU WKH OHDVW DQG PRVW
VWULQJHQWVWDWHV
7KH UHVW RI WKLV UHSRUW SURYLGHV PRUH GHWDLO RQ WKH ILQGLQJV 6HFWLRQ % GHVFULEHV WKH
GDWD DQG DQDO\VLV PHWKRGV 6HFWLRQ & SUHVHQWV WKH PDLQ UHVXOWV 6HFWLRQ ' SUHVHQWV
DGGLWLRQDODQDO\VLVDQGGLVFXVVLRQWRDGGUHVVSRVVLEOHH[SODQDWLRQVIRUWKHILQGLQJV6HFWLRQ
(UHSRUWVRXUFRQFOXVLRQV
% '$7$$1'0(7+2'6
7RGHVFULEHWKHUHODWLRQVKLSVEHWZHHQWKHWZRVHWVRIH[DPVZHUHFUXLWHGYROXQWHHUVWR
WDNH ERWK VHWV RI H[DPV 5HFRJQL]LQJ WKDW WKH H[DPV DUH SRWHQWLDOO\ EXUGHQVRPH ZH
UHFUXLWHGFXUUHQWDQGSRWHQWLDOWHDFKHUVZKRKDGDOUHDG\WDNHQRUZHUHVFKHGXOHGWRWDNHRQH
6HH$SSHQGL[$IRUWKHVWDWHVWKDWZHUHOHDVWDQGPRVWVWULQJHQWE\VXEMHFWDVZHOODVHDFKVWDWH·VFXW
VFRUH
RU ERWKVHWVRIH[DPVDQGWKHQJDYH WKHP PRQHWDU\LQFHQWLYHV WRFRPSOHWHWKHDGGLWLRQDO
H[DPVQHHGHGWRKDYHPDWFKHGSDLUV:HGLGQRWUHTXLUHVWXG\SDUWLFLSDQWVWRWDNHWHVWVLQ
PRUHWKDQRQHRIWKHWKUHHDUHDVPDWKHOHPHQWDU\HGXFDWLRQRUSHGDJRJ\EXWPDQ\WRRN
WKH SHGDJRJ\ H[DP DQG RQH RI WKH VXEMHFW H[DPV PDWK RU HOHPHQWDU\ HGXFDWLRQ 1RQH
WRRN DOO WKUHH SDLUV EHFDXVH WHDFKHU FDQGLGDWHV GR QRW W\SLFDOO\ VHHN FHUWLILFDWLRQ LQ ERWK
VHFRQGDU\PDWKDQGHOHPHQWDU\HGXFDWLRQ
7DEOHGHVFULEHVWKHWHVWVXVHGLQRXUVWXG\7KHUHDUHWZR3UD[LVH[DPVIRUSHGDJRJ\
RQHIRUHOHPHQWDU\WHDFKHUVDQGRQHIRUVHFRQGDU\WHDFKHUVEXWZHJURXSHGWKHPWRJHWKHU
IRUPRVWRIRXUDQDO\VHVDVVWDWHVXVHVLPLODUFXWVFRUHVIRUWKHWZRWHVWVDQG$%&7(XVHV
RQH SHGDJRJ\ WHVW IRU ERWK HOHPHQWDU\ DQG VHFRQGDU\ WHDFKHUV 7KH $%&7( SHGDJRJ\
H[DP LQFOXGHV ERWK ZULWLQJ DQG PXOWLSOHFKRLFH VHFWLRQV 7KLV UHSRUW IRFXVHV RQ WKH
PXOWLSOHFKRLFH VHFWLRQ RI WKH $%&7( SHGDJRJ\ H[DP EXW ZH FRQGXFWHG DQDO\VHV WKDW
LQFRUSRUDWHWKHZULWLQJSDUWDVZHOO
7KH VWXG\ SDUWLFLSDQWV ZHUH YROXQWHHUV ZKRP ZH UHFUXLWHG IURP WZR SRROV 7KH ILUVW
SRROFRQVLVWHGRILQGLYLGXDOVZKRWRRNWKH$%&7(H[DPRQWKHLURZQ:HUHFUXLWHGWKHVH
SHRSOH WR WDNH WKH FRUUHVSRQGLQJ 3UD[LV H[DPV 7KH\ WHQGHG WR EHHLWKHU FDUHHUFKDQJHUV
VHHNLQJ $%&7( FHUWLILFDWLRQ LQ RUGHU WR HQWHU WHDFKLQJ RU H[LVWLQJ WHDFKHUV VHHNLQJ
FHUWLILFDWLRQLQDQHZVXEMHFWDUHD7KHVHFRQGSRRORISDUWLFLSDQWVWRRND3UD[LVH[DPRQ
WKHLU RZQ :H UHFUXLWHG WKHVH SHRSOH WR WDNH WKH FRUUHVSRQGLQJ $%&7( H[DPV 7KH\
WHQGHGWREHVWXGHQWVRUUHFHQWJUDGXDWHVRIWUDGLWLRQDOVFKRROVRIHGXFDWLRQ Table 1. Tests and Sample Sizes by Subject
Number of
a
Test Takers
Subject
Praxis
ABCTE
Math
Math: Content Knowledge
Math (for secondary math
teachers)
39
Elementary
Elementary Education: Content Multiple Subject Exam (for
Knowledge
elementary education)
57
Pedagogy
Principles of Learning and
The Professional Teaching
Teaching (PLT) for Grades K–6 Knowledge (PTK) Multiple
and PLT for Grades 7–12
Choice Test
58
a
Some test takers completed more than one pair of exams. There were 104 test takers in total.
7DEOHGHVFULEHVRXUVDPSOHEDVHG RQ DEDFNJURXQG LQIRUPDWLRQIRUP FRPSOHWHGE\
SDUWLFLSDQWV 7KH WHVW WDNHUV DUH PRVWO\ ZKLWH DQGPRVWO\ IHPDOH 7KH\ KDYH KLJKFROOHJH
JUDGHSRLQWDYHUDJHVDQGKLJKOHYHOVRIHGXFDWLRQ-XVWRYHURQHTXDUWHUZHUHVWLOODWWHQGLQJ
7KH VHFRQG JURXS LQFOXGHV VL[ SUDFWLFLQJ WHDFKHUV ZKR WRRN DQ $%&7( H[DP IRU D SUHYLRXV VWXG\
%RRWVDQGZKRKDGDOUHDG\WDNHQWKHFRUUHVSRQGLQJ3UD[LVH[DPEHIRUHWKDW
FROOHJHRUJUDGXDWHVFKRRO$OPRVWKDOIZHUHWHDFKLQJZKHQWKH\SDUWLFLSDWHGLQWKHVWXG\
$OPRVWWZRWKLUGVRIWKHVDPSOHPHPEHUVZHUHLQWKHILUVWSRRORIUHFUXLWVGHVFULEHGDERYH
LQ RWKHU ZRUGV WKH\ WRRN WKH $%&7( H[DPV RQ WKHLU RZQ DQG WKHQ FRPSOHWHG WKH
FRUUHVSRQGLQJ3UD[LVH[DPVIRUWKLVVWXG\7KHUHVWRIWKHSDUWLFLSDQWVZHUHLQWKHVHFRQG
JURXS LQ RWKHU ZRUGV WKH\ WRRN WKH 3UD[LV H[DPV RQ WKHLU RZQ DQG WKHQ FRPSOHWHG WKH
$%&7(H[DPVIRUWKLVVWXG\RUDSUHYLRXVVWXG\
Table 2. Background Characteristics of Sample
Characteristic
Mean
Gender (percent female)
Race/ethnicity
White
Black
Other
Age (years)
Attending college or graduate school
Grade-point average in college (on a scale of 0 to 4)
Earned master’s degree or other graduate degree
Currently teaching
Parent education
Mother earned bachelor’s degree
Father earned bachelor’s degree
At least one parent worked in education
Exam taken only for this study
Praxis
ABCTE
Neither (took ABCTE for previous study)
Sample size
66.3
a
76.0
14.4
9.6
35.2
26.0
3.3
20.2
46.1
44.2
46.2
27.9
63.5
30.8
5.8
104
a
Numbers are percentages unless otherwise indicated and may not sum to 100 because of
rounding.
,W LV LPSRUWDQW WR NHHS LQ PLQG WKUHH PHWKRGRORJLFDO FRQFHUQV ZKHQ LQWHUSUHWLQJ RXU
VWXG\ILQGLQJV)LUVWRXUVDPSOHRIWHVWWDNHUVPD\QRWEHUHSUHVHQWDWLYHRIDSRSXODWLRQRI
LQWHUHVW6HFRQGWKHHODSVHGWLPHEHWZHHQHDFKSHUVRQ·VFRPSOHWLRQRIWKHWZRWHVWVPD\
DIIHFWUHODWLYHSHUIRUPDQFH)LQDOO\WKHLQFHQWLYHVIRUSHUIRUPLQJZHOORQWKHWZRW\SHVRI
WHVWV PD\ GLIIHU LQ LPSRUWDQW ZD\V :H WRRN VWHSV WR OLPLW WKH LQIOXHQFH RI HDFK RI WKHVH
LVVXHVDQGFRQGXFWHGDQDO\VHVWRDGGUHVVWKHPWRWKHH[WHQWSRVVLEOH:HDOVRWRRNWKHVH
LVVXHV LQWR DFFRXQW ZKHQ SUHVHQWLQJ WKH RYHUDOO VWXG\ ILQGLQJV :H GLVFXVV WKH WKUHH
FRQFHUQVEHORZ
)LUVWDSRVVLEOHFRQFHUQLVWKDWDVDPSOHRIYROXQWHHUVPD\QRWEHUHSUHVHQWDWLYHRIWKH
PDLQ SRSXODWLRQVRILQWHUHVWWUDGLWLRQDOWHDFKHU FDQGLGDWHVRUFDQGLGDWHVZKR ZRXOGOLNHO\
XVHWKHFHUWLILFDWLRQURXWHSURYLGHGE\$%&7()RUH[DPSOHWKHVWXG\YROXQWHHUVPD\KDYH
D GLIIHUHQW GLVWULEXWLRQ RI NQRZOHGJH RU WHVWWDNLQJ VNLOOV WKDQ WKH WDUJHW SRSXODWLRQ
+RZHYHU E\ UHFUXLWLQJ WHDFKHU FDQGLGDWHV ZLWK D UDQJH RI DELOLWLHV DQG SUHSDUDWLRQ
EDFNJURXQGVDQGUHTXLULQJWKDWWKHFDQGLGDWHVKDGDOUHDG\WDNHQRUZHUHVFKHGXOHGWRWDNH
RQHRIWKHWZRH[DPW\SHVZHZHUHDEOHWREXLOGDGLYHUVHDQGUHDOLVWLFVDPSOHWKDWFRYHUV
WKHUDQJHRIOLNHO\WHVWWDNLQJDELOLWLHV(YHQLQWKHFDVHRIVRPHGLIIHUHQFHVIURPDQLGHDO
WDUJHWSRSXODWLRQLWLVXQOLNHO\WKDWWKHGLIIHUHQFHVPDWWHUEHFDXVHZHDUHPDLQO\FRQFHUQHG
ZLWK WKHSHUIRUPDQFHRQWKH$%&7(H[DP UHODWLYHWRWKH 3UD[LV QRW DEVROXWHOHYHOV 2XU
VDPSOHPHPEHUVZRXOGKDYHWREHLGLRV\QFUDWLFLQWKHLUUHODWLYHDELOLWLHVRQWKHWZRWHVWVLQ
RUGHU IRU VWXG\ VDPSOH UHFUXLWPHQW WR LQWURGXFH ELDV )XUWKHUPRUH ZH SUREHG RXU GDWD
GLUHFWO\ DQG IRXQG WKDW DFFRXQWLQJ IRU WHVWWDNHU FKDUDFWHULVWLFV GLG QRW FKDQJH WKH UHVXOWV
)RU H[DPSOH ZH IRXQG QR VWDWLVWLFDOO\ VLJQLILFDQW GLIIHUHQFHV LQ WKH $%&7(3UD[LV
FRUUHODWLRQVE\UDFHRUJHQGHUIRUDQ\RIWKHWHVWVVWXGLHG
$ VHFRQG SRWHQWLDO FRQFHUQ LV WKDW WKH WLPLQJ RI WKH WHVWV PD\ KDYH DIIHFWHG UHODWLYH
SHUIRUPDQFHOHYHOVREVHUYHGLQRXUVWXG\,IWKHWZRH[DPVDUHQRWWDNHQVLPXOWDQHRXVO\
WKHQ WKH GLIIHUHQFH LQ VFRUHV RU SDVV UDWHV PD\ UHIOHFW PRUH WKDQ GLIIHUHQFH LQ GLIILFXOW\
ZKLFKLVZKDWZHDUHWU\LQJWRPHDVXUHLQWKLVVWXG\EXWDOVRFKDQJHVLQWHDFKHUNQRZOHGJH
RYHU WLPH DV WKH\ JDLQ H[SHULHQFH RU WKHLU UHFROOHFWLRQ RI IDFWV IDGHV 7R PLWLJDWH WKLV
SUREOHP ZH FKRVH RQO\ FDQGLGDWHV ZKR WRRN WKH H[DPV XVHG LQ RXU VWXG\ GXULQJ WKH PRQWK SHULRG EHWZHHQ 6HSWHPEHU DQG 'HFHPEHU 7KH DYHUDJH WLPH
HODSVHGEHWZHHQSDLUVRIPDWFKHGWHVWVZDVVL[PRQWKVIRUWKHZKROHVDPSOHDERXWHLJKWRU
QLQH PRQWKV IRU WKH FDQGLGDWHV ZKR WRRN WKH $%&7( WHVW IRU D VWXG\ HLWKHU WKH SUHVHQW
VWXG\RU%RRWVDQGDERXWWKUHHRUIRXUPRQWKVIRUWKRVHZKRWRRNWKH3UD[LVWHVWIRU
WKHSUHVHQWVWXG\7DEOHVXPPDUL]HVWKHQXPEHURIGD\VEHWZHHQDGPLQLVWUDWLRQRIWKH
WZRWHVWVGHSHQGLQJRQZKHWKHUSDUWLFLSDQWVWRRNWKH$%&7(RU3UD[LVH[DPIRUDVWXG\
Table 3. Elapsed Time between Completion of Exams
Test Taken for Study
ABCTE
Praxis
Subject
N
Median Days since Praxis
Math
15
287
24
106
Elementary education
15
252
42
95
Pedagogy
13
259
45
100
N
Median Days since ABCTE
7KHWKLUGSRWHQWLDOFRQFHUQUHODWHVWRWKHSRVVLELOLW\RIXQHTXDOHIIRUWRQWKHWZRW\SHV
RI H[DPV RQO\ RQH RI ZKLFK ZDV FRPSOHWHG DV SDUW RI D UHVHDUFK VWXG\ DQG WKH RWKHU RI
ZKLFKZDVWDNHQIRUSURIHVVLRQDOUHDVRQV7KDWLVDWHVWVFRUHFDQEHLQIOXHQFHGQRWRQO\E\
DWHVWWDNHU·VVNLOOVEXWDOVRE\WKHWHVWWDNHU·VHIIRUWLQSUHSDULQJIRUWKHWHVWDQGWKHLUHIIRUW
RQ WHVWWDNLQJ GD\ 7R D JHW D WUXH FRPSDULVRQ RI WKH $%&7( DQG 3UD[LV WHVW WDNHUV·
NQRZOHGJHDQGVNLOOVZHKDYHWRDVVXPHWKDWWHVWWDNHUVH[HUWHGHTXDOHIIRUWRQERWKWHVWV
,QRXUVWXG\WHVWWDNHUVZLOOKDYHEHHQPRWLYDWHGE\WKHSURVSHFWRIDGYDQFLQJWKHLUFDUHHUV
RQ RQH WHVWEXWQRWRQ WKHRWKHU 7R KHOSHTXDOL]H HIIRUW OHYHOVZH RIIHUHGLQFHQWLYHV RI
WRSHUWHVWWDNHQIRURXUVWXG\EDVHGRQWKHVFRUHREWDLQHG :HDOVRDGGUHVVHG
WKHSUREOHPRIXQHTXDOHIIRUWE\UHFUXLWLQJVDPSOHPHPEHUVZKRPLJKWEHDEOHWRXVHWKH
WHVWWDNHQIRUWKHVWXG\IRUSXUSRVHVRIDGYDQFLQJWKHLUFDUHHU)RUH[DPSOHZHUHFUXLWHG
YROXQWHHUVIRU3UD[LVWHVWLQJRI$%&7(FDQGLGDWHVPRUHKHDYLO\LQVWDWHVWKDWUHTXLUH3UD[LV
IRU WHDFKLQJ SRVVLEO\ JLYLQJ WKRVH WHVW WDNHUV UHDOZRUOG LQFHQWLYHV RQ ERWK H[DPV ,Q
DGGLWLRQ WR DGGUHVV WKH LVVXH RI XQHTXDO HIIRUW ZH UHSHDWHG WKH DQDO\VLV IRU VXEJURXSV
GHILQHGE\WKHWHVWWKH\WRRNIRUWKHVWXG\DQGIRXQGQRFKDQJHLQWKHPDLQILQGLQJV
& 5(68/76
7KLV VHFWLRQ SUHVHQWV UHVXOWV IRU WKH WZR PDLQ UHVHDUFK TXHVWLRQV ZKLFK DGGUHVV WKH
DVVRFLDWLRQEHWZHHQWKH3UD[LVDQG$%&7(VFRUHVDQGWKHUHODWLYHGLIILFXOW\RISDVVLQJWKH
WZRH[DPV
,V$%&7(3HUIRUPDQFH$OLJQHGZLWK3UD[LV3HUIRUPDQFH"
7RDQVZHUWKLVTXHVWLRQZHH[DPLQHGWKHGHJUHHWRZKLFKVFRUHVRQWKHWZRW\SHVRI
H[DPVZHUHDVVRFLDWHG:HSUHVHQWWKHGDWDLQWKUHHZD\VE\SORWWLQJWKHPRQDVLPSOH
VFDWWHUSORWE\H[DPLQLQJWKHSHUFHQWDJHVRIVDPSOHPHPEHUVZKRSDVVHGERWKH[DPVRU
IDLOHG ERWK H[DPV DQG E\ H[DPLQLQJ WKH FRUUHODWLRQV EHWZHHQ WKH $%&7( DQG 3UD[LV
VFRUHV
D 6FDWWHU3ORWV
3ORWWLQJ 3UD[LV VFRUHV DJDLQVW $%&7( VFRUHV )LJXUHV WKURXJK LV WKH PRVW GLUHFW
ZD\WRLOOXVWUDWHKRZWKHWZRVFRUHVDUHUHODWHG(DFKSRLQWRQWKHJUDSKUHSUHVHQWVDSDLURI
VFRUHVIRUDVLQJOHWHVWWDNHU,IWKHWZRH[DPVZHUHSHUIHFWO\FRUUHODWHGDOOWKHSRLQWVZRXOG
OLHRQDVWUDLJKWOLQH7KHVFRUHVQHHGHGWRSDVVHDFKH[DPDUHVKRZQZLWKKRUL]RQWDODQG
YHUWLFDOGRWWHGOLQHV$%&7(KDVRQHQDWLRQDOFXWVFRUHIRUHDFKRIWKHWKUHHWHVWV7KHFXW
VFRUHVIRU3UD[LVYDU\E\VWDWHWKHUHIRUHZHVKRZRQO\WKHORZHVWDQGKLJKHVWFXWVFRUHVLQ
WKH QDWLRQ 6WDWHVSHFLILF FXW VFRUHV OLVWHG LQ $SSHQGL[ $ DUH IDLUO\ HYHQO\ GLVWULEXWHG
DFURVVVWDWHVUHTXLULQJ3UD[LV :HRIIHUHGIRUFRPSOHWLQJWKHH[DPSOXVDSHUIRUPDQFHLQFHQWLYHWKDWZDVWLHGWRWKHLQGLYLGXDO·V
VFRUHUHODWLYHWRVFRUHVRIRWKHUWHVWWDNHUVSDUWLFLSDWLQJLQWKHVWXG\DSSUR[LPDWHO\SHUSHUFHQWLOHSRLQW
7KRVHZKRKDGSDUWLFLSDWHGLQWKHHDUOLHUVWXG\%RRWVUHFHLYHGVLPLODUSHUIRUPDQFHLQFHQWLYHV
:H REWDLQHG WKH $%&7( SDVVLQJ VFRUHV IURP WKH $%&7( :HE VLWH LQ 'HFHPEHU KWWSZZZDEFWHRUJKHOSSDVVSRUWH[DP:HREWDLQHGWKHGDWDRQ3UD[LVSDVVLQJVFRUHVE\VWDWHIURPWKH
(76:HEVLWHKWWSZZZHWVRUJLQ'HFHPEHU
)LJXUHVKRZVWKHUHVXOWVIRUPDWK7KHGDWDSRLQWVWHQGWROLQHXSDORQJDSRVLWLYHO\
VORSHGOLQHLQGLFDWLQJDSRVLWLYHOLQHDUDVVRFLDWLRQ)XUWKHUPRUHHYHU\RQHZKRSDVVHGWKH
$%&7( WHVW SRLQWV O\LQJ WR WKH ULJKW RI WKH YHUWLFDO GRWWHG OLQH DOVR VFRUHG DERYH WKH
ORZHVW3UD[LVFXWVFRUHKRUL]RQWDOGRWWHGOLQHODEHOHG´$5µIRU$UNDQVDV$ODUJHQXPEHU
RIWKRVHZKRIDLOHGWKH$%&7(WHVWSRLQWVO\LQJWRWKHOHIWRIWKHYHUWLFDOGRWWHGOLQHDOVR
H[FHHGHGWKHORZHVW3UD[LVFXWVFRUHDQGRQHWHVWWDNHUZKRIDLOHGWKH$%&7(VFRUHGKLJK
HQRXJKWRSDVVWKH3UD[LVLQWKHVWDWHZLWKWKHKLJKHVWFXWVFRUH&RORUDGR
)LJXUHVKRZVWKHUHVXOWVIRUHOHPHQWDU\HGXFDWLRQ$JDLQWKHGDWDSRLQWVDSSHDUWROLH
DORQJDSRVLWLYHO\VORSHGOLQH,QWKLVFDVHDOOWHVWWDNHUVZKRSDVVHGWKH$%&7(WHVWDOVR
VFRUHGKLJKHQRXJKWRSDVVWKH3UD[LVH[DPEDVHGRQWKHPRVWVWULQJHQW3UD[LVFXWVFRUHLQ
WKH QDWLRQ 0LVVLVVLSSL 2Q WKH RWKHU KDQG PRVW RI WKRVH ZKR IDLOHG WKH $%&7( DOVR
VFRUHG KLJK HQRXJK WR PHHW RU H[FHHG WKH PRVW VWULQJHQW 3UD[LV FXW VFRUH D ILQGLQJ ZH
GLVFXVVEHORZ
7KH VFRUHV IRU WKH SHGDJRJ\ H[DPV )LJXUH GR QRW GHPRQVWUDWH WKH SDWWHUQ RI
SRVLWLYHOLQHDUDVVRFLDWLRQIRXQGIRUWKHRWKHUWZRVXEMHFWV1RWDEO\WKHWZRORZHVWVFRULQJ
WHVW WDNHUV RQ WKH 3UD[LV VFRUHG KLJK HQRXJK WR SDVV WKH $%&7( H[DP E\ PRUH WKDQ SRLQWV(YHQLIWKHWZRORZHVW3UD[LVVFRUHUVZHUHWUHDWHGDVRXWOLHUVDQGUHPRYHGIURPWKH
VDPSOHWKHUHODWLRQVKLSZRXOGDSSHDUZHDN
E 3DVV5DWHV
7HVW WDNHUV LQ RXU VWXG\ ZKR SDVVHG WKH $%&7( H[DP JHQHUDOO\ SDVVHG WKH
FRUUHVSRQGLQJ3UD[LVH[DPDWDKLJKHUUDWH WKDQ WKRVHZKR IDLOHGWKH$%&7( H[DP )RU
H[DPSOHDVVKRZQLQWKHILUVWURZRI7DEOHSHUFHQWRIWKRVHZKRIDLOHGWKH$%&7(
PDWKH[DPVWLOOSDVVHGWKHFRUUHVSRQGLQJ3UD[LVH[DPEDVHGRQWKHOHDVWVWULQJHQWVWDWH·VFXW
VFRUH ,Q FRPSDULVRQ DOO RI WKRVH ZKR SDVVHG WKH $%&7( PDWK H[DP DOVR SDVVHG WKH
3UD[LVPDWKH[DPEDVHGRQWKHOHDVWVWULQJHQWVWDWH·VFXWVFRUH7KHVHFRQGURZRI7DEOH
VKRZV WKH SDVV UDWHV RQ WKH VDPH H[DP 3UD[LV PDWK RQFH ZH DSSO\ WKH PRVW VWULQJHQW
VWDWH·VVWDQGDUGVRWKHUDWHVDUHORZHU
,I WKH $%&7( H[DP ZHUH SHUIHFWO\ DOLJQHG ZLWK WKH FRUUHVSRQGLQJ 3UD[LVH[DP WKHQ
WKRVHZKRIDLOHGWKH$%&7(ZRXOGDOZD\VIDLOWKH3UD[LVPDNLQJDOOWKHQXPEHUVLQWKHILUVW
FROXPQRI7DEOHHTXDO WR$WWKHVDPHWLPH WKRVHZKRWKRVHZKRSDVV WKH$%&7(
ZRXOGDOVRSDVVWKH3UD[LVPDNLQJWKHYDOXHVLQWKHVHFRQGFROXPQHTXDOWRSHUFHQWDQG
DOOWKHGLIIHUHQFHVLQWKHODVWFROXPQ,IWKHH[DPVZHUHFRPSOHWHO\XQUHODWHGWKHQZH
ZRXOGH[SHFWWKHQXPEHUVLQHDFKFROXPQWREHDSSUR[LPDWHO\WKHVDPHDQGWKHGLIIHUHQFHV
QHDU7KHODUJHUWKHGLIIHUHQFHWKHJUHDWHULVWKHSUHGLFWLYHSRZHURIWKH$%&7(H[DP
Table 4. Is Passing ABCTE Associated with Passing Praxis?
Percent Passing Praxis
If Failed
ABCTE
If Passed
ABCTE
Subject
Praxis Cut Score
Difference
Math
Least stringent
Most stringent
78
6
100
52
22*
44*
Elementary
Least stringent
Most stringent
96
78
100
100
4
22*
Pedagogy
Least stringent
Most stringent
100
54
96
64
-4
10
*Significantly different from 0 at the .05 level, two-tailed test.
:H IRXQG WKDW WKH GLIIHUHQFHV LQ SDVV UDWHV IRU WKRVH ZKR SDVVHG YHUVXV WKRVH ZKR
IDLOHGWKH$%&7(H[DPZHUHSRVLWLYHJUHDWHUWKDQIRUILYHRIWKHVL[FRPSDULVRQVPDGH
LQ7DEOHDQGVWDWLVWLFDOO\VLJQLILFDQWIRUWKUHHRIWKHP7KLVILQGLQJVXJJHVWVWKDWSDVVLQJ
WKH$%&7(H[DPLVDVVRFLDWHGZLWKSDVVLQJWKH3UD[LVH[DP)RUH[DPSOHE\FRPSDULQJ
WKHSDVVUDWHRIWKH$%&7(PDWKH[DPWRWKHSDVVUDWHRIWKH3UD[LVPDWKH[DPLQWKHVWDWH
ZKHUH SDVVLQJLVHDVLHVWILUVWURZRI7DEOHZHIRXQGWKDWWKHSDVVUDWHVGLIIHUHGE\
SRLQWV SHUFHQW YHUVXV SHUFHQW :H IRXQG VLPLODU RU ODUJHU GLIIHUHQFHV ZKHQ ZH
H[DPLQHGWKHKLJKHVWFXWVFRUHIRUPDWKRUWKHKLJKHVWFXWVFRUHIRUHOHPHQWDU\VXEMHFWV,Q
VWDWHV ZLWK ORZ 3UD[LV FXW VFRUHV ZKHUH QHDUO\ HYHU\RQH SDVVHV WKH $%&7( FDQQRW EH
SUHGLFWLYHEHFDXVHWKHUHLVOLWWOHYDULDWLRQWRSUHGLFW7KLVLVWUXHRIWKHHOHPHQWDU\HGXFDWLRQ
H[DPZKLFKKDGDKLJKSDVVUDWHHYHQXVLQJWKHVWDQGDUGRIWKHPRVWVWULQJHQWVWDWH7KH
UHVXOWV IRU SHGDJRJ\ VXJJHVW WKDW WKH $%&7( LV QRW SUHGLFWLYH RI 3UD[LV VFRUHV EHFDXVH D
ODUJHSHUFHQWDJHRIWKHVDPSOHKDGWKHVDPHUHVXOWSDVVHGWKH$%&7(SHGDJRJ\H[DP
F 6FRUH&RUUHODWLRQV
7DEOHIRFXVHVRQSDVVUDWHVRQO\DQGWKHUHE\LJQRUHVYDULDWLRQLQSHUIRUPDQFHDERYH
DQG EHORZ WKH FXW VFRUHV 7R PDNH XVH RI WKH DGGLWLRQDO LQIRUPDWLRQ FRQYH\HG E\ WKH
VFRUHV 7DEOHSUHVHQWV FRUUHODWLRQVEHWZHHQWKHWHVWVFRUHVWKHPVHOYHV 7KHFRUUHODWLRQV
DUH VWDWLVWLFDOO\VLJQLILFDQWIRUDOOWKUHHWHVWV 7KH VFRUHFRUUHODWLRQIRUWKH SHGDJRJ\H[DP
LVVPDOOHUWKDQWKDWIRUWKHPDWKRUHOHPHQWDU\HGXFDWLRQH[DPVERWK $KLJK
FRUUHODWLRQWHQGVWRVXSSRUWWKHYLHZWKDWWKH$%&7(H[DPFDQVHUYHDVDVXEVWLWXWHIRUWKH
FRUUHVSRQGLQJ3UD[LVH[DP
Table 5. Correlations between ABCTE and Praxis Scores
Subject
Correlation
Math
0.73
Elementary
0.73
Pedagogy
0.30
Number of Test Takers
*
39
*
57
*
58
*Significantly different from zero at the .05 level, two-tailed test.
$UHWKH$%&7(([DPV0RUH'LIILFXOWWR3DVV"
7R DGGUHVV ZKHWKHU WKH $%&7( H[DPV DUH PRUH GLIILFXOW WR SDVV WKDQ WKH
FRUUHVSRQGLQJ3UD[LVH[DPVZHFRPSDUHGWKHSHUFHQWDJHVRIWKHVWXG\VDPSOHWKDWVFRUHG
DERYH HDFK RI WKH FXW VFRUHV VHW E\ VWDWHV IRU 3UD[LV DQG E\ $%&7( QDWLRQDOO\ 7KH
HYLGHQFHVXJJHVWVWKDWLQDWOHDVWVRPHVWDWHV³WKRVHZLWKWKHORZHVWFXWVFRUHV³DOOWKUHH
$%&7(H[DPVDUHPRUHGLIILFXOWWRSDVVWKDQWKH3UD[LVH[DPVIRUWKHVXEMHFWVZHVWXGLHG
)LJXUHVKRZVWKHSHUFHQWDJHRIWHVWWDNHUVSDVVLQJHDFKH[DP7KHSDVVUDWHVIRUWKH
3UD[LVH[DPVDUHEDVHGRQWKHKLJKHVWDQGORZHVWVWDWHFXWVFRUHV$KLJKHUSDVVUDWHWDOOHU
EDUVXJJHVWVWKDWWKHH[DPLVOHVVGLIILFXOWWRSDVVDQGDORZHUSDVVUDWHVKRUWHUEDUVXJJHVWV
WKDWWKHH[DPLVPRUHGLIILFXOW
)RUPDWKDQGSHGDJRJ\WKHSDVVUDWHVIRUWKH$%&7(WHVWVDUHEHWZHHQWKH3UD[LVSDVV
UDWHV EDVHG RQ WKH VWDWHV ZLWK WKH KLJKHVW DQG ORZHVW FXW VFRUHV DOWKRXJK WKH SHGDJRJ\
GLIIHUHQFHEDVHGRQWKHPRVWVWULQJHQWVWDWH·VFXWVFRUHLVQRWVWDWLVWLFDOO\VLJQLILFDQW 7KH
RWKHU GLIIHUHQFHVDUHDOOVWDWLVWLFDOO\VLJQLILFDQW)RUWKHHOHPHQWDU\WHVWVWKH$%&7(SDVV
$VZLWKDOODQDO\VHVLQWKLVUHSRUW7DEOHSUHVHQWVWKHFRUUHODWLRQIRUWKHSHGDJRJ\H[DPUHJDUGOHVVRI
ZKHWKHUWKHSDUWLFLSDQWFRPSOHWHGWKHHOHPHQWDU\RUVHFRQGDU\YHUVLRQRIWKH3UD[LV3/7H[DP:KHQZH
DQDO\]H WKH HOHPHQWDU\ DQG VHFRQGDU\ YHUVLRQV VHSDUDWHO\ ZH REVHUYH FRUUHODWLRQV RI DQG UHVSHFWLYHO\:HDOVRH[DPLQHGFRUUHODWLRQVRIUDQNVDVDUREXVWQHVVWHVWDQGIRXQGVLPLODUUHVXOWVFRUUHODWLRQV
RIIRUPDWKDQGHOHPHQWDU\HGXFDWLRQDQGIRUSHGDJRJ\
:KHQ ZH FDOFXODWHG WKH VWDWLVWLFDO VLJQLILFDQFH RI GLIIHUHQFHV LQ SDVV UDWHV ZH DFFRXQWHG IRU WKH
FRYDULDQFHEHWZHHQSHUIRUPDQFHVRQWKHSDLUVRIH[DPV
UDWHZDVVLJQLILFDQWO\ORZHUWKDQIRU3UD[LVLQDOOVWDWHVVXJJHVWLQJWKDWWKH$%&7(H[DPLV
KDUGHUWRSDVV
Figure 4
Pass Rates by Test Subject, Test Type, and Praxis Passing Cut-Score
100
Pass
Rate
*
*
*
*
80
60
40
*
20
0
Praxis ABCTE Praxis
(Least
(Most
Stringent)
Stringent)
Math
Praxis ABCTE Praxis
(Least
(Most
Stringent)
Stringent)
Praxis ABCTE Praxis
(Least
(Most
Stringent)
Stringent)
Elementary Education
Pedagogy
*Significantly different from the ABCTE pass rate at the .05 level, two-tailed test.
7KH SDVV UDWHV LQ )LJXUH LJQRUH LQIRUPDWLRQ RQ YDULDWLRQ LQ WHVW VFRUHV DERYH DQG
EHORZ WKH FXW VFRUHV 7R PDNH XVH RI LQIRUPDWLRQ RQ VXFK YDULDWLRQ ZH DOVR DQDO\]HG
GLIIHUHQFHVEHWZHHQVFRUHVRQWKH3UD[LVDQG$%&7(VFRUHVDIWHUVWDQGDUGL]LQJWKHPWRD
FRPPRQVFDOH7KHSDWWHUQVIURPWKDWDQDO\VLVSUHVHQWHGLQ$SSHQGL[%ZHUHVLPLODUWR
WKRVHSUHVHQWHGLQ)LJXUH
' (;3/$,1,1*7+(5(68/76
7R FRQYH\ D EHWWHU XQGHUVWDQGLQJ RI WKH UHVXOWV SUHVHQWHG DERYH ZH FRQGXFWHG
VXSSOHPHQWDO DQDO\VHV 7KH VXSSOHPHQWDO DQDO\VHV WU\ WR H[SODLQ WKH $%&7(3UD[LV VFRUH
FRUUHODWLRQV DQG ZK\ WKH FRUUHODWLRQV GLIIHU E\ VXEMHFW PDWWHU DV ZHOO DV WKH UHODWLYH
GLIILFXOW\RIWKHH[DPV
:KDW([SODLQVWKH&RUUHODWLRQV"
6HYHUDO IDFWRUV PLJKW H[SODLQ WKH VWUHQJWK RI WKH UHODWLRQVKLS EHWZHHQ 3UD[LV DQG
$%&7( H[DP VFRUHV DQG ZK\ WKDW UHODWLRQVKLS ZDV VWURQJHU IRU PDWK DQG HOHPHQWDU\
HGXFDWLRQ VXEMHFWV WKDQ IRU SHGDJRJ\ 7KH SRVVLEOH H[SODQDWLRQV LQFOXGH WKH WHVWWDNHUV
EDFNJURXQGFKDUDFWHULVWLFVWKHFRQWHQWRIWKHH[DPVWKHPVHOYHVDQGWKHFRQGLWLRQVXQGHU
ZKLFKWKHWHVWWDNHUVFRPSOHWHGHDFKH[DP
D 7HVW7DNHU%DFNJURXQG
7KHFRUUHODWLRQVEHWZHHQWKH$%&7(DQG3UD[LVVFRUHVDUHDOOSRVLWLYHDQGVWDWLVWLFDOO\
VLJQLILFDQW EXW VRPH SROLF\PDNHUV PLJKW ZRQGHU ZKHWKHU SHUIRUPDQFH RQ WKH $%&7(
H[DPSURYLGHVXVHIXOLQIRUPDWLRQDERXWWKHVNLOOVWHVWHGE\3UD[LVDERYHDQGEH\RQGZKDWLV
SURYLGHGE\REVHUYDEOHWHVWWDNHUFKDUDFWHULVWLFV:HDGGUHVVWKLVLVVXHE\WHVWLQJWRVHHLI
SHUIRUPDQFHRQWKH$%&7(H[DPLV SRVLWLYHO\DVVRFLDWHGZLWK SHUIRUPDQFH RQ WKH3UD[LV
DIWHU FRQWUROOLQJ IRU FROOHJH JUDGH SRLQW DYHUDJH *3$ HGXFDWLRQ DJH JHQGHU UDFH DQG
RWKHUWHVWWDNHUFKDUDFWHULVWLFV:HXVHGPXOWLYDULDWHUHJUHVVLRQPRGHOVLQZKLFKWKH3UD[LV
WHVW VFRUH H[SUHVVHG LQ VWDQGDUG GHYLDWLRQ XQLWV ZDV WKH RXWFRPH DQG WKH H[SODQDWRU\
IDFWRUVLQFOXGHGWKHFRUUHVSRQGLQJ$%&7(WHVWVFRUHDJDLQLQVWDQGDUGGHYLDWLRQXQLWVDQG
WKH RWKHU YDULDEOHV OLVWHG DERYH FROOHJH *3$ DQG VR IRUWK DV FRQWUROV 7KH UHVXOWV DUH
SUHVHQWHGLQ7DEOH
Table 6.
Regression-Adjusted Correlations between ABCTE and Praxis Scores
Subject
Correlation
Math
0.82*
Elementary
0.73*
Pedagogy
0.30*
NOTE: The correlations are coefficient estimates on the ABCTE scores from regressions of the
Praxis scores regressed on the ABCTE scores (after the scores were normalized to have
a mean of 0 and variance of 1.0), college GPA, own years of education, parents’ years of
education for the mother and father separately, years since leaving college, age, gender,
and race. The pedagogy model also controls for level (elementary or secondary) of the
Praxis test.
*Significantly different from zero at the .05 level, two-tailed test.
7KHUHODWLRQVKLSVVKRZQLQ7DEOHUHPDLQHGVWDWLVWLFDOO\VLJQLILFDQWIRUDOOWKUHHSDLUVRI
WHVWVPDWKHOHPHQWDU\HGXFDWLRQDQGSHGDJRJ\)RUH[DPSOHDVWDQGDUGGHYLDWLRQLQ
WKH $%&7( PDWK WHVW VFRUH LV DVVRFLDWHG ZLWK D VWDQGDUG GHYLDWLRQ LQFUHDVH LQ WKH
3UD[LV PDWK VFRUH DIWHU FRQWUROOLQJ IRU EDFNJURXQG IDFWRUV ,I WKH WHVWV ZHUH SHUIHFWO\
FRUUHODWHGWKHQWKHFRHIILFLHQWHVWLPDWHVZRXOGDOOEHHTXDOWR
*3$ZDVUHSRUWHGLQFDWHJRULHVDQGFRGHGDVIROORZV DQG %HORZ
:HGLVWLQJXLVKHGOHYHOVRIWHVWWDNHUV·
HGXFDWLRQDODWWDLQPHQWDVIROORZVEDFKHORU·VGHJUHHRUORZHUFRXUVHZRUNEH\RQGDEDFKHORU·VGHJUHHEXWOHVV
WKDQDPDVWHU·VGHJUHHDQGPDVWHU·VGHJUHHRUKLJKHU:HPHDVXUHGHDFKSDUHQW·VHGXFDWLRQDODWWDLQPHQWLQ
WHUPVRIKROGLQJDKLJKVFKRROGLSORPDRUOHVVFRXUVHZRUNEH\RQGDKLJKVFKRROGLSORPDEXWQREDFKHORU·V
GHJUHHDQGDEDFKHORU·VGHJUHHRUKLJKHU:HFRGHGUDFHHWKQLFLW\E\FUHDWLQJRQHFDWHJRU\IRUZKLWHRU$VLDQ
DQGRQHIRUDOORWKHUV
E ([DP&RQWHQW
,Q WKLV VHFWLRQ ZH GLVFXVV WKH FRQWHQW VXPPDUL]HG LQ 7DEOHV WKURXJK RI WKH
$%&7( DQG 3UD[LV H[DPV EDVHG RQ LQIRUPDWLRQ REWDLQHG IURP 3RVWPDQ DQG
FRPPXQLFDWLRQZLWK$%&7(VWDII
0DWK $V VKRZQ LQ 7DEOH ERWK PDWK WHVWV FRYHU VLPLODU WRSLFV EXW ZLWK VRPH
GLIIHUHQFHV LQ FRQWHQW DQG WHVWLQJ FRQGLWLRQV )RU H[DPSOH WKH $%&7( H[DP LQFOXGHV D
VHFWLRQ WHVWLQJWKHDELOLW\WRFRQYHUWEHWZHHQGLIIHUHQWPHDVXUHPHQWV\VWHPVZKLFKLVQRW
H[SOLFLWO\ WHVWHG IRU E\ WKH 3UD[LV H[DP ,Q DGGLWLRQ SHUFHQW RI WKH 3UD[LV PDWK WHVW
TXHVWLRQV IRFXV RQ WKH WRSLFV RI SUREDELOLW\ VWDWLVWLFV OLQHDU DOJHEUD DQG UHDVRQLQJ DV
FRPSDUHGZLWKRQO\SHUFHQWRQWKH$%&7(WHVW&DOFXODWRUVZHUHUHTXLUHGIRUWKH3UD[LV
H[DPEXWQRWDOORZHGIRUWKH$%&7(WHVW2WKHUFRPSDULVRQVDUHGLIILFXOWWRPDNHEHFDXVH
RIYDULDWLRQLQKRZWKHPDWHULDOVDUHGHVFULEHG
Table 7.
Math Content of the ABCTE and Praxis Math Exams
ABCTE
Topic
Praxis
Percent of Questions
Calculus
13%
Functions and Algebra
26%
Geometry and Measurement
20%
Trigonometry
11%
Probability, Statistics, and Data
Analysis
12%
Linear Algebra
6%
Number Sense
12%
Topic
24%
Functions, Their Graphs, and
Calculus
34%
Algebra, Geometry,
Trigonometry, and Arithmetic
42%
Probability and Statistics,
Discrete Math, Linear Algebra,
Computer Science, Reasoning,
and Modeling
(OHPHQWDU\(GXFDWLRQ7KH3UD[LVDQG$%&7(H[DPVDSSHDUWREHVLPLODULQWHUPV
RIFRQWHQWFRYHUHG,QGHHGWKHZRUGVXVHGWRGHVFULEHWKHFRQWHQWDUHDOPRVWLGHQWLFDODQG
WKHEDODQFHDFURVVVXEMHFWDUHDVLVJHQHUDOO\VLPLODUEDVHGRQWKHIUDFWLRQRITXHVWLRQVLQHDFK
VHFWLRQ VHH 7DEOH 7KH $%&7( H[DP KDV D JUHDWHU IRFXV RQ UHDGLQJ DQG PDWK ZKLOH
3UD[LVKDVDVRPHZKDWJUHDWHUIRFXVRQVRFLDOVFLHQFHDQGVFLHQFH
Table 8.
Elementary Education Content of the ABCTE and Praxis Elementary Exams
ABCTE
Topic
Praxis
Percent of Questions
Topic
Reading and English Language
Arts
32%
25%
Reading/Language Arts
History and Social Science
20%
25%
Social Studies, Psychology,
Anthropology, and Sociology
Math
28%
25%
Math
Science
20%
25%
Science
3HGDJRJ\$EUHDNGRZQRIWKHQXPEHURITXHVWLRQVE\WRSLFIRUWKH3UD[LVSHGDJRJ\
WHVWZDVQRWDYDLODEOHWKHUHIRUHWKHFRQWHQWFRPSDULVRQVLQ7DEOHGHVFULEHRQO\WKHWRSLFV
FRYHUHGE\HDFKWHVWUDWKHUWKDQWKHSHUFHQWDJHRITXHVWLRQVE\WRSLF
Table 9.
Pedagogy Content of the ABCTE and Praxis Pedagogy Exams
ABCTE
Instructional Design: curriculum selection, planning, and
organizing
Effective Instructional Delivery: clear communication,
focused instruction, efficient use of time, teaching study
skills
Praxis
Classroom Environment: planning,
objectives, assessment, motivation,
classroom approaches
Assessment
Classroom Management and Organization
Teaching for Student Learning:
classroom management, changing
behavior
None
Human Development and Diversity
None
School and Society
None
Teaching Reading and Language Arts:
phonics and whole language
%DVHG RQ WKLV LQIRUPDWLRQ ZH FRQFOXGHG WKDW WKH $%&7( DQG 3UD[LV SHGDJRJ\ WHVWV
XVHGLQRXUVWXG\FRQWDLQFRQWHQWWKDWLVVLPLODUEXWQRWLGHQWLFDO7KHWZRWHVWVFRYHUWKH
LPSRUWDQFH RI WHDFKHU SODQQLQJ FODVVURRP PDQDJHPHQW DVVHVVPHQW DQG RWKHU EDVLFV
+RZHYHU WKH 3UD[LV SHGDJRJ\ WHVW KLJKOLJKWV WKUHH RWKHU VHFWLRQV RQH DERXW KXPDQ
GLYHUVLW\DQGGHYHORSPHQWRQHDERXWVFKRRODQGVRFLHW\DQGDWKLUGDERXWWHDFKLQJUHDGLQJ
DQGODQJXDJHDUWV$%&7(KLJKOLJKWVRWKHUWHDFKLQJWRSLFVVXFKDVWHDFKLQJVWXGHQWVJRRG
VWXG\VNLOOVRUHIILFLHQWXVHRILQVWUXFWLRQ
7KH$%&7(DQG3UD[LVSHGDJRJ\H[DPVKDYHRWKHUSRWHQWLDOO\LPSRUWDQWGLIIHUHQFHV
)LUVW WKH\ DUH JUDGHG LQ YHU\ GLIIHUHQW ZD\V ,Q WKH 3UD[LV SHGDJRJ\ H[DP ZULWLQJ LV D
FULWLFDOFRPSRQHQWEXWDVWURQJHUSHUIRUPDQFHRQWKHPXOWLSOHFKRLFHVHFWLRQFDQPDNHXS
IRUZHDNHUSHUIRUPDQFHLQZULWLQJDQGYLFHYHUVD+RZHYHUIRUWKH$%&7(H[DPWKHWZR
VHFWLRQVRIWKHWHVWDUHJUDGHGVHSDUDWHO\DQGDWHVWWDNHUPXVWSDVVERWKLQRUGHUWRREWDLQ
DQ $%&7( FHUWLILFDWLRQ 6HFRQG WKH $%&7( WHVW LV SULPDULO\ D PXOWLSOHFKRLFH WHVW ZLWK
RQO\ RQH ZULWLQJ VHFWLRQ ZKLOH WKH 3UD[LV LQYROYHV VHYHUDO ZULWWHQ VHFWLRQV 7KLUG WKH
$%&7(WHVWLVQRWJUDGHVSHFLILFZKLOHZHXVHWZRYHUVLRQVRIWKH3UD[LVSHGDJRJ\H[DP³
RQHIRUJUDGHV.²DQGDQRWKHUIRUJUDGHV²
2XU DQDO\VHV IRFXVHG RQ UHVXOWV IRU WKH PXOWLSOHFKRLFH VHFWLRQ RI WKH $%&7(
SHGDJRJ\ H[DP :H FRPSDUHG WKH $%&7( PXOWLSOHFKRLFH UHVXOWV WR WKH RYHUDOO 3UD[LV
SHGDJRJ\ WHVW VFRUHV WKDW FRPELQH UHVXOWV IRU ERWK ZULWLQJ DQG PXOWLSOHFKRLFH TXHVWLRQV
7KH SRWHQWLDO LPSRUWDQFH RI WKH ZULWLQJ SRUWLRQ LV KLJKOLJKWHG E\ WKH IDFW WKDW WKH 3UD[LV
SHGDJRJ\ WHVW JXLGH VXJJHVWV VSHQGLQJ SHUFHQW RI WHVW WLPH RQ WKH DSSOLHG ZULWLQJ
UHVSRQVHV
:HGLGQRWLQFOXGHWKH$%&7(ZULWLQJVFRUHVLQPRVWRIRXUDQDO\VHVEHFDXVHRIWKH
GLIIHUHQFHVLQKRZWKH$%&7(DQG3UD[LVWHVWVDUHVFRUHG$VPHQWLRQHGDERYH$%&7(
FDQGLGDWHVPXVWSDVVERWKWKHZULWLQJDQGPXOWLSOHFKRLFHVHFWLRQVVHSDUDWHO\WREHFHUWLILHG
%\ H[FOXGLQJ WKH $%&7( ZULWLQJ UHVXOWV IURP RXU DQDO\VLV UHSRUWHG DERYH ZH PDGH WKH
H[DP DSSHDU HDVLHU WR SDVV WKDQ LW ZRXOG QRUPDOO\ EH IRU FHUWLILFDWLRQ FDQGLGDWHV 7R VHH
ZKHWKHU H[FOXVLRQ RI WKH ZULWLQJ VFRUHV PDGH D VXEVWDQWLDO GLIIHUHQFH ZH DQDO\]HG KRZ
SDVVLQJ ERWK VHFWLRQV RI WKH $%&7( SHGDJRJ\ WHVW LV DVVRFLDWHG ZLWK SDVVLQJ WKH 3UD[LV
SHGDJRJ\WHVWDQGIRXQGWKDWZKLOHWKHUHVXOWVZHUHVOLJKWO\VWURQJHUWKDQWKRVHSUHVHQWHGLQ
7DEOHWKH\ZHUHQRWVXEVWDQWLYHO\GLIIHUHQW:HDOVRFUHDWHGDQRYHUDOO$%&7(SHGDJRJ\
VFRUH WKDW FRPELQHV WKH ZULWLQJ DQG PXOWLSOHFKRLFH VFRUHV JLYLQJ ERWK SRUWLRQV HTXDO
ZHLJKWDQGFRPSDUHGWKDWWRWKH3UD[LVSHGDJRJ\VFRUH 7KH VFRUHV KDG D FRUUHODWLRQRI
VRPHZKDWKLJKHUWKDQWKHFRUUHODWLRQIRXQGIRUSHGDJRJ\XVLQJRQO\WKH$%&7(
PXOWLSOHFKRLFHSHGDJRJ\WHVW
F 7HVW)DWLJXHDQG0RWLYDWLRQ
,Q6HFWLRQ%ZHUDLVHGWKHFRQFHUQWKDWWHVWWDNHUVIDFHGGLIIHUHQWLQFHQWLYHVIRUHDFKRI
WKHWZRVHWVRIH[DPVWKH\FRPSOHWHG:HSUHVXPHWKDWWHVWWDNHUWRRNH[DPVRQWKHLURZQ
WRDGYDQFHWKHLUFDUHHU³IRUH[DPSOHWRDFKLHYHLQLWLDOVWDWHOLFHQVXUH³DQGWRRNWKHRWKHU
H[DPIRUWKHVWXG\WKHSUHVHQWVWXG\RUWKHVWXG\E\%RRWVLQZKLFKWKHRQO\LQFHQWLYHZDV
DFDVKSD\PHQWEDVHGRQSHUIRUPDQFH,WLVSRVVLEOHWKDWWKHVHLQFHQWLYHVFUHDWHGXQHTXDO
OHYHOVRIPRWLYDWLRQ7RWKHH[WHQWWKDWWKH\GLGWKHFRUUHODWLRQVZHUHSRUWDUHORZHUERXQG
HVWLPDWHVRIWKH´WUXHµFRUUHODWLRQWKDWZRXOGUHVXOWLIERWKH[DPV´FRXQWHGµIRUWKHVDPH
KLJKVWDNHVRIOLFHQVXUH,IWKHH[DPVKDGEHHQWDNHQZLWKWKHVDPHVHWVRIFRQVHTXHQFHV
WKHQWKHFRUUHODWLRQVZRXOGKDYHEHHQHYHQKLJKHUWKDQZKDWZHUHSRUWHGLQ6HFWLRQ&
0RWLYDWLRQ HIIHFWV FRXOG HVSHFLDOO\ FRPH LQWR SOD\ ZKHQ ZH FRQVLGHU WKH UROH RI WHVW
IDWLJXH D IDFWRU WKDW KDSSHQV WR PDWWHU PRUH IRU WKH SHGDJRJ\ H[DP WKDQ IRU WKH VXEMHFW
H[DPV 7HVW WDNHUV ZKR WRRN PRUH WKDQ RQH H[DP IRU WKH VWXG\ PD\ KDYH UHGXFHG WKHLU
HIIRUW RQ WKH VHFRQG H[DP EHFDXVH RI IDWLJXH 7KH SHUIRUPDQFHEDVHG LQFHQWLYH SD\PHQW
PD\KDYHEHHQHQRXJKWRFUHDWHDUHDVRQDEOHOHYHORIHIIRUWRQWKHILUVWH[DPWDNHQIRUWKH
VWXG\EXWPD\KDYHKDGOHVVLPSDFWRQHIIRUWIRUDVHFRQGH[DPLIWKHWHVWWDNHUVORVWLQWHUHVW
RU EHFDPH IDWLJXHG *LYHQ WKH OHQJWK RI WKH WHVWV IDWLJXH RU ORVV RI LQWHUHVW FRXOG EH DQ
LVVXHSDUWLFXODUO\ZKHQSDUWLFLSDQWVWRRNPRUHWKDQRQHH[DPIRUWKHVWXG\RQWKHVDPHGD\
$ERXW SHUFHQWRIWKRVHLQRXUVDPSOHZKR WRRNWKH 3UD[LVSHGDJRJ\H[DPDOVRWRRND
VXEMHFWH[DPHDUOLHULQWKHGD\FRPSDUHGWR$%&7(SHGDJRJ\FRPSOHWHUVMXVWSHUFHQWRI
ZKRPWRRNDVXEMHFWH[DPHDUOLHULQWKHGD\7HVWWDNHUVZHUHJLYHQXSWRIRXUKRXUVIRU
HDFK$%&7(VXEMHFWH[DPDQGWKUHHKRXUVIRUWKHSHGDJRJ\H[DPDOWKRXJK$%&7(VWDII
UHSRUW WKDWWHVWWDNHUV UDUHO\QHHGDOORIWKHDOORWWHGWLPH)RU3UD[LVWHVW WDNHUVKDGWZR
KRXUVSHUH[DP7KHSHGDJRJ\H[DPZDVDOZD\VWDNHQDIWHUWKHVXEMHFWH[DP 7KHPRGHVWVDPSOHVL]HRIWKHVWXG\OLPLWVRXUDELOLW\WRSHUIRUPGLDJQRVWLFDQDO\VHV
EXWZHGLGORRNDWVHOHFWHGFDVHVWKDWZHUHQRWDIIHFWHGE\WKHIDWLJXHLVVXH:KHQZHOLPLW
RXUVDPSOHWRWKHWHVWWDNHUVZKRGLGQRWWDNHWZRWHVWVIRUWKHVWXG\RQWKHVDPHGD\
WKHFRUUHODWLRQEHWZHHQWKH$%&7(DQG3UD[LVSHGDJRJ\H[DPVFRUHVGRXEOHVIURPWR
DQGLVVWDWLVWLFDOO\VLJQLILFDQWDWWKHOHYHO:KHQZHIXUWKHUOLPLWRXUVDPSOHWRWKH
VXEJURXSRIWHVWWDNHUVZKRWRRNRQO\WKHSHGDJRJ\WHVWIRUWKHVWXG\WKHFRUUHODWLRQLV
DQG LV VWLOO VWDWLVWLFDOO\ VLJQLILFDQW DW WKH OHYHO 7KHVH SLHFHV RI HYLGHQFH DUH RQO\
VXJJHVWLYHJLYHQWKHVPDOOQXPEHUVRIFDVHVEXWWKH\DUHFRQVLVWHQWZLWKWKHLGHDWKDWVFRUHV
RQWKHSHGDJRJ\H[DPDUHPRUHFORVHO\DVVRFLDWHGWKDQWKH\DSSHDULQRXUPDLQDQDO\VLV
:KDW([SODLQVWKH5HODWLYH'LIILFXOW\RIWKH([DPV"
2XU DQDO\VHV RI WKH UHODWLYH GLIILFXOW\ RI WKH $%&7( DQG 3UD[LV H[DPV VKRXOG EH
LQWHUSUHWHG ZLWK FDXWLRQ IRU DW OHDVW WKUHH UHDVRQV )LUVW WKH WHVW WDNHUV IDFHG GLIIHUHQW
LQFHQWLYHV³SURIHVVLRQDO DGYDQFHPHQW YHUVXV PRQHWDU\ JDLQ³ZKHQ WDNLQJ WKH H[DPV
6HFRQGWKH\PD\KDYHEHFRPHIDWLJXHGDVGLVFXVVHGDERYHLIWKH\KDGWRWDNHWZRH[DPV
RQ WKH VDPHGD\ZKLFKWKH\GLGPRUH RIWHQ IRUWKH 3UD[LVWKDQIRUWKH $%&7( )LQDOO\
WKH\ PD\KDYHJDLQHGRUORVWNQRZOHGJH GXULQJWKH SHULRGEHWZHHQWKH WZRH[DPVZKLFK
FRXOGKDYHDIIHFWHGWKHLUUHODWLYHSHUIRUPDQFHOHYHOV 7R DVVHVV ZKHWKHU WKH DERYH WKUHH IDFWRUV PLJKW KDYH PDWWHUHG ZH DQDO\]HG WKH
GLIIHUHQFHV EHWZHHQ WKH 3UD[LV DQG $%&7( VFRUHV FRQWUROOLQJ IRU ZKLFK WHVW ZDV WDNHQ
VROHO\ IRU WKH VWXG\ WKH GD\V EHWZHHQ WKH WHVWV WKH GLIIHUHQFH LQ LQFHQWLYHV IRU WDNLQJ WKH
WHVWVEDVHGRQVWDWHUHJXODWLRQVWKDWHLWKHUUHTXLUHWKH3UD[LVWHVWRUDFFHSWWKH$%&7(WHVW
7KLVZDVWUXHIRUDOOFDVHVZKHQWHVWWDNHUVWRRNWZR3UD[LVWHVWVRQWKHVDPHGD\DQGIRUWKUHHRIIRXU
FDVHVZKHQWHVWWDNHUVWRRNWZR$%&7(WHVWVRQWKHVDPHGD\:HDUHPLVVLQJLQIRUPDWLRQRQWKHRUGHURI
WHVWLQJIRUWKHUHPDLQLQJSDUWLFLSDQWZKRWRRNWZR$%&7(WHVWVRQWKHVDPHGD\
7KH3UD[LVDQG$%&7(H[DPVDOVRGLIIHUEHFDXVHWKH3UD[LVWHVWVDUHSDSHUDQGSHQFLOWHVWVZKLOHWKH
$%&7(WHVWLVFRPSXWHUEDVHG
ZKHWKHUWKH3UD[LVWHVWZDVWDNHQODVW VXJJHVWLQJ DSRVVLEOH EXUQRXWHIIHFW DQG ZKHWKHU
WKH$%&7(WHVWZDVWDNHQODVWRURQWKHVDPHGD\DVDQRWKHUWHVW:HH[DPLQHGWKHUHODWLYH
SDVV UDWHV IRU GLIIHUHQW VXEJURXSV RI RXU VDPSOH DQG UHSHDWHG WKH DQDO\VLV E\ XVLQJ D
FRQWLQXRXV PHDVXUH RI SHUIRUPDQFH WKDW ZDV EDVHG RQ WKH VFRUH LWVHOI ,Q HDFK RI WKHVH
DQDO\VHV ZH IRXQG OLWWOH FKDQJH LQ RXU PDLQ ILQGLQJV FRQFOXVLRQV EDVHG RQ )LJXUH $SSHQGL[%LOOXVWUDWHVVRPHRIWKHVHUREXVWQHVVWHVWVXVLQJVXEJURXSDQDO\VLV
:HGLGILQGWKDWWKHWHVWWDNHUVVFRUHGKLJKHURQWKHH[DPWKH\FRPSOHWHGRQWKHLURZQ
IRU MREUHODWHG UHDVRQV WKDQ RQ WKH RQH WKH\ WRRN IRU WKH VWXG\ SHUKDSV UHIOHFWLQJJUHDWHU
SUHSDUDWLRQRUWHVWGD\HIIRUWIRUWKHWHVWUHTXLUHG E\ WKH WKHLU MRE 'HVSLWHHYLGHQFH RID
PRWLYDWLRQ HIIHFW LH WKDW RXU LQFHQWLYH GLG QRW SHUIHFWO\ PLPLF WKH LQFHQWLYHV WKDW WHVW
WDNHUVIDFHXQGHUUHDOZRUOGFRQGLWLRQVWKHHIIHFWGRHVQRWDSSHDUODUJHHQRXJKWRFKDQJH
WKH VWXG\·V PDLQ TXDOLWDWLYH ILQGLQJV :H FRQGXFWHG WKH DQDO\VLV VHSDUDWHO\ IRU WKH JURXS
WKDWWRRNWKH3UD[LVH[DPIRURXUVWXG\DQGWKHJURXSWKDWWRRNWKH$%&7(IRURXUVWXG\
$VZLWKWKHIXOOVDPSOHUHVXOWVWKH$%&7(HOHPHQWDU\H[DPZDVPRUHGLIILFXOWWRSDVVWKDQ
WKH FRUUHVSRQGLQJ 3UD[LV H[DP IRU ERWK JURXSV UHJDUGOHVV RI ZKLFK FXW VFRUH ZH XVH IRU
3UD[LV)RUPDWKDQGSHGDJRJ\WKHUHVXOWVZHUHPRVWO\EXWQRWHQWLUHO\FRQVLVWHQWZLWKWKH
IXOOVDPSOHILQGLQJV7KH$%&7(H[DPZDVPRUHGLIILFXOWWRSDVVWKDQWKH3UD[LVH[DPLQ
DWOHDVWVRPHEXWQRWDOOVWDWHVUHJDUGOHVVRIZKLFKH[DPZDVWDNHQIRUWKHVWXG\
( &21&/86,21
,Q WKLV UHSRUW ZH KDYH FRPSDUHG SHUIRUPDQFH RQ WZR WHDFKHU OLFHQVXUH H[DPV³WKH
ZHOONQRZQ3UD[LV,,H[DPVSURGXFHGE\WKH(GXFDWLRQDO7HVWLQJ6HUYLFHDQGDQHZHUVHWRI
H[DPV SURGXFHG E\ WKH $PHULFDQ %RDUG IRU WKH &HUWLILFDWLRQ RI 7HDFKHU ([FHOOHQFH :H
REWDLQHGWKHIROORZLQJUHVXOWV
•
7KH $%&7( H[DP VFRUHV ZHUH SRVLWLYHO\ FRUUHODWHG ZLWK WKH
FRUUHVSRQGLQJ 3UD[LV WHVW VFRUHV LQ DOO WKUHH VXEMHFW DUHDV PDWK
HOHPHQWDU\ HGXFDWLRQ DQG SHGDJRJ\ 7KH FRUUHODWLRQV UHPDLQHG
VLJQLILFDQWHYHQDIWHUFRQWUROOLQJIRUEDFNJURXQGIDFWRUVVXFKDVFROOHJH*3$
HGXFDWLRQDJHUDFHDQGJHQGHU7KHUHVXOWVDUHQRWVXUSULVLQJJLYHQWKDWWKH
FRQWHQW RI WKH H[DPV DSSHDUV VLPLODU ZLWK VXEVWDQWLDO RYHUODS IRU WKH VXEMHFW
H[DPVLQPDWKDQGHOHPHQWDU\HGXFDWLRQ
• 7KH UHODWLRQVKLS EHWZHHQ WKH 3UD[LV DQG $%&7( H[DP VFRUHV ZDV
VWURQJHU IRU WKH PDWK DQG HOHPHQWDU\ HGXFDWLRQ VFRUHV WKDQ IRU WKH
SHGDJRJ\VFRUHV7KLVUHVXOWPLJKWKDYHEHHQDWWULEXWDEOHWRGLIIHUHQFHVLQWKH
FRQWHQW RI WKH $%&7( DQG 3UD[LV SHGDJRJ\ WHVWV RU WR GLIIHUHQFHV LQ WKH
DPRXQW RI HIIRUW WHVW WDNHUV SXW LQWR WKH $%&7( SHGDJRJ\ H[DP YHUVXV WKH
RWKHUH[DPVFRYHUHGLQWKHVWXG\
• 7KH $%&7( HOHPHQWDU\ HGXFDWLRQ WHVW ZDV KDUGHU WR SDVV WKDQ WKH
FRUUHVSRQGLQJ3UD[LVWHVW7KLVILQGLQJEDVHGRQWKHUHODWLYHIUDFWLRQVRIRXU
VDPSOHWKDWSDVVHGHDFKH[DPKHOGUHJDUGOHVVRIZKLFKVWDWH·VFXWVFRUHZHXVHG
IRUWKH3UD[LVDQGGRHVQRWDSSHDUWREHDWWULEXWDEOHWRGLIIHUHQFHVLQWHVWWDNLQJ
HIIRUW
• )RUPDWKDQGSHGDJRJ\WKHUHODWLYHGLIILFXOW\PHDVXUHGE\SDVVUDWHVRI
$%&7(DQG3UD[LVGHSHQGHGRQWKHVWDWHFXWVFRUHIRUSDVVLQJXVHGE\
WKH3UD[LVH[DP7KLVILQGLQJKHOGUHJDUGOHVVRIZKLFKH[DPZDVFRPSOHWHG
ILUVW RU KRZ FORVH LQ WLPH WKH H[DPV ZHUH FRPSOHWHG DOOD\LQJ FRQFHUQV DERXW
WLPLQJRUPRWLYDWLRQHIIHFWV
7KHVH UHVXOWV ZLOO KHOS SROLF\PDNHUV DOUHDG\ IDPLOLDU ZLWK WKH 3UD[LV H[DPVWR SXW WKH
$%&7( H[DPV LQ FRQWH[W E\ DVVHVVLQJ WKH GHJUHH WR ZKLFK WKH $%&7( VFRUHV FDQ EH
DFFHSWHGDVDVXEVWLWXWHIRU3UD[LVVFRUHV7KHSXUSRVHRIWKLV VWXG\ZDVQRWWRGHWHUPLQH
ZKHWKHU$%&7(H[DPVDUHXVHIXOIRULGHQWLI\LQJWHDFKLQJHIIHFWLYHQHVVRUSRWHQWLDO7KDW
PRUH DPELWLRXV UHVHDUFK TXHVWLRQ ZRXOG UHTXLUH DQ RXWFRPH PHDVXUH VXFK DV VWXGHQW
DFKLHYHPHQWJURZWKRUREVHUYHGFODVVURRPSUDFWLFHWRYDOLGDWHWKHH[DP·VDELOLW\WRSUHGLFW
JRRGWHDFKLQJ7KHUHIRUHZHDUHFRQGXFWLQJDGGLWLRQDOUHVHDUFKWRHVWLPDWHWKHTXDOLW\RI
WHDFKHUVZKRREWDLQ$PHULFDQ%RDUGFHUWLILFDWLRQUHODWLYHWRRWKHUVDOUHDG\LQWKHWHDFKLQJ
ZRUNIRUFH7KDWUHVHDUFKZLOOSURYLGHWKHFULWLFDOLQIRUPDWLRQQHHGHGWRZHLJKWKH$%&7(
FUHGHQWLDOLQJSURFHVV
5()(5(1&(6
%DOORX'DOHDQG0LFKDHO3RGJXUVN\´5HIRUPLQJ7HDFKHU3UHSDUDWLRQDQG/LFHQVLQJ:KDW
,VWKH(YLGHQFH"µ7HDFKHUV&ROOHJH5HFRUGYROQRSS
%RRWV -RVKXD ´0DUFK 9DOLGDWLRQ 6WXG\ 7KH $VVRFLDWLRQ RI 3DVVSRUW WR 7HDFKLQJ
(OHPHQWDU\ &HUWLILFDWLRQ DQG 6WXGHQW $FKLHYHPHQWµ :DVKLQJWRQ '& $PHULFDQ
%RDUGIRUWKH&HUWLILFDWLRQRI7HDFKHU(GXFDWLRQ
'DUOLQJ+DPPRQG/LQGD'HERUDK-+ROW]PDQ6X-LQ*DWOLQDQG-XOLDQ9DVTXH]+HLOLJ
´'RHV7HDFKHU3UHSDUDWLRQ0DWWHU"(YLGHQFH$ERXW7HDFKHU&HUWLILFDWLRQ7HDFKIRU
$PHULFDDQG7HDFKHU(IIHFWLYHQHVVµ6WDQIRUG&$6WDQIRUG8QLYHUVLW\'HSDUWPHQW
RI(GXFDWLRQ$SULO
'HFNHU3DXO7'DQLHO30D\HUDQG6WHYHQ*OD]HUPDQ´$OWHUQDWLYH5RXWHVWR7HDFKLQJ
7KH ,PSDFWV RI 7HDFK IRU $PHULFD RQ 6WXGHQW $FKLHYHPHQW DQG 2WKHU 2XWFRPHVµ
-RXUQDORI3ROLF\$QDO\VLVDQG0DQDJHPHQWYROSS
*ROGKDEHU'DQ´7HDFKHU/LFHQVXUH7HVWVDQG6WXGHQW$FKLHYHPHQW,V7HDFKHU7HVWLQJ
$Q (IIHFWLYH 3ROLF\"µ 3UHSDUHG IRU WKH 8UEDQ ,QVWLWXWH·V 7KLUG $QDO\WLF 5HVHDUFK
6HPLQDU:DVKLQJWRQ'&0D\
*ROGKDEHU'DQDQG'RPLQLF-%UHZHU´'RHV7HDFKHU&HUWLILFDWLRQ0DWWHU"+LJK6FKRRO
7HDFKHU&HUWLILFDWLRQ6WDWXVDQG6WXGHQW$FKLHYHPHQWµ(GXFDWLRQDO(YDOXDWLRQDQG3ROLF\
$QDO\VLVYROQRSS
3RVWPDQ 5REHUW %DUURQ·V +RZ WR 3UHSDUH IRU 35$;,6 WK (GLWLRQ +DXSSDXJH 1<
%DUURQ·V(GXFDWLRQDO6HULHV
86'HSDUWPHQWRI(GXFDWLRQ´7KH6HFUHWDU\·V)LIWK$QQXDO5HSRUWRQ7HDFKHU4XDOLW\µ
:DVKLQJWRQ '& 2IILFH RI 3RVWVHFRQGDU\ (GXFDWLRQ $YDLODEOH DW
>ZZZWLWOHRUJ7LWOHB,,BSGI@
$33(1',;$35$;,6&876&25(6%<67$7(
7DEOH$VKRZVWKHGLVWULEXWLRQRIWKHWHVWWDNHUVLQRXUVDPSOHE\VWDWH2XUVDPSOHLV
GLVWULEXWHGDFURVVVWDWHV$OPRVWD TXDUWHU RIWKH VDPSOHFRPHVIURP ,GDKR DQG ODUJH
IUDFWLRQVFRPHIURP3HQQV\OYDQLDDQG)ORULGDDOOVWDWHVWKDWDFFHSW$%&7(FHUWLILFDWLRQ
Table A.1. Distribution of Sample by State
State(s)
Percent of Sample
Idaho*
24.0
Pennsylvania*
21.1
Tennessee
16.4
Florida*
10.6
Kentucky
5.8
Kansas, New Hampshire*, South Dakota, Minnesota,
South Carolina, Utah*, Georgia, Louisiana, North Carolina,
Oregon, Vermont, West Virginia (each below 4 percent of
sample)
22.1
*State recognizes ABCTE certification. Mississippi also recognizes ABCTE certification, but was
not listed as the home state for any members of our sample.
7DEOH $ VKRZV WKH FXW VFRUHV IRU WKH 3UD[LV ,, H[DPV FRYHUHG LQ WKH VWXG\ 7KH
QXPEHUVPD\EHXVHGWRJHWKHUZLWK)LJXUHVWRWRGHWHUPLQHWKHDSSUR[LPDWHIUDFWLRQV
RIWHVWWDNHUVZKRZRXOGKDYHSDVVHGWKHWHVWEDVHGRQWKHFXWVFRUHVIRUHDFKVWDWH
Table A.2. Praxis Cut Scores by State (2006–2007)
Pedagogy
State
K–6
Content
7–12
Math
AL
118
AK
146
AR
164
Elementary
116*
CA
CO
156**
147
CT
137
148
DE
141
151
DC
141
145
FL
GA
HI
IA
136
163
157
136
Table A.2 (continued)
Content
Pedagogy
State
ID
K–6
7–12
161
Math
119
IN
Elementary
143
136
KS
161
161
137
KY
161
161
125
148
LA
161
161
125
150
ME
166
126
145
162
141
142
MD
MN
159
157
125
145
MS
152
152
123
153**
160
137
161
144
MO
NE
NV
169**
NH
127
148
NJ
137
141
NC
ND
162
OH
168
139
165
139
OR
138
PA
136
143
RI
167
167**
145
SC
165
165
131
SD
146*
146*
124
137*
TN
155
159
136
140
UT
160
160
138
150
VT
141
148
VA
147
143
WA
134
141
WV
165
156
WI
WY
* Lowest passing score
** Highest passing score
133
135
161
147
$33(1',;%68%*5283$1$/<6,62)3$665$7(6
,Q 6HFWLRQ % RI WKH UHSRUW ZH UDLVHG WKH FRQFHUQ WKDW WKH GLIIHUHQFH LQ SDVV UDWHV
EHWZHHQ WKH 3UD[LV DQG $%&7( H[DPV PD\ UHIOHFW IDFWRUV RWKHU WKDQ GLIIHUHQFHV LQ WKH
GLIILFXOW\RIWHVWLWHPVLQZKLFKFDVHZHZRXOGUXQWKHULVNRIXQGHURURYHUHVWLPDWLQJWKH
UHODWLYHGLIILFXOW\RIWKH$%&7(H[DP2QHSRVVLELOLW\ZDVWKDWWKHLQFHQWLYHVRUPRWLYDWLRQ
WR SDVV WKH H[DPV PD\ GLIIHU 7KH RWKHU SRVVLELOLW\ LV WKDW WKH DPRXQW RI WLPH HODSVHG
EHWZHHQDQ\JLYHQWHVWWDNHUFRPSOHWLQJWKHWZRH[DPVPD\DIIHFWSHUIRUPDQFH
7RKHOSDGGUHVVWKHVHFRQFHUQVZHSUHVHQWSDVVUDWHVE\VXEJURXSVIRUPHGDORQJWZR
GLPHQVLRQV 7KH ILUVW GLPHQVLRQ LV EDVHG RQ WKH H[DP WDNHQ IRU WKH VWXG\ $%&7( RU
3UD[LVDQGWKHVHFRQGGLPHQVLRQLVEDVHGRQWKHWLPHHODSVHGEHWZHHQFRPSOHWLRQRIWKH
H[DPVPRUHWKDQWKHPHGLDQQXPEHURIGD\VRUIHZHUWKDQWKHPHGLDQQXPEHURIGD\V³
VHH7DEOH%\GLYLGLQJWKHVDPSOHLQWRDJURXSWKDWWRRNWKH3UD[LVH[DPIRUWKHVWXG\
DQGDJURXSWKDWWRRNWKH$%&7(H[DPIRUWKHVWXG\ZHFDQSODFHERXQGVRQWKHVL]HRI
WKHPRWLYDWLRQHIIHFW:HDVVXPHWKDWWKHHIIRUWRQWKHH[DPWDNHQIRUWKHVWXG\ZDVORZHU
WKDQWKHHIIRUWRQWKHH[DPWDNHQIRUSHUVRQDOUHDVRQVWKHUHIRUHHDFKVXEJURXSIDYRUVRQH
RI WKH WZR H[DPV %\ GLYLGLQJ WKH VDPSOH LQWR WKRVH ZKR WRRN WKH WZR H[DPV ZLWKLQ D
VKRUWHUSHULRGRIWLPHYHUVXVDORQJHUSHULRGRIWLPHZHFDQDVVHVVWKHOLNHOLKRRGRIWLPLQJ
HIIHFWV7KHUHVXOWVIRUWKRVHZLWKDVKRUWHUHODSVHGWLPHVKRXOGKDYHDVPDOOHUWLPHHIIHFW
WKDQWKRVHZLWKDORQJHUHODSVHGWLPH
7KHERG\RIWKLVUHSRUW)LJXUHVKRZVWKDWWKHSDVVUDWHVIRUWKH$%&7(H[DPVLQ
PDWK DQG SHGDJRJ\ OLH LQ EHWZHHQ WKH WZR 3UD[LV SDVV UDWHV EDVHG RQ WKH VWDWHV ZLWK WKH
KLJKHVWDQGORZHVWFXWVFRUHVZKLOHIRUWKHHOHPHQWDU\HGXFDWLRQH[DPVWKH$%&7(SDVV
UDWHV ZHUH ORZHU WKDQ WKH 3UD[LV SDVV UDWHV LQ DOO VWDWHV VXJJHVWLQJ WKDW WKH $%&7(
HOHPHQWDU\ VXEMHFWV H[DP LV XQDPELJXRXVO\ KDUGHU WR SDVV WKDQ WKH FRUUHVSRQGLQJ 3UD[LV
H[DP $V )LJXUHV % WKURXJK % LOOXVWUDWH WKHVH SDWWHUQV VKRZQ LQ )LJXUH DUH XVXDOO\
UHSOLFDWHGZKHQZHDQDO\]HWKHGDWDE\VXEJURXS
)LJXUH%VKRZVWKHVXEJURXSUHVXOWVIRUWKHPDWKH[DPVRQO\7KHFRPSDULVRQVRQ
WKHOHIWRIWKHYHUWLFDOGLYLGLQJOLQHVKRZWKHUHVXOWVIRUWKRVHZKRWRRNWKH$%&7(H[DP
IRUWKHVWXG\DQGWKH3UD[LVRQWKHLURZQ,IZHVXVSHFWPRWLYDWLRQHIIHFWVWKHQWKHEDUV
UHSUHVHQWLQJSDVVLQJWKH$%&7(DUHDUWLILFLDOO\ORZ7KHUHYHUVHLVWUXHIRUWKHFRPSDULVRQV
WR WKH ULJKW RI WKH YHUWLFDO OLQH ZKHUH WKH 3UD[LV H[DPV ZHUH QRW QHFHVVDULO\ WDNHQ IRU D
OLFHQVXUHGHFLVLRQ7KHIDFWWKDWWKH$%&7(SDVVUDWHUHODWLYHWRWKHWZR3UD[LVSDVVUDWHVLV
WKHVDPHWRWKHOHIWDQGULJKWRIWKHYHUWLFDOOLQHDQGWKHVDPHDVLQ)LJXUHVXJJHVWVWKDW
PRWLYDWLRQ HIIHFWV ZHUH QRW VWURQJ HQRXJK WR DOWHU RXU FRQFOXVLRQV :H ILQG WKH VDPH
UREXVWQHVV RI WKH RYHUDOO UHVXOW IRU PRWLYDWLRQ HIIHFWV LQ )LJXUHV % HOHPHQWDU\ DQG %
SHGDJRJ\DVZHOOZLWKRQHH[FHSWLRQGLVFXVVHGEHORZ
7KH RWKHU VXEJURXS LOOXVWUDWHG LQ )LJXUH % LV WKH WLPLQJ RI WKH FRPSOHWLRQ RI WKH
VHFRQGWHVWUHODWLYHWRWKHILUVW$VPHQWLRQHGDERYHZHGLYLGHGWKHVDPSOHLQKDOIIRUHDFK
H[DP EDVHGRQWKHQXPEHURIGD\VHODSVHGIURPFRPSOHWLQJWKHILUVWH[DPWRFRPSOHWLQJ
WKHVHFRQG&RPSDULQJWKHWZRVHWVRIWKUHHEDUVRQHDFKVLGHRIWKHYHUWLFDOGLYLGLQJOLQH
ZHVHHOLWWOHFKDQJHLQWKHDEVROXWHSDVVUDWHVRUWKHLUUHODWLYHSRVLWLRQ
Figure B.1
Pass Rates in Mathematics
by Exam Taken for Study and Time between Exams
Praxis Exam for Study
(Sample Size = 24)
ABCTE Exam for Study
(Sample Size = 15)
*
100
*
80
60
Pass
Rate
40
*
20
0
<median time
>=median time
Praxis Using Most Stringent Cut Score
<median time
ABCTE
>=median time
Praxis Using Least Stringent Cut Score
*Significantly different from the ABCTE pass rate at the .05 level, two-tailed test.
2QH UHVXOW IURP )LJXUH LQ WKH PDLQ UHSRUW WKDW LV QRW UHSOLFDWHG KHUH LV VKRZQ LQ
)LJXUH%,Q)LJXUHWKH$%&7(SHGDJRJ\SDVVUDWHLVKLJKHULQGLFDWHGE\DWDOOHUEDU
WKDQ WKH 3UD[LV SDVV UDWH EDVHG RQ WKH VWDWH ZLWK WKH PRVW VWULQJHQW FXW VFRUH 7KH VDPH
UHODWLRQVKLSKROGVIRUWKHVDPSOHPHPEHUVZKRWRRN3UD[LVH[DPIRUWKHVWXG\ULJKWKDQG
VLGH RI )LJXUH %EXWQRWIRU WKRVH ZKR WRRNWKH $%&7( H[DP IRUWKH VWXG\OHIWKDQG
VLGHRI)LJXUH%7KHSDVVUDWHVRQWKH$%&7(SHGDJRJ\H[DPIRUWKRVHZKRWRRNWKH
$%&7( H[DP IRU WKH VWXG\ OHIW RI WKH YHUWLFDO OLQH DUH ORZHU WKDQ WKH SDVV UDWHV RQ WKH
SHGDJRJ\H[DPHYHQIRUWKHOHDVWVWULQJHQWVWDWH7KHORZHU$%&7(SDVVUDWHFDQSUREDEO\
EHH[SODLQHGE\WKHIDWLJXHHIIHFWVGLVFXVVHGLQ6HFWLRQ'6RPHRWKHUUHVXOWVQRWUHSOLFDWHG
KHUH DUH UHODWHG WR WKH VWDWLVWLFDO VLJQLILFDQFH RI WKH GLIIHUHQFH EHWZHHQ WKH 3UD[LV DQG
$%&7(SDVVUDWHV7KLVLVPRVWOLNHO\H[SODLQHGE\WKHIDFWWKDWWKHVXEJURXSDQDO\VHVUHO\
RQ VPDOO VDPSOHV DQG WKHUHIRUH DUH OLNHO\ WR \LHOG VWDWLVWLFDOO\ LQVLJQLILFDQW GLIIHUHQFHV HYHQ
ZKHQ WKH VXEVWDQWLYH GLIIHUHQFHV DSSHDU ODUJH 2YHUDOO KRZHYHU WKH VXEJURXS ILQGLQJV
JHQHUDOO\VXSSRUWWKHIXOOVDPSOHILQGLQJVVKRZQLQ)LJXUHLQWKHERG\RIWKHUHSRUW
Figure B.2
Pass Rates in Elementary Education
by Exam Taken for Study and Time between Exams
ABCTE Exam for Study
(Sample Size = 15)
*
*
100
Praxis Exam for Study
(Sample Size = 42)
*
*
80
*
60
Pass
Rate
40
20
(0%)
0
<median time
>=median time
<median time
>=median time
Figure B.3
Pass Rates in Pedagogy
by Exam Taken for Study and Time between Exams
Praxis Exam for Study
(Sample Size = 45)
ABCTE Exam for Study
(Sample Size = 13)
*
100
80
*
60
Pass
Rate
40
20
0
<median time
>=median time
Praxis Using Most Stringent Cut Score
<median time
ABCTE
>=median time
Praxis Using Least Stringent Cut Score
*Significantly different from the ABCTE pass rate at the .05 level, two-tailed test.