Classroom Diagnostic Tools
CDT UPDATES for PAIUCC
September 17, 2015
Dan Richards
Dr. Carrie Soliday
Brian Stamford
Rich Maraschiello
Tom Wolf, Governor
*
Pedro A. Rivera,
Secretary of Education
1
Classroom Diagnostic Tools
2015-16 CDT Lead Team
(Pending Contract Approvals)
• Dr. Bobbie Pfingstler - Consultant
• Dan Richards - IU14
• Dr. Carrie Soliday - IU12
• Brian Stamford - IU3
*
2
Classroom Diagnostic Tools
Updated Helpful Documents on eDIRECT
1. Go to https://pa.drcedirect.com
2. Go to General Information.
3. Click on Documents.
4. Under Administration, select the
most current year for Classroom
Diagnostic Tools.
5. Under Document Type, click on
All.
6. Click Show Documents.
Classroom Diagnostic Tools
New Assessment Names
Current Assessment Names
New Assessment Names
Mathematics Lower Grades
Math Grades 3–5
Reading Lower Grades
Reading Grades 3–5
Science Lower Grades
Science Grades 3–5
Writing Lower Grades
Writing Grades 3–5
Mathematics
Math Grades 6–8
Algebra I
Algebra I
Algebra II
Algebra II
Geometry
Geometry
Reading/Literature
Reading/Lit Grades 6–HS
Writing/English Composition
Writing/Eng Comp Gr 6–HS
Classroom Diagnostic Tools
Two Different Map Configurations
There are two different Map Configurations:
Lower Grades now named grades 3-5 (response probability .65)
Upper Grades now named 6-HS (response probability .5)
For CDT testing INSIGHT selects the items by the grade level (determined when
student is loaded to eDIRECT) for the first assessment.
Exs.: When a session is created for students in grade 4, the user would select content area Math, then
assessment name is now Math Grades 3-5. This will ensure the student will get the correct grades 3-5 Map
Configuration. Once the student takes the second math assessment it will start the student where they have
left off (depending on their ability level).
If the student was put into a Math Grades 6-8 assessment, they will not have the ability to see the Grades 3-5
Map Configuration and vice versa.
Classroom Diagnostic Tools
CDT Correlation Explanation
Rich Maraschiello:
Pennsylvania Department of Education
Classroom Diagnostic Tools
Correlations from previous technical reports are shown in the
next slide. Please note
1.
2.
3.
4.
CDTs in the math content area were first available in 2010-11.
CDTs in the reading and science content areas were first available in 2011-12.
Keystone Exams were not available in 2011-12
Correlations for 2014-15 are not yet available for 2014-15 since the CDT for 201415 just ended a couple of weeks ago.
NOTE: Correlations between CDT and Keystone scores are provided in the CDT
technical report as evidence of validity (chapter 17). Results from CDT and Keystone
are matched using PA secure ID. The correlation reported is the correlation between
CDT total scale score and Keystone total scale score.
Classroom Diagnostic Tools
Correlation between CDT and Keystone Exams Scores
CDT
Technical
Report
CDT Test
Keystone Test
N
Correlation
2010-11
Algebra I
Keystone Algebra I
8,591
0.749
2012-13
Algebra I
Keystone Algebra I
94,138
0.790
2012-13
Biology
Keystone Biology
65,954
0.795
2012-13
Reading/Literature
Keystone Literature
79,140
0.757
2013-14
Algebra I
Keystone Algebra I
67,322
0.744
2013-14
Biology
Keystone Biology
58,301
0.804
2013-14
Reading/Literature
Keystone Literature
56,659
0.752
For example, the first row indicates that in the 2010-11 school year there were 8,591 students who took CDT Algebra I and had a Keystone
Algebra I scale score. The correlation between CDT scale score and Keystone scale score is 0.749. This positive correlation indicates that
students with high CDT total scale score tend to have high Keystone total scale score and vice versa. This is an expected result given that
both CDT and Keystone align to the same content standards.
Classroom Diagnostic Tools
Evaluating CDT Cut Scores
The Pennsylvania Department of Education’s (PDE) previously stated goals in
evaluating benchmark cuts:
• Students scoring Below Basic or Basic on PSSA/Keystone are likely to be
in the CDT red range, indicating areas of need.
• Students scoring Proficient or Advanced on PSSA/Keystone are likely to
be in the CDT green or blue ranges, indicating strengths to build upon.
• In balancing over- versus under- identification, it is more desirable to err
toward under identification. (Better to have students who are in the CDT
red range scoring Proficient or Advanced on PSSA/Keystone than students
who are in the CDT green or blue ranges scoring Below Basic or Basic on
PSSA/Keystone.)
Classroom Diagnostic Tools
Reading
Classroom Diagnostic Tools
Math
Classroom Diagnostic Tools
New ranges can be
found in 2015-16
document on DRC
eDIRECT site.
Classroom Diagnostic Tools
Field Testing Items
• Additional items have been developed for the
CDT to supplement the existing item pools and
introduce the evidence based selected response
(EBSR) items in the reading content area.
• Field testing specifics can be found in 2015-16
documents on DRC eDIRECT site.
Classroom Diagnostic Tools
A New
Addition Batch
Printing
Classroom Diagnostic Tools
Statewide Trainings
• CDT ToT
–8/12 (IU7), 8/13(IU14), 8/24(IU12)
• CDT NEXT STEPS ToT
–9/15(Harrisburg), 9/22(Pittsburgh), 10/1(KOP)
• SAS Institute
–Proposed Sessions 12/7 & 12/8
Classroom Diagnostic Tools
Feedback from the Field
• How are you supporting data interpretation beyond the training
modules?
• Which leaders in your LEAs could we contact for testimonials on
their leadership of using the CDT?
• Which educators could we contact who are successfully one to one
conferencing?
• Which teachers in your LEAs could we contact about how CDT has
impacted their instruction?
• http://goo.gl/forms/4XzriWmWKn