INTERPRETATION of SCORES
“Using the Student Data Tool”
Alternate Assessment Scores
8/1/2017
1
ACCESS
• To access the Student Data Tool(SDT)
application, contact your District Assessment
Coordinator (DAC) or school administrator .
• Installation of the SDT application must be
provided by an administrator.
8/1/2017
2
To Access The Tool
• Click Start
• Go to Programs
• 2009 Student Data Tool Application
8/1/2017
3
LOGIN
• The DAC or school administrator will have
access to identification codes and passwords
for all schools within the district.
8/1/2017
4
SITE ENTRANCE
• Provide Identification Code
• Provide Password
8/1/2017
5
SITE ENTRANCE
• Click the “OK” button to continue to the Main
Menu.
8/1/2017
6
SITE ENTRANCE
• Select school site for viewing
• Click Load Selected School
8/1/2017
7
SITE ENTRANCE
• Choose data year for review
• Click Show Alternate Assessment Scores
8/1/2017
8
Show Alternate Assessment
Scores
• Show Alternate Assessment Scores is a data file for
Alternate Assessment scores containing Performance
Dimension, Performance cut scores, Complexity cut
scores and Supports cut scores. The data contains
biographic information and accountability status. Also
available are the score information detail and condition
codes. There are a total of 45 fields with detailed
information relevant to student Alternate Assessment
scores.
8/1/2017
9
STUDENT DATA TOOL
Reporting Sheet
• Use your Student Data Tool reporting sheet to
identify cells and their contents.
•
http://www.education.ky.gov/KDE/Administrative+Resources/Testing+and+Reporting+/District+Su
pport/Kentucky+Alternate+Assessment+Program/KAAP+Resources.htm
• Cells provided 1-45 have a specific purpose.
• The reporting sheet provides descriptive
interpretation of each cell.
8/1/2017
10
CELLS 1-10
• Cells 1-9 consist of student biographic
information. (Lithicode does not apply to AA)
• Cell 10 identifies the student’s dimension.
• (A or B)
AA Scores Query
Litho
(1) N/A
8/1/2017
Grade
(2)
Year
(3)
Code
od
(4)
Code
ogod
(5)
Ssid
(6)
Lname
(7)
Fname
(8)
mi
(9)
PerfDi
m (A
or B)
(10)
11
CELLS 11-16
• Cells 11-16 identify the combined scores for each part of the
portfolio scores:
11 through 13
11 Reading Performance Level
12 Reading Complexity Level
13 Reading Supports Level
14 through 16
14 Math Performance Level
15 Math Complexity Level
16 Math Supports Level
AAScores Query
rd_perf
(11)
8/1/2017
rd_comp
(12)
rd_support
(13)
ma_perf
(14)
ma_comp
(15)
ma_support
(16)
12
CELLS 17-19 (SCIENCE ONLY)
• Cells 17-19 only apply to students in grades 4,
7, or 11 completing the science assessment.
17 through 19
17 Science Performance Level
18 Science Complexity Level
19 Science Supports Level
AA Scores Query
sc_perf
(17)
8/1/2017
sc_comp
(18)
sc_support
(19)
13
CELLS 20-26
• Cells 20-26 provide the assigned score (NAPD) for each content
area.
– Cell 20 Reading (portfolio assessment) Score
– Cell 21 Mathematics (portfolio assessment) Score
– Cell 22 Science (portfolio assessment 4, 7 and 11)
– Cell 23 Social Studies (attainment task) Score
– Cell 24 Arts and Humanities (attainment task) Score
– Cell 25 PL/CS (does not apply)
– Cell 26 Writing (attainment task) Score
AA Scores Query
RD_Lvl
(20)
8/1/2017
MA_Lvl
(21)
SC_Lvl
(22)
SS_Lvl
(23)
AH_Lvl
(24)
PL_Lvl
(25)
WR_Lvl
(26)
14
CELLS 27-30
• Cells 27-30 focus on scores from the Transition
Attainment Record (TAR).
• Scores apply only to students in grades 8, 10 or 11.
• Cell 27- TAR Reading Score
• Cell 28- TAR Mathematics Score
• Cell 29- TAR Science Score
• Cell 30- TAR Combined Score
AA Scores Query (Students in grades 8, 10, 0r 11 only.)
TAR_RD_Score
(27)
8/1/2017
TAR_MA_Score
(28)
TAR_SC_Score
(29)
TAR_Comp_Score
(30)
15
CELLS 31-35
• Cells 31-45 focus on the condition codes applied to
reading, mathematics and science portfolio entries.
• Cells 31-35 provide condition codes for reading
standards 1-5. Dimension B students would only show
information in cells 31-33.
AA Scores Query
Rea1CC_1
(31)
8/1/2017
Rea2CC_1
(32)
Rea3CC_1
(33)
Rea4CC_1
(34) (A ONLY)
Rea5CC_1
(35) (A ONLY)
16
CELLS 36-40
• Cells 36- 40 provide condition codes for mathematics
standards 1-5. Dimension B students would only show
information in cells 36-38.
AA Scores Query
Mat1CC_1
(36)
8/1/2017
Mat2CC_1
(37)
Mat3CC_1
(38)
Mat4CC_1
(39) (A ONLY)
Mat5CC_1
(40) (A ONLY)
17
CELLS 41-45
• Cells 41-45 provide condition codes for science
standards 1-5. Dimension B students would only show
information in cells 41-43. Science applies to students in
grades 4, 7 and 11.
AA Scores Query (Applies to grades 4, 7 and 11.)
Sci1CC_1
(41)
8/1/2017
Sci2CC_1
(42)
Sci3CC_1
(43)
Sci4CC_1
(44) (A ONLY)
Sci5CC_1
(45) (A ONLY)
18
CONDITION CODES
•
http://www.education.ky.gov/KDE/Administrative+Resources/Testing+and+Reporti
ng+/District+Support/Kentucky+Alternate+Assessment+Program/KAAP+Resources.
htm
• The condition codes reported on the student
data tool were designed to provide feedback
for each standard assessed in the content
areas represented by the Alternate Portfolio.
• “Please be aware that not all condition codes
affect the Alternate Portfolio Score.”
8/1/2017
19
CONDITION CODES
• Every condition code is broken down by subcomponents as
shown below. KDE only reports the whole number as a code.
When determining what was missing or completed
inappropriately; focus on each area as an alert for correcting
future assessments. Time does not permit an individual report
for every section of a code to be reported.
– 1.0 Code of Ethics- continue to score the portfolio and provide a raw score, but record
a Condition Code of 1.
•
•
•
8/1/2017
1.1 Not Present
1.2 Not Signed by Teacher
1.3 Not Signed by Administrator
20
REPORTING CODES
• When viewing the student data tool, any standard with assessment,
administration, or scoring abnormalities has been assigned a condition
code.
Mat1CC_1
1
• The example provided shows that for math standard 1, a condition code of
1 (Code of Ethics) was assigned.
• When completing this years assessment, the teacher needs to make sure a
Code of Ethics, signed by the teacher and administrator, has been
submitted for the student. (only 1 required per student)
8/1/2017
21
REPORTING CODES
• Some standards may receive more than one condition code
for an individual standard. If this situation occurs then
multiple codes would be reported for that standard.
Rea3CC_1
259
• Reading standard 3 has not been given a condition code of
“259”, it has received a 2, a 5 and a 9. A 2 for alignment, a 5
for Insufficient Evidence and a 9 representing development
concerns found during scoring.
8/1/2017
22
CONDITION CODE 1
Code Ethics
8/1/2017
CODE
CODE
EXPLANATION
APPLIED TO SCORE
1.1
Not present
Continue to score the
portfolio and provide a raw
score but record a
Condition Code 1. (Applies
to All for Code 1)
1.2
Not signed by teacher
1.3
Not signed by
administrator
23
CONDITION CODE 2
Alignment
CODE
CODE EXPLANATION
APPLIED TO SCORE
2.1
CAN ALTER SCORE
Condition and demonstrator not
aligned to the
Measurable/Observable Skill
and the assessment probe is
missing.
Score all dimensions 0
2.2
CAN ALTER SCORE
Assessment Probe is not
aligned to the Measureable,
Observable Skill
Score all dimensions 0
Work sample not aligned to the
standard
Use the assessment probe to score
all dimensions
2.3
2.4
CAN ALTER SCORE
Measurable/Observable Skill
does not match the
requirements.
Score all dimensions 0
2.5
CAN ALTER SCORE
Assessment probe (test) does
not address all of the
requirements of the
Measurable/Observable Skill
Score performance and complexity a
1, score supports according to the
rubric and record the condition code.
*Note: Supports can not score above
a2
8/1/2017
24
CONDITION CODE 3
Date Error
CODE
CODE EXPLANATION
APPLIED TO SCORE
3.1
Work sample is dated prior to
baseline probe
currently does not affect the
score of the alternate
assessment portfolio (APPLIES
TO ALL CONDITION CODE 3)
3.2
Work sample is dated in
between probes 2-4
3.3
Work sample is dated same date
as probe
3.4
Baseline and following probe on
same day
3.5
Work sample is dated after
assessment probe (test)
3.6
Baseline and final three
assessment probe scores are
within one week
3.7
Baseline and final three
assessment probes scores are
all on the same day
8/1/2017
25
CONDITION CODE 4
Documentation Error
CODE
CODE EXPLANATION
APPLIED TO SCORE
4.1
Work sample not scored correctly
Currently does not affect Alternate
Assessment score
4.2
Work sample not scored
Currently does not directly affect
Alternate Assessment score – Use
the assessment probe to score all
dimensions
4.3
Work sample not dated
Currently does not directly affect
Alternate Assessment score – Use
the assessment probe to score all
dimensions
4.4
Work samples are out of order
Currently does not affect Alternate
Assessment score
4.5
Page numbers missing
Currently does not affect Alternate
Assessment score
4.6
Page numbers are inconsistent (out
of order, skipped, etc.)
Currently does not affect Alternate
Assessment score
8/1/2017
26
Condition Code 4
(continued)
CODE
CODE EXPLANATION
APPLIED TO SCORE
4.7
Assessment probe responses
are prompted
Performance cannot score
above a one because the
performance was not
independent.
A task direction is not a
prompt
4.8
Work Sample responses are
prompted
A task direction is not a
prompt
4.9
A task direction is not a
prompt
8/1/2017
All responses on the
assessment probes and the
work samples are prompted
Use work samples to score
complexity and supports.
Use assessment probe to
score complexity. This does
not affect performance.
Score Performance and
Complexity at a level one.
Supports cannot score above a
level 2.
27
CONDITION CODE 5
Insufficient Evidence
CODE
CODE EXPLANATION
APPLIED TO SCORE
5.1
Fewer than the required assessment
probes scores
Score as long as baseline and one
additional probe score are present
5.2
No citation or photocopy of grade level
text
Record condition code and score
Assessment probe (test) not present
Record condition code, score
performance, complexity, and supports
from the Individual Assessment
Target. **Cannot score above a 2 for
complexity or supports if work sample
is also missing
Work sample not present
Use the assessment probe to score all
dimensions
Fewer than required number of
standards
Score all dimensions of missing
standards as 0
Baseline assessment probe score @
50% for Dimension A students only
Score as usual, record condition code
5.3
CAN ALTER SCORE
5.4
5.5
CAN ALTER SCORE
5.6
5.7
CAN ALTER SCORE
Baseline assessment probe score
above 50% for Dimension A students
only
Score performance at 0, score
complexity and supports with rubric
5.8
CAN ALTER SCORE
Missing Individual Assessment Target
Sheet
Score all dimensions of all standards 0
8/1/2017
28
CONDITION CODE 6
Could result in allegation investigation
• Information that may influence scorer (e.g., statements
relating to student disability/behavior etc.)
• No information can be provided that gives the scorer
unnecessary data not relevant to the actual assessment.
Student behaviors, medical conditions, or activities
not related to the assessment should never be
provided.
• Portfolio scored by the instructor or DOK level
included in the portfolio will not result in an
allegation investigation but will receive a condition
code of 6.
8/1/2017
29
CONDITION CODE 7
The instrument or worksheet content error
CODE
CODE EXPLANATION
APPLIED TO SCORE
7.1
Instrument/worksheet has incorrect
information (referring to a triangle as
an irregular shape)
currently does not affect the score of
the alternate assessment portfolio
7.2
Student was given less than three
choices
currently does not affect the score of
the alternate assessment portfolio
7.3
Instrument/worksheet contains
unethical/illegal information (“we feed
chickens so they grow to fight”
provided as a choice)
currently does not affect the score of
the alternate assessment portfolio
8/1/2017
30
CONDITION CODE 8
Miscellaneous
CODE
CODE EXPLANATION
APPLIED TO SCORE
8.1
Assessment probe (test) dated after
assessment window closed
currently does not affect the score of
the alternate assessment portfolio
8.2
Work sample dated after assessment
window closed
currently does not affect the score of
the alternate assessment portfolio
8.3
Student performance dimension is
not indicated on the Content Area
Cover Sheet
currently does not affect the score of
the alternate assessment portfolio
8.4
Dimension marked on the coversheet
and dimension completed are
contradictory.
currently does not affect the score of
the alternate assessment portfolio
8/1/2017
31
CONDITION CODE 9
- Development concerns identified at scoring –
8/1/2017
CODE
CODE EXPLANATION
APPLIED TO SCORE
9.1
Test and instruction are
identical for same student
Could result in allegation
investigation
9.2
Duplicate work in multiple
student portfolios
(Photocopied)
Could result in allegation
investigation
9.3
All content area assessment
probes combined all into one
test
Could result in allegation
investigation
32
CONCLUSION
• If you have additional questions; contact in
the following order:
• School Administrator (principal, supervisor)
• District Assessment Coordinator (DAC)
8/1/2017
33
KDE
• Kentucky Department of Education (Kevin
O’Hair)
• Kevin O'Hair
Division of Assessment Support
Kentucky Department of Education
18th Floor Capital Plaza Tower
500 Mero Street
Frankfort KY 40601
Ph: (502)564-4394 ext. 4164
kevin.o'[email protected]
8/1/2017
34