Preparing for the
Administration of the Spring
2015
Dynamic Learning Maps
(DLM) in English Language
Arts and Mathematics
February 23, 2015 Version
PART TWO
NJ DLM Winter Training 2015
1
Professional Development Modules


DLM developed over forty self-directed professional
development modules to help support the transition to the
new alternate assessment and Common Core State
Standards instruction.
Some of the modules include:
◦ DLM Claims and Conceptual Areas
◦ Composing, Decomposing, and Comparing Numbers
◦ Writing: Text Types and Purposes


The learning modules provide significant information on
the background, purpose, and design of the assessment as
well as guidance on providing instruction on the CCSS, the
DLM conceptual areas, EEs, and nodes.
Viewing the PD modules is optional, though educators will
find the information informative.
NJ DLM Winter Training 2015
2
Assessment Coordinator
Responsibilities
Includes but not limited to:
◦ Schedules training for teachers and is the direct liaison for
teacher questions
◦ Ensures the correct students are assessed
◦ Assists in scheduling students for testing
◦ Interacts with District Data Steward and Technical Liaison to
ensure all tasks are completed
◦ Utilizes DLM website, reviews materials, and disseminates
information to staff
◦ Reviews DLM Manual and any other required documents
◦ Contacts DLM help desk when DLM documents do not
provide clear answers to district questions
◦ District point of contact for test activities
NJ DLM Winter Training 2015
3
Sample of Assessment Coordinator
Checklist in Manual
NJ DLM Winter Training 2015
4
Note:
This page is from
the DLM NJ
website and is for
the Assessment
Coordinator
NJ DLM Winter Training 2015
5
Data Steward Responsibilities
Includes but not limited to:
◦ Interacts with Assessment Coordinator, Technical Liaison, and Teachers as
necessary to ensure successful completion of testing
◦ Creates and uploads data files including:
 the Users file (opens DLM user accounts for testing)
 Enrollment file
 Class roster files
◦ Assigns roles to users which generates user login IDs
◦ Understand and utilize IT/technical expressions contained in the
System Start-Up Manual in order to prepare files correctly
according to specifications
◦ Utilize consistent and appropriate naming conventions and provide clean data
for data files in order to successfully upload files as outlined by the DLM User
Guide for State and District Staff (Data Steward)
◦ Utilizes DLM website, reviews materials, and disseminates information to staff
◦ Reviews DLM Manual and other applicable documents (e.g. Data Tips, etc.)
◦ Contacts DLM help desk when DLM documents do not provide clear answers
to user account issues, data file upload errors, etc.
NJ DLM Winter Training 2015
6
Sample of Data Steward Checklist in
Manual
NJ DLM Winter Training 2015
7
Note:
This page is from
the DLM NJ
website and is for
the Data Steward
NJ DLM Winter Training 2015
8
Recent DLM Email Update
Recent KITE and Educator Portal updates.
 Looking for the student Username and Password
to access KITE? You’ll find it in the Test
Management area of Educator Portal. See the
procedure titled View Student Username and
Password in the TEST ADMINISTRATION MANUAL.
 Up to 6,000 records may be uploaded at a single
time using the Enrollment or Roster templates.
 Accessibility Profile Data Extract includes new
fields for Last Modified Time (with date and time)
and Last Modified User.

NJ DLM Winter Training 2015
9
Technical Liaison Responsibilities
Includes but not limited to:
◦ Is responsible for the infrastructure (network, hardware and
devices), software applications and technical support as well as
understanding how the hardware, software, policies, and procedures
fit together in the big picture of the district’s technology
implementation.
◦ Ensures district technology readiness and implementation (IT staff)
◦ Reviews DLM Technical Liaison Manual revised 1/13/2015 and
completes all tasks
◦ Interacts with Assessment Coordinator, District Data Steward, and
Teachers as necessary to ensure successful completion of testing
◦ Utilizes DLM website, reviews materials, and disseminates
information to staff
◦ Contacts DLM help desk when DLM documents do not provide
clear answers to technology issues
NJ DLM Winter Training 2015
10
Sample of Technical Liaison
Checklist in Manual
NJ DLM Winter Training 2015
11
This is from
the KITE page
Note:
This page is
from the DLM
NJ website and
is for the
Technical Liaison
NJ DLM Winter Training 2015
12
Webinars for School and District
Staff Who Monitor Assessment
NJ DLM Winter Training 2015
13
Webinars for School and District
Staff Who Monitor Assessment

Recorded versions of the webinars will be
available on the DLM website 2 days after
the live session. Staff who could not
participate in a live webinar could use the
recording to learn about the responsibilities
and procedures to monitor assessments.
NJ DLM Winter Training 2015
14
Classroom Teacher/Test Administrator
Responsibilities
Includes but not limited to:
◦ Provide instruction throughout the year related to the
CCSS, EEs, nodes, etc.
◦ Assist in the completion of the First Contact and PNP
surveys.
◦ Activate educator portal user ID in KITE
◦ Schedule students for testing and gather needed
supports such as manipulatives
◦ Reviews DLM Manual, reviews the accessibility features
of the DLM system, completes required training
modules, and reviews DLM website for any other
required documents/necessary information
◦ Contacts District/School Test Coordinator with any
questions or issues
NJ DLM Winter Training 2015
15
Test Administrator Partial Checklist
from Manual for Teachers
NJ DLM Winter Training 2015
16
Note:
This page is from
the DLM NJ
website and is for
the teacher who
administers the
DLM
NJ DLM Winter Training 2015
17
TEST ACCESSIBILITY
AND OTHER FEATURES
NJ DLM Winter Training 2015
18
Online Student Surveys
There are two student surveys that are
completed by the student’s teacher, and who may
be assisted by other educators who knows the
student well.
 The First Contact survey asks questions about
the student’s level of skills in ELA and Math.

◦ This survey assists in the selection of the level of test
items (node linkage levels).

The Personal Needs Profile asks questions about
the students’ support and accessibility needs
during testing.
◦ This survey assists in the selection of the computer
accessibility features and other support needs during
testing.
NJ DLM Winter Training 2015
19
Online Student Surveys

First Contact
◦ Online survey completed
by ELA and Math
classroom teachers. A
copy of the student’s IEP is
needed as a reference
when answering the
questions.
◦ This survey helps identify
the student’s academic
levels in order to establish
a baseline as the system
selects test items.
NJ DLM Winter Training 2015

Personal Needs
Profile (PNP)
◦ PNP online survey must be
completed for each
individual student being
tested for DLM.
◦ Once PNP is completed, a
summary will be generated.
◦ This profile collects
information on the
students support needs
and current level of
instruction, and engages
computer accessibility
features.
20
Accessibility Manual
This manual was updated on February 16, 2015.
If the FC and PNP surveys were completed during
field testing, please review them one more time,
then hit submit in order to finalize the survey info.
NJ DLM Winter Training 2015
21
Accessibility Features
DLM offers a variety of accessibility tools
and supports during assessment.
 Some of these are delivered through the
KITE system, which are determined by
responses to the First Contact and
Personal Needs Profile (PNP) survey.
 Other supports, such as having the
teacher read the test aloud, is provided by
the school.

NJ DLM Winter Training 2015
22
Accessibility Features
Six Steps to Customize DLM Accessibility Features for Students
Step 1: Include Eligible Students in the DLM Assessment
Step 2: Learn About the DLM Accessibility Features: What Does DLM
Provide?
Step 3: Discuss and Select Appropriate Supports and Tools: Considerations
for IEP Teams
Step 4: Enter Appropriate Supports into the DLM System
Step 5: Prepare for the Assessment: Using the Chosen Accessibility Features
Step 6: Evaluate the Accessibility Features Used After the Assessment
These six steps are explained in detail in the Accessibility Manual for DLM 20142015. Steps 1 through 3 are intended for full IEP teams to determine the
accessibility features for eligible students, and steps 4 through 6 are for the
educator or test administrator to enter, use, and evaluate the effectiveness of
the selected features.
NJ DLM Winter Training 2015
23
Computer synthesized
read aloud is no longer
available. Teachers will need
to provide this support if
needed by the student.
Category 1: Supports provided within DLM via the PNP profile
Online supports include magnification, invert color choice, color contrast,
and overlay color. Descriptions about how to select supports provided by
the PNP are found in Step 4 of the six-step DLM accessibility
customization process.
NJ DLM Winter Training 2015
24
Category 2: Supports requiring additional tools or materials
These supports include Braille, switch system preferences, iPad
administration, and use of special equipment and materials. These supports
typically require prior planning and setup. These supports are all recorded in
the PNP even though two-switch system is the only option actually
activated by PNP.
NJ DLM Winter Training 2015
25
Category 3: Supports provided outside the DLM system
These supports require actions by the test administrator, such
as reading the test, signing or translating, and assisting the
student with entering responses. These supports are recorded
in the PNP even though they are delivered by the test
administrator.
NJ DLM Winter Training 2015
26
Supports: Braille Test
Please contact the Office of
Assessments if you have a DLM student
that needs a Braille test.
 Final information is not yet available.

◦ [email protected]
NJ DLM Winter Training 2015
27
What Must Be Written in a Student’s
IEP Regarding Accessibility?
Specific instructional supports are usually included, such as
use of communication board, picture symbols, text read
aloud to the student, etc.
 For DLM the training materials will describe which
accessibility features, supports, etc. are available.
 Select only the DLM accessibility features that are familiar to
the student based on instruction.

◦ It is not necessary for all test accessibility features and supports be
listed in the IEP for DLM. However, it is important to select the
features and supports for testing that students need during instruction.
◦ An accessibility feature may be used by the student even if it is not
explicitly listed in the IEP.
NJ DLM Winter Training 2015
28
General Test Information
Practice item testlets are available on the DLM
system and should be administered to the students
prior to testing.
 Practice testlets relate to various accessibility
features the student may use. Select the practice
testlets (“demos”) based on the PNP features.
 The purpose of using the practice items are to

◦ confirm that the accessibility features engaged are
appropriate for the student.
 If they are not you may revise the PNP before administering the
test.
◦ give the student experience with the online test
experience prior to answering live test questions.
 This allows the student and teacher to be aware of the
computer features, and helps to determine whether the student
or teacher would “drive” (use the computer mouse) during
testing.
NJ DLM Winter Training 2015
29
General Test Information
Prompting is not allowed in the DLM
system.
 Teachers may repeat a test question and
then pause an appropriate amount of
time for a student to process the
question and select an answer.

◦ If a student does not answer a question the
teacher will mark “no response” if listed as
one of the student response options.
 If a student cannot answer the question, and ‘no
response’ is not an option provided by the system,
then do not mark a response and continue to the
next test item.
NJ DLM Winter Training 2015
30
Clarification Allowed if Needed

Some test item directions ask the teacher to
say “Show me the ….”
◦ If necessary, after stating the phrase “Show me
the …,” you may restate the phrase for
clarification by saying either of the following:
 “Look at the …”
 “Point to the …”
 “Touch the …”

For example, the teacher may say “Show me
the red marker.” Then for clarification say
“Point to the red marker.”
NJ DLM Winter Training 2015
31
Educator Resource Page
Review the DLM web page
http://www.dynamiclearningmaps.org/cont
ent/erp_ye to obtain information on
sample testlets, tested Essential Elements,
familiar texts, and other important
information.
 The following slide shows an excerpt
from the DLM math glossary, a summary
of the math terms utilized during testing.

NJ DLM Winter Training 2015
32
Section of the Glossary
NJ DLM Winter Training 2015
33
Manipulatives

The list of math manipulatives needed for
each grade level is available on the
Educator Portal.
◦ Teachers can login to the portal and access the
list of manipulatives needed for any grade.

Once the student ticket is available, click on
the Test Management tab in the Educator
Portal.
◦ This tab is where the TIPS pages are located, as
well as the student test tickets.
◦ The manipulative list associated with the
assigned student testlet will be described in the
TIPS page.
NJ DLM Winter Training 2015
34
Testlet Information Page
NJ DLM Winter Training 2015
35
Manipulatives

Once a teacher reviews the TIPS page and
the recommended manipulative list, he/she
may make appropriate substitutions if
necessary when the original manipulative is
not available in the school/district or if
substituting a manipulative is best for the
student.
 Consider the attributes of the required manipulative
when selecting a substitute. The substitute
manipulative must fulfill the required attributes,.
 Example: if the original manipulatives were two large red
buttons and one small blue button, you may substitute with
two large red markers (exact same markers) and one small
blue marker. Do not use red markers that are not the same
size, and do not use a blue marker that is the same size as
the red markers.
NJ DLM Winter Training 2015
36
SECURITY
INFORMATION
NJ DLM Winter Training 2015
37
SECURITY PLAN
•
Mandatory Turnkey Training
•
Technology Problems
•
Reporting Breaches & Irregularities
•
Chain of Command
•
Disruptive or Sick Student
NJ DLM Winter Training 2015
38
Security Protocols for Computer Based Testing
 All computers must have the required software to support
computer-based testing.
 KITE is the site used to access testlets.
 Educator Portal is used to input and review data,
obtain student test tickets, etc.
 All computers have access to broadband and secure
internet connectivity.
 Consider whether or not proctor caching is necessary
in each school.
NJ DLM Winter Training 2015
39
TESTING SITES
• Testing requires a computer or tablet device with the KITE
application
•Testing may be done in the classroom as long as:
•The student can hear and respond to directions and test
questions without loud background noise or noise at a level
that would disturb the testing student.
•Other students and staff cannot view the test questions.
•Testing may be done in a computer center, quiet office, or other
alternate location that offers a secure and quiet environment.
• NO Cell Phones, MP3 Players or Any
Unauthorized Electronics
NJ DLM Winter Training 2015
40
TEST SECURITY
• Security is a district wide responsibility.
• Absolutely NO reproduction or transmittal by any means of test
items, passages, prompts, or other secure items or materials.
•
Security breaches may have:
• Financial consequences for the district
• Professional consequences for staff
• Disciplinary consequences for students
• Inform ALL district & school personnel of security procedures prior
to test administration
• Review the module on test security posted in late March on the
DLM NJ webpage.
NJ DLM Winter Training 2015
41
Test Security

Information on reporting irregularities and
security breaches during testing along with the
forms will be posted to the DLM NJ page by the
end of March.

The test security agreement for all educators involved
in DLM will be posted on the DLM NJ page in March.


Teachers administering the DLM will electronically sign a test
security form found on the KITE Educator Portal.
All other educators involved in DLM will sign the New Jersey
paper version of the test security agreement and submit it to the
District Test Coordinator prior to April 6, 2015.


This form will be posted to the DLM NJ page in late March.
DLM test results will be included in the state
accountability reports produced by the Title I
office.
NJ DLM Winter Training 2015
42
MORE INFORMATION
NJ DLM Winter Training 2015
43
Topics Not Included

As information becomes available on
scoring and reporting of DLM results, it
will be posted on the DLM website.

Standard setting will occur the week of June 15.
Educators who are interested in participating in
DLM standard setting should contact
[email protected]

DLM test results will be included in the
state accountability reports produced by
the Title I office.
NJ DLM Winter Training 2015
44
Forms for DLM
Forms for documenting teacher
administration observations will be
available online by end of March.
 These forms are optional, but will help
you collect administration information
useful for DLM, Office of Assessments,
and your school.
 Please check the DLM NJ page in late
March to review the forms for possible
use.

NJ DLM Winter Training 2015
45
District Communication
Districts must share information among staff, and
ensure that all DLM teachers are prepared for
instruction and testing.
 The Assessment Coordinator must turn key train
all administrators involved in testing, and provide
copies or web links to the required training
materials.
 Only the District Assessment Coordinator, Data
Steward, and Technical Liaison may contact the
DLM help desk or DOE with questions.

◦ Please ask others to communicate their questions to
you clearly with specific error references and/or
training material page references so that you might
obtain the information.
NJ DLM Winter Training 2015
46
Where To Get More Information?
DLM has various customer support contact information
depending on the issue. It is imperative that:




Only those individuals serving as Assessment Coordinator, Technical
Liaison, and Data Steward contact DLM.
Contact DLM support only after reviewing all pertinent manuals,
handbooks, and modules.
Use the specific contact info listed in the applicable manual to ensure
your question is directed to the correct individuals.
Provide in your email your CDS code (known to DLM as your
“Organization”), your name and which of the three positions above
you hold, as well as detail the specific issue/error you encountered.
◦ Questions directed to DLM Support, and when necessary NJ DOE, must
be from either the Assessment Coordinator, Technical Liaison, or the
Data Steward.
 Questions from other district staff including teachers must be
directed to one of the following individuals noted above.
NJ DLM Winter Training 2015
47
Where To Get More Information?
Questions regarding DLM please contact the Customer Service
Help Desk via PHONE: 1-855-277-9751 (toll free) or Email
[email protected]
 Prior to requesting assistance, DLM information must be
reviewed. Specific questions related to the training manuals, KITE,
educator portal, and other DLM topics should be addressed to
the DLM helpline with specific details about the issue. Use
manual page references when applicable, and cite the exact
system error or issue you are experiencing.
 DLM and Office of Assessment staff cannot summarize
or provide topic information in place of educator review
of the training materials. Review all DLM materials
prior to contacting the help desk.
NJ DLM Winter Training 2015
48
Where To Get More Information?
Assessment Coordinators with general questions about test design,
training, accessibility features, scheduling, test administration, etc.,
contact:
Elizabeth Celentano
Office of Assessments
609-984-0107
[email protected]
Data Stewards with questions about APA and DLM student data file
uploads, Pre-ID, SDIF, record changes, score interpretation, and other
data file issues etc., contact:
Jo-Lin Liang
Office of Assessments
609-633-6884
[email protected]
Please contact DLM support for assistance prior to the Office of
Assessments in order to facilitate a timely response.
NJ DLM Winter Training 2015
49
Where To Get More Information?
Technical Liaisons with questions about technology
readiness issues contact:
Linda Carmona-Bell
Office of Assessments
609-292-1414
[email protected]
Joseph Seaman
Office of Assessments
609-292-8407
[email protected]
Please contact DLM support for assistance prior to the Office of Assessments in
order to facilitate a timely response.
NJ DLM Winter Training 2015
50
NJDOE Contact Information
www.state.nj.us/education
[email protected]
Test Coordinators
PARCC 3-5
Orlando Vadel
609-341-3456
PARCC 6-8
Timothy Steele Dadzie
609-777-2087
PARCC HS & HSPA
Veronica Orsi
609-292-8739
DLM Technology
Joseph Seaman
609-292-8407
DLM Technology
Linda Carmona-Bell
609-292-1414
NJBCT & NJASK Science
Michael Luke, Interim
609-292-3226
APA & DLM
Elizabeth Celentano
609-984-0107
AHSA
Faye Ball
609-984-1970
NAEP
Tabitha McKinley
609-984-1540
NJ DLM Winter Training 2015
51
Office
of Assessment - Fax
609-984-6032
NJDOE
HSPA
Measurement Specialists
& Biology
Rob Akins
609-984-1435
DLM/APA
Jo-Lin Liang
609-633-6884
PARCC
Don White
609-777-2051
NJ DLM Winter Training 2015
Where To Get More Information?
Office of Special Education (general special
education questions; please do not send DLM
questions to this office)
New Jersey Department of Education
609-292-0147
http://www.nj.gov/education/specialed/
Department of Education website:
www.state.nj.us/education
NJ DLM Winter Training 2015
53
Final Notes
I hope you have found this information
helpful.
 Please check back to the DLM NJ
webpage periodically in March for
additional modules.
 Thank you for your time.

NJ DLM Winter Training 2015
54