Data Pipeline - Colorado Department of Education

Data Pipeline Regional Training
2013
1
Who Are We?
 Project Manager for Data Pipeline:
 Lisa Bradley (303) 866-4902 [email protected]
 Data Services Unit:
 Kevin Smith (Student October/Student Interchange) (303) 866-6723







[email protected]
Heather Ford-Sajovetz (Student End of Year) (303) 866-6755 [email protected]
Annette Severson (Student Discipline and HR/Staff Interchange) (303) 866-6824
[email protected]
Dennis St. Hilaire (Directory and Report Card March) (303) 866-6840
[email protected]
Debbie Puccetti (RITS/EDIS) (303) 866-697 [email protected]
Kristi Gleason (December Count/SPED Interchange) (303) 866-4620
[email protected]
Lindsey Heitman (SPED End of Year) (303) 866-5759 [email protected]
Jan Rose Petro (Director) (303) 866-6838 [email protected]
Who Are We?
 Other Data Pipeline Contacts:
 Jessica Allen (TCAP/CoAlt, ACT, ACCESS SBDs and Pre-coded Labels process) (303) 866-6281





[email protected]
Linda Lamirande (11th Grade Alternate Assessment) (303) 866-6863
[email protected]
Nazanin Mohajeri-Nelson (Math Science Partnerships) (303) 866-6205
[email protected]
Donna Morganstern (Title I Interchange) (303) 866-6209 [email protected]
Dian Prestwich (READ) (303) 866-6150 [email protected]
Adam Williams (Finance) (303) 866-6843 [email protected][email protected]
Together We Can
Vision
All students in Colorado will become educated and
productive citizens capable of succeeding in a globally
competitive workforce.
Mission
The mission of CDE is to shape, support, and safeguard a
statewide education system that prepares all students
for success in a globally competitive world.
4
Goals
Students
Successful students
Prepare students to thrive in their education and in a globally competitive workforce.
 Ensure every student is on track to graduate postsecondary and workforce ready.
 Increase achievement for all students and close achievement gaps.
 Ensure students graduate ready for success in postsecondary education and the workforce.
 Increase national and international competitiveness for all students.
Great teachers and leaders
Educators
Ensure effective educators for every student and effective leaders
for every school and district.
 Increase and support the effectiveness of all educators.
 Optimize the preparation, retention, and effectiveness of new educators.
 Eliminate the educator equity gap.
Outstanding schools and districts
Schools/
Districts
State
Build the capacity of schools and districts to meet the needs of
Colorado students and their families.
 Increase school and district performance.
 Turnaround the state’s lowest performing districts and schools.
 Foster innovation and expand access to a rich array of high quality school choices for students.
Best education system in the nation
Build the best education system in the nation.
 Lead the nation in policy, innovation, and positive outcomes for students.
 Operate with excellence, efficiency, and effectiveness to become the best SEA in the nation.
 Attract and retain outstanding talent to CDE.
5
Driving
Questions
Students
Educators
Schools/
Districts
6
What do we want
students, educators,
schools, and districts to
know and be able to do?
How will we
know if
expectations
are met?
How will we respond
when help is needed
and to support
continued growth?
Assessments
•
•
•
•
RTI
PBIS
Targeted interventions
IEPs
Educator quality
standards
Educator
evaluations
•
•
•
•
Induction
Mentoring
Professional development plans
Remediation plans
Performance
indicators
School and
district
performance
frameworks
• Unified planning
• Priority
• Turnaround
Colorado Academic
Standards
Expanding Student Learning
When we intentionally integrate…

Coherent and rigorous academic standards

Innovative and engaging learning options

Supported and effective educators

Aligned and meaningful assessments

Statewide and district accountability
We can personalize learning and
ignite the potential of every
student.
7
Before We Begin . . .
Change is Difficult!!!
 How do you feel?
• Excitement, fun
• Trepidation, dread
 Intent is to streamline efforts
• Probably not first year
• CDE is learning too
Know Data Pipeline Before 2013-14
 Strong, basic understanding
 In lieu of a hands on computer lab
 Get to Know Data Pipeline Activity
 3 student files
 How to Download Files
 Activity Instructions
 Pilot Phase Two
 Current ADE respondents alerted
 Open to all
 Complete as many as needed
 Minimum: Student and Staff
 Two-week focus periods for various submissions
Technical Assistance Efforts Increasing
 Town Halls on high interest topics
 Thursdays 9:00 -10:00 am
 Begins March 21st
 Submission specific webinars
 Process change webinars
 Self assessment
 [email protected]
Transition Discussions Necessary
 Data Pipeline is a new way of thinking
 Will require a change in processes
 Administration must be aware
 Communication essential
 Administrators
 IT staff
 Business owners
 Vendors
Two Musts for a Successful Transition
for the 2013-14 Implementation
1.
Communicate,
Communicate,
Communicate
2. Pilot,
Pilot,
Pilot
Meeting Objective
The purpose of this meeting is to provide all respondents with a
better understanding of the changes that are associated with
pipeline and an action plan of how to prepare for the changes.
The changes we discuss include data pipeline terminology and
process changes.
14
Agenda
 Data Pipeline
 Overview
 Pipeline Calendar
 Changes/Similarities compared to ADE
 Benefits
 Terminology
 Demonstration
 Types of Collections
 Essential Steps
 Communication Needed for Success (within your organization,
between organizations, vendors)
 Roles and Responsibilities (Oracle Identity Management)
Data Pipeline - Project Overview
Collection Submission Process
 Current Process - ADE
 Point-in-time
 Level 1 & 2 edits – collection specific
 Text files only
 Each collection has a collection owner
 New Process – Data Pipeline
 Interchanges rather than collections
 Ed-Fi data model (national standard)
 Level 1 business rules
 Submission options
 Web services or Flat files (Excel, .csv, or text)
 Snapshots
 Pulls data from interchanges
 Level 2 business rules
Data Pipeline vs. ADE – Similarities
and Differences
Presentation Challenge
Name two differences
between ADE and Data
Pipeline
19
Challenge Answer
 ADE
 Point in time
 Only text files
 Single login for one collection owner
 Data Pipeline
 Data can be submitted any time
 Support multiple file formats (text, csv, excel)
 Multiple logins and privileges
Interchanges
 Data sent to CDE from district’s system
 Submit at any frequency
 Submit using excel, csv, or text
 Web services available for real time submission
 Based on common data rather than reporting requirements
 Student
 Staff
 Special Education IEP
 Title I
 Discipline
 Teacher/Student Data Link
Interchanges
Interchange
Student &
Enrollment
Files Required
Student
Student School Association
Advanced Course Completion
Staff &
Assignments
Discipline
Staff
Staff Assignment Association
Discipline Incident
Discipline Action
Special Education Child
Student Special Education
Participation
Student Parent Association
Special Education
IEP’s
Teacher/Student
Math Science Partnership
Data Link
Title 1 Interchange Title I File
Collections Represented
Student October
Student End of Year
Special Education December Count (student)
Special Education End of Year
Pre-coded Labels
SBD (WIDA (formerly CELA), TCAP, ACT)
Human Resource
Special Education December Count (staff)
Special Education Discipline
Special Education December Count (student)
Special Education End of Year
Math and Science Partnerships
Consolidated State Performance Report (CSPR)
Presentation Challenge
Work with a neighbor and
list four of the six
interchanges
23
Challenge Answer
 All six interchanges
 Student & Enrollment
 Staff & Assignment
 SPED IEP
 Discipline
 Title I
 Teacher/Student Data Link
Data Pipeline – Pilot Calendar
 Beginning in March (Two week segments)
 RITS
 EDIS
 Directory
 11th Grade Alternate Assessment
 Title I Interchange
 Student Interchange
 Student October
 Staff Interchange
 HR
 Finance
 SBD (Access, TCAP, ACT)
Data Pipeline – Go Live Calendar
 July 1
 RITS
 EDIS
 Directory
 September 1
 Student
 Staff
 And all other collections
 Note: ADE calendar will remain the same. (Snapshot, Year
Round and Periodic)
Benefits of Data Pipeline
• Number of collections
• 113 demographic data elements
eliminated
• Student data – 12 collections to 1
• Staff data 3 collections to 1
• Eliminated data redundancy in 15
collections/snapshots
• Complexity of collections
• 28% decrease in business rules
• 62% of business rules shifted to
Business Analyst
Collection
Human Resources
Data
Elements
Eliminated
24
Student October
12
Pre-coded Labels
14
Student End of Year
11
Mathematics and Science
Partnerships
Special Education December
Count
Special Education End Of Year
3
Special Education Discipline
14
Demographic Data
Elements Eliminated
113!!
21
14
Terminology and Definitions
Data Pipeline Definitions Documentation can be found
at the following link:
http://www.cde.state.co.us/rise/ADEReplacement-Rationale.asp
 Click on Glossary of Terms
28
Demonstration Slides
Login
Initial Data Pipeline Screen
FAQ screen
Initial Data Pipeline Screen Student
Initial Data Pipeline Screen-RITS
Initial Data Pipeline Screen- Apps
File Upload
Format Checker - Success
Format Checker
Format Checker – File has errors
Data File Upload – File Type
Data File Upload
Data File Upload – Select file
Data File Upload - Replace
Data File Upload – Batch ID
Email when job is done loading
Validation Report – with Errors
Validation Report – without Errors
Batch Maintenance
Batch Maintenance – Delete batch
Cognos Reports
Cognos Reports – Student Profile
Summary error report
Summary error report
Summary error report
Summary detail report
Summary detail report
Cognos report save options – Show
window with excel etc.
Correcting Errors
Student Profile
Student Profile – Add record
Student Profile – Edit record
Student Profile – Edit record
Student Profile – Edit record
(Errors)
Student Profile – Number rows
Creating A Snapshot
Snapshot – Student October
Snapshot – created successfully
Snapshot – with errors
Status dashboard – Submit to CDE
Snapshot – Submit to CDE
Snapshot – Download report
Status dashboard – Download
report
Snapshot – Submit Home School
data
File Extract Download
Snapshot – Report folder
Snapshot – Report listing
Snapshot – Summary report
Collection Types
Student Interchange
 3 files
 Student Demographics
 School Association
 Advanced Course Completion
 Contact information
 Heather Ford-Sajovetz
 [email protected]
 303-866-6755
 Kevin Smith
 [email protected]
 303-866-6723
Student Interchange
 Today in ADE
 Student End of Year
 Student October
 In Future
 Student is a combination of Student End of Year and Student
October
 File layout is more similar to Student End of Year
 Common format
 Simplifies changes to the system.
 Each collection is a snapshot from a common interchange(s).
Staff Interchange
 2 Files
 Staff Profile
 Staff Assignment Association
 Contact
 Annette Severson
 [email protected]
 (303) 866-6824
81
Staff Interchange
 Today in ADE
 Human Resources
 Special Education December Count (Staff)
 In Future
 Staff is combination of Special Education December Count and
Human Resources
 File Layout similar with additional evaluation fields to meet new
legislation
 Each collection is a snapshot from a common interchange
82
Discipline Interchange
 2 Files
 Discipline Incident
 Discipline Action
 Contact
 Kristi Gleason
 [email protected]
 (303) 866-4620
83
Discipline Interchange
 Today in ADE
 Special Education Discipline
 In Future
 2013-2014: Special Education students discipline reported
 2014-2015: All students discipline reported at the student level
 2013-2014 File Format already set to meet both Special Education
Discipline and Safety and Discipline Indicators (SDI) requirements
84
Special Education IEPs Interchange
 3 Files – Statewide data management system
 Special Education Child
 Student Special Education Participation
 Student Parent Association
 Contacts
 Kristi Gleason
 [email protected]
 (303) 866-4620
 Lindsey Heitman
 [email protected]
 303-866-5759
85
Special Education IEPs Interchange
 Today in ADE
 Special Education December Count (student)
 Special Education End of Year
 In Future
 Data uploaded through Statewide data management system and
populates nightly to the Pipeline
 Each collection is a snapshot from a combination of interchanges
86
Teacher/Student Data Link
Interchange
 1 Files
 Math Science Partnership
 Contact
 Nazanin Mohajeri-Nelson
 [email protected]
 (303) 866- 6205
87
Teacher/Student Data Link
Interchange
 Today in ADE
 Math Science Partnership
 In Future
 Data required for Math Science Partnership pulled from
Teacher/Student Data Link Interchange, Student Interchange and
Staff Interchange
 Currently also working on potential new file to meet other Teacher
Student Data Link requirements
88
Title I Interchange
 1 File
 Title I Participation
 Contact
 Donna Morganstern
 [email protected]
 (303) 866-6209
89
Title I Interchange
 Today
 Currently collected in CSPR spreadsheet-not in ADE
 In Future
 In separate interchange to capture additional Title I required data
90
TCAP/CoAlt SBD
 2 files combined for review
 Pre-Coded label: snapshot from Student Profile.
 SBD file from vendor
 Contact
 Jessica Allen
 [email protected]
 (303) 866- 6281
 Today in ADE
 Pre-coded Label Collection
 TCAP/CoAlt SBD
91
TCAP/CoAlt SBD
 In the Future
 Process
 Pre-coded label data pulled student profile data.
 SBD remains similar to ADE process.
 2013-2014 (anticipated)
 New Science and Social Studies Assessment collection (General and Alternate
Assessments).
 TCAP/CoAlt collection includes Mathematics, Reading and Writing.
 2014-2015 (anticipated)
 Science and Social Assessment collection (General and Alternate Assessments).
 New English Language Arts and Mathematics Assessments (PARCC)
 New Alternate English Language Arts and Mathematics Assessments
 Current TCAP/CoAlt collection eliminated.
92
ACCESS for ELLs SBD
 2 files combined for review
 Pre-Coded label: snapshot from Student Profile.
 SBD file from vendor
 Contact
 Jessica Allen
 [email protected]
 (303) 866- 6281
93
ACCESS for ELLs SBD
 Today in ADE
 Pre-coded label data pulled from Student October data.
 ACCESS for ELLs SBD
 In the Future
 Pre-coded label data pulled from Student Profile.
 SBD remains similar to ADE process.
94
CO ACT SBD
 2 files combined for review
 Pre-Coded label: snapshot from Student Profile.
 SBD file from vendor
 Contact
 Jessica Allen
 [email protected]
 (303) 866- 6281
95
CO ACT Data
 Today in ADE
 Pre-coded Label Collection
 CO ACT SBD
 In the Future
 Pre-coded label data pulled in January from student profile data.
 SBD remains similar to ADE process.
96
Snapshots
 Snapshot data taken directly from Interchanges
 Corrections to Snapshot data
 Made in the source Interchange file(s)
 Interchange File(s) resubmitted
 Snapshot created again
 Snapshots represent a ‘point-in-time’ of the data
97
Presentation Challenge
How do you correct
snapshot errors?
98
Challenge Answer
 Modify data in source system
 Communicate with other Administrative Units or Districts
 Upload data to Interchange(s)
 Create Snapshot
 Repeat to clear all errors
Snapshots
 Student October
 Human Resources
 Title I/Consolidated State Performance Report (CSPR)
 11th Grade Alternate Assessment
 Special Education December Count
 Special Education End of Year
 Special Education Discipline
 Student End of Year
 Math and Science Partnership
100
RITS (Year- Round Collection)
 1 File
 RITS READ & RITS BATCH
 Contact
 Debbie Puccetti
 [email protected]
 (303) 866-6612
101
RITS (Year- Round Collection)
 Today
 Currently can submit records online or through ADE
 Limited number of batch submissions
 Optimizer is separate process
 Web process
 In Future
 Can continue to submit online or through Pipeline
 New tool within Pipeline to replace Optimizer
 Unlimited number of batch submissions
 Web process (no change)
102
EDIS (Year- Round Collection)
 1 File
 EDIS READ & EDIS BATCH
 Contact
 Debbie Puccetti
 [email protected]
 (303) 866-6612
103
EDIS (Year- Round Collection)
 Today
 Currently can submit records online or through ADE
 Limited number of batch submissions
 Optimizer is separate process
 Web process
 In Future
 Can continue to submit online or through Pipeline
 Unlimited number of batch submission
 New tool within Pipeline to replace Optimizer
 Web process (no change)
104
Periodic
 Report Card March (Web Form or File Submission)
 11th Grade Alternate Assessment (Web Form)
 READ (Reading to Ensure Academic Development) Former CBLA
 Finance
105
Presentation Challenge
Name three collection types
106
Challenge Answer
 Four collection types
 Interchange
 Periodic
 Year Round
 Snapshot
Data Pipeline – How to Prepare
Data Pipeline – How to Prepare
 Speak with vendors, business owners and IT staff
 Communicate within your local education agency (LEA)
 Communicate beyond your LEA
 Determine your role
 Participate in Get to Know Data Pipeline Activity
 Get involved in Phase II pilots
 Tune in to Town Halls
 Attend training webinars
 Complete the self assessment
 Access the online curriculum
 Check updates on the ADE replacement web site
109
Data Pipeline – Work with Vendors
 For each interchange, periodic and year round submission
 Determine how file will be created
 Vendor product generates
 IT pulls
 Self-created
 Is there any additional information that must be pulled in?
 Who has it?
 How will you get it?
 Who will ensure it is placed into the file?
110
Vendors Contacted
 Alpine
 Edupoint
 Go Edustar
 Harris School Solutions
 Infinite Campus
 Pearson
 Power School
 Tyler Technologies (Formerly Infinite Visions)
 Specialized Data Systems
 Weidenhammer
111
Communicate Internally
 Work Structure of Data Pipeline
 Determine individuals responsible for each submission
 Interchanges provide data for more than one snapshot
 Same individuals
 Different
 Collaboration
 Authoritative source for data
 Which system will provide the finalized data?
 Only provide data one time- if multiple sources, select the best
 Ensure file naming convention in place
 ADE used file type + district code + version number
 File location management
 Determine which snapshots, periodic and year round submissions
will be piloted
112
Communicate Externally
Reporting District or
Admin Unit
After Pipeline
Staff
Interchange
Sped IEP
Interchange
Discipline
Interchange
Student
Interchange
11th grade
assessment
Student
October
Snapshot
HR
Snapshot
SPED End
of Year
Snapshot
Interchange
Snapshot
113
SPED
December
Count
Snapshot
SPED
Discipline
Snapshot
Student End
of Year
Snapshot
External Communications for SPED
 Manner in which data flows within the Pipeline will increase
the need for external communication between Districts,
Administrative Units (AUs), and BOCES
 It will be up to AUs and Districts to determine who should
submit their SPED data files
 AUs will still be accountable for all SPED data reported and
thus will need to work closely with their District counterparts
to be sure accurate data is reported
114
User roles within Data Pipeline
 Interchange User roles:
 LEA Viewer: able to view data. Read only access
 LEA User: able to upload, edit, and submit data to Interchange
 Snapshot User roles:
 LEA Viewer: able to view data. Read only access
 LEA User: can create and update snapshots
 LEA Approver: has same permissions of the LEA User role AND
able to provide final sign-off of data
 Periodic/Year-round User roles:
 LEA Viewer: able to view data. Read only access
 LEA User: able to upload and submit data
115
User roles continued
 Individuals may have only one role per dataset (interchanges
or snapshots).
 Individuals may have access to multiple datasets.
 Example : An individual needs user access to the Student
Interchange and Student October Snapshot.
 User roles:
 PIPELINE-XXXX-STD-LEAUSER
 PIPELINE-XXXX-OCT-LEAUSER (not able to sign off on data)
116
Participate in Hands-On Experience
 In advance of the 2013-14 implementation, take the
opportunity to:
 Determine in which pilots to participate- consider LEA setup
 Multiple individuals with responsibilities = multiple pilots
 Few individuals for various collections = pick 1-2 interchange/snapshot,
periodic or year round submissions
 Become familiar with the system
 Prepare files for the Data Pipeline
 File layouts on ADE replacement website
 Specify authoritative data sources
 Discover collaboration needs
 Resolve issues related to missing data
Transition Readiness Assessment
 Self Assessment tool aligned with curriculum Rubric
 Includes Essential Indicators to help identify areas of risk in
transition to Data Pipeline
 Essential Indicators are scored in terms of Operational
Measures to identify fundamental capabilities and challenges.
 Essential Indicators are scored in terms of priority and cost to
the LEA to help with transition and continued improvement
planning
Curriculum
 Curriculum to help administrators, data providers, and data
submitters in developing and executing a transition plan to the
Data Pipeline.
 Curriculum addresses four (4) Topic Areas:
 Administration/Process
 Submission process - Data Extraction, Data Processing, Data
Submission
 Errors - Error handling, processing, corrections, submission
 Transition Planning
 Curriculum delivered as recorded Webinars
 Curriculum Rubric specifies levels of operational proficiency
relative to curriculum topic areas.
Oracle’s Identity Management
What is Oracle’s Identity
Management?
 Single sign-on for State systems
 Set up permissions for users
 Provide access to applications (CEDAR, CAESAR, Growth
Model, Course Codes, etc.)
 Districts maintain logins
 Districts assign access to State systems
How will Identity Management
help me?
 Districts control logins
 Single sign on for the State
 User controls the password
 CDE cannot identify your password or make changes
 Multiple users can access a single system
 Users have different levels of access
 View
 Create snapshot
 Approve snapshot
 All future applications use Identity Management
How do I find my district LAM?
 Request access from Local Access Manager
 Email
 Call
 Personal visit
 Who is my LAM?
 Superintendent is the ultimate administrator
 Email request [email protected] for LAM
 Receive URL to access list of Local Access Managers
Service Request from LAM
 Follow the link to:

https://cdeapps.cde.
state.co.us/index.ht
ml
 Look for ‘Request
for Assistance’ on
left hand side
 Complete the form
 Do I have an

account?
Reset password?
Resetting your password
 Follow the link
to:

https://cdeapps.cde.
state.co.us/index.ht
ml
 Click on an
application on
the left hand
side.
 Your username is
your email
 Forgot my
password
Getting to Know Data Pipeline
Getting to Know Pipeline Activity
 Objectives
 Upload files
 Create snapshots
 Submit data to CDE
 View reports
 Practice environment for the system
127
Getting to Know Pipeline Activity
 Who should participate?
 Everybody and anybody
 Why should I participate?
 Allow early access to the system
 Plan for the future.
 How do I participate?
 Attend training and registration
 Email to [email protected]
128
Getting to Know Pipeline Activity
 IP address required to access test environment
 Whatsmyip.org from machine at work
 Will not match your local IP address
 IP address 10… or 192.168….
 Logins created and email automatically generated
 Files emailed out
 Getting to Know Pipeline Activity document
 Detailed file upload documentation
 Three files for testing the system functionality
129
Getting to Know Pipeline Activity
 Practice SASIDs cleared out each night
 Two users in same district could overwrite each other
 Entered incorrect IP address (Whatsmyip.org)
 Blank page or Page Not Found error
 [email protected] for assistance
 Won’t be able to access system unless we have logins
130
Resources
Data Pipeline Website (Under construction more information to follow)
Information on Interchanges, Snapshots, Year-Round Collections, Periodic Collections,
Trainings, Resources, FAQ’s and Contacts
File Layouts
Recorded Webinars and Training Tutorials
Data Pipeline Project ADE Replacement Website
http://www.cde.state.co.us/rise/ADEReplacement.asp
Details on the Data Pipeline Project
Timelines
Pilot participation
Definitions and Terminology
Get to Know Pipeline Activity
IDM Website https://cdeapps.cde.state.co.us/faqs.html
What is Identity Management
FAQ’s
User Policy
IDM Videos
131
Data Pipeline – How to Prepare
 Speak with vendors, business owners and IT staff
 Communicate within your local education agency (LEA)
 Communicate beyond your LEA
 Determine your role
 Participate in Get to Know Data Pipeline Activity
 Get involved in Phase II pilots
 Tune in to Town Halls
 Attend training webinars
 Complete the self assessment
 Access the online curriculum
 Check updates on the ADE replacement web site
132
Data Pipeline – Take Away
 Transition plan
 Internal process review
 Identify responsibilities
 Internal and external communications
 Hands on experience
 Get to Know Data Pipeline Activity
 Participate in pilots
133
Data Pipeline
Thank you
Please look for an email with an evaluation
[email protected]
134