Enterprise Data System to support Decision Making and Reporting

1
Enterprise Data Systemto support Decision
Making and Reporting
Kansas State Department of Education

• Update to
• KSDE Leadership
• August 10, 2006

2
The Vision
School Secretary
District Level
Secretary of Education
State Level
3
The Vision - Project Objectives

• The SHORT List
• Data Accessibility
• Data Quality
• Effective Data Use
• The NOT-SO-SHORT List
• Ensure data provided are accurate, timely, and
  reliable
• Build a culture of data awareness and data
  quality
• Establish a secure environment for this critical
  information
• Establish convenient, reliable, repeatable
  processes for data collection and data access
• Provide educators and policymakers with the data
  they need to improve student achievement and
  effectively allocate resources (D3M)
• Provide appropriate data access to researchers to
  improve our understanding of effective management
  and instructional policies
• Enable more efficient compliance reporting,
  releasing staff to focus on educating students
• Improve the publics access to school academic
  financial data
• Provide alternatives for tracking and measuring
  student progress

4
The Vision Enterprise System Design
Staff Stakeholder Training Capacity Building
Enterprise Architecture
Student Identifier
Student Data Repository
Submission Verification
Data Mart Research
Core Student Data
Cleanse Integrate Transform Load
LEA District Schools
Submission Verification
Enterprise Data Warehouse Integrated Time
Variant Cleansed
Submission Verification
Extraction Analysis
Submission Verification

Submission Verification

Submission Verification

Submission Verification
MetaData Business Rules, Tech Info, Data Quality
Definitions
S e c u r i t y
Common Authentication Security Architecture
Security Confidentiality Policies
Security Certificates
5
The Reality Project Considerations

• Must comply with 1998 Senate Bill 5
• Legislative Funding
• 3 year plan iterative process
• Priorities based on business objectives and
  technical realities
• Must ensure KSDEs capacity to maintain
• Not just a technology change also a culture
  change

6
The Reality Project Planning and Initiation
(1/2006 9/2006)

• Secure funding
• Establish internal capacity
• Hiring
• Training
• Creating a culture!
• Establish initial business priorities for
  guidance for project execution iterations
• Iteration 1 Student Data (KIDS), Org Data
  (Directory), Assessment/Accountability Data
  (CETE)
• Iteration 2 Staff (Teacher Education
  Licensure, Para Databases)
• Iteration 3 Programs (Migrant, Special Ed, Tech
  Ed), Other (ACT, ?), Finance
• Complete initial project documents
• Planned Project document (CITO)
• High Level Project Plan (CITO)
• Other important project documents (Project
  Statement, Roles Responsibilities,
  Communication Matrix)
• Award contract for consulting expertise
• Develop RFP
• Gain approval of RFP (CITO)
• Let and award RFP
• Complete project management tasks
• Develop detailed project plan for first iteration

You Are Here
7
The Reality Getting the work done

• KSDE Staff
• KSDE staff will lead most tasks, accessing
  contractors expertise as needed, and developing
  in-house expertise to maintain the system
• Plan capitalizes on KSDEs business knowledge
• Contract Staff (via RFP)
• Contract with experts experienced in data
  warehousing and business intelligence systems
• Contractors will provide advise and expertise as
  needed. In many cases they lead the first
  iteration and KSDE leads subsequent iterations.
• Contractors will lead quality verification
  efforts

8
The Reality Project Execution Includes 3
Iterations

• Establish Enterprise Data System
• 9/2006 6/2007
• Priority 1 Data System Load
• 6/2007 3/2008
• Priorities 2 3 Data System Load
• 3/2008 5/2009

9
The Reality Iteration 1 Establish Enterprise
Data System

• (9/2006 6/2007)
• Enterprise Data Model
• Conceptual Model of data subjects
• Technical Infrastructure
• Hardware System Software
• Enterprise Metadata
• Design, develop, and implement framework
• Enterprise Data Warehouse
• Design, develop, and implement framework
• Plan for Data Marts / Business Intelligence
• Establish needs for iteration 1 data delivery
• Select tools based on these needs
• Build capacity with these tools

10
Establish Enterprise Data System
Enterprise Architecture
Student Identifier
Student Data Repository
Submission Verification
Core Student Data
LEA District Schools
Submission Verification
Submission Verification
Submission Verification
Submission Verification

Submission Verification

Submission Verification
Definitions
S e c u r i t y
Common Authentication Security Architecture
Security Confidentiality Policies
Security Certificates
11
The Reality Iteration 2 Load System with
Priority 1 Data

• Priority 1 Data System Load (6/2007 3/2008)
• (Student, Organization, Assessment
  Accountability)
• Model relationships of Priority 1 data
• Load initial data to Enterprise Data Warehouse
  Metadata Repository (Priority 1 data) current
  historical
• Extract, Transform, Load
• Populate technical metadata
• Validate data quality
• Establish repeatable process for ongoing loads
• Establish Data Mart(s)
• Load data
• Train stakeholders

12
Load Priority 1 Data
Enterprise Architecture
Student Identifier
Student Data Repository
Submission Verification
Core Student Data
LEA District Schools
Submission Verification
Enterprise Data Warehouse
Enterprise Data Warehouse Integrated Time
Variant Cleansed
Submission Verification
Submission Verification
Submission Verification

Submission Verification

Submission Verification
MetaData Business Rules, Tech Info, Data Quality
Definitions
S e c u r i t y
Common Authentication Security Architecture
Security Confidentiality Policies
Security Certificates
13
The Reality Iteration 3 Continue Data Loads

• (3/2008 5/2009)
• Priority 2 Data System Load Staff
• Expand Model to include Priority 2 data
  relationships
• Load Initial data Enterprise DW Metadata
  Repository (Priority 2 data) current
  historical
• Extract, Transform, Load
• Populate technical metadata
• Validate data quality
• Establish repeatable process for ongoing loads
• Establish Data Mart(s)
• Load data
• Train stakeholders
• Priority 3 Data System Load Program Finance
• Expand Model to include Priority 3 data
  relationships
• Load Initial data Enterprise DW Metadata
  Repository (Priority 3 data) current
  historical
• Extract, Transform, Load
• Populate technical metadata
• Validate data quality
• Establish repeatable process for ongoing loads
• Establish Data Mart(s)

14
Load Priority 2 3 Data
Enterprise Architecture
Student Identifier
Student Data Repository
Submission Verification
Data Mart Research
Core Student Data
Cleanse Integrate Transform Load
LEA District Schools
Submission Verification
Enterprise Data Warehouse
Enterprise Data Warehouse Integrated Time
Variant Cleansed
Submission Verification
Extraction Analysis
Submission Verification

Submission Verification

Submission Verification

Submission Verification
MetaData Business Rules, Tech Info, Data Quality
Definitions
S e c u r i t y
Common Authentication Security Architecture
Security Confidentiality Policies
Security Certificates
15
The Reality Project Closeout

• (5/2009 6/2000)
• Obtain signoff of the project
• Prepare (PIER) Post Implementation Evaluation
  Report for CITO
• Document Lessons Learned Celebrate!

16
The Reality The projects over but there will
be more work
changing data rulesnew data elementsnew
federal and state needsnew questions to be
answered!
17
Leaderships Role Participate in Data
Governance
Issues and Responsibility
18
Leaderships Role Advocate the Vision

• To the field
• To the agency
• Others?

19
The Challenges

• Business Intelligence
• Identifying alternatives
• Understanding and using data
• Building capacity at KSDE and in schools
• Developing and implementing a quality research
  agenda

20
Future Challenges

• SIF
• Collecting data
• Transcript transmission (school-school
  school-higher ed)
• Establish standards for data definitions code
  sets for data sharing (PK 20)
• Schools
• Universities
• Other agencies
• Evaluating Programs
• Tie teachers to results
• Tie teacher ed programs to results
• Requires standard state course codes
• Use of State ID in multiple systems (KBOR,
  Licensure, ??)
• Complying with FERPA, but
• meeting federal requirements for data sharing and
• effectively using the data