Vision to Know and Do: Helping Educators Use Data Effectively

1
Vision to Know and Do Helping Educators Use
Data Effectively

• NCES SUMMER Data Conference
• Wednesday, July 27, 2005
• 230 PM
• Washington, DC

2
PANEL PARTICIPANTS

• Irene K. Spero, Vice President, CoSN, Moderator
• Phyllis Chasser, Ph.D.,
• Sr. Data Warehouse Analyst,
• Broward County Public Schools, Florida
• Joe Duggar ( in absentia)
• Associate Director, Northwest Regional Data
  Center (NWRDC ), Florida

3
PRESENTATION OUTLINE

• Learning about CoSNs Data-driven Decision Making
  Initiative Vision to Know and Do
• Hearing about the approach of Broward County to
  data-driven decision making
• Engaging the audience with questions

4
VISION TO KNOW AND DOwww.3d2know.org

• Launched in 2003 by CoSN to help educators use
  data effectively. This initiative is
• a highly-respected source of up-to-date,
  unbiased information
• an easy to use mechanism for educating school
  leaders
• a nationally-recognized framework for sharing
  knowledge
• Supported by Founding Partners ETS, IBM and SAS
  with additional support from Co-nect, Dell,
  Pearson Education, Plato Learning PowerSchool ,
  SchoolNet, and Texas Instruments. Scholastic
  Administr_at_tor is the Media Partner.

5
VISION TO KNOW AND DO

• Released Vision to Know and Do The Power of Data
  as a Tool in Educational Decision Making, an in
  depth examination of the issue
• Developed a self assessment tool to estimate a
  districts readiness to use data-driven decision
  models
• Convened a Congressional Seminars in Washington,
  DC
• Issued quarterly newsletter, Vision to Know and
  Do newsletter

6
CURRENT CONTEXT

• Data collection, analysis and reporting are
  critical components of No Child Left Behind
  (NCLB).
• School districts must collect more data, in more
  detail and disaggregate them.
• State-level systems and support are being
  developed for collecting and integrating student
  assessment data with demographic information.

7
NATIONAL EDUCATION TECHNOLOGY PLAN

• Toward A New Golden Age in American Education
  calls upon states, districts and schools to
• establish a plan to integrate data systems
• use data from both administrative and
  instructional systems to understand
  relationships
• ensure interoperability  and
• use assessment results to inform instruction.

8
NCLB

• "Information is the key to holding schools
  accountable for improved performance every year
  among every student groupData is our best
  management tool.  I often say that what gets
  measured, gets done.  If we know the contours of
  the problem, and who is affected, we can put
  forward a solution.  Teachers can adjust lesson
  plans.  Administrators can evaluate curricula. 
  Data can inform decision-making.  Thanks to No
  Child Left Behind, we're no longer flying
  blind." 
• Secretary of Education Margaret Spellings

9
MOVING BEYOND THE MANDATE

• Current environment is an opportunity to
• use data to transform teaching, learning and
  administration.
• inform decisions about everything from class
  schedules to textbook reading levels to
  professional development budgets.
• provide a rationale for decisions that parents,
  teachers, taxpayers, and students can understand.

10
DEFINITION

• Data-Driven Decision Making
• A process of making choices based on appropriate
  analysis of relevant information

11
Data-Driven Decision Making
Districts That Employ A Data-driven Decision
Making Process (Digital Leadership Divide
CoSN/Grunwald Survey)
12
NEW!!

• From Vision to Action How School Districts Use
  Data to Improve Performance
• for school district leaders and K-12 educators
  seeking ways to implement a data-driven decision
  making process

13
KEY THEMES

• Implementing a successful school district
  data-driven decision making process requires a
  collaborative team approach.
• The process is continual and cyclical moving from
  the collection of data , to reporting and
  analysis and finally to using data for targeted
  interventions.
• Technology tools can be effectively utilized in
  the process.

14
EMPOWERING THOUSANDS OF NONTECHNICAL USERS WITH
VITAL INFORMATION FROM A LARGE DATA WAREHOUSE AT
BROWARD COUNTY PUBLIC SCHOOLS Phyllis
Chasser, Ph.D. Sr. Data Warehouse
AnalystBroward County Public Schools, Broward
County, Florida Phone [phone] Email
phyllis.chasser_at_browardschools.com
Session 3013A
15
BROWARD COUNTY PUBLIC SCHOOL DISTRICT 2004/2005

• The sixth largest school district in the United
  States

278,000 PK-12 students
40,000 employees
Over 275 schools
174 differentnative languages
16
WHY BUILD A DATA WAREHOUSE?

• There was a need to empower teachers and
  administrators with the information necessary to
  make instructional decisions that enhance and
  improve student achievement.
• Distribution of data is a big problem with
  200,000 potential users, many of whom are
  technologically challenged.
• The Broward Schools Data Warehouse project was
  the solution to the information distribution
  problem.

17
DATA WAREHOUSE VISION

• School improvement teams, administrators,
  teachers and parents gain fingertip access to
  data that will enable better decision-making.
  Data can and will make a difference in student
  achievement.

18
STATISTICS
19
STAFF SIGN-ONS ISSUED
20
HOW THE DATA IS LOADED
21
TECHNICAL RESOURCES

• Hardware
• IBM eServer iSeries i5
• Model 570
• Model 570
• IBM eServer zSeries
• Macintosh
• PC
• Software
• Hyperion Intelligence
• Adobe Acrobat
• Lakeview Technology Replicate1
• Middleware
• iAccess
• MacMidrange Client

22
INFORMATION AVAILABLE

• Student
• Demographics
• Enrollment
• Attendance
• Special Programs
• Test Scores
• Course Transcripts
• Transportation
• Maintenance
• Vendor
• Purchase Order
• Work Orders
• Finance
• Accounts Payable
• Budget

• District
• Discipline Information
• Teacher Information
• School Information
• Summary Information
• Mobility Rate
• District Maintenance
• Workforce Development Information Systems
• HRMS
• Demographic
• Education
• Certification
• And LOTS MORE ! !

23
ACCESS IS LIMITED BY USER ID
Teacher
District
Admin
Specialized signons are available for the
Psychological Services, Finance, and the
Maintenance departments
24
SPECIAL REQUESTS

• Requests for special reports come in daily
• Ad-hoc queries created for customers to run
  themselves
• Customer requests include those from Schools,
  Departments, Board Members, the Media and
  Government Agencies.

25
AUTOMATED TRANSFER OF FILES

• Parent Phone Link
• Foster Care
• Maintenance
• Broward InformationNetwork

Job Scheduler
26
DEPLOY THE DATA

• Technologically capable andPower Users
• Hyperion Intelligence Client
• Pre-designed repository queries
• Client software
• Internet Surfers
• Interactive web queries
• Novice
• Intranet Access
• Created in Hyperion Intelligence Client
• HTML Summary reports
• pdf Static web-based DWH reports

27
THE DATA WAREHOUSE WEB SITE
www.broward.k12.fl.us/dwh/
28
DWH REPORTS
29
DWH REPORT

• Created with Hyperion Intelligence to pdf

30
OPEN TO THE DISTRICT A SECURE PORTAL
31
BENCHMARK ASSESSMENT TESTS
32
Benchmark Graphic Reports

• Created with Hyperion Intelligence to html

33
VIRTUAL COUNSELOR WEB INTERFACE
34
HIGH SCHOOL GRADES ON THE WEB
35
CENTRALIZED SCHOOL REPORTS MENU
36
2005 DISTRICT DEMOGRAPHICS
Hyperion Intelligence to the Web Portal
37
GRAPHIC TEST RESULTS
38
RESULTS

• Measured the effectiveness of metal detectors vs.
  alternative disciplinary approaches
• The surprising findings were that anger
  management courses, counseling and peer-to-peer
  arbitration had a better outcome.
• 105,000 savings achieved developing DWH reports
  on students taking the Stanford Diagnostic (SDG)
  test, instead of buying reports from outside
  vendor

39
RESULTS

• School improvement plans are based on data and
  are thus streamlined and more effective
• Daily attendance is monitored with a report
  through the data warehouse
• Increased student attendance results in increased
  funding
• Florida students with low attendance rates lose
  their drivers licenses

40
OVERALL RESULTS

• Dramatic changes in the way Broward educates
  students and propels them to achieve beyond what
  was previously thought to be attainable
• Important decisions are now made based on timely
  reporting
• A school system that was data starved is now a
  data driven organization.

41
LESSONS LEARNED

• Buy-in Begins at the Top
• Focus on District and School Administration First
• Follow-up with Teachers
• A Customer-friendly Data Warehouse is not
  Normal-ized
• Customize your training with business data

Ease of Access Use of Data
42
CHALLENGES WE STILL FACE

• Expanding on Browser Interface
• Easing access for schools
• Data Simplicity
• Pre-run reports
• Schools becoming heavy users
• Data Quality
• Bad data shows more readily
• Exposes weaknesses
• Overwhelming Requests
• Everyone wants their data added
• Need to prioritize requests

43
DATA WAREHOUSE TIMELINE
Upgrade to HyperionPerformance Suite ?
Live to Entire District
New HRMSData Added
IBM ReinventingEducation Grant
Pilot in 3 Schools
Virtual CounselorOpen to District
Interactive pdfReports on the web
Jan1996
Jan1997
Jun2002
SY2006
SY 2001
SY 2004
SY 1999
Spring 2005
Sep1996
SY 2003
SY 1998
SY 2000
Jul2001
Dec1995
Open to Parents
Brio Intelligence?Selected to Access Student
Data
Web Queries
New Dashboards and Zero Client
Maintenance Data Added
Virtual CounselorPilot to High Schools
Pilot Expanded to 21 Schools
44
Let Data Drive Your Decisions
NOT

• Technology
• Joe Duggar ( in absentia)
• Associate Director,
• Northwest Regional Data Center (NWRDC ), Florida

45
Underlying Technology is Constantly Changing
46
Technology Tools
Data
Information

47

• Technology is constantly changing
• Information is the result of passing Data
  through Technology Tools
• Technology, by itself, has no value
• Results are primary goal
• Processes and tools are much less important than
  the information

48

• Data Driven Decision Making Process
• Determine your desired outcome
• Define your business processes
• Identify data available

49

• Data Driven Decision Making Process (cont.)
• Select your technology team based on expertise
  and ability to perform
• Technologies employed must be based on the
  business goals and not the other way around
• Let the technology team do their job with
  frequent check points to the business model

50

• Data Driven Decision Making Process (cont.)
• Enjoy a successful system using the Data Driven
  Decision Making model

Data
Technology
Outcome
51
NWRDC Product Offerings

• State of the Art Data Center
• 7 X 24 Operation
• Redundant Communications
• Redundant Environmental Environment
• Dedicated Systems Support Staff
• IBM Mainframe Processing
• Windows Server Hosting
• AIX Server Hosting FSU/FAMU PeopleSoft ERP
• SUN Solaris Server Hosting
• HP Unix Server Hosting

52
(No Transcript)
53
DATA DRIVEN DECISION MAKING PROCESS

• A process of three functional areas
• collection, integration and dissemination of
  data
• analysis and reporting of data and
• process and procedures for acting on the data.

54
PROGRESS IN DATA DRIVEN DECISION MAKING

• Majority of districts are making progress in
  collection of data and most are working towards
  analysis and reporting.
• Challenging task remains providing teachers with
  proven strategies for targeted interventions in
  the classroom.

55
DATA COLLECTION AND INTEGRATION CHECKLIST

• Is a data warehouse in place?
• Are the technical and human support tools in
  place to move data from warehouse to schoolhouse?
• Are systems developed to integrate data into
  instruction?
• Are teachers using assessments to measure
  progress?
• Are curriculum and assessments aligned to
  standards?

56
DATA ANALYSIS CHECKLIST

• Do teachers have access to data in an easy-to-use
  format soon after assessment?
• Does the district support the process with
  analytical tools and trained staff to give
  decision makers confidence in the data and tools?
• Are teachers trained to use item analysis to
  understand student outcomes and instructional
  effectiveness?

57
USING DATA CHECKLIST

• Does the district provide the tools and training
  to interpret and query data?
• Have data teams developed a process for
  identifying, recommending and implementing
  intervention based on data?
• Do district and school-site change agents support
  teachers and their use of targeted interventions?

58
ONLINE ASSESSMENT TOOL

• Take a simple 10-question assessment is available
  at 3d2know.cosn.org/assessment/survey.cfm
• Receive an immediate response
• Learn where you are in the process of becoming a
  data rich district

59
FOR ADDITIONAL INFORMATION www.3d2know.org

• What's New
• Publications
• Best Practices
• Other Resources
• Subscribe to the Newsletter

60
ABOUT COSN

• CoSN Mission
• To promote the use of information technologies
  and the Internet to ensure technology has a
  positive effect on learning by focusing on
  leadership development, coalition building,
  advocacy and emerging technologies.
• Audience
• Key technology leaders at the school district,
  state and national level

61
CoSN GOALS

• Leadership Development supporting school leaders
  to ensure technology has a positive effect on
  learning
• Advocacy creating an effective voice on
  education technology issues
• Coalition Building building partnerships and
  collaborative efforts around the use of
  technology in schools
• Emerging Technology exploring meaningful uses
  for new technologies in education

62
COSN LEADERSHIP INITIATIVE

• New!! Accessible Technologies for All Students
  Project
• http//www.accessibletech4all.org/
• increasing achievement and success for all
  students through the unlimited and effective use
  of accessible technologies
• Taking Total Cost of Ownership (TCO) to the
  Classroom http//classroomtco.cosn.org/
• Helping School Leaders Budget More Accurately
  for Education Technology
• Safeguarding the Wired Schoolhouse
• http//safewiredschools.cosn.org/
• Resources to Help School Administrators
  Understand Internet Safety Strategies
• 3D Vision to Know Do
• http//3d2know.cosn.org/
• Enabling Educators to Think Strategically about
  the Use of Data Driven Decision-Making
• Cyber Security for the Digital District
• http//securedistrict.cosn.org/
• Ensuring Security of School Networks

63
Irene K. Speroirene_at_cosn.orgVice
President202-861-2676 x112 1710 Rhode Island
Ave., NW 900Washington, DC 20036www.cosn.org