Fourth Annual StatetoState Information Sharing Community Meeting

1
Fourth Annual State-to-State Information Sharing
Community Meeting

• Pennsylvania Department of Education (PDE)
• Pennsylvania Training and Technical Assistance
  Network (PaTTAN)
• October 18, 2006

2
Purpose

• Provide an overview of PAs Data-Informed
  Decision-Making Framework
• Highlight statewide supports utilized within the
  framework to assist with identifying and
  intervening to meet the needs of students

3
Data-Informed Decision-Making Framework
4
Pennsylvanias Accountability Plan

• Performance indicators in PA include
• Achievement goals in reading mathematics
• for 2005-2007
• 54 proficient in reading.
• 45 proficient in math.
• Also
• 90 test participation.
• 80 graduation rate or improvement.

5
DEQUATE
P
A
Y
ROGRESS
EARLY
READING Proficient by Year

• -

45 54 63 72 81 91 100
2004 2003 2002
2007 2006 2005
2010 2009 2008
2014
2011
2012
2013
6
DEQUATE
P
A
Y
ROGRESS
EARLY
MATH Proficient by Year

• -

35 45 56 67 78 89 100
2004 2003 2002
2007 2006 2005
2010 2009 2008
2014
2011
2012
2013
7
Pennsylvania Department of Education Goals

• Close the achievement gap among subgroups.
• Bring every student to proficient or above in
  reading and math.
• Successful prevention/intervention via proven
  practice/research validated, evidence-based
  programs.

8
Aligned School Improvement System
Standards- Based Curriculum
Fair Assessments
Instruction
Resources Materials for Instruction
Clear Standards
Interventions Safety Nets
9
Our Tasks as Instructional Leaders

• No Child Left Behind puts special emphasis on
  closing the A________________ G_______.
• Targets for achievement apply to ALL
  s______________.
• An Achievement Gap represents a large
  d____________ between subgroups.
• Pennsylvania has one of the largest achievement
  gaps in the country.

10
The Case for a Data-Informed Culture
We must acknowledge that people work more
effectively, efficiently and persistently when
they work collectively, gauging their efforts
against results Results goad, guide and motivate
groups and individuals.
Michael Schmoker Results The Key to
Continuous Improvement, 1999
11
Data-Informed Decision-Making Framework
12
Data-Informed Decision-Making
Analysis Discovery
Data
Solutions

• Data
• PSSA
• PVAAS
• 4Sight Benchmark Assessments
• Riverside/Edusoft
• DIBELS
• Local Assessments

• Analysis Discovery
• Standards
• Curriculum
• Fair Assessments
• Instruction
• Materials Resources for Instruction
• Interventions
• Professional Development

• Solutions
• What Works Clearinghouse
• CCSSO K-8 Access Center
• NICHY
• CDDRE
• National Resource Center for Learning
  Disabilities
• School Intervention Model (SIM)
• Tutoring (EAP)

13
Multiple Sources of Data

• What are the issues?

14
School Structures for Data-Informed Decision
Making
District-Level Support (Budgetary Support,
Professional Development, Resources and Time)
Student Learning Data
Demographic/Perceptual/Process Data
Annual Building-wide Planning Process Focus
All Students Who School-wide Team How Data
Retreat, School Planning Process

• School Level
• School Demographics
• Discipline Data
• Attendance Data
• Mobility Rate

School Level PSSA PVAAS Standardized
Assessments District End-of-Year Tests Final
Benchmark Test

• Grade/Course Level
• Initial PSSA/PVAAS/final tests
• class/subgroup levels
• Cyclical
• Benchmark Data - grade level
• District quarterly assessments
• Common Classroom Data
• Classroom Summaries

Periodic Grade Level Planning Process Focus
Groups of Students Who Teacher Teams How
Regular 1-2 hour meetings

• Grade/Course Level
• Class Demographics
• Class Engagement Data
• Satisfaction Data
• Attendance Data

Student Planning Process Focus Classroom of
Students Who Teacher

• Classroom Level
• Initial PSSA/PVAAS/final tests
• student level
• Cyclical
• Benchmark Data Student Level
• Continuous
• Individual Classroom Assessments
• Progress Monitoring

• Classroom Level
• Qualitative Data
• Student Historical Information
• Student Medical Information
• Student Learning Information

15
We must help educators move from using data only
for accountability to using data for continuous
improvement.
High stakes testing
On-going planning intervention
16
How do we create confident data users in a school
district?

• Common language
• Access to information
• Collaborative communication skills
• Process tools
• Habits of reflection
• Wellman, B. Lipton, L (2004)

17
Data-Informed Decision-Making
Analysis Discovery
Data
Solutions

• Data

• Analysis Discovery
• Vision College Ready
• Standards
• Curriculum
• Fair Assessments
• Instruction
• Materials Resources for Instruction
• Interventions
• Professional Development

Solutions

• What Works Clearinghouse
• CCSSO K-8 Access Center
• NICHY
• CDDRE
• National Resource Center for Learning
  Disabilities
• School Intervention Model (SIM)
• Tutoring (EAP)

4Sight Benchmark Assessments
18
Assessing to Learn PA Benchmark
Initiative 4Sight Benchmark Assessments
19
What is a Benchmark Assessment?

• A _____________ Assessment is a means of
  assessing students ________ towards reaching
  success on ________ ______ tests (in Pennsylvania
  its PSSA).
• Tests students knowledge on the grade level
  objectives (anchors).
• Administered periodically throughout the school
  year.
• Data is intended to be used to inform
  instructional decision-making.

20
Purpose of Benchmark Assessments

• Benchmarks allow you
• to take a pulse
• and not an autopsy.
• Dr. Robert Slavin
• Success For All Foundation

21
What are 4Sight Benchmark Assessments?

• PA Reading and Math Benchmark Assessments for
  grades 3 to 11
• paper or on-line versions
• Mirror the look and feel of the PSSA
• Multiple choice items
• Open response items
• Aligned correlated to PA Academic Standards,
  Assessment Anchors, PSSA

22
Alignment of 4Sight with State Expectations -
PSSA

• How do the 4Sight Benchmark Assessments
• mirror the look and feel of the PSSA?
• Test Design and Blueprint
• Data Provided by 4Sight
• Proficiency Level Data
• Estimate of Student Performance on PSSA
• Subscale data

23
Administering 4Sight Benchmarks

• Who takes 4Sight Benchmarks?
• Students in grades 311 who take the PSSA
• Use the same modifications/exemptions that are
  used for the PSSA for students with disabilities

24
4Sight Benchmark AssessmentA Data Tool

• Helps direct our actions by
• Informing instruction.
• Identifying students in need of additional
  supports.
• Guiding professional development efforts.
• Assisting districts in evaluating curriculum and
  programs.
• Highlighting areas for further investigation.

25
4Sight Across Pennsylvania2006-2007 School Year

• Participation
• 320 School Districts
• 1,200 Buildings
• 34,259 Reading Math Classroom Orders
• 1,027,000 Student Tests
• Initiatives involving 4Sight
• CDDRE Center for Data-Driven Reform in
  Education (USDOE Partnership)
• EAP Educational Assistance Tutoring Program (up
  to 175 Districts)

26
Supports Provided to Districts and Schools Using
4Sight

• Acquisition
• Ordering
• Pilot Schools
• Fiscal Support of purchase of 4Sight through
  grants
• Professional Development
• Statewide, regional professional development
  opportunities for District Teams including
  District Building Administrators, Regular
  Education Teachers, Special Education Teachers,
  Curriculum Specialists

27
Additional Supports Provided to Districts and
Schools Using 4Sight

• Technical Assistance
• Provided on-site and regionally
• Local 4Sight Users Groups
• Opportunities to collaborate and build local
  support system between school districts
• Trainings
• Designed to be trainer-of-trainer to build
  capacity at local levels
• 4Sight Certification Trainings for New Users
• 4Sight Refresher Trainings for Current Users
• 4Sight Technology Trainings for District
  Technology Staff
• 4Sight Data Analysis Process Trainings
• Provide Consistent Data Protocol

28
Data-Informed Decision-Making Framework
29
Six Components to Maximize Student Achievement
Alignment occurs when all areas support one
another
30
Why do districts have trouble leading teachers
through discussions about data?

• Data not user friendly
• Dont know what questions to ask
• Difficulty making instructional decisions based
  on data
• Lack facilitation skills
• Not sure how to set goals and develop action plans

31
Data-Informed Decision-Making Tools Provided to
Districts

• Leading for Learning!
• Getting Ready for the PSSA
• Getting Results!
• Data Tools
• PSSA Reports
• PSSA Data Interactive
• PVAAS
• Quality Reviews
• Tutoring Evaluations

32
Data Tools Available to PA Districts

• System-Level Information
• PDE Website www.pde.state.pa.us
• PA AYP www.paayp.com
• School Matters www.schoolmatters.com
• NAEP http//nces.ed.gov/nationsreportcard/
• Student-Level Systems
• PVAAS https//pvaas.sas.com
• PSSA Reports www.grownetwork.com
• PSSA Data Interaction by eMetric
  http//pssa.emetric.net
• PennData (Local District System)

33
Why Use Data Protocols?
What do we know about changing behavior?

• Critical elements

New skills or replacement behaviors
Predictable structures
Understanding the function
Frequency/opportunities To practice
Consistent vocabulary
Clear expectations
Reinforcement of new behaviors
34
Why Use Data Protocols?

• Consistent in results
• Engaging
• Structured
• Evidence Based
• Direct support for the school
• Improvement based on holistic accountability

35
Data-Informed Decision-Making Framework
36
Moving from Discovery to Solutions

• Through an analysis of the data, teachers can
  identify areas of strengths and concern.
• Teachers should hypothesize why these patterns
  exist by looking for the root cause of the
  concern
• Teachers can then develop an action plan to
  address the needs identified by the root cause
  analysis.

37
Moving from Discovery to Solutions

• The effectiveness of the action plan is monitored
  by an on-going assessment and revisiting the root
  cause analysis if needed.
• The action plan is adjusted accordingly
  throughout the year to match the students and
  teachers needs.

38
Solutions

• What Works Clearinghouse
• CCSSO K-8 Access Center
• NICHY
• CDDRE
• National Resource Center for Learning
  Disabilities
• School Intervention Model (SIM)
• Tutoring (EAP)

39
Tier III Intensive (5-10 of all
students) Progress Monitored weekly
Percentage of Students Requiring Intensive
Supports Decreases
Continuum of Time, Intensity and Data Increases
Tier II Strategic (10-15 of all
students) Progress Monitored 2 X per month
Tier I Benchmark (80 of all
students) Progress Monitored 3 X per year
40
Data-Informed Decision-Making
Analysis Discovery
Data
Solutions

• Data

• Analysis Discovery
• Vision College Ready
• Standards
• Curriculum
• Fair Assessments
• Instruction
• Materials Resources for Instruction
• Interventions
• Professional Development

Solutions

• PSSA
• PVAAS
• 4Sight Benchmark Assessments
• Riverside/Edusoft
• DIBELS
• Local Assessments

Tutoring (EAP)
41
Educational Assistance Program (EAP) Tutoring

• Initiative provides 66 million dollars to
  directly support intervention services for
  students at the strategic and intensive level of
  need
• Over 45,000 students eligible to receive tutoring
  in reading and mathematics
• 175 school districts 2006-2007 SY
• State and Local Level EAP Liaisons Advisors

42
Educational Assistance Program (EAP) Tutoring

• State and Local Level EAP Liaisons Advisors
• Assist districts with implementation of before
  school, during school, and after school tutoring
  programs
• Facilitate the collaboration of efforts within
  EAP SDs, especially with program selection,
  training, professional development and monitoring

43
Educational Assistance Program (EAP) Tutoring

• Keys to meeting the needs of students in the
  tutoring program
• Collaborate effectively with the classroom
  teachers to provide a comprehensive program that
  supports student success in curriculum.
• Monitor effectiveness of program and student
  performance through progress monitoring at
  students instructional level.

44
Data-Informed Decision-Making Framework
45
The Key to a Results-Driven Culture

• Teams of teachers and administrators who
• Share a common vision and set of goals
• Collect data on student performance
• Analyze these data
• Meet regularly to interpret these data for the
  purpose of informing instructional decisions
  focused on increasing student achievement

46
A data informed school

• Uses information at multiple levels and in
  multiple ways.
• Provides a structure and format for teachers to
  reflect on student performance and instruction.
• Keeps its goals front and center at all times.
• Recognizes that its greatest strengths are the
  experience and skills of its teachers and builds
  on this knowledge to increase student performance.

47

• The goal has never changed.its still about
  student learning!

48
Additional Information

• Kerri McCarthy, kmccarthy_at_pattan.net
• Britt Britton, bbritton_at_pattan.net
• Regina Palubinsky, palubinsky_at_pattan.net
• PaTTAN Website www.pattan.net