Developing a Framework for Ensuring the Validity of State Accountability Systems

1
Developing a Framework for Ensuring the Validity
of State Accountability Systems

• Council of Chief State School Officers
• AERA
• San Diego
• April 15, 2004

2
Council of Chief State School Officers

• Non-profit organization representing state
  superintendents of public K-12 education
• Through Leadership, Advocacy and Service assist
  chief state school officers and their
  organizations in achieving the vision of an
  American education system in which all children
  succeed in school, work, and life.

3
Support for State Accountability

• Communication among states to identify solutions
  and challenges
• Targeted technical assistance through group
  problem-solving
• On-going analysis
• JanuaryWorkshop on accountability plan
  submission
• Summer On going analysis of state plans,
  challenges, and solutions
• September Workshop on implementing AYP in state
  accountability systems

4
State Strategies for Reliability

• Minimum student group size (4/9/04)
• Variation
• 0 to 200, under certain circumstances
• Differentiation
• By subgroup3
• By students with disabilities 5
• By LEP students 1

5
State Strategies for Reliability

• Statistical Tests
• Confidence Intervals, Standard error of
  measurement
• Applications
• Other Academic Indicator
• Safe Harbor
• Participation Rate

6
Full Academic Year

• Full Academic Year
• Fall date enrollment count, start of school,
  etc.
• One test administration to the next
• Snapshot of one day

7
State Strategies with AYP

• Two Look System
• Includes an NCLB accountability system as the
  primary method of identifying schools a
  secondary, more rigorous, state system then takes
  a second look at the schools.
• Weighting Assessments
• Writing (10) and English/Language Arts (90)
• Uniform averaging
• Comparing a schools current year results to the
  most recent two- and three-year average

8
State Strategies with AYP

• Same indicator for two consecutive years
• (1) Reading percent proficient and participation
  (2) Math percent proficient and participation
  (3) Other Academic Indicator
• Use of Index systems
• Accounting for students who move from below basic
  to basic
• Proxy indicators for graduation rate
  disaggregation
• Used for the disaggregation of the graduation
  rate for purposes of safe harbor

9
Recent Changes to State Plans

• Use of Confidence Intervals
• Uniform Averaging
• Standard number of years for graduation
  determined by a students IEP
• New flexibility on participation rate, LEP issues

10
Current Issues for States in AYP

• Forming a single statewide accountability
  system-blending AYP with state systems
• Balancing Type I and Type II error
• Evaluating consequences of accountability systems
• What data to collect and how to determine the
  validity of AYP/Accountability system.

11
Resources for States
12
Additional Information

• ROLF BLANK, ROLFB_at_CCSSO.ORG
• CCSSO NCLB Website www.ccsso.org

13
Areas of State Creativity