National Assessment of Educational Progress NAEP

1
National Assessment of Educational Progress(NAEP)

• Virginia
• Inclusion of
• Students with Disabilities
• Doug Cox
• Virginia Department of Education

2
The Average Scale Scores for Grade 4 Mathematics
in 2007 for both Students with Disabilities and
for All Students was statistically higher than
each of the previous years (2000, 2003, and 2005)
3
Grade 8 Math 2007 Virginias Students with
Disabilities were significantly higher than
most other states (red states are lower). Only
MA was higher.
4
Participation Rates for Students with
Disabilities NAEP 2007
Much lower than Natl Public
These are the VA percentages that will appear on
state Report Cards
5
Participation Rates for Students with
Disabilities NAEP 2007
Virginia accommodation that is not allowed by
NAEP Calculator SOURCE NAEP State Service
Center
6
Participation Rates for Students with
Disabilities NAEP 2007
Virginia accommodation that is not allowed by
NAEP Calculator SOURCE NAEP State Service
Center
7
Participation Rates for Students with
Disabilities NAEP 2007
Virginia accommodation that is not allowed by
NAEP Reading the test SOURCE NAEP State
Service Center
8
Participation Rates for Students with
Disabilities NAEP 2007
Virginia accommodation that is not allowed by
NAEP Reading the test SOURCE NAEP State
Service Center
9
Virginias Inclusion Efforts

• Developed Guidelines for Inclusion of Students
  with Disabilities and Limited English Proficient
  (LEP) Students on NAEP
• Developed List of Most Frequent Accommodations
  Provided by National Assessment of Educational
  Progress (NAEP) in Virginia
• Put in the same order as the Virginia Assessment
  Implementation Manual
• Middle Column describes if and how NAEP allows
  each Virginia SOL accommodation
• Last Column specifies how Virginia students
  should be included in NAEP

10
Virginia SOL Implementation Manual
Copy of part of the page from SOL manual
Virginias Accommodations for SOL
11
Most Frequent Accommodations Provided by National
Assessment of Educational Progress (NAEP) in
Virginia
Put in the same order as the Virginia
Implementation Manual
Virginias Participation Guidelines If NAEP
does not allow, states Student should take NAEP
without this accommodation
Same order and same numbers as the Virginia SOL
Implementation Manual
Whether or not NAEP allows
12
Dissemination - 2009

• Included Expectation of Inclusion
• in Fall VDOE updates to Division Directors of
  Testing
• Guidelines and Participation Chart
• Sent to schools in January as NAEP packets were
  being sent to schools
• Included in NAEP packets sent to schools
• Placed on the MyNAEP Web site for participating
  schools
• Placed on the VDOE Web site

13
Dissemination 2009 (cont.)

• NAEP State Coordinator
• Presented Guidelines, Chart, and Virginias
  expectation that students should be included to
  NAEP field staff at their training in December.
• Checked NAEP online system that records
  exclusions after NAEP Pre-Assessment Visits on a
  regular basis
• E-mailed school test coordinator with copy to
  principal if exclusions seemed higher than
  expected
• Called schools to discuss inclusion
• Talked with school personnel that called after
  NAEP Pre-Assessment Visit

14
NAEP 2009 Did efforts make a difference?

• Virginia does not know official results yet
• According to monitoring of the online system,
  Virginia has included more students with
  disabilities in NAEP.
• These are not weighted numbers
• These numbers are what each NAEP Assessment
  Coordinator reported in the online system PRIOR
  to NAEP testing in each school

15
Dissemination - 2010

• All of efforts for NAEP 2009
• Included expectation of inclusion
• Notification e-mail to school division
  superintendents of schools selected for NAEP 2010
  (May)
• Notification e-mail to school principals of
  their assigned NAEP 2010 assessment date (June)
• All e-mails, etc. to be sent to schools
• (late September, mid November, early January)

16
Paragraph included in all NAEP 2010
correspondence (letters, e-mails, etc.) being
sent to superintendents, principals, and school
test coordinators in Virginia

• All students with disabilities who
  participate in the Standards of Learning (SOL)
  assessments, including Plain English Mathematics
  tests, Virginia Grade Level Alternative (VGLA),
  or Virginia Substitute Evaluation Program (VSEP)
  should participate in NAEP using NAEP
  accommodations as appropriate. Only students with
  disabilities who participate in the Virginia
  Alternate Assessment Program (VAAP) may be
  excluded from any NAEP assessment.

17
Decision Tree used in Questionnaire Booklets
prior to NAEP 2010
18
NAEP 2010 Checklist Decision Tree is now
embedded Column H
19
New NAEP ChecklistDirections from NAEP

• Column H Record how the student is tested on
  your state test in the NAEP subject listed in
  Column D using the codes provided. Refer to the
  FAQs on Page 1 if the NAEP subject is not tested
  on your state tests.
• COLUMN H SD Codes
• 1 Without accommodations (Skip to column J)
• 2 With accommodations
• 3 Using a modified state test
• 4 Using an alternate state test
• Virginia will send specific directions on
  completing these new checklists to schools in
  January 2010 when the schools receive their
  Pre-Assessment packet.