Results of the 2005 National Assessment of Educational Progress for California and the Nation

1
Results of the 2005 National Assessment of
Educational Progressfor California and the
Nation
Presented to the California State Board of
Education November, 2005
2
NAEP Design

• NAEP collects data from a sample of schools in
  each jurisdiction. In many schools, only a
  random sample of students in a given grade may be
  assessed.
• Samples are stratified by geographic location,
  ethnic mix, school size, and STAR scores.
• Parents may opt their students out of NAEP.
  Learning disabled and English learner students
  may be excluded from the assessment if NAEP does
  not offer the appropriate accommodation or if the
  student does not normally take state tests.
• The NAEP assessments are matrix tests No student
  answers every question.
• Scores are only reported at the state and
  national level.

3
Interpreting NAEP Results

• Comparisons should be focused on specific
  sub-groups of interest.
• Whole state population comparisons are
  problematic.
• For example, English learners have substantial
  impacts on California results.
• NAEP scores contain variability due to sampling
  and measurement error.
• Statistical tests must be conducted to determine
  if observed differences are larger than would
  occur simply by chance.
• Changes in populations over time can impact
  statewide trends.
• For example, the change in the proportion of
  economically disadvantaged students between 2003
  and 2005.

4
California Participation in NAEP Grade 4 and 8
Reading 1998 - 2005
5



Change from 1992 is statistically significant
5
6




Change from 1990 is statistically significant
6
7
Changes in California NAEP Grade 4 Math and
Reading Scores 1992 to 2005


Not significantly different from 1992
7
8
California NAEP Grade 4 Reading Average Scale
Scores and Sample Population Percentages for
Major Ethnic Groups 1992 to 2005
Bubbles are centered on group average, area of
bubble is proportional to population proportion
1992
1994
1998
2002
2003
2005
8
All Changes from 1992 are statistically
significant
9
California NAEP Grade 4 Math Average Scale Scores
and Sample Population Percentages for Major
Ethnic Groups 1992 to 2005
Bubbles are centered on group average, area of
bubble is proportional to population proportion
9
1992
1996
2000
2003
2005
10
Notes on Comparing Performance Among States

• Because of sampling and measurement error in
  NAEP, small differences in scores may not be
  significantly different.
• Therefore, a ranking of states by average scale
  score is inappropriate.
• Differences in population composition can greatly
  affect scores.
• Differences in exclusion rates for various groups
  can potentially confound results.

11
English Learner Proportions and Exclusion Rates
on NAEP 2005 Grade 4 Reading for Selected States.
Source NAEP 2005 Reading Report for California.
Appendix A Overview of Procedures Used for the
NAEP 2005 Reading Assessment, page 27. U.S.
Department of Education, Institute of Education
Sciences, National Center for Education
Statistics, National Assessment of Educational
Progress (NAEP).
11
12
Grade 4 Math - Overall
12
13
Grade 4 Math - White
13
14
Grade 4 Math - Black
14
15
NAEP Grade 8 Reading 2005 Results for Selected
States All Students






Average scale score significantly different
from California Average scale score of the 90th
percentile is significantly different from
California
15
16
NAEP Grade 8 Reading 2005 Results for Selected
States - White Students



Average scale score significantly different
from California Average scale score of the 90th
percentile is significantly different from
California
16
17
NAEP Grade 8 Reading 2005 Results for Selected
States - Black Students
Average scale score significantly different
from California Average scale score of the 90th
percentile is significantly different from
California
17
18
Summary

• California students NAEP scores in reading and
  mathematics parallel the national trend.
• Progress in reading is slower than in
  mathematics.
• Hispanic students that are not English learners
  have made the greatest gains on NAEP in recent
  years.