Leadership in Using NeSA Data - PowerPoint PPT Presentation

Loading...

PPT – Leadership in Using NeSA Data PowerPoint presentation | free to download - id: 6a18ce-NGFhY



Loading


The Adobe Flash plugin is needed to view this content

Get the plugin now

View by Category
About This Presentation
Title:

Leadership in Using NeSA Data

Description:

Leadership in Using NeSA Data Data Conference April 18-19, ... Measure program success and effectiveness. Promote accountability to meet state and federal requirements. – PowerPoint PPT presentation

Number of Views:33
Avg rating:3.0/5.0
Slides: 32
Provided by: jhoegh
Category:

less

Write a Comment
User Comments (0)
Transcript and Presenter's Notes

Title: Leadership in Using NeSA Data


1
NEBRASKA STATE ACCOUNTABILITY
  • Leadership in Using NeSA Data
  • Data Conference
  • April 18-19, 2011

Pat Roschewski pat.roschewski_at_nebraska.gov J
an Hoegh jan.hoegh_at_nebraska.gov John Moon
john.moon_at_nebraska.gov
2
Nebraska schools have many sources of data
Data Sources Data Sources
EXPLORE/PLAN/ACT AIMSweb
DIBELS Gates MacGinitie
Reading Theme Tests Chapter Tests
Measures of Academic Progress Developmental Reading Assessments (DRAs)
Curriculum-Based Measurement Teacher Observation
Running Reading Records Student Projects
Each assessment tool has a purpose and a role in
the big picture of Continuous Improvement!
Commit to data analysis as a continuous process,
not an event. (Reeves, 2009)
3
Commit to data analysis as a continuous process,
not an event. (Reeves, 2009)
4
AND NOW . . .
Nebraska State Accountability
5
Nebraska schools should use NeSA data to . . .
  • Provide feedback to students, parents and the
    community
  • Inform instructional decisions.
  • Inform curriculum development and revision.
  • Measure program success and effectiveness.
  • Promote accountability to meet state and federal
    requirements.

6
Leadership in Using NeSA Data
  • Session I
  • What is NeSA?
  • How do we access and interpret NeSA data?
  • Session II
  • How do we use NeSA data?

7
  • What is NeSA?

Commit to data analysis as a continuous process,
not an event. (Reeves, 2009)
8
NeSA . . .
  • Criterion-referenced summative tests.
  • Measurement of the revised Nebraska Academic
    Standards for reading, mathematics, and science.
  • Tools that include multiple-choice items.
  • Tests administered to students online OR
    paper/pencil.

9
Commit to data analysis as a continuous process,
not an event. (Reeves, 2009)
10
NeSA . . .
  • Administered during the spring of the year.
  • Based on Tables of Specification and Performance
    Level Descriptors.
  • Built upon the best thinking of Nebraska
    educators, national experts, and a worthy partner
    Data Recognition Corporation.

11
  • What is the authors purpose for writing the
    story?
  • to inform the reader about chores for children
  • to persuade the reader to increase chore rates
  • to entertain about two children visiting a farm
  • to describe the benefits of living on a farm

12
Goals for Instruction
13
  • Where do we find the content components of NeSA?
  • www.education.ne.gov/Assessment
  • Tables of Specification
  • Performance Level Descriptors
  • Accommodations Guides
  • Webbs DOK documents
  • Other important NeSA documents

14
NeSA . . .
  • Produces a raw score that converts to a scale
    score of 0-200.
  • Allows for students to be classified into one of
    three categories Below the Standards, Meets the
    Standards, Exceeds the Standards.
  • Provides comparability across Nebraska school
    buildings and districts.

15
  • How do we access and interpret NeSA data?

Commit to data analysis as a continuous process,
not an event. (Reeves, 2009)
16
(No Transcript)
17
What is the Data Reporting System?(DRS)
  • Secure Site through portal
  • Public Site NDE website http//drs.education.ne.
    gov

Commit to data analysis as a continuous process,
not an event. (Reeves, 2009)
18
Interpreting NeSA-R Data Reports
  • District/building level information
  • Individual student level information
  • Subgroup information
  • Indicator information

19
Use the Reports Interpretive Guide!
http//www.education.ne.gov/Assessment/documents/N
ESA.Read.InterpretiveGuide.pdf
20
PERFORMANCE LEVELS - three possible categories of
student performance on NeSA
NeSA Performance Levels
Exceeds the Standards
Meets the Standards
Below the Standards
NeSA Terminology
21
How are performance levels determined?
  • Cut score processes
  • Contrasting Group Method 400 teachers
  • Bookmark Method 100 teachers
  • State Board of Education Reviewed
  • Examined results of both processes
  • Examined NAEP and ACT results for Nebraska
  • Made decisions within recommended range at
    public meeting

22
RAW SCORE the number of items a student answers
right on NeSA-R
Content Area Points Possible Points Earned Students Scale Score
Reading 42 21 126
Mathematics 42 21 127
on NeSA Reports
Raw Score Scale Score Performance Level
25 200 Exceeds
24 167 Exceeds
23 148 Exceeds
22 135 Exceeds
21 126 Meets
20 118 Meets
19 111 Meets
on Conversion Chart
NeSA Terminology
23
SCALE SCORE a students transformed version of
the raw score earned on NeSA
Performance Level Reading Scale-Score Range
Exceeds the Standards 135 -- 200
Meets the Standards 85-134
Below the Standards 84 and below
NeSA Terminology
24
What is the difference between a raw score and a
scale score? What is a raw score? A raw score
is the number of correct items. Raw scores have
been typically used in classrooms as percentages
18/20 90 correct.
NeSA Terminology
25
What is a scale score? A scale score is a
transformation of the number of items answered
correctly to a score that can be more easily
interpreted between tests and over time. The
scale score maintains the rank order of students
(i.e., a student who answers more items correctly
gets a higher scale score). For NeSA, we selected
0-200 and will use it for all NeSA tests,
including writing.
NeSA Terminology
26
Why convert raw scores to scale scores? Raw
scores are converted to scale scores in order to
compare scores from year to year. Raw scores
should not be compared over time because items
vary in difficulty level. Additionally, raw
scores should not be compared across different
content area tests. Scale scores add stability to
data collected over time that raw scores do not
provide.
NeSA Terminology
27
On score reports why is the . . .
SCALE SCORE CONVERTED TO PERCENTILE RANK?
The percentile rank was placed on the score
reports because our Technical Advisory Committee
felt that parents would want to know their
childs position in relation to other test
takers. A percentile rank of 84 means the child
scored better than 84 of the students who took
the test that year.
NeSA Terminology
28
NeSA (CRT) vs. NRT ?
  • --Differences--
  • Purposes
  • NeSA is intended to match and measure identified
    standards and instruction.
  • NRT is not intended to measure any states
    standards. The intention is to compare students
    to each other.
  • Item Development
  • NeSA items with exact match to the standards
    NDE had to prove the match with an independent
    alignment study
  • NRT No standards to match matches inherent
    and previous knowledge, enriched homes,
    pre-skills.

29
NeSA (CRT) vs. NRT ?
  • --Similarities
  • All the psychometric steps standard setting
    (Bookmark, Angoff, Contrasting Group)
  • Reliabilities KR 20-21 / Inter-rater
    Reliabilities
  • Descriptive Statistics (Item P-values,
    Dif-analysis)
  • Administration
  • Both standardized are generally administered
    the same way.

30
Leadership in Using NeSA Data
  • Session I
  • What is NeSA?
  • How do we access and interpret NeSA data?
  • Session II
  • How do we use NeSA data?

31
NeSA results ARE an important data source! When
combined with other information, these data can
support curricular, instructional, and learning
support decision making.
--Its all about the Continuous Improvement
Process!
About PowerShow.com