The New England Common Assessment Program NECAP - PowerPoint PPT Presentation

Loading...

PPT – The New England Common Assessment Program NECAP PowerPoint presentation | free to download - id: 14536f-YjkxN



Loading


The Adobe Flash plugin is needed to view this content

Get the plugin now

View by Category
About This Presentation
Title:

The New England Common Assessment Program NECAP

Description:

An Introduction and Overview of the (now) 4-State Assessment Collaborative ... NECAP Overview ... NECAP Overview - Accommodations. There are several differences ... – PowerPoint PPT presentation

Number of Views:73
Avg rating:3.0/5.0
Slides: 82
Provided by: OoT3
Learn more at: http://www.maine.gov
Category:

less

Write a Comment
User Comments (0)
Transcript and Presenter's Notes

Title: The New England Common Assessment Program NECAP


1
The New England Common Assessment Program (NECAP)
An Introduction and Overview of the (now)
4-State Assessment Collaborative Presented by
Susan Smith April 13, 2009 Updated on April 14,
2009
2
Presentation
  • This complete presentation, including audio, will
    be available as soon as possible at
  • http//www.maine.gov/education/lsalt/necap/present
    ations.html
  • The PowerPoint portion of this presentation is
    currently posted.

3
Presentation
  • The information contained in this presentation is
    based on current NECAP policies and may be
    subject to change.

4
Presentation Overview
  • Maines partnership with NECAP
  • NECAP Standards and Maine Learning Results
  • Brief history of NECAP
  • Maines testing program
  • Overview of content area test designs,
    administration, reporting

5
No Child Left Behind Requirements
  • Each State
    Shall…
  • Develop and implement a statewide accountability
    system that will be effective in ensuring that
    all local educational agencies, public elementary
    schools and public secondary schools make
    adequate yearly progress.

6
What exactly is NECAP?
  • NECAP is the assessment used by four New England
    states to meet the testing and accountability
    requirements of the No Child Left Behind Act.

7
Multiple Uses of NECAP Testing
  • School Accountability
  • Public Reporting
  • Program Evaluation and Improvement
  • Student Proficiency and Progress

8
Why is Maine Joining NECAP?
All Maine state departments were directed by the
governor to achieve major cuts in future
spending. The Commissioner was directed to
identify significant cost reductions across all
MDOE programs.
9
Why is Maine Joining NECAP?
The state assessment program had only two
realistic options 1) Adopt an all
multiple-choice test format 2) Find a less
costly way to deliver a test that also includes
student constructed responses.
10
Why is Maine Joining NECAP?
  • In the fall of 2008, the MDOE conducted content
    comparisons and cost analyses associated with
    joining NECAP.
  • Comparison studies between NECAP and Maine
    standards showed adequate correlation (in reading
    and mathematics) to move forward with adoption of
    NECAP in Maine.

11
Why is Maine Joining NECAP?
  • Savings were estimated at 1 million dollars
    per year.
  • The Maine Department of Education petitioned the
    3-state collaborative for acceptance into the
    assessment group.
  • Acceptance was unanimously offered.

12
Why is Maine Joining NECAP?
  • To achieve the cost savings, Maine is adopting
    the following for the content areas of reading,
    writing, and mathematics for assessment purposes
  • NECAP standards (GLEs) at all grades 2-high
    school,
  • NECAP tests at grades 3-8,
  • NECAP cut scores at grades 3-8 to determine
    achievement levels, and
  • NECAP reports at grades 3-8.

13
2007 MLRs and NECAP Standards
The 2007 Maine Learning Results (MLRs) are
still very much in effect and describe the
breadth and depth of knowledge and skills
expected to be taught and learned at all grades
and in all content areas.
14
2007 MLRs and NECAP Standards
  • The MLRs will be modified to include the NECAP
    assessment standards (GLEs) in mathematics,
    reading and writing at grades 2-7 and high
    school, providing a consistent progression along
    the learning continuum.

15
2007 MLRs and NECAP Standards
Until the MLRs are modified, instruction
should be informed by the current Parameters for
Essential Instruction unless there is a
discrepancy between them and the NECAP GLEs. In
those instances, instruction should reflect the
NECAP GLEs.
16
2007 MLRs and NECAP Standards
  • The Department is providing content-specific
    presentations that discuss the major differences
    between the NECAP GLEs and the MLRs, which will
    be posted at
  • http//www.maine.gov/education/lsalt/necap/present
    ations.html

17
Some Questions Well Try to Answer
  • Can you supply a brief history of NECAP?
  • What are the major differences between the NECAP
    and the MEAs?
  • What are the major differences in reporting?
  • How will AYP be affected?

18
Which States Participate in NECAP?
19
NECAP A Brief History
  • Developed through a collaborative effort by
    Vermont, New Hampshire and Rhode Island
  • Tests were administered for the first time in
    October 2005, assessing Reading and Math in
    grades 3 through 8 and Writing in grades 5 and 8
  • Grade 11 Reading, Math and Writing was added in
    Fall 2007

20
NECAP A Brief History
  • Participating states share the same NECAP
    standards, tests accommodations, cut scores, and
    reports (for the most part).
  • Each state maintains its own alternate assessment
    program
  • Each state maintains its own accountability
    system.

21
Maines Participation in NECAP - HS
Maine will continue with the SAT Initiative
including the Mathematics Augment and Science
Tests as in previous years and not join the NECAP
high school assessments. The Maine High School
Assessment (MHSA) tests will continue to be
administered during the spring of grade 11.
22
Maines Participation in NECAP - HS
While Maine has not adopted the NECAP high
school testing series, the MDOE has adopted the
NECAP high school assessment standards (GLEs)
from which the NECAP tests are developed.
23
Maines Participation in NECAP - HS
The reasons for adopting the NECAP high school
GLEs are twofold 1) It completes the
articulated continuum of NECAP assessment
expectations from grades 2 through high school.
This is also important for the alternate
assessment system that is required to develop
assessment tasks backed down from the high
school level standards.
24
Maines Participation in NECAP - HS
2) Adopting the common NECAP high school
standards allows for the sharing of future
learning experiences and assessment development
across the New England Secondary Schools
Consortium partners.
25
Maines Participation in NECAP - HS
In the past, Maine has conducted an independent
alignment study on the SAT, Mathematics Augment
and Science test to the Ch. 131 accountability
standards. In the future, these alignment
studies on the reading and mathematics tests will
be to the NECAP GLEs and provide information on
the need for any augmentation.
26
Maines Science Testing Program
Maine will NOT adopt the NECAP GLEs or tests
in science. Maine will continue with the
current MEA science testing program at this time
in grades 5, 8 and 11, assessing the existing
science accountability standards of the 2007
MLRs.
27
Maines Science Testing Program
The decision to stay with MEA science testing
was based on the discrepancy between Maine and
NECAP science standards. In addition, no savings
were projected for joining the NECAP science test
due to the format of the test. The MEA testing
window for science at grades 5 and 8 will be
moved to May 10-21, 2010.
28
Maines Participation in NECAP Gr. 3-8
  • Maine will participate fully in the NECAP for
    reading, mathematics, and writing in grades 3-8.
  • The NECAP test will assess the NECAP GLEs in
  • reading and mathematics in grades 3-8 (testing
    the grades 2-7 GLEs).
  • writing in grades 5 and 8 (testing the grades 4
    and 7 GLEs).

29
Maines Alternate Assessment
As in past years, Maines Personalized
Alternate Assessment Portfolio (PAAP) will
parallel the blueprint of the standard state
assessment plan. PAAP alternate standards and
tasks in reading, writing, and mathematics are
currently being revised.
30
Maines Alternate Assessment
  • PAAPs will now be administered in Grade 2 for
    the first time.
  • The Department is providing a presentation on
    PAAP that addresses revisions to Maines
    2009-2010 Alternate Assessment Standards due to
    the adoption of NECAP standards that will be
    posted at http//www.maine.gov/education/lsalt/ne
    cap/presentations.html

31
NECAP Overview
NECAP and the MEA use the same testing
contractor, Measured Progress, and NECAP has
acknowledged borrowing from the MEA when they
were forming their program. Consequently
(fortunately), there are many similarities in
policies, formats of test and answer booklets,
administration manuals, reports, etc.
32
NECAP Overview - Committees
Maine educators will still be involved in
reviewing and giving input on all test items by
serving on NECAP Item Review and Bias/Sensitivity
Committees. Maine educators, working with
colleagues from New Hampshire, Rhode Island and
Vermont, have recently completed this work for
the October 2009 test.
33
NECAP Overview Teaching/Testing Years
NECAP assesses the learning of one year
(teaching year) at the beginning of the following
year (testing year), so grades 2-7 are assessed
at the beginning of grades 3-8 in reading and
mathematics. Fourth and seventh grade writing
is assessed at the beginning of grades 5 and 8.
Alternate assessments are provided for
students in grades 2-7.
34
NECAP Overview - Test Design
Reading, Mathematics, and Writing tests consist
of multiple-choice (1 point) and
constructed-response (4 points) items. The
mathematics sessions also include short-answer
questions (1 or 2 points). One writing session
includes an extended response item (prompt - 12
points).
35
NECAP Overview Test Design
There are 3 testing sessions in both reading and
mathematics of 45 minutes each, with up to an
additional 45 minutes allowed (100 extra time).
There are 9 test forms at each grade. The
forms contain common, field test and matrix
items. There are integrated test/answer
booklets at grades 3 and 4.
36
NECAP Test Design -Reading
  • There are 52 common score points at all grades
    in reading, distributed between the following
    item types
  • 28 1-point Multiple Choice (MC)
  • 6 4-point Constructed Response (CR)
  • 54 MC and 46 Student Generated

37
NECAP Test Design -Reading
  • Reading Passages are similar to the MEA since
    there are
  • purpose setting statements,
  • the same formatting,
  • paragraphs numbered in the margin when referenced
    in the item.
  • Poems are numbered every 5th line.
  • 25 to 50 of the reading test is released each
    year.

38
NECAP Test Design -Reading
Reading passages are divided evenly between
literary and informational text. The common
reading test contains 2 long passages (4 MC, 1CR,
4MC, 1CR) and 2 short passages (4 MC, 1 CR), plus
4 stand alone MCs. Questions are arranged
primarily in text order.
39
NECAP Test Design - Writing
Maine and the other NECAP states all value
writing highly so have chosen to include it in
their tests although it is not required under
NCLB. The writing portion of the NECAP test is
the most different from the MEA of the content
areas.
40
NECAP Test Design - Writing
This October, the NECAP writing test will
consist of a previously scheduled writing field
test only. No student scores will be reported,
but data from the field test, including that of
Maine students, will be used to inform the
writing test for the next five years. 100 of
writing items are released each year. No items
from this years field test will be released.

41
NECAP Test Design - Writing
  • There are 34 common score points at all grades
    distributed among the following item types
  • 10 1-point Multiple Choice (MC)
  • 3 4-point Constructed Response (CR)
  • 1 12-point Prompt
  • 27 MC and 73 Student Generated
  • There are 2 sessions of writing.

42
NECAP Test Design - Writing
Multiple choice items at grade 5 assess aspects
of writing such as accurate spelling, combining
sentences in a correct and efficient way, correct
end punctuation of sentences, accurate
capitalization of words, and correct usage of
commas in a series and in dates.
43
NECAP Test Design - Writing
Multiple choice items at grade 8 assess aspects
of writing such as accurate spelling, combining
sentences in a correct and efficient way,
identifying sentence fragments and run-on
sentences, use of apostrophes, correct
subject-verb agreement, capitalization, quotation
marks, etc.
44
NECAP Test Design - Writing
Constructed response items require students to
respond in a paragraph after first reading
stimulus materials. Stimulus materials require
students to read text appropriate for the range
of students at the particular grade or
occasionally respond to a photograph. The
stimulus may be a few lines or a whole page.
45
NECAP Test Design - Writing
  • Constructed response items require students to
    respond to 3 of the following 5 types of writing
  • response to literature (after reading a story,
    part of a story, or a poem
  • response to informational texts (after reading a
    short article)

46
NECAP Test Design - Writing
  • report (after reading a graphic organizer
    containing relevant or possibly irrelevant facts
    about a topic),
  • narrative (may or may not utilize stimulus
    materials)
  • persuasive at grade 8(7) a response to a
    situation with no stimulus material.

47
NECAP Test Design - Writing
  • There is one extended response item (prompt) that
    will assess a type of writing not included in the
    constructed response items, although there will
    never be a narrative prompt at grade 8.
  • All stimulus material for the prompt is read by
    the teacher.

48
NECAP Test Design - Writing
  • The Department is providing more in-depth
    presentations on the reading and writing NECAP
    GLEs and tests that will be posted at
    http//www.maine.gov/education/lsalt/necap/present
    ations.html

49
NECAP Test Design -Mathematics
  • Mathematics Test Design Gr. 3 4
  • There are 65 common score points at grades 3-4
    distributed among the following item types
  • 35-1 point Multiple Choice (MC),
  • 10-1 point Short Answer (SA),
  • 10-2 point Short Answer (SA),
  • 54 MC and 46 Student Generated

50
NECAP Test Design - Mathematics
  • Mathematics Test Design Gr. 5-8
  • There are 66 common score points at grades 5-8
  • 32-1 point MC
  • 6-1 point SA
  • 6-2 point SA
  • 4-4 point Constructed Response (CR)
  • 48 MC and 52 Student Generated

51
NECAP Test Design - Mathematics
Scratch paper is allowed on all math sessions.
(ALL answers must appear in the student answer
booklet.) For every grade, calculators are not
permitted for the 1st session, but are permitted
for the last 2 sessions.
52
NECAP Mathematics
  • For calculator sessions, the following resources
    are allowed
  • calculators that meet NECAP specifications,
  • NECAP Multiplication Tables,
  • NECAP Hundreds Charts,
  • NECAP mathematics tool kits, and rulers.
  • 25-50 of mathematics items are released.

53
NECAP Mathematics
The Department is providing a more in-depth
presentation on the mathematics NECAP GLEs and
tests that will be posted at http//www.maine.go
v/education/lsalt/necap/presentations.html
54
NECAP Overview - Accommodations
NECAP accommodations and related policies are
currently being reviewed by educators in all four
states. (Refer to http//www.maine.gov/education/
edletrs/ilethome.shtml for more
information.) The protocol for approving
accommodations for any student is basically the
same as that used for the MEA currently. A team
must meet to discuss, approve and document
allowable accommodations for students who receive
them on an everyday basis.
55
NECAP Overview - Accommodations
There are several differences in current
NECAP accommodations. For instance, in the
reading sessions, the questions and answers
accompanying the reading passage can not be read
to students who have the approved read aloud
accommodations.
56
NECAP Overview - Accommodations
The MEA has not allowed modifications, but NECAP
currently allows the following modifications to
the test F-1 Using calculator and/or
manipulatives on Session 1 of the Mathematics
test F-2 Reading the reading test HOWEVER,
all affected sessions using these modifications
are counted as incorrect.
57
NECAP Overview - Accommodations
Also, the responses for students who have been
approved to use a word processor, typewriter, or
computer must be transcribed by school personnel
exactly as written into the students answer
booklet prior to returning materials. NECAP
can not allow computer-generated responses to be
returned in the special handling envelope for
hand scoring due to the volume of returned
materials.
58
NECAP Overview - Accommodations
Following the current review, updated
accommodation policies and a crosswalk to 08-09
MEA accommodations will be available prior to the
start of testing. IEP teams should use the
current 08-09 MEA accommodation policies and
codes for Spring 2009 meetings. These policies
are located at http//www.maine.gov/education/mea
/0809materials/policiesprocedures.pdf Approved
accommodations from the MEA 08-09 list will be
allowed for the 2009 NECAP.
59
NECAP Overview Policies
Another difference to note is that NECAP
testing policies require that schools ensure that
no students are advantaged or disadvantaged by
their testing environment. Reference materials,
including those on classroom walls or desks,
should not be used by students. All reference
materials that interfere with proper test
administration must be covered or removed during
testing, or students desks must be positioned so
that the materials cannot be viewed.
60
NECAP Overview Administration Dates
The NECAP testing window will always begin on
October 1st, or the first school day following
October 1st, each year and is 3 weeks long.
Maines first administration of the NECAP tests
will begin on October 1, 2009 and continue
through October 22nd.
61
NECAP Overview Administration Dates
Testing materials will be shipped from MP the
week of September 14 -18, 2009. They should
arrive in schools during the latter part of that
week or more likely the beginning of the
following week. Following test administration,
the materials will be picked up on October
23rd.
62
NECAP Overview Administration Info.
MEDMS/Infinite Campus student data used for
printing labels will be provided to Measured
Progress on August 14,2009. The Department
will use the best information available to
determine interim enrollment for students who are
promoted from one school to another over the
summer.
63
NECAP Overview Administration Info.
The Department will provide an updated
enrollment file to Measured Progress based on
October 2nd MEDMS/IC student data. Additional
labels will then be printed and mailed to schools
during the testing window.
64
NECAP Overview Administration Info.
NECAP test administration presentations
(possibly in this electronic format) containing
more specific information will occur in September
2009.
65
The NECAP Reporting System
  • NECAP is very similar to Maines current
    reporting system in that it
  • Utilizes an 80-point scale, with an initial digit
    representing the grade being tested.
  • Classifies student achievement across 4
    achievement levels with definitions similar with
    Maines present language.

66
NECAP Achievement Levels
Proficient with Distinction (Level 4) Students
performing at this level demonstrate the
prerequisite knowledge and skills needed to
participate and excel in instructional activities
aligned with the GLE at the current grade level.
Errors made by these students are few and minor
and do not reflect gaps in prerequisite knowledge
and skills. (MEA - Exceeds the Standards)
67
NECAP Achievement Levels
Proficient (Level 3) Students performing at
this level demonstrate minor gaps in the
prerequisite knowledge and skills needed to
participate and perform successfully in
instructional activities aligned with the GLE at
the current grade level. It is likely that any
gaps in prerequisite knowledge and skills
demonstrated by these students can be addressed
during the course of typical classroom
instruction. (MEA Meets the Standards)
68
NECAP Achievement Levels
Partially Proficient (Level 2) Students
performing at this level demonstrate gaps in
prerequisite knowledge and skills needed to
participate and perform successfully in
instructional activities aligned with the GLE at
the current grade level. Additional instructional
support may be necessary for these students to
meet grade level expectations. (MEA Partially
Meets the Standards)
69
NECAP Achievement Levels
Substantially Below Proficient (Level 1)
Students performing at this level demonstrate
extensive and significant gaps in prerequisite
knowledge and skills needed to participate and
perform successfully in instructional activities
aligned with the GLE at the current grade level.
Additional instructional support is necessary for
these students to meet grade level expectations.
(MEA Does Not Meet the Standards)
70
The NECAP Reporting System
  • NECAP assessment reports are very similar to MEA
    reports, will be available in late January 2010,
    and will consist of
  • Individual student reports
  • Item analysis reports
  • School and SAU reports

71
The NECAP Reporting System
The reports will be delivered on the same
secure online reporting tool as the MEA reports
have been. Data will be supplied to both
teaching and testing schools.
72
Student Report

73
Item Analysis Report
74
The Item Analysis Report
75
School/SAU Report
76
The NECAP Reporting System
77
The NECAP Reporting System
  • NECAP reporting presentations containing more
    specific information will occur in late January
    and/or February 2010.

78
Maine Accountability Reporting
  • At this time, pending federal approval, the plan
    is that the 2009-10 Adequate Yearly Progress
    (AYP) determinations will be based on the
    following assessments of learning during the
    2008-09 teaching year
  • October 2009 NECAP reports
  • 2008-09 PAAP data (except at grade 3)
  • first year LEP participation based on 2008-09
    ACCESS administration

79
Maine Accountability Reporting
  • Full Academic Year (FAY) will be based on student
    enrollment prior to October 1, 2008.
  • AYP targets for grades 3-8 for 2009-10
    are Reading 66
  • Mathematics 60
  • Average Daily Attendance 92
  • AYP reports will be posted online about a month
    after the NECAP reports.
  • Please see the contact list at the end for
    information on directing AYPrelated questions.

80
Maine Accountability Reporting
  • NECAP information, such as GLEs, released items,
    other content-related information, and
    administration information is or will be posted
    and regularly updated on links from the NECAP
    page on the DOE website at
  • http//www.maine.gov/education/lsalt/necap/index.h
    tml.

81
Maine DOE Contact Information
About PowerShow.com