NECAP Science Pilot Test Administration Workshop Grades 4, 8

1
NECAP Science Pilot Test Administration
WorkshopGrades 4, 8 11
NH Department of Education and Measured Progress

• April 30 May 1, 3, 4

2
NH DOE Contact Information

• Tim Kurtz, Director of AssessmentTKurtz_at_ed.state.
  nh.us603.271.3846
• Jan McLaughlin, Science Curriculum Assessment
• jmclaughlin_at_ed.state.nh.us
• 603.271.3856
• Gaye Fedorchak, Alternative Assessment
• gfedorchak_at_ed.state.nh.us
• 603.271.7383
• Lisa Kaim, Assistant for Math and Science
• lkaim_at_ed.state.nh.us
• 603.271.7450
• NH Department of Education, 101 Pleasant Street,
  Concord, NH 03301-3860

3
Measured Progress NECAP Science Team
NECAP Service Center 1-877-632-7774

• Elliot Scharff NECAP Science Program Manager
• Phone - 1-603-749-9102 ext. 2126
• E-mail - escharff_at_measuredprogress.org
• Jennifer Varney NECAP Science Program
  Assistant
• Phone - 1-603-749-9102 ext. 2115
• E-mail - jvarney_at_measuredprogress.org

4
Measured Progress NECAP Team
Mellicent Friddell NECAP Program
Assistant Phone - 1-603-749-9102 ext.
2355 E-mail - mfriddell_at_measuredprogress.org Tin
a Haley NECAP Program Assistant Phone -
1-603-749-9102 ext. 2427 E-mail -
chaley_at_measuredprogress.org
Harold Stephens NECAP Program Director Phone -
1-603-749-9102 ext. 2235 E-mail -
hstephens_at_measuredprogress.org Amanda Smith
NECAP Program Manager Phone - 1-603-749-9102
ext. 2259 E-mail - asmith_at_measuredprogress.org J
oshua Evans NECAP Program Manager Phone -
1-603-749-9102 ext. 2244 E-mail -
jmevans_at_measuredprogress.org
NECAP Service Center 1-877-632-7774
5
The purpose of this workshop is to ensure that

• everyone understands the administration
  procedures for the tests and knows where to find
  support materials and information.
• the NECAP tests are administered in a comparable
  way in all locations across the three states.
• quality control procedures are followed for
  returning materials.

6
Important Dates (page i)

• April 30 - May 4
• Test Materials and Student ID Labels shipped to
  schools
• May 14 - 24
• Test Administration Window
• May 25
• UPS pickup of test materials for return to
  Measured Progress. (Materials need to be ready at
  8 a.m.)

7
The New England Common Assessment Program (NECAP)
(page 1)

• Background
• Collaboration among New Hampshire, Rhode Island,
  and Vermont to create a common program
• Allows states to combine experience, increase
  capacity, and share costs
• Allows development of a customized science
  assessment program, which includes an inquiry
  task component

8
The New England Common Assessment Program (NECAP)
(page 1)

• Purpose of the Pilot Test
• Field testing of all items
• Try out testing procedures
• Opportunity for all schools to become familiar
  with science testing, including the inquiry task,
  prior to the May 2008 operational assessment.

9
The New England Common Assessment Program (NECAP)
(page 1)

• Structure of the Science Pilot Test
• Students in every school in all three states will
  take the test.
• Each student completes one session of
  multiple-choice and constructed-response
  questions and one session of questions tied to an
  Inquiry Task.
• Differences between Pilot Test and Operational
  Test
• Total testing time
• Number of sessions
• Make-up tests
• Testing window
• Reporting

10
Where do NECAP Science Assessment Targets come
from?
11
New Hampshire NECAP Information

• The NECAP Science Assessment is based on the
  Science Assessment Targets as designated in the
  NH Frameworks for Science Literacy K-12.
• The designated state (NECAP) assessment targets
  are the expectations in BOLD boxes in the Science
  Grade Span Expectations (GSEs).
• We use the same statements of enduring
  knowledge to organize our frameworks as the
  NECAP documents.

12
New Hampshire NECAP Information

• NECAP Resources on the NH Science Page
• www.ed.state.nh.us
• Programs and Services ? S ? Science in NH Schools
• NH Science Framework
• New Hampshire Framework for Science Literacy
  K-12 (includes all Science Grade Span
  Expectations)
• NH Science Grade Span Expectations (includes
  NECAP targets)
• K-12 Science Process Skills (includes inquiry
  targets)
• K-12 Earth Space Science 
• K-12 Life Science 
• K-12 Physical Science 

13
New Hampshire NECAP Information

• More NECAP Resources on the NH Science Page
• www.ed.state.nh.us
• Programs and Services ? S ? Science in NH Schools
• NH NECAP Inquiry Task Information
• Planning Guide for Investigations 
• Planning Guide for Non-Investigations 
• Sample Investigation Inquiry Task at Grade 4 
• Sample Non-Investigation Inquiry Task at Grade
  8    
• Sample Non-Investigation Inquiry Task at Grade
  11 
• Released Inquiry Performance Tasks   
•  
• NH NECAP Science Information
• NH NECAP Science Assessment Information 
  (includes all assessment targets)
• Number of Targets by Domain and Grade Span 
•  

14
Content Framework for NECAP Science Assessment
Science Domains by Enduring Knowledge Statements Assessment Targets Assessment Targets Assessment Targets
Science Domains by Enduring Knowledge Statements Grade 4 Grade 8 Grade 11
LS 1 - Survival of organisms 1-4 1-4 1-2
LS 2 - Matter energy of ecosystems 5-6 5-7 3-5
LS 3 - Organisms change over time 7 8-9 6-9
LS 4 - Humans are similar and different 8-9 10-12 9-10
PS 1 - Properties and structure of matter 1-3 1-5 1-4
PS 2 - Energy 4-6 6-7 5-7
PS 3 - Forces and motion 7-8 8 8-10
ESS 1 - Earth and earth materials 1-6 1-5 1-4
ESS 2 - Solar System 6-8
ESS 3 - Universe and galaxies 5-8
15
New Hampshire NECAP Information
Eligible NECAP Targets for the Inquiry Task at
each grade tested can be found in the Science
Process Skills (SPS) GSE in the last row in SPS1
labeled NECAP Science Assessment Targets for
Inquiry (INQ) May be subject of performance
component Resources and Information about the
Science Frameworks and NH Information about the
NECAP Science Assessment can be found at
www.ed.state.nh.us Programs and Services ? S ?
Science in NH Schools Science Reference Sheets
can be found at the link below www.ed.state.nh.us
Programs and Services ? N ? NECAP
16
Item Types
Multiple Choice (MC) 1 Point Answer Key
Constructed Response (4-CR) 4 points Rubric 0-4 points
Inquiry Task 16-18 points assessed with a mix of 2- and 3-point SA
17
Grade 4 Science Pilot Test Design
Session 1 50 Minutes
Session 2 95 Minutes
8 short-answer questions
29 Multiple Choice (1 pt each)
Making Your Predictions
2 Constructed Response (4 pts each)
Setting Up and Conducting Your Investigation
Organizing and Presenting Your Data
For Session 1, students are allowed an
additional 45 minutes without an accommodation.
Analyzing and Using Your Results
A New Investigation
For Session 2, students should complete the
Inquiry Task and all questions within 95 minutes.
18
Grade 8 Science Pilot Test Design
Session 1 50 Minutes
Session 2 95 Minutes
8 short-answer questions
29 Multiple Choice (1 pt each)
Making Your Predictions
2 Constructed Response (4 pts each)
Setting Up and Conducting the Investigation and
Collecting Data
For Session 1, students are allowed an
additional 45 minutes without an accommodation.
Organizing and Presenting Your Data
Analyzing and Using Your Results
For Session 2, students should complete the
Inquiry Task and all questions within 95 minutes.
19
Grade 11 Science Pilot Test Design
Session 1 50 Minutes
Session 2 80 Minutes
29 Multiple Choice (1 pt each)
8 short-answer questions
Prediction
2 Constructed Response (4 pts each)
Analyzing and Using Data
Organizing and Presenting Data
For Session 1, students are allowed an
additional 45 minutes without an accommodation.
Using Evidence and Applying What You Learned
For Session 2, students should complete the
Inquiry Task and all questions within 80 minutes.
20
Inquiry Task Design Pilot Test
Grade 4 8 INVESTIGATION
Introduction Prompt with Content Question
Make a predictions (gr. 4) or hypothesis (gr. 8) and explain.
Conduct Investigation with a partner Collect and display data
Summarize results
Develop and evaluate explanations with content
Propose new question (gr. 4) that could be investigated or investigation (gr. 8)
21
Inquiry Task Design Pilot Test
Grade 11 NONINVESTIGATION
Introduction prompt with content question
Review results from an investigation Develop and evaluate explanations
Formulate questions and hypothesize
Plan/Critique Investigation
Construct or analyze alternative explanation
Link to Enduring Knowledge concept
22
The New England Common Assessment Program (NECAP)

• Science Assessment Changes of Note
• For the pilot ONLY, session 1 will be 1 domain
  per student.
• Every school will have all domains present.
• Student Test Booklet and Student Answer Booklet
  are separate documents for Grades 4, 8, and 11.
• Districts/schools may decide if students can use
  a calculator on the assessment (not recommended
  at grade 4.)
• A science reference sheet will be provided for
  each student in grades 8 and 11. (There are
  different sheets at grade 8 and 11.) The
  reference sheets are available now on the NH
  Science web page.

23
Setting up the Inquiry Task

• Questions

24
School Test Coordinators Responsibilities (page
2)

• Primary responsibilities
• serve as the schools contact person with
  Measured Progress
• coordinate all test-related activities
• prepare test administrators to administer NECAP
  according to directions in the Test Administrator
  Manual
• oversee the inventory, distribution, collection,
  and return of ALL test materials
• ensure test security and compliance with test
  administration procedures

25
Test Security (page 3)

• Test Security relies on the professional
  integrity of everyone in our schools across all
  three states. No student should be advantaged or
  disadvantaged based on how or where the test is
  administered.
• All test items and responses to those items in
  the NECAP are secure and may not be copied or
  duplicated in any way or kept by the school after
  testing is completed.
• Using secure test material to prepare students in
  any way for this test administration is a
  violation of test security and testing procedure.

26
Breaches in Test Security (page 3) Any concern
about breaches in test security must be reported
immediately to the test coordinator and/or
principal. The test coordinator/principal is then
responsible for reporting breaches to the
district superintendent and the state department
of education.
27
Getting Ready

• Select each schools Test Coordinator
• Communicate test plan to staff
• Ensure test security is in place
• Schedule testing
• Plan logistics around testingespecially for the
  Inquiry Task

28
Preparation for Test Administration
BEFORE TESTING (page 4)

• Manuals
• Read the Principal/Test Coordinator and Test
  Administrator Manuals
• Student Participation and Accommodations
• The Accommodations and Procedures Administrators
  Training Guide covers these topics
• Who should be tested
• Determining how students will participate using
  accommodations
• Documenting and bubbling in accommodation codes

29
Who should be tested for the pilot? (page 4)

• As many students as possible, including
• Students with disabilities
• English language learners
• Students attending career and technical centers

• EXCEPTIONS for the pilot test ONLY
• Students who would normally participate in
  alternate assessment
• ELL students enrolled in U.S. schools less than
  one year
• Students absent for entire testing window
• Students experiencing extraordinary personal
  circumstances

30
Classroom Environment
Preparing for the Inquiry Task Grades 4 and 8
Only

• Check to ensure there are enough materials for
  the Inquiry Task.
• Materials are packed by type, not by kit.
• Ensure that students have enough room to place
  materials on the 11 x 17 Placemat.
• Identify plan for setting up materials for the
  Inquiry Task.
• Identify process for grouping students (see
  Appendix 6 of the Principal/Test Coordinator
  Manual).

31
Appendix 6 Guidelines for Grouping Students in
Session 2 Grades 4 8 only
Part 1 Making your prediction Students will make predictions and record them on their own Prediction Sheet.
Part 2 Setting up and conducting your investigation and collecting data Students will work in collaborative groups. All students must record data on their Data Sheets for use in Parts 3 and 4 ( and Part 5 for grade 4).
Parts 3 and 4 (and Part 5 for grade 4) Organizing and presenting your data, and analyzing and using your results Students will work alone with data collected from Parts 1 and 2 and record all their answers in their own Student Answer Booklet.
32
Accommodations for the Pilot

• Who is eligible for testing accommodations?
• ALL students
• Accommodations do not change what we expect
  students to know and be able to do.
• Test accommodations are based on individual
  student needs and classroom assessment practice
  they are not for the use of an entire classroom
  or category of students.
• They should not give students unfair advantages
  rather they are meant to remove barriers that may
  exist due to a students learning style or
  disability.

33
Appendix 5Table of Standard Test Accommodations
(Page A-6)
34
Accommodations for the Pilot

• Accommodations, Guidelines, and Procedures
  Administrator Training Guide Still available
  on state DOE website under NECAP, but not yet
  updated for Science. Everything listed there is
  still available.
• For the Science Pilot, Use the Table of Standard
  Test Accommodations found in Appendix 5 of the
  Test Coordinator and the Test Administrator
  Manuals.
• Only these manuals have the most recent
  updates.
• School teams may use, without state approval,
  only standard accommodations listed in categories
  A, B, C, or D. Please note Categories E and F
  work differently, as follows

35
Accommodations for the Pilot

• Use of Category E Other Accommodations -
• Contact NHDoE, Gaye Fedorchak, in advance of
  testing
• to discuss any other (non-listed) accommodations
  you want to
• use during the pilot.
• Accommodation(s) must be consistent with those
  used in students regular classroom instruction.
• If the DOE finds the Category E-Other
  accommodation to be comparable to a standard
  accommodation, we will note this and consider for
  future updates to Accommodations Manual.
• DOE is seeking collecting teacher ideas for the
  Inquiry Task
• During full test implementation (May 2008),
  student work done using category A, B, C, D, or
  state approved E accommodations will be fully
  credited scored.

36
Accommodations for the Pilot

• Use of Category F Modifications -
• If the state determines that your request for a
  (non-listed) E-Other Accommodation will change
  what the test measures, then the state will
  respond in writing that use of this procedure
  will produce a test modification and must
  therefore be documented as an F-Modification.
• After the pilot, during full test administration,
  use of an F-Modification will result in no credit
  given for student work during test sessions in
  which this F-Modification was used.
• When full assessment starts, any E Other
  Accommodation not registered as approved by
  your state DOE will be treated as an F-
  Modification.

37
Accommodations for Pilot

• After Testing, Document all accommodations and
  modifications actually used on page 2 of the
  Student Answer Booklet. (If not used, dont
  bubble.)
• Accommodation Updates for the Science Pilot
• C-4 . Now includes Science
• C-12 .. Now includes Science
• C-13 .. Does not appear in Test Manuals but is
  still in effect
• for NECAP and will return in future manuals.
• An abacus is not likely to be needed for the
  Science
• Pilot.
• D-5 . Now includes Science
• D-6 . Now includes Science
• D-7 . Reserved for Future Standard
  Accommodation (after
• pilot data is gathered)

38
Accommodations - Thinking long term

• Support teachers through the accommodations
  decision-
• making process.
• Include all of a students classroom teachers,
  parents, and,
• whenever possible, the student in the
  decision-making
• process.
• Consult with parents regarding use of
  accommodations
• through phone or similar kinds of contacts. A
  face-to-face
• meeting is not required.
• Standardize the accommodation administration
  process and
• plan the resources necessary for large-scale
  implementation.
• Ensure that the students records include the
  decisions made
• to inform both current and future educational
  planning.

39

• Scheduling Test Sessions (page 5)
• Session 1 of the NECAP Science pilot test in
  grades 4, 8, and 11 is designed to be completed
  in approximately 50 minutes.
• Students are allowed an additional 45 minutes for
  Session 1 without an accommodation. Plan
  accommodations for those students who typically
  take more than 50 additional time for regular
  classroom assessment. Only those students with
  an extended time accommodation may be permitted
  more than 95 minutes to complete Session 1.
• Session 2 of the NECAP Science pilot test in
  grades 4 8 is designed to be completed in
  approximately 95 minutes. Session 2 in grade 11
  is designed to be completed in approximately 80
  minutes.
• The student questionnaire for grades 4, 8, and 11
  is designed to be completed in 20 minutes.

40
Scheduling Test Sessions (page 5)

• All testing, including accommodated sessions,
  must occur within the testing window.
• Test sessions must be scheduled and given in the
  order presented in the Student Test Booklet.
• All classrooms of students in a school should
  take the same test session simultaneously.

41
Student ID Labels (page 7)

• Student ID Labels
• Labels created for students based on beginning of
  school year 2006-07 enrollment files
• 2 identical labels printed for each student (one
  for Student Answer Booklet, one for Student Test
  Booklet)
• Student labels are sorted by group field prior to
  printing (if requested)

42
Student ID Labels (page 7)

• Students enrolled in your school WITH Student ID
  Labels
• 3 fields MUST be correct in order to use label
  student name, state-assigned Student ID number,
  and school name
• If any of the 3 fields are incorrect or missing,
  DO NOT USE the label.
• Call your state DOE to report incorrect
  information.
• Follow procedure for students without Student ID
  Labels.

43
Student ID Labels (page 7)

• Student ID Labels for students NOT in your school
• Labels are NOT transferable between schools.
• Throw away any labels provided for students not
  enrolled in your school.
• DO NOT forward these labels on to other schools.
• DO NOT affix these labels to Student Answer
  Booklets.

44
Student ID Labels (page 7)

• Students WITHOUT ID labels
• Complete the student information on pages 1 and 2
  of the Student Answer Booklet.

45
Preparing Student Test Booklets and Answer
Booklets for Testing (page 7)

• Booklets will be shrink-wrapped in packs of 15,
  10, 5, and singles.
• Count the booklets to verify that the quantity
  received matches the quantity sent. Call
  Measured Progress if your count does not match
  the quantity indicated on the Material Summary
  form sent by Measured Progress.
• Do not re-sequence test booklets or answer
  documents.
• Student Answer Booklets come inserted in the
  Student Test Booklet, paired by form.

46
Preparing Student Test and Answer Booklets for
Testing (page 7)

• DO NOT separate the Student Answer Booklets from
  the Student Test Booklets.
• If the booklets do become separated, you will
  need to match the form number on the front cover
  of the Student Test Booklet with the bracketed
  portion of the number printed on the bottom right
  corner of the Student Answer Booklet.
• The unique serial numbers on Student Test
  Booklets and Student Answer Booklets are not
  designed to match.

47
Preparing Student Test Booklets and Answer
Booklets for Testing (page 7)

• For students WITH Student ID labels
• For students enrolled with a label, affix the
  label to the front cover of the Student Answer
  Booklet.
• Affix second label on the front cover of the
  Student Test Booklet
• For students WITHOUT Student ID labels
• For students enrolled without a label, fill in
  all required information.
• Write student name and school name on cover of
  the Student Test Booklet

48
(No Transcript)
49
(No Transcript)
50
New Hampshire
51
Prior to Test Administration (page 8)

• Designating Test Administrators
• Administer content area test sessions
  simultaneously within each grade level at the
  school and district.
• Test students in surroundings that will provide
  them the opportunity to do their best work.
  (Grades 4 and 8 will need a level workspace for
  session 2).
• Students who require accommodations must be
  supervised by trained test administrators (refer
  to Accommodations, Guidelines, and Procedures
  Administrator Training Guide)

52
Preparing Test Administrators (page 8)

• Assign each Test Administrator to a specific
  group of students.
• Notify Test Administrators of the testing
  schedule.
• Explain security procedures.
• Plan for grouping students into pairs in grades 4
  8 prior to Session 2.
• Plan for inventorying, distributing, collecting,
  and storing materials.
• Create a plan for applying Student ID Labels or
  code student identification info on covers of
  Student Test Booklets and Answer Booklets.
• For students without a label, plan for completing
  student info on page 2 of Student Answer Booklet.

53
Preparing Test Administrators (cont.)

• Discuss additional materials needed
• calculators,
• scratch paper and/or Post-Its,
• Science reference sheets
• Explain guidelines for classroom environment.
• Encourage completion of Test Administrator
  Questionnaire.
• Answer questions regarding test administration
  and security.

54
Test Materials (pages 10-14)
Inventory Test Materials

• Packing Order of NECAP Science Materials
• Quantities of Student Test Booklets and Answer
  Booklets
• Quantities of Other Materials
• Ordering Additional Materials
• Storing and Access to Test Materials
• Equipment and Materials Permitted During Test
  Administration
• Equipment and Materials Prohibited During Test
  Administration
• Ancillary Test Materials

55
Test Administration
DURING TESTING (page 14)

• Distributing Test Materials
• Make sure materials are kept in a locked storage
  area prior to testing and between sessions.
• Include an additional set of test materials for
  the test administrator to use while giving
  directions.
• Monitoring Test Administration
• Test administrators may not comment on students
  work. Test administrators may not help students
  in any way except during the General
  Instructions, Student Questionnaire, or as
  specified in the Test Administrator Manual.

56
Preparation of Test Materials for Return
AFTER TESTING (page 15)

• Collecting Materials After Testing
• List on page 15 of Principal/Test Coordinator
  Manual
• Special Materials
• Make sure that all non-standard,
  student-generated work (computer-generated,
  large-print, and Braille responses) have been
  transcribed into a regular Student Answer
  Booklet.
• Examples of materials for the Special Handling
  envelope torn booklets, responses written with
  anything other than a 2 pencil, damaged test
  booklets

57

• Verifying Completion of Student Information on
  Student Answer Booklets (page 16)
• Ensure that a label is affixed properly for all
  students with a Student ID Label.
• Ensure that all applicable student information
  has been competed for students without a Student
  ID Label.
• Ensure that accommodation information has been
  coded on page 2 of the Student Answer Booklet for
  students who used an accommodation(s).

58
(No Transcript)
59
(No Transcript)
60
Completing Principals Certification of Proper
Test Administration (page 16)

• Complete 1 form online for each grade tested.
• Must be done prior to return of materials
• Numbers you need
• total of booklets sent to your school
• of used booklets being returned
• total of booklets being returned
• Detailed instructions will be shipped with test
  materials.
• Print, sign, and return a copy of the form with
  test materials.

61
Return of Materials (page 17)

• Packaging test materials for return to Measured
  Progress
• UPS One-Day Pickup on May 25th at 800 a.m.
• Use original shipping cartons.
• Pack materials for one grade only per carton.
• Follow packing instructions on the bottom on
  page 17 of your Principal/Test Coordinator
  Manual.

62
DO NOT return the following (page 18)

• Manipulatives from the Inquiry Task Kits
• Inquiry Task Placemats
• Materials Summary Form Packing Slips Secured
  Material
• Science reference sheets
• Principal/Test Coordinator Manual and Test
  Administrator Manuals
• Principal/Test Coordinator Questionnaire
  (Return completed answer sheets only.)
• Test Administrator Questionnaire (Return
  completed answer sheets only.)
• Student Questionnaires (Students answered the
  questions in their Student Answer Booklets.)

63
NH Science NECAP Resources

• NECAP Page on NH Dept. of Ed Website.
• www.ed.state.nh.us
• Programs and Services? N ? NECAP?2007 Science
  pilot
• Student Support and Testing Materials
• Science Reference Sheets
• Policy Material
• Accommodations, Guidelines, and Procedures
  Administrator Training Guide
• Calculator Policy
• 2007 NECAP Science Principal/Test Coordinator
  Test Administrator Manuals
• Reference Materials
• 2007 Test Administration Workshop Presentation

64
Questions and Answers