EndofCourse Tests 1st Semester 200809 General Assessments Online Assessments

1
End-of-Course Tests 1st Semester 2008-09
General AssessmentsOnline Assessments

• Carteret County Schools
• Test Coordinator Training
• 17 December 2008

2
Eligible Students

• ALL students enrolled in courses that result in
  credit for Algebra I, Algebra II, Biology,
  Chemistry, Civics Economics, English I,
  Geometry, Physical Science, Physics, or U.S.
  History must take the appropriate EOC, even if
  the class is an honors or AP class.
• Exceptions
• LEP students qualified and using NCCLAS alternate
  assessment.
• AP Students who have previously taken the
  standard or honors level course for credit AND
  have a EOC score recorded in NCWISE.
• Any student withdrawn from an EOC-eligible class
  before the 10th day of the semester. Any student
  withdrawn from an EOC course after the 10th day
  must have written approval from the Central
  Services Testing Office authorizing the
  withdrawal, or the student will be required to
  take the EOC.

3
EOC Test Forms This Year
4
Test Scheduling

• Test in the morning whenever possible.
• EOCs testing window is 12 16 January.
• On-line EOCs can be scheduled as early as 5
  January, if all classes in the subject are
  scheduled early.
• All make-up exams must be completed and scanned
  within 10 days of the regularly scheduled exam
  date.

5
Test Scheduling contd.

• Teachers may not have access to test materials
  (or online tests) and then teach classes on that
  subject. When using teachers as Test
  Administrators and/or proctors, schedule
  carefully to prevent misadministrations.
• Student survey completion for general assessment
  exams may be done prior to the actual test date,
  so long as test booklets are not issued.

6
Time

• Estimated time for all EOCs is 164 minutes.
  (Includes online EOCs)
• Maximum time limit to complete all EOC exams is
  240 minutes within the same school day. Applies
  to all students except those with IEP/504 for
  extended time and/or multiple sessions.
• For best practices, the North Carolina Testing
  Program strongly recommends that schools schedule
  each end-of-course test for a maximum 4-hour time
  period within the same school day that does not
  interfere with lunch or bus schedules. All
  students, including students with Scheduled
  Extended Time accommodations, must be allowed to
  travel home at their regularly scheduled time.
• NO administration of an EOC test may exceed 4
  hours, (except students with documented special
  needs requiring accommodations, such as Scheduled
  Extended Time).
• Be ready to provide for lost time when students
  leave testing due to emergencies.

7
Number of Items
8
Answer Documents

• Only the form letter is printed the form number
  must be bubbled by students.
• One answer document must be scanned for every
  student in membership of the EOC classes and for
  those students who do not have C.S. authorization
  for a late withdrawal.
• Answer documents will be pre-coded.
• Student must bubble for Regular.
• All Retest (1 and 2) administrations will be done
  online.

9
Embedded Field Test Items

• Some sections of EOC tests contain items used for
  field testing and experimental purposes.
• Embedded items are not identified and will not
  count for/or against student scores.
• By embedding the experimental questions in the
  operational EOCs, future field testing is
  minimized.

10
EOC Test Materials

• Test Administrators Manual
• Accurate timing device (no alarms!)
• Student Survey Questionnaire
• General Purpose Header per class (new style
  only)
• Blank paper
• Highlighters and acetate overlays are optional
• Graph paper for ALG I, ALG II, and GEOM only
• Calculators (graphing for ALG I, ALG II
  scientific for CHEM, GEOM, PHYS SCI)
• NCDPI-issued reference tables (Chemistry,
  Physical Science, or Physics)
• NO FORMULA / REFERENCE SHEETS ALLOWED for ALG I,
  ALG II, GEOM
• (Students are expected to know and use common
  formulas. Uncommon formulas required to complete
  a problem will be provided in the problem itself.
  No individual crib notes, or cheat sheets,
  or wall displays in any manner or form are
  allowed. )

11
Test Forms and Accommodations

• One read-aloud form/number will be used for small
  group administrations, whenever possible.
• If you have more than one read-aloud small group
  administration, a different test form/number will
  be issued for each group.
• Large print, one-per-page, Braille editions are
  available but must be ordered immediately to
  arrive in time.

12
EOC Accommodations

• See page 16 of the TAM for allowed accommodations
• No Test Administrator Read-Aloud, or Interpreter
  / Transliterator Signs accommodation for the
  English I test
• Read-aloud-to-self accommodations must be in
  one-on-one sessions.
• Test Administrator Read-Aloud Upon Request
  accommodations should be one-on-one or in room
  large enough that other members of the group
  cannot hear when the Test Administrator reads to
  a student.

13
Accommodations contd (2)

• Freedom of choice is not an option
• No surprises on test day IEP changes made after
  16 December 2008 will NOT be used for the EOCs.
• Must be specified in IEP or 504.
• Use it or report it and do it again.
• When in doubt, ask in advance.

14
Accommodations contd (3)

• For any State-mandated test, the accommodation
  must (1) be documented in the students current
  IEP or Section 504 Plan and (2) the documentation
  must reflect routine use during instruction and
  similar classroom assessments that measure the
  same construct. However, in cases where the
  documentation is not consistent with
  accommodations used during instruction, the
  student is to receive the accommodations
  specified in the current IEP or Section 504 Plan
  although this could adversely affect student
  performance. It is vital for students with
  disabilities to receive accommodations on
  State-mandated tests that allow them to
  demonstrate their true abilities however,
  students must not receive unnecessary or
  inappropriate accommodations.
• Testing Students with Disabilities, Pg. A1.06

15
Test Administrators Manual
16
Test Security Testing Code of Ethics

• EVERYONE except students reads the Testing Code
  of Ethics
• School personnel are not to disclose the
  contents of secure tests by discussing specific
  questions or information contained within the
  tests with each other or with students.
• In addition, excerpts must not be used at any
  time during classroom instruction or in resource
  materials as study guides.
• Access to the tests shall be limited to school
  personnel who have a legitimate need.
• Not copied, filed, used in instructional
  activities, reproduced, or paraphrased.
• Report any sample test questions in instructional
  material prior to use, whether generated locally,
  from another school, or from an unknown source
• General Statute 14-118.2 Assisting, etc. in
  Obtaining Academic Credit by Fraudulent Means

17
Test Security General Statute 14-118.2

• It shall be unlawful for any person, firm,
  corporation or association to assist any student,
  or advertise, offer, or attempt to assist any
  student, in obtaining or in attempting to obtain,
  by fraudulent means, any academic credit, grade
  or test score

18
Test-day Procedures

• Wall displays removed/covered.
• At no time are proctors to be alone with the
  student test booklets or state test
  administration materials. Proctors are not to
  pick up test materials from or return test
  materials to the school test coordinator at the
  beginning or the end of testing unless
  accompanied by the appropriate school personnel.
  
• TAM, pg 18
• No additional materials given to students during
  the test administration, except blank paper or
  pencils.

19
Test-day Procedures contd (2)

• Unethical testing practices include, but are not
  limited to, interpreting, explaining, or
  paraphrasing the test directions, or test items.
  Test administrators may repeat test directions
  only and are not permitted to provide any
  specific assistance with answering test
  questions. For example, test administrators and
  proctors are NOT permitted to clarify test
  directions, provide synonyms for unknown words,
  or to rephrase the questions.
• TAM, Pg 28

20
Test-day Procedures contd (3)

• Students DO NOT bring anything (other than
  pencils) into the sessions.
• Follow school-specified procedures concerning
  students reading other materials (novels or other
  non-textbook materials) while waiting for other
  students to complete the test.

21
Specified Procedures (1)

• See Pg 17 Uniformity of Test Administration
• ...Directions for distributing test materials
  such as blank paper and pencils must be followed.
  Placing the test materials on the students desk
  prior to the beginning of the test administration
  is a violation of the procedures outlined in...
  the Testing Code of Ethics.
• Test books are NOT to be distributed until after
  the Student Background Information is
  completed/checked.

22
Specified Procedures (2)

• ...the test administration directions must be
  followed EXACTLY as written. The test
  administrator must read aloud only the
  information in boldface print that is preceded by
  the word SAY
• Failure to follow the script as written in this
  manual may constitute a misadministration or
  violation of the Testing Code of Ethics.
• TAM, Pg 29

23
Assorted Information contd

• The following items are prohibited in test
  sessions
• Cheat sheets
• Cell phones / pagers
• PDAs / Blackberries / iPhones
• iPods / MP3 players
• Reference books
• Text books
• Thesauruses / Dictionaries
• Music
• Bookmarks
• Food
• Drink
• Candy / Gum
• Procedures, formulas, or word lists
• Tips for Taking Tests

24
Test Administrators and Proctors

• Every test administrator and proctor must be
  trained prior to the test. No exceptions.
  Training last year, over the summer, or for
  off-cycle online tests does not count for this
  semester s EOCs.
• All test sessions must be proctored. Even
  one-on-one.
• Test administrators NEVER leave the session
  except for an emergency and only after having
  contact with TC. (See earlier slide concerning
  proctors and test materials.)
• Proctors may not leave the room, except in an
  emergency.
• Proctors dont read directions assist students
  with their answers read student answers or
  modify, change, alter, or tamper with student
  responses.

25
Test Administrators and Proctors contd

• Proctors and test administrators must be
  attentive exclusively to the testing session.
  They may NOT do other work or reading while the
  test session is in progress.
• Failure to follow this rule constitutes a
  misadministration for all students in the
  session.
• Test administrators and proctors are to move
  quietly about the room and scan the students
  work areas to ensure that students are following
  the test directions, performing the required
  tasks, and not sharing responses.

26
Responsibilities

• State Board of Education Policy list of specific
  test administrator and proctor responsibilities
  includes
• Avoid distracting behaviors such as
• Holding extended conversations
• Reading newspapers, novels, etc.
• Eating
• Carrying out other personal or professional
  duties (includes working on the computer for any
  reason, etc)
• Talking on cell phones, etc.

It does not matter how long you have been
administering tests or how you have always done
it. The rules have changed. Do it this way,
or retest all your students.
27
Answer Sheet Review and Coding

• Prepare and submit to C.S. Testing a written plan
  for reviewing student answer documents for stray
  marks and coding. (Required by DPI for annual
  accountability audits)
• The review/coding of secure test materials for
  stray marks and coding must occur under secure
  conditions in a group setting.
• A group is defined as, 3 or more school
  personnel.
• During review of answer sheets and headers before
  scanning, no test booklets may be available.
• No changes to student answers are allowed.
  Student answers are NOT to be changed or modified
  in any manner during this process.

28
Test Coordinator Accessibility

• The school test coordinator must be
  accessible to test administrators and proctors
  during the administration of secure state tests.
  Due to the accessibility requirement, the school
  test coordinator must not be given the
  responsibility of administering a test.
• No exceptions.

29
Accounting for Materials

• Everything issued out gets returned to C.S.
  Testing
• Secure, locked, limited access storage area
• Classrooms, and desks/file cabinets in classrooms
  are NOT secure!!
• USE TRACKING SHEETS FOR EVERYTHING!
• Count whenever any testing item changes hands
• Prohibit reproduction of all or any part for the
  tests
• Prohibit employees from disclosing the content
• Minimize access by anyone before, during, and
  after testing
• Report materials discrepancies immediately to
  C.S. Testing
• Review for scanability, required coding, and
  SIQ information in secure conditions of a group
  session

30
Test Security Materials contd

• Under no circumstances will Test Coordinator
  allow test administrators to keep any type of
  test materials overnight.
• If answer sheets are issued to test
  administrators prior to the actual test date for
  survey completion and data verification, all
  answer sheets must be returned and secured by the
  Test Coordinator at the end of the day.
• Test Coordinator must verify that issued test
  materials of any type have been returned to them
  at the end of each day.
• Keeping test materials in classrooms is not
  allowed, even when locked in filing cabinets or
  desks.

31
A Gentle Reminder

• Misadministrations ARE preventable.
• Experience is not a reliable guide
• Good intentions cause many misadministrations
• ALWAYS protect the security of test materials
• Keep your attention on the rules and students
• Ignore accommodations at your peril!!!
• Prepare yourself and the room
• Facilitate the environment, not the answers
• Interpretations usually cause misadministrations
• Imaginations have no place in testing!!
• Make sure required medications are taken
• We can fix just plain Oops.

32
Avoid Misadministrations

• NEVER put materials on desks before the students
  are seated. Hand out all materials in accordance
  with the script in the TAM.
• AFTER handing out the materials, move students as
  necessary so that forms are distributed to
  prevent sharing.
• Make sure each students form/color answer sheet
  matches their test book.
• Verify the test book form matches the form
  bubbled by the student on his/her answer document.

33
When a Test Irregularity Occurs

• Test Coordinator calls or emails C.S. Testing
  (David).
• C.S. Testing determines whether retesting is
  required.
• Obtain supporting documentation/statements of
  test administrator, proctor, and principal
  regarding irregularity, as directed.
• Test Coordinator files OTISS report within 5
  days. ( https//otiss.schools.nc.gov )
• Forward additional documentation, when requested.

34
Answer Document Review and Coding

• Prepare a written plan for reviewing student
  answer documents for stray marks and coding. (Now
  required by DPI)
• The review/coding of secure test materials must
  occur under secure conditions in a group
  setting.
• A group is defined as, 3 or more school
  personnel.

35
Clarification of Coding

• In the Special Codes, the Anticipated Grade
  (Column A) and the Anticipated Achievement Level
  (Column H) will be accurately completed on ALL
  answer sheets.
• Achievement Level descriptors for the EOC courses
  are listed in Appendix A to the TAM (pages
  79-91).
• Students Percentage Grade (columns C, D, E) is
  cumulative course grade PRIOR to addition of EOC
  score.
• EOC score must be computed as at least 25 of
  final grade
• Complete Exit Standard Eligibility (column F) for
  all repeating 11th grade and all 12th grade
  students.
• Make sure to use Special Codes column G when the
  student tests as a make-up, or when they are
  absent from the make-up and dont test at all.

36
For scoring . . .

• Double and triple check to make certain all
  answer sheets are marked with the form.
• Use the front door at C.S. only.
• Bring answer documents and headers organized and
  edited for completeness and accuracy.
• Scores for answer sheets with missing anticipated
  grades and achievement levels will not be
  provided.
• We have only one functional scanner again, so be
  prepared to wait in the designated conference
  room until it is your turn.

37
End-of-Course Online Testing 1st Semester
2008-09

• Online Test-Specific Information

38
Eligible Students

• All EOCs are now available as on-line tests.
• ALL students enrolled in courses that result in
  credit for Physics must take the Physics online
  EOC Test. (There is no paper/pencil test for
  Physics anymore.)
• Exceptions
• LEP students using NCCLAS alternate assessments.
• Any student withdrawn from an EOC-eligible class
  before the 10th day of the semester.
• Any student withdrawn from an EOC-eligible class
  after the 10th day must have written approval
  from the C.S. Testing authorizing the withdrawal,
  or the student will be required to take the EOC
  test.

39
Online EOC Test Forms

• Forms of the tests are randomly selected once
  students log into the appropriate online EOC
  test.
• All student surveys and answers are completed
  online, so no answer sheets or test booklets are
  required.
• NCDPI-issued reference tables for Chemistry,
  Physical Science, and Physics are provided.
  Students get a paper copy and have one online,
  also.

40
Accommodations

• See page 20 of the TAM for allowed
  accommodations.
• Test Administrator Reads-Aloud, Reads-Aloud Upon
  Request, and Student Reads-Aloud to Self
  accommodations MUST be one-on-one sessions for
  on-line testing because of the random selection
  of the test forms.
• Large print, one-per-page, Braille editions are
  not available for the online Physics test.
  Students with visual impairment will require
  assistive technology to complete the test.
  Braille reference tables ARE available.

41
Test Scheduling

• Please coordinate your test sessions immediately
  so we can reserve seats on your preferred date
  and time. DO NOT WAIT!! You may be forced to
  test at a less convenient time, if you do.
• Test in the morning whenever possible.
• Online make-up exams can be completed, as long as
  they are done within the testing window or within
  the 10-day make-up period.

42
Time

• Same times, same limits, same requirements as the
  general assessment EOC tests.
• Plan for 164 minutes within a 4-hour block that
  is not interrupted by lunch, etc.
• Maximum time for all students is 4 hours, unless
  Scheduled Extended Time is specified in IEP.

43
Online EOC Test Materials

• Online EOC Test Administrators Manual (light
  green)
• Accurate timing device (no alarms!)
• Properly programmed computers with latest web
  browser, high-speed Internet connection and Flash
  8 Player software.
• Blank paper
• Pencils
• NCDPI-provided graph paper for Algebra I, Algebra
  II, Geometry
• Per student graphing calculator for Algebra I
  and Algebra II scientific calculator Geometry,
  Chemistry, Physical Science, and Physics
• NCDPI-provided reference tables for Chemistry,
  Physical Science, and Physics ONLY

44
Online Test Administrators Manual
45
Online EOC Test Reminders

• Seats for testing must be reserved in advance.
  Any registered student can test in a reserved
  seat.
• Login students not more than 30 minutes before
  test time (730 for 800 reservations)
• Do not login any student that is not physically
  present and ready to test.
• DO NOT let students click START until told to do
  so.
• Watch to make certain that only the online test
  is being used on the computer no Internet,
  Google, etc.
• Use the PAUSE button if a student has an
  emergency that requires them to leave the testing
  room.
• All calculators cleared by TC before AND after
  each test session.

46
SIQ Reminders

• SIQs must be completed at least 24 hours before a
  student is scheduled to test.
• Complete SIQs are essential.
• Anticipated Grade and Achievement Level entries
  are required for all students, just like for the
  paper/pencil tests.
• The Achievement Level Descriptors are NOT
  included in the Online EOC TAM, so copies have
  been provided for you to duplicate and distribute
  to the teachers involved in online EOC testing.

47
Scores for Online EOCs

• Results for all Online EOCs will be available the
  morning following the test.
• There is no way to get them sooner.