EndofCourse Assessment Test Coordinators Manual Training

1

• End-of-Course AssessmentTest Coordinators
  Manual Training
• Phase I and Phase II 2009/2010

1
2
Agenda

• EOC General Information and Changes
• Testing Windows Test Formats
• Online Test Examiners Manual
• Questions

2
3
End-of-Course Assessments

• Required Tests
• English II
• Algebra I
• Biology
• Government

4
End-of-Course Assessments

• Phase I Assessments
• Include English II, Algebra I, and Biology
• Were the first group of EOC tests created
• Became operational in Spring 2009
• Required for AYP, APR and/or NCLB

5
End-of-Course Assessments

• Phase I Assessments Session II
• Points are not the same for each content area
• English II writing prompt is worth 4 points
• Algebra I PE is worth 4 points
• Biology PE is worth 20 points

6
End-of-Course Assessments

• Phase II Assessments
• Include English I, Algebra II, Geometry,
  American History, and Government
• Were the second group of EOC tests created
• Become operational October 13, 2009

7
End-of-Course Assessments

• Phase II Assessments
• Government is the only required Phase II
• Assessment
• Government is required for APR

8
End-of-Course Assessments

• Phase II Assessments
• Have selected response (SR) items only
• English I has 52 items 7 passages with 6 or 8
  items each
• All other Phase II Assessments have 50 items
  each.
• All are worth 40 points

9
End-of-Course Assessments

• Scoring EOC
• SR Items for both Phase I and Phase II
  Assessments are officially scored by Riverside
  Publishing immediately after testing
• Official SR scores are returned to the district
  within 5 business days from receipt of tests

10
End-of-Course Assessments

• Scoring EOC
• WPs and PEs are officially scored by the
  Assessment Resource Center (ARC) at a later time
• Unscored WP and PE items are scanned and
  electronic copies are returned to the district
  for local scoring 5 business days from receipt of
  tests

11
End-of-Course Assessments

• Scoring EOC
• Session I official scores and locally scored
  Session II results can be included in a students
  final grade
• DESE highly recommends that EOC Assessments be
  used as 10-25 of the students final grades
• The percentage is a district-level decision

12
End-of-Course Assessments

• Scoring EOC
• Riverside Publishing sends two e-mails with
  attachments to the DTC one for training and one
  for scoring
• Task Scoring Workshop and Teacher Interface have
  URLs, user names, and passwords

13
End-of-Course Assessments

• Scoring EOC
• User names and passwords for Task Scoring
  Workshop and Teacher Interface allow teachers
  access to secure materials
• For security reasons, the passwords are not
  forwarded to the STC or teachers until district
  testing is complete

14
End-of-Course Assessments

• EOC score results
• Official scores for PEs and WPs arrive in the
  district in August
• Both Session I II are combined into a Scale
  Score for Student Reports
• Official state scores will be used for AYP and
  APR
• Crystal Reports have breakdown of Session I and
  Session II scores
• Teachers will be able to compare their scored
  Session II assessments to the official
  state-scored Session II

15
End-of-Course Assessments

• EOC score results

16
End-of-Course Assessments

• Level Not Determined (LND)
• For EOC Assessments, a district will receive a
  Level Not Determined (LND) for a student if that
  student NEVER participates in a required EOC
  Assessment (English II, Algebra I, Biology,
  Government) before they graduate
• beginning with the graduating class of 2011
• EOC Assessments are not a graduation requirement

17
End-of-Course Assessments

• Lowest Obtainable Scale Score (LOSS)
• Students who participate in an EOC Assessment
  receive scores
• A student receives the Lowest Obtainable Scale
  Score (LOSS) if a students test is invalidated
  for cheating or paraphrasing in any content area
  because they have participated in the test

18
End-of-Course Assessments

• Individualized Education Program (IEP)
• Students who have an IEP with accommodations can
  be accommodated during testing

19
End-of-Course Assessments

• Changes and Updates
• The Not Enrolled bubble is used for a student
  who begins any session of an EOC Assessment and
  moves either out of the district or from building
  to building within a district before finishing
  the entire assessment
• The sending school should keep documentation on
  file about the students move
• In the manuals EOC Assessments will be
  categorized as Phase I and Phase II

20
End-of-Course Assessments

• Changes and Updates
• Dictionaries, thesauruses, and grammar handbooks
  can be used with the writing prompt for English
  II, Session II
• When students are taking the online version of
  the test, do not mark a student as absent until
  the END of the districts testing window
• English II will not have a stand alone field test
  this year - however, the Phase II GIS has a
  bubble for an English II field test so please
  disregard

21
Agenda

• EOC General Information and Changes
• Testing Windows Test Formats
• Online Test Examiners Manual
• Questions

22

• EOC TESTING WINDOWS for SJSD
• Fall/Winter
• 11/30 12/4 Biology and English II
• 12/7 12/11 Algebra I and Government
• Spring
• 4/19 4/23 Biology and English II
• 4/26 4/30 Algebra I and Government
• Summer

23
EOC in Two Versions

• Paper/Pencil version
• Online version

24
End-of-Course Assessments

• All Phase I Assessments
• Two sessions
• Session I - Selected Response Items
• Session II - Performance Events (PE) or
• Writing Prompts (WP)

25
End-of-Course Assessments

• Phase I, Session I Assessments
• Have 47 selected response (multiple choice) items
• Present students with a question followed by four
  response options
• Are worth 35 points total

26
End-of-Course Assessments

• Phase I, Session II Assessments
• Require students to work through more complicated
  items
• Make allowances for more than one approach to a
  correct answer
• Allow insight into a students ability to apply
  knowledge and understanding to real-life
  situations

27
Session II Performance Events for Algebra I and
Biology

• Assesses students applied knowledge
• Algebra I PE assesses CLEs with a Level 3 DOK
  from the Algebraic Relationships strand
• Biology PE assesses the Inquiry strand

28
Session II Writing Prompt for
English II

• On-demand writing proficiency
• Scored holistically, using a four-point scoring
  guide
• The prompt may be persuasive, descriptive,
  expository, or narrative

29
Snapshot of Phase I
30
Snapshot of Phase II
31
Agenda

• EOC General Information and Changes
• Testing Windows Test Formats
• Online Test Examiners Manual
• Questions

32
Purpose of
Test Coordinators Manual

• Detailed instructions for
• Preparing for online testing
• Delivering of online tests
• Administering of online tests

33
Test Coordinators

• District Test Coordinator (DTC) the point
  person for testing in a school district
• School Test Coordinator (STC) the point person
  for testing in a particular building
• These are sometimes the same person and/or they
  may have interchangeable roles

34
Breakdown of EOC AssessmentsGuidelines for
Testing Prepare

• Notify parents in advance so that students will
  be well-rested
• Pre-read the manual
• Inclusions of Special Populations
• Make-up Sessions
• Use of Translators
• Invalidation Procedures
• Accommodations and Status Codes

35
Special Populations

• IEP students must take all EOC Assessments
  administered by the district or portions of each
  content-area assessment as determined by the IEP
  team
• IAP/504 Students

Students Not Tested

• MAP-Alternate (MAP-A)
• ELL students who have been in the US for 12
  months or fewer (cumulative time) may be exempt
  from the English II assessment

36
Students who move before or during testing (p. 5)

• If a student was enrolled to take an EOC
  Assessment but moved prior to test
  administration, the sending school should keep
  documentation on file about the students move
• The receiving district tests the student in any
  applicable EOC Assessment
• The Not Enrolled bubble is used for a student
  who begins any session of an EOC Assessment and
  moves before finishing the entire assessment,
  either out of the district or from building to
  building within a district. The sending school
  should keep documentation on file about the
  students move.

37
Students Who Are Absent During Testing

• Districts should make every attempt to have all
  students take the entire test. If a student is
  absent and unable to take the test during the
  testing window, the school should keep
  documentation on file about the students absence
  and use the following procedures
• 1. If a student is absent and unable to take the
  test at a later test window, fill in the Absent
  bubble
• 2. If a student is absent and the district will
  assess the student during the next testing
  window, fill in the District Team Decision
  Delayed bubble
• 3. The districts may re-enroll the student in the
  next semesters testing window.

38
Use of Translators

• Translators must be trained in test
  administration
• No for English I and English II assessments
• Yes for all other Phase I and Phase II tests
• Native language responses are acceptable from ELL
  students transcribe appropriately

39
Invalidation Procedures

• Check the chart (Page 7)
• Mark appropriately

40
Test Invalidation Reasons
Neither student behavior nor the judgment of
student effort can invalidate test.
41
What Districts Must Do When Invalidating A Test

• Agreement on Invalidation (between STC and
  Examiner)
• Information STC must provide to DTC
• The Letter to DESE from the Superintendent
• A Copy of the letter for the District

42
Accommodations and Status Codes (Pages 22 - 23)

• Student accommodations are recorded for the
  entire assessment
• Accommodation Code definitions can be found in
  the EOC manual and on the DESE website. Check the
  appropriate box for the corresponding test.
• Status code definitions can be found in the Test
  Examiners Manuals.

43
Electronic Devices

• Yes to Calculators at minimum, students can
  use, a four-function calculator for Algebra I
  both sessions (nothing with Internet access of a
  Qwerty keypad)
• No to cell/mobile phones, electronic music
  players, digital cameras, handheld scanners,
  gaming devices, any portable device that can be
  connected to the internet, etc.

44
Testing Periods
Phase I Suggested Times

• Algebra I
• Session I 90 100 minutes
• Session II 60 70 minutes
• Biology
• Session I 55 60 minutes
• Session II 65 70 minutes
• English II
• Session I 90 110 minutes
• Session I 90 - 100 minutes

45
Testing Periods
Phase II Suggested Times

• Government 60 - 80 minutes
• American History 60 - 80 minutes
• English I - 90 - 110 minutes
• Algebra II 90 - 100 minutes
• Geometry 90 - 100 minutes

46
DTC Responsibilities

• The District Test Coordinator (DTC) is
  responsible for training ALL School Test
  Coordinators (STCs) on EOC Assessment processes.
• Communicating with RPC (Riverside Publishing
  Company) one point of contact for the district
• Responsible for test security
• Ordering additional materials if/when needed

47
STC Responsibilities

• Ensure EOC Browser is on each workstation for
  test delivery
• Input students who were not included in the MOSIS
  precode file to the online testing system
• Verify/edit student demographic information for
  pre-imported students
• Contact District Assessment Office if any
  students need to be transferred
• View/set student classes, testing statuses, and
  accommodations

48
District Team Decision Delayed

• This is a bubble designed for students who are
  not yet ready to take the EOC assessment for
  which they were enrolled.
• PRIOR to the testing window(s), the district
  should have their delay procedure clearly in
  place
• The procedure should
• include decision parameters
• include who is on the team to make the decision
• be in writing

49
Bubble and Document

• If the district believes a particular student is
  not ready to take the EOC assessment for which
  he/she was enrolled, the district team makes the
  decision based upon the qualifications in the
  procedure.
• The STC bubbles in the District Team Decision
  Delayed
• The district keeps documentation about the
  decision to delay testing.

50
Post Test Administration

• Task Scoring Workshop
• The Task Scoring Workshop is an Internet-based
  tool that provides training on how to score the
  Session II portion of the Phase I Missouri
  End-of-Course assessments. Through this system,
  teachers have access to scoring rubrics, anchor
  papers, annotations and practice papers that
  allow them to practice the scoring process
  independently.
• Once Riverside has received a districts testing
  materials, an e-mail will be sent to the DTC with
  the Task Scoring Workshop URL, user IDs, and
  passwords. The e-mail will be sent from
  mo.coordinator_at_hmhpub.com with the subject line
  of MO EOC Task Scoring Workshop. The DTC is
  responsible for distributing the information to
  their teachers. Please note that this information
  should not be distributed until all testing has
  been completed for a subject area.

51
Post Test Administration

• Teacher Interface
• The Teacher Interface is the system through which
  teachers are able to view students selected
  response raw scores and view, print, and locally
  score the unscored, scanned copies of their
  students performance events. Teachers are able
  to include these scores in the students final
  grades. However, the official state scoring of
  the Session II items will not occur until a later
  time. Teacher Interface does not provide export
  files of raw scores, nor does it allow for batch
  printing of the performance events/writing
  prompts.
• Within 5 business days of Riverside receiving a
  districts testing materials, an e-mail will be
  sent to the DTC with the Teacher Interface URL,
  user IDs, and passwords. The e-mail will be sent
  from noreply_at_hmco.com with the subject line of
  the DTCs name followed by MO EOC Teacher
  Interface. DTCs and STCs will have access to a
  performance event summary report for their
  buildings. Teachers will have access to their
  class roster page with the selected response raw
  scores and performance event images.

52
Accommodation Codes List for
English Language Learners (ELL)

• The following slide are the only accommodations
  allowed for ELL students.
• Oral reading, oral reading in native language, or
  the use of a bilingual dictionary during the
  English II assessment will result in the LOSS
  (Lowest Obtainable Scale Score).

53
(No Transcript)
54
Accommodations List for Students with
DisabilitiesHas changed since last year!
55
Note 1 for Students with Disabilities

• NOTE 1 Oral reading, oral reading in native
  language or signing any English assessment will
  result in the LOSS (Lowest Obtainable Scale
  Score). The use of a bilingual dictionary during
  the English I or English II, Session I assessment
  will result in the LOSS. Students identified as
  blind/visually impaired (who do not read Braille)
  may use the oral reading accommodation if it is
  their primary instructional method.

56
Note 2 for Students with Disabilities

• Paraphrasing test questions invalidates all
  EOC Assessment student scores for accountability
  purposes.

Note 3 for Students with Disabilities
Use of magnifying equipment, amplification
equipment, graph paper and testing with the
teacher facing the student are not listed as
accommodations because these are not required to
be reported as accommodations for the EOC
Assessments.
57
Examiners Manual Phase I II

• Directions for Administering Online Assessments
• English II (Pages 34-37)
• Biology (Pages 38-41)
• Algebra I (Pages 42-47)
• Government (Pages 54-55)

58
Test Materials

• Student Materials
• Computer workstation with EOC Browser
• Scratch, graph or draft paper (not provided)
• At minimum four-function calculators for Algebra
  I (not provided and not required)
• Algebra I reference sheet (for Algebra I Sessions
  I and II)
• Dictionary, thesaurus, grammar handbook (for
  English II Session II only not provided)

59
Prepare for Test Administration

• Organize the classroom
• Plan seating arrangements/computer usage
• Eliminate distractions under your control
• Use a Do Not Disturb sign (not provided) on your
  door
• Remove or cover any maps, charts, or other
  materials that relate to the content and
  processes of the test.
• Make testing arrangements for students who do not
  finish testing in the allotted time frame.

60
Electronic Devices

• At minimum, students may use a four-function
  calculator during the Algebra I (Session I and
  Session II) Assessment. Other electronic devices
  must not be accessible during the testing
  session. Such items include, but are not limited
  to
• cellular/mobile phones
• electronic music players
• digital cameras
• handheld scanners
• portable gaming devices
• any portable device that can connect to the
  Internet

61
Administer the Tests

• Specific directions for each content area are in
  the Examiners manual.
• The following symbol is used throughout the
  specific directions

62
Agenda

• EOC General Information and Changes
• Testing Windows Test Formats
• Online Test Examiners Manual
• Questions

63
Re-Read the Manuals
What If We Still Have Questions After Today?

• Who Calls Riverside?

The district should have one point of contact
the DTC!