CELLA Test Administrator Training for Middle School

1
CELLATest Administrator Training for Middle
School
2
Test Administrator Responsibilities

• You are responsible for reading and understanding
  all relevant sections of the Test Administration
  Manual including the Test Security Statute and
  Test Security Rule on pages 57-58.
• You are also responsible for reading and becoming
  familiar with the relevant sections of the
  Directions for Administration Scoring Guides
  before the day of the test. Please review the
  Scoring Guides found in the color-tabbed sections
  for each test level to become comfortable with
  the rubrics used to rate the Speaking test.

3
CELLA provides

• evidence of program accountability in accordance
  to Title III of NCLB
• data on students over time
• information about the language proficiency of
  students across the State
• diagnostic information about students strength
  and weakness in English
• fair, reliable, and valid information about ELLs
  in grades K through 12

4
Spring 2009 CELLA

• Volusia Testing Window
• April 14 May 15, 2009

5
CELLAWhat Is New for 2009?
6
Addition of Binder Markings on ALL2009 Test Books
Binder Markings (Numbers will be located on the
top of the binding)
7
Security Numberson Test Books Clearly Identified
Security Numbers
8
Level A Student Responses Graphic

• Please demonstrate how students should mark their
  responses in their test book

Correct Incorrect
9
Updates to the DFA/Scoring Guides

• Electronic Use Policy added to the first section
  of each DFA/Scoring Guide Level
• Clearer instructions and demonstration graphic on
  how to fill in the responses in the Level A test
  book included (graphic on page 10 of DFA).

10
CELLATest Accommodations
11
Test Accommodations

• Section in Directions for Administration (DFA) to
  addresses ALL allowable accommodations (begins on
  page 288)
• Students with Disabilities with Current IEPs
• Students with Section 504 Plans
• Not Permitted Accommodations
• List of not permitted accommodations is included
• Guidance on accommodations for Deaf or
  Hard-of-Hearing

12
CELLATest Security
13
(No Transcript)
14
Test Administrator Responsibilities

• Required Administration Information
• All fields must be accurately filled out
• Ensure all students have a Test Code Disposition
• Notify the School Coordinator if secure material
  is missing

Test Codes
15
Test Administrator Responsibilities

• Security Log
• Complete this log when entering and exiting the
  room

16
CELLAPre-ID Labels StudentDemographics
17
Pre-ID Label Sample

• The following information MUST be correct for the
  student label to be used
• Students Last Name
• Student ID Number
• District Name
• School Number (code)
• Grade Level

18
Required Demographic Information for students
that HAVE a Pre-ID Label

• Even if the student has a preidentified student
  label, the following information MUST be provided
  and gridded on the Level A Student Test Book,
  Level A Functional Level Test Book, or on the
  Level B, C, and D Answer Sheet
• Grid 1 Student Name
• Grid 2 Test Administrator Name
• Grid 3 School Name
• Grid 4 School Number
• Grid 5 District Name and District Number
• Grid 14 Test Date
• Grid 17 Listening/Speaking Test Level
• Grid 18 Reading/Writing Test Level
• Grid 25 Accommodations (if applicable)
• Grid 26 Do Not Score or UNDO Do Not Score (if
  applicable)

19
Demographic Information ONLY for students that
do NOT have a Pre-ID Label

• Personal and demographic information will be
  collected for each student
• Level A, last two pages of the test book
  completed by the Test Administrator
• Level B-D, first two pages of the answer sheet
  assist the student if needed
• Must Grid 1 23 (refer to Test Administration
  Manual)

20
CELLATesting Levels
21
(No Transcript)
22
Approximate Administration Times
23
Students to be tested

• All English Language Learners (ELLs) that
  enroll before April 3, 2009 and are classified
  ELL (a code of LY or LP) must be assessed.
• All former English Language Learners (ELLs)
  coded LF that were exited from the ESOL program
  after May 31, 2008 and before April 14, 2009 must
  also be assessed.

24
Determining the Correct Test Level

• All students in grades 6-8 participate in Level C
  for Listening and Speaking.
• Students in grades 6-8 who are on grade level in
  reading take Level C Reading and Writing tests.

25
Determining the Correct Test Level

• Students in grades 6-8 who are not on grade level
  in reading may take the Reading and Writing tests
  in Levels A, or B.

26
Determining the Correct Test Level

• Each School Testing Coordinator has a list
  identifying current and former ELLs to be tested
  along with their test level.
• For students in grades 6-8 without an identified
  test level, a brief online locator test will be
  given to determine the correct CELLA level.

27
Locator Test Overview

• Designed to help determine which level of Reading
  and Writing assessmentA, B, or C is most
  appropriate for each student
• Can only be taken online
• May be administered before the first day of CELLA
  Assessment

28
Level B, C, D Sections
Level B, C, D Reading and Writing can be given
at the same time in the same room.
29
Level B, C, or D Reading

• Divided into two parts
• Part one Students answer discrete vocabulary
  questions
• Part two Students read passages and answer
  questions about each passage
• Approximate testing time for the Reading section
  is 45 minutes

30
Level B, C, or D Writing

• Divided into four parts
• Part one and Part two contain multiple-choice
  questions
• Parts three and four require students to write
  sentences and paragraphs, respectively
• Approximate testing time for the Writing sections
  is 70 minutes

31
Functional Level Testing Level A Grades 3-12

• Students in grades 6-8 assigned to Level A
  Reading and Writing record responses in their
  green Level A test book.
• Listening and Speaking responses for these
  students are also recorded in the same Reading
  and Writing test book.

32
Functional Level Testing Level A Grades 3-12
Administered in small groups
Level A Reading
Level A Writing

• 25 questions
• (approx. 35 minutes)
• 1-11 students put an X
• 12-25 students fill in the circle

16 questions (approx. 30 minutes) Students will
write letters, words, sentences, and edit
sentences
33
Level C Listening

• Divided into four parts and is guided by a script
• Script contains all of the test items to which
  students must respond
• Recorded Delivery play the CD
• Approximate testing time is 25 minutes

34
(No Transcript)
35
(No Transcript)
36
Individually Administered Sections

• STOPPING POINTS are available for individually
  administered sections of CELLA
• Test administrators should stop the
  administration of that section only IF the
  student cannot respond to five questions in a
  row.
• Not responding does not mean answering
  incorrectly. If a student is engaged in tasks
  and continues to answer questions, even
  incorrectly, continue the test.

37
Level C Speaking

• Administered individually
• Approximate testing time is between 10 and 15
  minutes
• Scored by the test administrator as the test is
  given
• Scores are recorded on page 8 of the Level B,C,
  and D answer sheet

38
(No Transcript)
39
Level C Speaking Section Item Types

• Oral Vocabulary
• Speech Functions
• Personal Opinion
• Story Retelling
• Graph Interpretation
• item types are rubric-scored

40
WHAT IS A SCORING RUBRIC?

• Rubrics
• are multidimensional sets of scoring guidelines
  that can be used to provide consistency in
  evaluating a students level of performance or
  work.
• spell out scoring criteria so that multiple
  teachers, using the same rubric for a student,
  would arrive at the same score.
• are based on the sum of a full range of criteria,
  rather than a single numerical score.
• help teachers monitor student learning in an
  authentic way and also help a teacher develop
  and/or revise an instructional plan.

41
WHAT IS A SCORING RUBRIC? continued

• There is no limit as to how many students will
  fall within a score range scoring is based
  strictly on the criteria spelled out in the
  rubric, not on how many students should be in
  the range.

42
Speaking Prompts

• During the testing session
• Read aloud to the student the text in bold print
  in the Speaking script
• Hold the Speaking script so that the student
  cannot read it
• If the student does not initially understand a
  prompt, repeat the prompt, varying speed and
  intonation as appropriate
• If a students response is too brief to
  accurately represent the students speaking
  ability, ask probing questions as appropriate

43
Level C Speaking Section Probing Questions

• Probing questions can be used to
• Get students started speaking if they are stuck
• Clarify the question itself if that will help
• Encourage the student to expand or elaborate

44
Level C Speaking Section Probing Questions

• Note that probing questions must NOT introduce
  new topics, change the focus of the topic, or
  provide students with language or vocabulary to
  use in their response.

45
Level C Speaking SectionSpeech Functions

• Measures a students oral response to a specific
  prompt
• Criteria include
• Appropriateness of information
• Grammatical accuracy

46
Rubric for Speech Functions
47
Level C Speaking SectionPersonal Opinion

• Measures students ability to orally state and
  defend opinion
• Criteria include
• Clarity of response
• Adequate support
• Good control of grammar adequate vocabulary

48
Personal Opinion Rubric
49
Level C Speaking SectionStory Retelling

• Measures a students ability to hear a story
  (while looking at sequential picture cues) and to
  then retell it with detail
• Criteria include
• Comprehensive response
• Vocabulary
• Grammar
• Fluency

50
Story Retelling Rubric
51
Story Retelling Checklist
52
Level C Speaking Section Graph Interpretation

• Measures students ability to orally summarize and
  interpret a graph
• Criteria include
• Summary response
• Comparison response
• Vocabulary
• Grammar
• Fluency

53
Graph Interpretation Rubric
54
2009 Answer Sheet Do Not Score
55
2009 Answer Sheet
Required Items on the Answer Sheet Have Been
Shaded
56
2009 Answer Sheet continued
Instructions have been added to indicate which
items are required for PreID students
57
2009 Answer Sheet continued

• 23, Exceptional Student Education (Grid Only
  One)
• Arranged in Alpha Order
• Updated Exceptionalities to match FCAT

58
DNS and UNDO BUBBLES

• Item 26, Do not score contains DNS and UNDO
  bubbles for each content area
• If all or part of a student answer sheet for any
  one of the tests is not to be scored, grid the
  appropriate DNS bubble(s) for each of the tests.
  
• If a test has been invalidated by mistake, erase
  the DNS bubble(s) and grid the corresponding UNDO
  bubble(s).
• If the DNS bubble is gridded for any of the tests
  (Listening, Speaking, Reading or Writing), that
  section will not be scored.
• If all DNS bubbles are gridded, none of the tests
  will be scored.
• If the DNS bubble(s) for a test has been erased
  and the corresponding UNDO bubble(s) has been
  gridded, that test will be scored unless it is
  packaged with the NOT TO BE SCORED materials

59

• (Consult your School Testing Coordinator)
• If an answer document is damaged, please
  transcribe the students answers to another
  document.
• Mark the damaged answer document with a large X
  and return it in the brown boxes with Not To Be
  Scored materials.
• If a child is ill and a document cannot be
  transcribed, arrange a make-up test within the
  testing window. Email the serial number of the
  soiled document to Kathy Stubbs and then destroy
  the document in a secure manner.

60
Test Administrator Responsibilities

• What/How to prepare for the School Coordinator

61
Sorting Test Material After Testing

• To Be Scored
• Verify the DNS has NOT been gridded
• Group your TO BE SCORED material by GRADE
• DO NOT insert Answer Sheets INSIDE of the Test
  Books
• Notate the TO BE SCORED answer document count BY
  GRADE for the School Coordinator

62
Sorting Test Material After Testing

• Not To Be Scored
• Unused Scannable Answer Sheets
• Used DNS Scannable Answer Sheets
• NOTE Any Used Scannable Answer Sheets mixed with
  this material WILL NOT BE SCORED
• All Used and Unused Test Books
• NOTE Used Grade K-2 SCANNABLE Test Books should
  NOT be included with the Not To Be Scored, UNLESS
  the DNS is notated
• Secure Listening CDs
• Secure 2009 Directions for Administration
  Scoring Guides
• Test Administration Manual
• Security Log
• Required Administration Information

63
Questions???

• Please contact your School Testing Coordinator
  with general questions or if you need materials.
• If you have specific questions about
  administering a subtest, please contact Gordon
  Butler (x20694) or Sylvia Garcia (x20676).

64
What should you do when you finish testing?

• CELLABRATE!!!