UALPA 20082009

1
UALPA 2008-2009 Administering Utahs Academic
Language Proficiency Assessment
2

• Overview What, Why, Who, When
• LEA Assessment Directors and Test
  Administrators Roles Responsibilities
• III. Structure and Format of the Assessment
• Test Administration Procedures
• After Testing

3
I. UALPA What, Why

• Statewide assessment of all identified ELL / LEP
  students
• Mandated by the No Child Left Behind Act of 2001

4
Who

• Students to be tested include
• All newly enrolled LEP students
• All LEPs whose proficiency level was below
  Fluent, as measured by the 2007-2008 UALPA
• All LEPs at proficiency level P, E, I and A to be
  tested annually until they reach the F (Fluent
  with Monitoring) level

5
UALPA is intended for Limited English Proficient
(LEP) students onlyDo not test Kindergarten
Native Speakers of English
Who
6
Who Are ELL and LEP Students?

• Definition
• An English Language Learner (ELL) is a student
  for whom English is not his native or first
  language. 
• A Limited English Proficient (LEP) student is an
  ELL specifically identified for a language
  development program.

7
IDENTIFICATION OF LEP STUDENTS

• The identification and placement of LEP students
  in appropriate programs is based on the following
  required stepsStep 1. Home Language Survey
• The (HLS) is a district-developed tool that
  should include the following minimum information

8
IDENTIFICATION OF LEP STUDENTS

• The students first language is other than
  English.
• The student understands a language other than
  English.
• The students parents speak a language other than
  English at home or the students language has
  been influenced by a language other than English
  by someone such as a parent, grandparent, or
  other adult.
• The student primarily speaks a language other
  than English at home.
• The student was placed in an LEP program with
  another school.

9
IDENTIFICATION OF LEP STUDENTS

• Number of years of education outside the U.S.
• Number of years of education in the U.S.
• Step 2.
• Parent referral
• Classroom teacher referral based on assessments
  (grades, scores, student work, observational
  notes)

10
When

• Testing window January 12, 2009 through
• May 8, 2009 (for traditional and year-round
  schools)
• All LEPs whose proficiency level was below
  Fluent,
• as measured by the 2007-2008 UALPA

11
LEA Testing Schedule

• March 2, 2009
• Deadline for submission of answer documents for
  1st scoring window (50 of students)
• Reports will be available after April 13
• May 8, 2009
• Deadline for submission of answer documents for
  2nd scoring window (remaining 50 of students)
• Reports will be available after June 22

12
LEA Testing Schedule

• If reports are needed before the end of the
  school year, answer documents must be submitted
  by March 2.
• New students who enroll AFTER April 24, 2009 DO
  NOT need to be tested with the 2008-2009 UALPA.

13
II. Roles and Responsibilities of the LEA
Assessment Director and the Test Administrator
14
LEA Assessment Director

• Before testing
• Create master list of LEP students to be
  assessed.
• Order test materials.
• Inventory and confirm materials received.
• Select and train Test Administrators.
• Adhere to test ethic policy as required by the
  Utah Board of Education and in UALPA
  administration.
• Order answer documents and pre-printed student
  labels, as needed, by submitting pre-print files
  to USOE.

15
LEA Assessment Director

• Key to a smooth assessment process
• Read the UALPA 2008-2009 Coordinators Guide,
  then use it as a reference tool when needed.
• Become familiar with the Test Administration
  Manual general information as well as other
  testing materials.

16
Test Administrators

• Before testing
• Complete UALPA administration training and
  Testing Ethics training.
• Receive test materials from LEA Assessment
  Director.
• Receive a roster of students they are responsible
  to test.
• Prepare testing site.
• Schedule individual and group test administration
  sessions.

17
Test Administrators

• Keys to a smooth assessment process
• Familiarize themselves with the Test
  Administration Manual and other test materials.
• Use the Test Administrators Checklist found in
  each Test Administration Manual.

18
Test Administrators

• During testing
• Administer the one-on-one Speaking tests first.
• Administer the other three tests in a group
  setting.
• Continually monitor students.
• Maintain and oversee the security of all test
  materials.
• Arrange make-up testing sessions for absentees.

19
III. Structure and Format of the UALPA
20
Grade Spans and Test Forms

• Five Grade Spans K, 1-2, 3-6, 7-8, and 9-12.
• No off-grade level testing is allowed.
• For each grade-span group, except kindergarten,
  there are two different ability-level forms
• Level 1 Pre-Emergent
• Level 2 Emergent or above

21
Proficiency Levels
22
Test Forms Field-test Items
23
Tests for Kindergarten and How Administered (Form
A1x)
24
Tests for Grade Spans 1-12 and How Administered
25
Test Booklets

• One test booklet per student (except
  kindergarten).
• Students may not switch levels of the test form
  after completing the Speaking Test.
• Grade Span 1-2 test booklets are consumable.
• Grade Spans 3-12 test booklets are reusable.

26
Flipcharts

• For kindergarten, the flipchart functions as a
  combination Test Administration Manual and
  reusable student booklet for all four tests.
• For all other grades, the flipchart is used to
  administer the Speaking Test only, and includes
  administration instructions and script for the
  Speaking Test.

27
Answer Documents
28
Test Administration Manuals

• There are four Test Administration Manuals for
  each grade span.
• Kindergarten administration is part of the
  kindergarten flipchart.
• Each contains
• general instructions
• grade span-specific instructions
• script for three tests (L, R, W)
• These must be kept secure.

29
(No Transcript)
30
IV. Test Administration Procedures A.
General Refer to Test Administration Manuals
for official and complete procedures.
31
Test Site

• Individual Testing
• Quiet one-on-one environment
• Seating (Test Administrator across from student)
• Group Testing
• Quiet room
• Testing Do Not Disturb sign on door
• Desks must be cleared

32
Testing Ethics

• No questions from the UALPA may be taught to or
  reviewed with students.
• Copying any test material is prohibited.
• All Test Administrators must be trained under the
  direction of the LEA Assessment Director.
• Information and forms can be found at
• www.schools.utah.gov/arc/AAEthicsPolicy.pdf.

33
Grouping Students for Testing

• As long as the group is not too large, all
  students within a grade span, taking the same
  form may be tested together in a group setting.
• Optimal group size 10 or less
• Recommended maximum group size 20
• Take into account the maturity of the students,
  the number of available proctors, and the
  acoustics of the room.

34
Prompting

• Prompting is not allowed.
• Exceptions
• To clarify a students response
• If student responded in another language
• Test Administrator may repeat a question if
• There was a distraction or interruption.
• The student has not yet begun to respond and asks
  for the question to be repeated.

35
Translating Directions

• No general directions, no question directions,
  and no question content may be translated. The
  script must be read in English exactly as printed
  in the test administration manual.

36
Timing

• The UALPA is an untimed test.
• During individual testing, Test Administrators
  should wait approximately 15 seconds for a
  student to begin a response.
• During group testing, Test Administrators should
  use their best judgment in allowing sufficient
  time for students to finish multiple-choice and
  extended responses.

37
Frustration Level

• Frustration level is defined as when a student
  has made five consecutive scores of 0 or is
  obviously unable to respond to test prompts.
• If frustration level is reached on a Level 1
  Speaking test, administer all other tests
  individually.
• If frustration level is reached on a Level 2
  Speaking test, switch to the Level 1 test.
• If frustration level is reached on any test, mark
  the FL bubble in the Office Use Only box on the
  answer document.

38
Accommodations

• Test Administrators and/or teachers may not make
  accommodation decisions at the time of test
  administration.
• Decisions regarding accommodations must be made
  ahead of time by the IEP, 504 and ELL team and
  documented in the students file.
• Information on accommodations can be found at
  http//www.schools.utah.gov/arc/aa/SpNeedAccPol.pd
  f
• Braille and Enlarged Print versions of the test
  are available, but must be ordered two months in
  advance.

39
?
Non-Allowable Accommodations

• Reading directions or questions aloud in English
  (except as indicated by the Test Administrator
  script).
• Translating directions or questions.
• Providing bilingual word lists.
• Bilingual dictionary.

40
Scoring of Responses

• Oral responses on the Speaking test are scored by
  Test Administrators at the time of testing.
• Responses are rated using the Scoring Guides in
  the flipchart.
• The Test Administrator must study the Scoring
  Guides before giving the test for the first time.
• Constructed response items for Reading and
  Writing are scored by the USOE.

41
Pre-Printed Student Barcode Labels

• ELL students will need to have been identified as
  receiving Level 1 or Level 2 test forms. Refer
  to guidance provided in the Test Administration
  Manual and Coordinators Guide.
• LEAs submits a pre-print file to USOE Computer
  Services at least 10 working days prior to date
  the pre-printed student labels will be needed.
• LEAs should request pre-prints as close as
  possible to the administration date.

42
Pre-Printed Student Barcode Labels

• LEP codes in the student information system
• A Advanced proficiency level on the UALPA last
• year
• Y Yes, took UALPA last year and had a
  proficiency
• level of P, E, or I
• O Was identified as an LEP student but refused
• placement in ALS

43
Pre-Printed Student Labels

• Test Administrators will apply the labels to the
  answer documents of those students they are
  assessing.
• Test Administrators are responsible for placing
  the pre-printed student labels in the correct
  location.

LABEL goes HERE
44
New Students Without Labels
For new students without pre-printed labels

• Student information will need to be hand-bubbled.
• An SSID number must be assigned before UALPA
  administration.
• Use students LEA ID number on answer document .

45
Testing Absentees

• All LEP students must be administered all four
  tests.
• If a student is absent for a particular testing
  session, schedule a make-up test for that
  student as soon as possible.
• Pre-print labels should only be placed on answer
  documents if the student took the test.

46

• Pre-print labels should only be placed on answer
  documents if the student took the test.

47
B. Testing Kindergarten
48
Kindergarten Test Materials

• Form A1x
• Color-coded orange

49
Kindergarten Test Administration

• All four tests are administered individually.
• All responses are marked by the Test
  Administrator on the students answer document.

50
C. Testing Grades 1-2
51
Grade Span 1-2 Test Materials

• Forms B1a and B2x
• Color-coded purple

52
Grade Span 1-2 Test Administration

• The Speaking test is administered individually
  using the Speaking test flipchart, and is always
  administered first.
• Speaking responses are recorded by the Test
  Administrator in the consumable booklet.
• The other three tests are administered to small
  groups (ideally of not more than 10 students),
  with students marking their answers in the
  student document.

53
D. Testing Grades 3-12
54
Grades 3-12 Test Materials

• Each grade span has
• One Level 1 form and four Level 2 test booklets.
  
• Four Speaking Test Flipcharts
• Four Test Administration Manuals
• Two answer documents (1 Level 1 1 Level 2)

55
Grades 3-12 Test Administration

• The Speaking test is administered individually
  using the flipchart, and must be administered
  first. Speaking responses are recorded by the
  Test Administrator on the students answer
  document.
• The other three tests are group-administered
  (recommended 20 students maximum) using the
  script in the Test Administration Manual. The
  responses are marked or written on the student
  answer document by the student.

56
V. After Testing
57
Pre-Printed Student Barcode Labels

• Pre-print labels should only be placed on answer
  documents if the student took the test.
• Unused pre-print labels are to be returned in a
  special handling envelope.

58
Test Administrators

• After testing
• Check that answer documents are complete and
  correctly marked.
• Check that the Form Code is marked correctly.
• Check to see if any applicable testing
  accommodations are marked.
• Organize test materials as required.
• Return test materials to the LEA Assessment
  Director.

59
LEA Assessment Directors

• After testing
• Organize scoring of constructed responses.
• Return completed answer documents to the USOE.
• Collect and securely destroy all 2008-2009 test
  materials at end of school year.

60
Scoring Constructed Responses

• Oral constructed responses (on the Speaking test)
  are scored by the Test Administrator during test
  administration.
• IMPORTANT Written responses (for the Reading and
  Writing tests) are scored by the USOE after
  testing is completed. LEAs will not score the
  constructed response items in the reading and
  writing test modalities.

61
Returning Completed Answer Documents to the USOE

• Separate each grade within boxes by
  teacher/school header sheets.
• Use packing material to avoid movement of
  materials inside box. Do not use foam, as this
  affects the scannability of the documents.
• Tape box securely with heavy-duty tape (not
  cellophane or masking tape).
• Ship to the USOE via UPS, FedEx, or another
  carrier that tracks shipments. Do not send by
  U.S. Mail.

62
Key Dates for UALPA 2008-2009

• January 2, 2009
• Testing materials shipped to districts
• January 12, 2009 May 8, 2009
• Testing window
• March 2, 2009
• Deadline for submission of answer documents for
  1st scoring window
• May 8, 2009
• Deadline for submission of answer documents for
  2nd scoring window

63
If you have questions...
64
This PowerPoint is intended for training purposes
only. It reflects a summary of the Coordinators
Guide and Test Administration Manuals. The
Coordinators Guide and Test Administration
Manuals are the documents that represent official
policy.
65
Thank you for your efforts and professionalism
in test administration!