CriterionReferenced Tests Administration

1
Criterion-Referenced TestsAdministration

• David Smith, Test Development Coordinator
• Randy Honaker, Operations Coordinator
• Wendy Carver, Specialist
• Julie Quinn, Specialist
• Sarah Moore, Production
• Sharon Marsh, Computer Services
• Utah State Office of Education
• February 2009

2

• Welcome
• Introductions

3
CRT Timelines

• Week of March 24
• All Paper Based Test Materials arrive at LEA
  Office
• Prior to April 1
• All Computer Based Test print materials arrive at
  LEAs

4
Paper Based Testing CRT Timelines

• 2 Weeks Before Testing Window
• LEA Pre-print File to USOE
• 1 Week Before Testing Window
• Answer Documents arrive at LEA
• Testing Window

5
Computer Based Testing CRT Timelines

• 2 Weeks Before Testing Window
• LEA Pre-load file to USOE
• Sharon collects files on a continuing basis as
  usual
• USOE checks against CBT projections
• We will call to verify differences

6
Computer Based Testing CRT Timelines

• USOE sends pre-load files to Measured Progress
• MP needs 4 days to load
• MP will load on Wednesdays and Fridays only
• Student data will be available on Thursdays and
  Mondays

7
CRT Timelines

• Testing Window
• Computer Based Testing 48 hour preliminary raw
  score report (generated when answer documents are
  scored at 200 am each day)

8
CRT Timelines

• Paper Based Testing
• Return Answer Documents to USOE
• Answer documents not returned will count against
  participation
• Materials due no later than 5 days after the end
  of the testing window
• Return the all_student file to USOE

9
CRT Timelines

• Paper Based Testing
• - 4 Days after all Answer Documents arrive at
  USOE (Traditional and year round may be sent
  separately)
• CRT Raw Score Roster Report
• Electronic in the testing website
• Individual student by class
• LEA, school, class summary
• Teacher/Subject summary report
• Electronic in the testing website
• Error List
• Electronic in the testing website

10
CRT Timelines

• Computer Based Testing once data window is
  closed
• CRT Raw Score Roster Report
• Electronic in the testing website
• Individual student by class
• LEA, school, class summary
• Teacher/Subject summary report
• Electronic in the testing website
• Error List
• Electronic in the testing website

11
CRT Timelines Summary

• Computer Based Testing raw score reports 48
  hour turn-around
• (remember these are preliminary scores)
• Paper Based Testing raw score reports 4 days
  after answer docs received
• (remember these are preliminary scores)
• CBT reports end of Testing Window

12
CRT Timelines Summary

• 4. LEA submits corrected error list to USOE
  within 5 days of receipt
• Corrected raw roster sent electronically to LEA
  within 3 days
• 6. Combined PBT CBT Raw Score Research Disk in
  the testing website, within a day of receiving
  corrected raw roster error report

13
CRT Timelines

• Due Dates for Error Reports
• Submit as Early as Possible
• No Later than
• June 26th
• Final Error Report Due for Traditional Schools
• July 6th
• Final Error Report Due for Year Round Schools

14
Home and Private School Board Rule R277-604

• Private School Students MAY participate
• Payment in advance for assessment costs to USOE
• Payment in advance for administration costs (LEA)
• Participation under the supervision of LEA

15
Home and Private School Board Rule R277-604

• Home School Students SHALL be allowed to
  participate
• Must be enrolled in at least one course in public
  school
• Costs the same as public students (no cost to the
  student)
• Participation under the supervision of LEA

16
Home and Private School Board Rule R277-604

• Bureau of Indian Affairs (BIA) students
• No cost to the student
• Participation under the supervision of LEA

17
Home and Private School Board Rule

• State Costs for each test
• ELA CRT 6.00
• Math CRT 4.00
• Science CRT 4.50
• UBSCT reading 10.00
• UBSCT writing 20.00
• UBSCT math 10.00
• DWA 15.00

18
CRT Administration for ELLs

• ELL students enrolled before April 15 of current
  school year and who are new to the United States
  (first year of enrollment in any U.S. school)
• and
• ELL students enrolled on or after April 15 of
  previous school year
• Must take the Science and Math CRTs (not counted
  in any AYP calculation)
• Non-Regulatory Guidance, May 2007

19
CRT Reminders

• Remember the CRTs are untimed tests.
• Most students can complete a test section in the
  normal class period
• Allow each student to complete each section
• Make up any incomplete sections (computer or
  paper based)
• Do not allow a student to work in other sections
  if they are making up an incomplete section

20
CRT Reminders

• Dont test multiple subjects at the same time
  unless in a make-up session
• Mark the accommodations box
• Paper Based Testing top right hand corner of
  demographics page
• Computer Based Testing mark accommodated and
  the accommodations that are being provided

21
Development Opportunities

• CRT Development Opportunities are ongoing
• The USOE NEEDS educators to participate to
  continue to make high quality assessments
• It is great Professional Development (free to the
  LEA) for educators
• Opportunities include
• Item writing, item review, bias/sensitivity
  reviews, statistical reviews, form reviews

22
Test Administration Manuals (TAMs)

• All TAMs are as consistent as possible in format
  and directions, given the individual variances of
  the three content areas
• TAMs are meant for test administrators/proctors
  (teachers, counselors)
• Please remind test administrators/proctors of the
  importance of reading and following the TAMs

22
23
Changes to Science CRTs

• Secondary Science will have a pilot section
• 7th Grade Science,
• 8th Grade Science,
• Earth Systems Science,
• Biology,
• Chemistry
• Physics

24
Math Reference Sheets

• Math Reference sheets will be inside the testing
  booklets and available onscreen for CBT.
• Math Reference sheets are for elementary grades
  4, 5, 6 and all secondary courses.

24
25
Elementary CRT Calculator Usage

• For calculator usage for each test section refer
  to the Test Overview in the TAM
• For PBT students may use their own calculator or
  one provided by the teacher

25
26
Elementary CRT Calculator Usage

• For CBT the four function calculator will be
  available for all grades. For grades 5 and 6,
  students will need to have a scientific
  calculator available for use.
• We recommend that students bring or have made
  available to them a calculator they have used
  during instruction during the year.

26
27
Secondary CRT Calculator Usage

• Four function calculator only will be available
  on the computer.
• Students will need access to calculators, either
  their own or provided by proctor, for both paper
  based and computer based tests.

28
Secondary CRT Calculator Usage

• Calculator should be similar to the one used
  during instruction throughout the year.
• Graphing calculators need to have their memory
  cleared before testing.

29
Elementary ELA CRTs

• Second and Third Grades
• The tests are to be administered in three
  sessions.
• Fourth, Fifth, and Sixth Grades
• The tests are three sessions each with minimal
  teacher-student interaction.
• After getting students started at the beginning
  of each session, it is only during the listening
  portions of the tests that teachers speak with
  the whole class.

30
Elementary and Secondary ELA CRTs for CBT

• Passages will be vertically aligned on the
  computer screen.
• The passage appears first by itself.
• The Next button will bring up the items one at
  a time on the right side of the screen.
• The passage stays constant on the left.

31
Number of Sessions Per Test

• Available on-line at http//schools.utah.gov/asse
  ssment/documents/DA_Assessment_Dir_Mtg_2008_09_Uta
  h_CRT_2009_Forms.pdf

32
2008 Elementary ELA Test Overview

• All grades have
• 3 Sessions
• No Pilot items
• No extra materials are necessary

33
2009 Elementary Math Test Overview

• Grade 2
• 2 Sessions
• No pilot items
• Grade 3
• 2 Sessions
• No pilot items
• Calculator allowed on section 2

34
2009 Elementary Math Test Overview

• Grades 4-6
• 2 Sessions
• No pilot items
• Calculator allowed on section 2
• Reference sheets provided in the test booklets

35
2008 Elementary Science Test Overview

• Grades 4-6
• 2 Sections
• No pilot items
• Students may write in the booklet

36
2008 Secondary ELA Test Overview

• Grades 7-11
• 4 Sections
• Pilot items in all grades

37
2008 Secondary Math Test Overview

• All subjects
• 2 Sections
• No pilot items
• Calculator use allowed

38
2008 Secondary Science Test Overview

• All subjects
• 3 Sections
• Pilot items in all subjects
• Reference sheets for chemistry and physics
• Calculators not allowed

39
Site Coordinators Manual

• Meant for the person coordinating testing in each
  school
• Three Sections
• General
• Paper-Based Testing
• Computer-Based Testing

40
Accommodations Out-of-Level Tests

• Wendy Carver
• Special Education Assessment Specialist
• wendy.carver_at_schools.utah.gov

41
Out-of-Level Assessments

• In 2008 there were 4,717 out-of-level assessments
  in Utah.
• There were 2,083 special education out-of-level
  assessments and 2,634 general education
  out-of-level assessments.
• Congratulations, Rich School District! No
  out-of-level assessments!!

42
No Out-of-Level AssessmentsCongratulations!

• Academy for Math, Engineering and Science
• American Preparatory Academy
• Beehive Science Technology Academy
• City Academy
• Entheos Academy
• Fast Forward High
• Freedom Academy
• George Washington Academy
• Itineris Early College High School
• John Hancock
• Lincoln Academy
• Moab Charter School
• Monticello Academy
• Mountainville Academy
• Navigator Pointe Academy

43
No Out-of-Level AssessmentsCongratulations!

• Noah Webster Academy
• North Davis Preparatory Academy
• North Star Academy
• Northern Utah Academy for Math, Engineering and
  Science
• Odyssey Charter School
• Reagan Academy
• Salt Lake Arts Academy
• Soldier Hollow
• Spectrum Academy
• Success Academy
• Summit Academy
• Syracuse Arts Academy
• Thomas Edison North
• Timpanogos Academy
• Wasatch Peak Academy

44
Out-of-Level Assessments

• Most widespread use of out-of-level tests
  involves 9th graders taking pre-algebra.
• High school students taking language arts in one
  grade lower such as a 10th grader taking 9th
  grade language arts occurs frequently.
• Eighth graders taking math 7 are also common.
• There are very few out-of-level tests in science.

45
Out-of-Level Assessments

• Check the error reports so that you are aware of
  out-of-level assessments occurring in your LEA.
• Out-of-level assessments can be avoided by
  choosing appropriate courses for instruction.

46
Utahs Alternate Assessment (UAA)

• Language Arts grades 1-12
• Math grades 1-12
• Science grades 4-12
• Super seniors do not need to take any test
• Exempted from other U-PASS tests
• Tasks bubble sheets remain the same this year
  next
• A student either takes the UAA in all subject
  areas or the CRT in all subject areas.

47
Utahs Alternate Assessment (UAA)

• If a student is tested on a CRT in one subject
  and a UAA in another subject, the student will be
  non-proficient on the UAA no matter what the
  proficiency score.
• Example CRT in math science UAA in Language
  Arts non-proficient on UAA
• The presumption is if a student is cognitively
  able to take the CRT in one subject, that student
  is cognitively able to take the CRT in all
  subjects.

48
Utahs Alternate Assessment (UAA)

• Teacher should fill in only one task for each
  content area (language arts, math science).
• If the student has more than one math goal,
  choose only one math task for the UAA
• Accommodations have been removed from the UAA
  answer document since the UAA is individually
  accommodated.

49
Accommodations

• On CRT answer documents mark accommodations in
  both places
• Non-Standard Participation - lower left corner
• Specific accommodations under Accommodations
  (ELL, IEP, 504) - upper right corner

50
Accommodations

• While teachers are still in school check the
  error reports so that the teachers can correct
  accommodation errors.

51
Modifications

• Definition Modifications are changing, lowering,
  or reducing learning or assessment expectations.
• May result in implications that could adversely
  affect a student throughout that individuals
  educational career.
• Modified tests will NOT be counted toward
  PROFICIENCY in AYP.

52
Presentation Accommodations

• Directions Read Aloud in English and Signed
• CRT - Clarification, paraphrasing and
  re-reading of directions are allowed
• Should be in a place separate from students who
  do not have this accommodation

53
Presentation Accommodations

• Questions Read Aloud in English, Signed, and
  Screen Reader
• CRT Math Science Yes
• CRT Elem. Sec. Language Arts Depends
  (notification of items that can and cannot be
  read aloud will be distributed prior to CRTs)

54
Presentation Accommodations

• Oral Translations
• CRT Math Science Yes
• CRT Elem. Sec. Language Arts No, ELA passages,
  questions, and options may not be translated.

55
Response Accommodations

• Calculation Devices
• Elementary need to bring calculator for
  non-calculator sections of the CRT.
• Secondary do not need a calculator since no
  non-calculator sections of the CRT.
• Any student may use his/her own calculator as
  long as it is equivalent to a Texas instruments
  89 or below.

56
Response Accommodations

• Graphic Organizers Visual Organizers
• These accommodations only provide a student with
  a blank sheet of paper or blank graph paper for
  assessment.

57
Setting Accommodations

• Reduce Distractions to Student
• Change in location
• Inside classroom
• In another room in the school
• Reduce Distractions to Others
• Change in location
• Students who need a reader or scribe
• Students who read or think out loud
• Students who make noises

58
Setting Accommodations

• Physical Access
• If all students in a subject and a grade are
  being assessed via the computer, paper-based
  assessments are an accommodation only available
  to students with disabilities and students on
  Section 504 plans.
• The Paper Based form must be requested during the
  ordering window or the LEA will bear the cost of
  production of the forms.

59
Timing/Scheduling Accommodations

• Extended Time
• Common often time and one half
• Reader or scribe often double time
• CRT it is recommended that subtests be
  completed on same day as started.
• If necessary, additional completion sessions
  should be scheduled, within the LEAs determined
  testing window, and carefully proctored to ensure
  that the student does not access previously
  completed items.

60
Timing/Scheduling Accommodations

• Multiple Breaks
• Supervision is required for all students.
• If student has multiple breaks or needs to stop
  testing before the section is completed, make
  sure the student does not have access to item
  previously completed before break, etc.
• Schedule Change
• Best time of day multiple days

61
CBT Read Aloud

• To ensure all students in a school receive the
  same form, the accommodation must be marked prior
  to the student logging into the test if a student
  receives
• Directions and/or questions read aloud,
• Directions and/or questions signed or
• Directions and/or questions for oral translation.

62
Computer-based Testing

• Large print and Braille are not available in
  Computer Based Testing.
• No need for scribe/word processor on Computer
  Based Testing.

63
Computer-based Testing

• Some LEAs are saying students with disabilities
  do better on Computer Based Testing than
  paper-based tests.
• Teachers will have to read aloud to student while
  student takes computer-based test unless student
  is using text-to-speech technology.

64
English Language Learners

• English language learner assessment information
  can be found in the Assessment Participation and
  Accommodations Policy on pages 12 and 49.
• The Assessment Participation and Accommodations
  Policy can be found at http//www.schools.utah.go
  v/assessment/documents/Special_Needs_Accommodation
  s_Policy.pdf.

65
Production and Distribution

• Sarah Moore
• Production
• Sarah.Moore_at_schools.utah.gov
• 801-842-8601/801-538-7944/801-842-8601

66
Test Materials Receipt

• All materials are packaged by school and shipped
  to the LEA except Language Arts Grade 2
• Verify the number of boxes received
• Principals - Do not distribute to teachers until
  test window opens

67
Verifying LEA Shipment

• Verify box contents using the LEA packing list in
  box 1 of LEA labeled boxes
• Do not open the shrink-wrapped packages at this
  time
• Contact USOE if the shipment appears incomplete
  or if you have any questions.

68
School Test Materials

• Test Administration Manuals for Computer and
  Paper Based Testing
• Test booklets for each subject based on ordered
  materials and mode using to administer

69
Paper Based Test Materials

• Math, English Language Arts (ELA) and/or Science
• Math and ELA will be shipped from Pearson
• Science will be shipped from Measured Progress
• ALL Re-orders through USOE

70
Paper Based Test Materials

• Math
• Grade 2 through Algebra 2 Shipped by Pearson
  per order requests, boxed by school, shipped to
  LEA offices for security and verification
• Reorders through UTOS, shipped by USOE

71
Paper Based Test Materials

• ELA
• ELA grade 2 Shipped from Computer Services,
  USOE, after pre-print upload
• ELA grade 3 through 11 Shipped by Pearson per
  order requests, boxed by school, shipped to LEA
  offices for security and verification
• Reorders through UTOS, shipped by USOE

72
Paper Based Test Materials

• Math grades 4 and up have reference sheets
  included in the booklets
• Science Physics and Chemistry Reference
  sheets are inside back cover and individual,
  included in shrink-wrapped packs

73
Paper Based Test Materials

• Science Grades 4 through Physics
• Shipped from Measured Progress per Order
  Requests, boxed by school, shipped to LEA for
  verification
• Reorders through USOE, shipped by USOE

74
Paper Based Test Materials

• Additional materials available through UTOS, open
  April 1st.
• 48 hour turn around

75
Computer Based Test

• Preordered through USOE
• Pre-loaded through Computer Services, USOE
• TAMs should be provided for each lab or each
  teacher
• TAMs should already be ordered through UTOS

76
Computer Based Test

• Invoice
• Concerns about invoicing do not include booklet
  orders that were a result of the UTOS update.
  Might be addressed for your LEA if your CBT
  participation numbers drop without reason.
• Packing slip
• Please note any discrepancies between pack slip
  from vendor and actual receipt count.
• Reconciliation

77
Security

• LEA Assessment Director Sign-off Guide
• Administration and Security

78
Braille and Large Print

• Standard print booklets and TAM included with
  Braille
• We dont provide answer documents in Braille and
  large print.
• Therefore, make sure answers are transferred!

79
Pre-Prints

• Sharon Marsh
• Computer Support Specialist
• Sharon.Marsh_at_schools.utah.gov
• 801-538-7915

80
Lets Identify Problems From Last Year
81
Lets Identify Problems in 2007-2008

• Not checking header sheets for teacher and
  section information
• All student files still not in on time
• Answer Documents not preprinted were not bubbled
  correctly
• UAA more than one task entered
• Tests packaged by school and not test type

82
Problems 2007-2008

• Both UAA and CRT test given.
• Error reports not corrected on time
• Accommodation errors
• Withdrawn students not being returned with
  regular batch to be scored causing a error on the
  missing document report
• Bar-code label for booklets not being returned on
  booklet with special code box marked

83
Problems 2007-2008

• Remember the test-id is printed on the bar code
  label so please remind your teachers to check for
  LA0202 for language and MA0202 for math.
• Every year we have classes that place the labels
  on the wrong booklets.

84
Old Answer Documents 2007-2008

• Sharon Marsh

85
Trimester Testing 2008-2009

• We sent out documents that were used last spring
  and normally we would tell you that we would have
  new answer documents before our spring testing
  but for this year that wont be the case. However
  they will be scored using last years keys.
• As soon as all of the districts are finished for
  that testing session we are going to send out the
  student reports.

86
Trimester Testing 2008-2009

• If you have students that received an answer
  document but wont test until spring mark the
  answer document withdrawn and send it back with
  the batch to be scored.
• Even though the answer documents havent changed
  for this spring dont wait and send trimester
  documents in or you will have problems on both
  testing sessions and possibly be scored under a
  wrong key.

87
On When to Send Files or If Im just doing CBT
why do I need to do anything?
Secure Testing Website to upload files for PBT
Documents and CBT Preloads
88
Information on Testing Website

• Log onto the testing website
  (https//cs.schools.utah.gov/assessment)
  and click on support on the toolbar to download
• Verification Application
• How To Manual
• Assessment Pre-print File Name Specification
  File Format

89
Pre-Print Layout is different for PBT read pg. 9
10 of the pre-print file name document
90
Test File Upload

• You must send a pre-print file for every test
  that you are giving
• UAA students have to be in 3 separate files one
  for every test that they will take US0112,
  UM0112, UL0112.
• Remember that on science you dont need to send
  in students that are grade 3 or below.

91
Testing Answer Documents

• Pearson will send you the math 2 booklets, but
  you will send in pre-print files to create the
  bar code labels
• Language 2 booklets will be sent from USOE with
  your labels
• All math, science, and language answer documents
  will be printed from the files that you send in

92
Testing Answer Documents

• All UAA answer documents will be sent to you from
  pre-print files that you send to USOE even if you
  are doing everything online UAA must be done PBT.
• Last year we had districts that marked a task
  online and marked UAA as a non-participation code
  for the CBT testing which was an error so we had
  to bubble in an answer document so the student
  would get scored.

93
CBT PRE-LOADS
94
Computer Based Testing DOWNLOADS

• Use testing website to upload files
  (https//cs.schools.utah.gov/assessment)
• Files will be sent to Measured Progress on
  Wednesday and Friday from USOE.
• Refer to page 9 10 of the preprint file naming
  specification document the layout for Paper Based
  Testing is different than
• Instead of PRE as part of your file name you will
  use Computer Based Testing

95
Computer Based Testing Downloads

• A paper backup is no longer necessary. UAA
  students however will need to use the new UAA
  answer document
• The 9 2 position used for CBT testing is used
  to both load students into lab classes. This
  must be a numeric field
• When those files are returned to USOE for the
  official raw roster reports and raw class
  summaries it will be used as a class identifier

96
CBT DOWNLOADS

• If you send in a preload file for Science 7 and
  you have 8th grade students in that file you will
  have an error on the file.
• If you are trying to test 8th grade students on a
  Science 7 test you wont be able to do that
  online but must use Paper Based Testing for those
  students.

97
We scan 6 days a week, 2 shifts a day.
Anything that is not part of the answer document
stops the scanner.
98
The following is a list of problems that continue
to slow scanning

• Tests grouped together by school instead of by
  test
• Bar code labels put over other labels or lined
  out and used for a different student
• Photocopied answer documents substituted for
  actual test, these will not scan
• Tests mixed with other tests, e.g., language 2
  booklet in with math 2

99
The following is a list of problems that continue
to slow scanning

• Using only one header sheet for a teachers
  elementary classes
• Mixing 3rd and 4th grade classes together under
  one header sheet
• Sending 1st TRI answer documents in with your 2nd
  TRI or worse keeping them until SPRING. Remember
  the error reports shows your missing answer
  documents.

100
The following is a list of problems that continue
to slow scanning

• When using blank answer documents check to see
  that all information has been bubbled in
• We still have districts that use another students
  pre-printed answer document and cross out the
  information
• Remember every pre-printed document must be
  returned with the special code box marked with
  the reason why the student didnt take the test

101
Why is quality screening of your various tests so
important?

• Anytime a problem is detected, scanning is halted
  until the problem is resolved, which causes
  additional delays not only for your district but
  subsequent districts that are next in line for
  their documents to be scanned and processed
• Cooperation on your part ensures that we can
  return results to you as quickly and accurately
  as possible

102
What happens after testing is finished?
103
CRT Timelines

• Computer Based Testing - 48 hour preliminary raw
  score reports
• All student file to USOE when you close your
  testing session for your district

104
CRT Timelines

• Paper Based Testing - within 5 days after Testing
  Window
• Answer Documents to USOE
• All student file to USOE

105
The following is a list of potential problems
that should be recognized

• Answer documents should be stacked with the
  student names face up with the timing tracks to
  the left. When the folded edge is cut preparatory
  to scanning, timing tracks will be cut off
  causing significant delay in scanning
• Use a light rubber band to separate individual
  teacher batches, with the header sheet on top, so
  they will stay in order when cutting the answer
  documents

106
Packaging Shipping

• Please make sure that the answer documents are
  all facing the same way
• Check to see that answer documents that werent
  pre-printed have been bubbled in
• Check all header sheets and make sure that
  teacher number section number have been bubbled
  (MUST)
• Teacher number is left justified with no spaces
  in the 9 position field

107
Shipping Address

• Answer documents are to be delivered to your data
  technician one of two ways
• Option 1 Hand-deliver, FedEx, or UPS
  Recommended
• Utah State Office of Education
• District Computer Services
• 250 East 500 South
• Salt Lake City, UT 84111-4200

108
Shipping Information

• All tests must be grouped in one shipment to DCS
• All test materials need to be boxed in
  appropriately sized boxes to avoid damage
• Each box must display the following on the
  outside (short side) of the box

109
Shipping Information

• District Name
• School Number
• School Name
• Grade Level
• In small districts, multiple schools of the same
  grade level may be placed in one box. Each must
  have a control document and header sheet

110
Package Box Label Example

• DISTRICT
• TEST
• GRADE

111
Understanding Error Reports and Corrections
112
Edit and Scoring

• As soon as your answer documents are scanned,
  they are processed. Students that match the all
  student file and dont have any other type of
  errors will be on your raw reports. Students that
  have problems will be listed on your error
  reports
• All reports will be placed on our testing website
  as soon as they are created.

113
The following is a list of problems that appear
on error reports

• If you have students that have withdrawn from the
  class that is being tested mark withdrawn in the
  special code box and return with that teachers
  class
• On the math and language 2 if you have a student
  that does not test put their label on a booklet
  and mark the special code box and return with the
  teachers class this will help with your missing
  documents

114
Where Will I Find Reports

• This year instead of the move-it folder as soon
  as scoring is finished and reports and error
  reports are finished you will be notified that
  you have information on the testing web-site.
• All of the testing directors will be set up as a
  user on this site.
• When we are busy with testing we will have one
  less step to get your reports to you.

115
Missing Document Report

• If you dont return every document that was
  pre-printed you will see them listed by test and
  by school
• Every bar code label needs to be returned on a
  booklet and the special code box marked. This was
  a really big problem last year for lots of
  districts

116
Resolving Error Reports

• Any of the students that have error problems
  will not be on your raw roster or summary reports
  but will be included on the error reports
• It will be the districts responsibility to
  provide the information to make the corrections.
  In some cases it might be necessary to send
  another all student file

117
New Reports

• This year we have two new reports
• one will compare all of your pre-prints to the
  documents that are returned for scanning
• the second report will list the students that are
  missing and from which test

118
New Reports

• REMEMBER every answer document needs to be
  returned with the Special Code Box marked
• Those answer documents not returned will count
  against your participation

119
Computer Based Testing Error Reports

• When your LEA has completed testing the files
  will be returned by Measured Progress at that
  time we will match them to the all student file
  and create raw roster and raw summary reports.
  This process also will generate error reports
  just like on your Paper Based Testing. These will
  be placed in your move-it folder.

120
Types of Computer Based Testing Errors

• No match on all student file
• Absent or withdrawn with responses
• Accommodation errors
• Just like the Paper Based Testing you might need
  to send a new all student file to fix your errors
  or you might need to tell us what type of
  accommodations were used

121
Types of Computer Based Testing Errors

• Remind teachers that if they mark accommodated
  they must fill in all of the accommodations that
  they used
• Also if the students took any part of the test
  they were not absent
• The same applies to withdrawn
• You can tell your reports apart because they will
  say Computer Based Testing on them

122
Count of Pre-Print to Scan File
Missing Answer Document Report
123
Who Do I Call with questions?

• Sharon Marsh [phone]
• Becky Andrews [phone]
• Cindy Marshall [phone]
• Dawn West [phone]
• Shane Johnson [phone]

124
Gentle Reminders for Teachers
125
Gentle Reminder

• Bar Code labels are printed by grade and test ID
• They need to be placed in the area that states
  apply actual student label here
• If teachers have applied their labels in any
  other area dont try and remove it

126
Non-Standard Participation

• Accommodated (ELL, IEP, 504) (1) if this is
  bubbled you must show what type of accommodations
  were used. (If this bubble is marked you must
  bubble accommodations above)
• Private or Home School (5)
• Modified (IEP Team) (2)

127
Non-Participation

• Absent-Unable to make up test (1)
• Excused-Medical Emergency (2)
• Unknown Student (3)
• Officially withdrawn from class/school (4)

128
Non-Participation

• Private or Home School (7)
• RT (8)
• UAA, Utahs Alternate Assessment (IEP team) (9)

129
What Do I need to Do?

• When teachers bubble students as accommodated
  they need to also mark the types of
  accommodations that were used
• This year you have a new error report that will
  need to be fixed when that isnt resolved
• When applying bar code labels make sure they have
  the correct subject

130
Managing Answer Documents For UALPA 2008-2009

• Sharon Marsh

131
Testing Website

• We will have a power point that will give step by
  step instructions for sending back your UALPA
  answer documents.
• This year when you send in your batches you must
  also send in an All Student File this is
  different than last year.
• Batches will not be done weekly but at regular
  test windows

132
Batching UALPA for Scoring

• Kindergarten is the only grade that does not have
  multiple grade levels but does have different
  forms. So this year you will need to batch by
  form IF you are a LEA that has multiple forms. If
  not you can batch all of your A1a together for
  school 108 then use a header sheet for 112 and
  place your A1a students together.

133
Batching UALPA for Scoring Contd

• Because this is so different from last year a
  power point and instructions will be made
  available to you so that all of your questions
  will be answered if you would like you can talk
  to me during lunch.
• Please remember to ask questions before you send
  in your UALPA answer documents. If they are
  batched wrong we will have to call and have you
  come in a fix them.

134
Ethics

• David Smith
• David.Smith_at_schools.utah.gov
• 801-538-7731

135
Thank you for participating!