Utah Performance Assessment System for Students U-PASS Accountability Plan

1
Utah Performance Assessment System for
StudentsU-PASS Accountability Plan

• Judy W. Park
• Assessment Accountability Director
• Utah State Office of Education
• February 2006

2
U-PASS

• Product of Utah Code 53A-1-605, establishing an
  accountability system for Utah public schools
• Uses multiple measures to determine acceptable
  levels of school performance
• Focus is on individual student progress
• Includes total school and subgroup accountability
• Electronic Report
• Disaggregated Assessments Indicators
• Additional Information
• Previous U-PASS Report Elements

3
U-PASS

• Plan was developed by
• U-PASS Task Force
• U-PASS Elementary, Middle, High School Working
  Groups
• District Superintendents
• District Assessment Directors
• Technical Advisory Committee
• Policy Advisory Committee
• U-PASS Committee

4
U-PASS

• This model has been shared with
• State Board monthly
• PTA Legislative representatives
• District leadership teams
• CMAC Executive Council

5
U-PASS Legislation

• 53A-1-605
• (1) develop a plan to analyze the results of
  the U-PASS scores for all grade levels and
  courses required under Section 53A-1-603 and the
  student behavior indicators referred to in
  Subsection 53A-1-602 (3) (e).

6
U-PASS Legislation

• 53A-1-605
• 2(b) identify schools not achieving state
  established acceptable levels of student
  performance in order to assist those schools in
  raising their student performance levels.

7
U-PASSAccountability Plan

• Student Participation on Assessments
• Status Scores
• Percentage of students proficient on the
  collection of assessments and other indicators
• Progress Scores
• Longitudinal measure based on comparing the
  achievement levels of the same student from one
  year to the next

8
U-PASSAccountability Plan

• Student Participation
• 95
• Acceptable Status Score
• 75
• Progress Score
• Low 0 184
• Medium 185 - 214
• High 215 - 400

9
Schools will be identified as

• Achieved State Level of Performance
• Participation is 95 and
• Total School Status is acceptable or progress is
  medium or high AND
• Subgroup Status is acceptable or progress is
  medium or high
• Needs assistance
• Participation is less than 95 or
• Total School Status is not acceptable and
  progress is low OR
• Subgroup Status is not acceptable and progress is
  low

10
Achieved State Level of Performance
11
U-PASS Accountability Plan

• Multiple Assessments Indicators
• English language arts CRT
• Math CRT
• Science CRT
• Direct Writing Assessment
• Utah Basic Skills Reading Assessment
• Utah Basic Skills Writing Assessment
• Utah Basic Skills Math Assessment
• UALPA
• UAA
• Attendance
• Graduation Rate

12
Elementary/Middle Status and Progress Score

• Language Arts (35)
• ELA CRT (35)
• Or
• ELA CRT (30)
• DWA 5
• Science (20)
• Science CRT

• Math (35)
• Math CRT
• Attendance (10)

13
High School Status and Progress Score

• Language Arts (30)
• ELA CRT (60)
• Or CRT 50 DWA 10
• UBSCT reading (25)
• UBSCT write (15)
• Science (25)
• All Science CRT

• Mathematics (25)
• Math CRT Courses
• (50)
• UBSCT math (50)
• Attendance (10)
• Graduation rate (10)

14
Progress Value Table
15
U-PASSAccountability Plan

• Student Participation
• 95
• Acceptable Status Score
• 75
• Progress Score
• Low 0 184
• Medium 185 - 214
• High 215 - 400

16
U-PASS Accountability Plan

• English Language Learners
• Students focus on learning academic English
• skills first (up to 3 years)
• After three years, or when students achieve
• language proficiency, they become accountable
• for proficiency on U-PASS assessments

17
ELL Students

• 2005 2006
• ELL students (level A and B) in country less than
  3 years, CRT and DWA proficiency in U-PASS
  Accountability Plan
• 2007
• ELL students (level B,P,E) in country less than 3
  years, their proficiency on CRT and DWA will be
  substituted for proficiency on UALPA

18
ELL for U-PASS NCLB
19
Title I - ELL FlexibilityRod Paige Letter,
February 23, 2004

• LEP students, during their first year of
  enrollment in U.S. schools
• Must take an English proficiency assessment
  (UALPA)
• Must take the math assessment (CRT) with
  accommodations as necessary
• Not included in AYP academic determinations even
  if the student has been enrolled in the school or
  district for a full academic year.
• Are included in the 95 participation
• May participate in the reading/language arts
  assessment
• The assessment results for (CRT) are not required
  to be included in AYP, even if the student has
  been enrolled in the school or district for a
  full academic year
• If these students take (UALPA) and or language
  arts assessment
• (CRT) they can be counted as participants toward
  meeting the 95 participation
• Level D E students may remain in LEP subgroup
  for 2 years after they have attained proficiency
• These students are not required to take UALPA
• These students not required to receive language
  services as LEP student

20
Who Participates in Testing?

• For students in the United States for less than
  one year
• The rule is based on if the student is enrolled
  during the testing window
• The rule is not based on the number of days the
  student was enrolled during the school year.
• Phone conversation 11/14/05, Kerri Briggs, DOE

21
Who Participates in Testing?

• For students new to the United States
• If enrolled prior to April 15, they are not
  required to take the language arts CRT. They are
  required to take the math CRT for participation,
  but their score is not included in the AYP
  calculation for that year. They are also
  required to take the UALPA.
• If enrolled on, or after, April 15, they are
  exempt from all testing for that year.
• For students new to the United States, the second
  year of enrollment
• If enrolled prior to April 15 of the previous
  year, they are required to take the language arts
  CRT and the math CRT. Both scores are used for
  participation and proficiency. They are also
  required to take the UALPA.
• If enrolled on, or after, April 15 of the
  previous year, they are not required to take the
  language arts CRT. They are required to take the
  math CRT for participation, but their score is
  not included in the AYP calculation for that
  year. They are also required to take the UALPA.

22
Who Participates in Testing?

• Examples
• Student comes to US enrolled in March of 05
• 05 - not required to take ELA CRT, but must take
  math CRT UALPA
• 06 required to take the ELA CRT, math CRT
  UALPA
• Student comes to US enrolled in May of 05
• 05 exempt from all spring testing
• 06 - not required to take ELA CRT, but must take
  math CRT UALPA
• 07 - required to take the ELA CRT, math CRT
  UALPA
• Student comes to US enrolled in September of 05
  
• 06 - not required to take ELA CRT. but must take
  math CRT UALPA
• 07 - required to take the ELA CRT, math CRT
  UALPA

23
U-PASS Accountability Plan

• Students with Disabilities
• Five participation options
• Standard administration
• Accommodations
• Modifications
• Utah Alternate Assessment 1
• Additional flexibility 2 ?

24
U-PASS Accountability Plan
Extensive subgroup reporting

• Economically disadvantaged
• Students with Disabilities
• Ethnicity
• African American
• American Indian
• Asian
• Caucasian
• Hispanic
• Pacific Islander

• Total Group
• ELL proficiency levels
• A,B,C,D,E
• Gender
• Migrant
• Mobility
• Students without
• Disabilities

25
U-PASS Accountability Plan

• Aggregate Subgroup Accountability
• Every student who belongs to a subgroup other
  than white
• Individual student proficiencies are added
  together and divided by the number of students to
  determine the subgroup proficiency level
• Any individual subgroup not meeting proficiency
  will appear on the front page of the report

26
U-PASS Accountability Plan

• Subgroup Status Accountability
• Allows greater accountability
• Students in a subgroup with less than 10 are now
  included in the aggregate calculation
• Students are more fairly represented
• Each student only counts once, regardless of the
  number of subgroups in which the student
  qualifies.
• Increased reliability
• We are evaluating a larger group
• More students and more schools are represented
• Increased validity
• We do not overweight small populations.
• This lifts the burden of one subgroup being the
  sole determinant of unacceptable status of the
  school.

27
U-PASS Timeline 2004-2006

• 2004 CRT established baseline
• 2005 CRT begins progress score
• 2005 Status Progress for all but High School
  and ELL
• UBSCT in effect for 2006
• UALPA implemented 2007
• 2006 Status Progress for all but HS and ELL
  progress
• UBSCT implemented 2006, progress 2007
• UALPA implemented 2007, progress 2008
• 2007 Status Progress for High School
• 2008 Progress available for UALPA

28
Previous U-PASS Report Elements

• School summary information
• Student summary information
• NRT results by State, District and School
• CRTs for the past two years by District and
  School

29
U-PASS Report Elements
30
The 2005 U-PASS Report

• Web-based report format
• An increased amount of information available on
  each school
• Allows for drill-down information

31
(No Transcript)
32
1
33
2
34
(No Transcript)
35
(No Transcript)
36
(No Transcript)
37
(No Transcript)
38
(No Transcript)
39
Second Level Drill Down
40
Third Level Drill Down
41
Progress Drill Down
42
Progress Table
43
Additional Reports
44
U-PASS

• Additional Information
• NRT
• ACT/SAT
• AP
• Concurrent Enrollment
• School Summary Information
• Student Summary Information
• Percent of student reading on grade level
• (reported for grades 1-10)
• Dropout Rate (disaggregated by 08)
• Disciplinary Action
• Course Taking Patterns and Trends

45
U-PASS Report Elements
46
U-PASS Report Elements
47
(No Transcript)
48
AYP Reports
49
Timeline for U-PASS

• January 06
• U-PASS report available on secure site for 30 day
  review

50
Timeline for U-PASS

• February 06
• Electronic Report available to the public
• April 06
• Full Drill down available to public
• 2006 U-PASS Report
• Available with AYP

51

• Questions?