TETN Accountability Update Session

1
TETN Accountability Update Session

• November 15, 2007

2

• State Accountability Update

3
Recent and Upcoming Events

• November 15 AEIS release on TEASE
• November 28 AEIS release on TEA public website
• December 6 PEG release on TEASE
• December 11 School Report Cards (SRCs) released
• (target)
• December 12 Public Education Grant (PEG) list
• (target) released on TEA Correspondence Site
• Mid-December 2006-07 Pocket Edition published
• (web and print)

4

• Gold Performance Acknowledgments

5
Gold Performance Acknowledgments

• Among the campuses that were evaluated for GPA
• 18 earned exactly 1
• 18 earned exactly 2
• 14 earned exactly 3
• 78 earned 1 or more
• 59 earned 2 or more

6
Gold Performance Acknowledgments (continued)

• Among the districts that were evaluated for GPA
• 16 earned exactly 1
• 17 earned exactly 2
• 12 earned exactly 3
• 76 earned 1 or more
• 60 earned 2 or more

7
Gold Performance Acknowledgment (continued)
8
Gold Performance Acknowledgment (continued)
9
Gold Performance Acknowledgments (continued)

• The number of campuses and districts earning
  acknowledgment on the RHSP indicator continues to
  decline.

10
Gold Performance Acknowledgments (continued)

• At the district level, the number of districts
  earning acknowledgments declined for every GPA
  indicator, except the two TSI indicators. The
  biggest decline was in commended performance on
  writing. There are 208 fewer districts commended
  on writing than in 2006. The greatest increase
  was for the TSI in ELA where there are 266 more
  districts earning this acknowledgment.

11
Gold Performance Acknowledgments (continued)

• At the campus level, the number of campuses
  earning acknowledgments declined for 8 of the
  possible 14 GPA indicators. The biggest decline
  was in commended performance on mathematics.
  There are almost 600 fewer campuses commended on
  mathematics than in 2006. The greatest increase
  was for the TSI in ELA where there are 307 more
  campuses earning this acknowledgment.

12

• Technical Assistance Teams

13
TAT Methodology

• The TAKS data was rebuilt for both 2006-07 and
  2005-06 to include selected TAKS-Inclusive grades
  and subjects and to include grade 8 science
  results. These data are reported on the 2006-07
  AEIS reports as a Preview Indicator (example to
  follow).
• SDAA II results are not evaluated.
• Paired campuses and obsolete campuses are removed
  from the TAT list.
• There is no waiver provision for the 2007-08 TAT
  list.

14
TAT Facts

• There are 395 unique districts with one or more
  campuses on the TAT list. This compares to 157
  unique districts on the 2006-07 list.
• Most districts have only one campus on the list
  (62). Houston ISD has the most campuses of any
  single district, with 56.
• The most common campus type on the list is Middle
  School with 40 (among the Both, Elementary,
  Middle School, and Secondary categories).
• The 2006-07 TAT list had 234 campuses, with 35
  waivers, so only 199 campuses had TAT
  requirements. The 2007-08 list is almost four
  times as large with 877 campuses and no waivers.

15
The TAT Data

• The AEIS reports (released to superintendents
  today through the TEASE site) contains a 2008
  Preview Indicator.

16
The TAT Data (continued)

• The 2008 Preview Indicator is the data that was
  used to identify campuses for the TAT list.
• The TAT processing also evaluated student group
  size, checked for requirement improvement, and
  applied the Exceptions Provision. These details
  cannot be discerned from the Preview Indicator.

17
TAT Consequences

• Questions about TAT membership should be directed
  to the PMI Division at 463-9414.
• Team membership should be submitted by November
  30, 2007.

18
TAT FAQs

• Why is a certain school on the list? See the
  AEIS 2008 Preview Indicator.
• I have a school on the list. What must I do now?
  Identify your TAT membership and submit name(s)
  to the PMI Division.
• Is this particular person eligible to be a team
  member? Contact PMI.

19
TAT FAQs (continued)

• I cant reconcile my data with your data. How
  did you get the results you used? We recomputed
  both the 2007 data and the 2006 data to include
  grade 8 science results at the PR level as well
  as TAKS-I (science and social studies and grade
  11).
• Will the agency provide data in the future? No
  recomputation of data is necessary next year, so
  August 1 Accountability Data Tables can be used.
  Reasons will be provided on the TAT list. It is
  also anticipated that notification will occur via
  TEASE instead of via mailing.

20
TAT FAQs (continued)

• I have a 2007 granted appeal based on data
  quality issues, yet you evaluated me for the TAT
  list based on the bad data anyway. Why? Even
  with granted appeals the underlying data are not
  altered. The 2007 data was the only performance
  data available to evaluate against the 2008
  system criteria.

21

• 2006-07 Academic Excellence Indicator System
  (AEIS) Update

22
November 15 TEASE release

• Email notification was sent November 14 to
  district superintendents with a copy to ESC
  directors.
• The TEASE site provides everything districts need
  to fulfill statutory requirements associated with
  AEIS.
• Site also provides Guidelines and Glossary.
• Unlike other TEASE products, the AEIS reports are
  NOT confidential.

23
District Responsibilities (See Guidelines for
details)

• PUBLISHING
• MUST publish performance and profile sections
  of district and campus AEIS reports
• MAY publish Glossary (Note Spanish language
  translation of the Glossary will be available in
  January 2008)
• MUST ADD and publish
• Campus performance objectives
• Report of violent or criminal incidents
• Information from THECB about performance of
  students in postsecondary institutions

24
District Responsibilities (continued)

• HEARING FOR PUBLIC DISCUSSION
• Must be held within 90 calendar days after the
  November 15th TEASE release. District winter
  break days do not count toward the 90 days.
• Within 2 weeks after the hearing, the AEIS report
  must be disseminated.

25
District Responsibilities (continued)

• DISSEMINATION OF THE REPORT
• May be accomplished by
• Directing readers to copies of the reports
  located on the districts website (preferred).
• Directing readers to the TEA AEIS website.
• Through mailouts.
• By posting the report in public places.

26
District Responsibilities (continued)

• AEIS AND THE DISTRICT WEBSITE
• TEC 39.252 requires the district to post the most
  current AEIS report by the 10th instructional
  day. There is no requirement in this statute
  that district websites must be updated with new
  AEIS reports after the 10th instructional day
  however, districts are encouraged to do so.
• See our FAQ about this requirement at
  http//www.tea.state.tx.us/perfreport/3297_faq.htm
  l

27
November 28 Public Release

• Includes the TEASE products namely, individual
  district and campus AEIS reports, CI reports,
  Glossary, and Guidelines.
• ADDS
• Region reports
• State report
• A separate report of how mobile students
  performed (state-level only)
• Data download (including explanation of masking)
• Additional CI information
• The Multi-Year feature
• Direct links to prior year reports
• Direct links to grade level Progress of Prior
  Year Failers

28
Changes to 2006-07 AEIS

• Accountability Preview of 2008
• An indicator is included that shows TAKS
  performance constructed to reflect the indicator
  definition that will be used in the 2008
  accountability system. This indicator is titled,
  TAKS Met 2008 Standard (Sum of All Grades
  Tested, INCLUDING grade 8 Science and TAKS-I2008
  Preview at Panel Recommended).
• Participation
• TAKS-Alternate Only and Combination have been
  added to the tested subsection.

29
Changes to 2006-07 AEIS (continued)

• TAKS-Inclusive
• TAKS-I results, previously reported as a separate
  indicator, have been deleted. The TAKS-I results
  (for selected subjects and grades) are now
  included with other TAKS data in the
  Accountability Preview indicator described above.
  TAKS-I results are not included in the TAKS
  results by grade.
• Although TAKS-I has been renamed TAKS
  (Accommodated), the 2006-07 AEIS reports and
  Glossary use TAKS-I.

30
Changes to 2006-07 AEIS (continued)

• Annual Dropout Rate
• The annual dropout rate for grades 9-12 is added.
  All three annual dropout rates (7-8, 7-12, and
  9-12) will appear on each district, region, and
  state report. However, only the 7-8 and 9-12
  rates will appear on campuses evaluated under
  standard procedures. The 7-8 and 7-12 rates will
  appear on campuses evaluated under AEA
  procedures. Due to definition changes to the
  annual dropout rate, only the current year of
  dropout data is shown.

31
Changes to 2006-07 AEIS (continued)

• College-Ready Graduates
• A new indicator of college readiness is added to
  the college-ready section of the report. To be
  considered college-ready, a graduate must have
  achieved a certain performance level on any one
  of the following tests the exit-level TAKS, the
  SAT, or the ACT.
• English Language Learners Progress Measure
• For the first time, two years of information are
  available for this indicator (2006-07 and
  2005-06). Also, more details are provided for the
  definition of this indicator in a new appendix to
  the Glossary, Appendix H.

32

• School Report Card
• 2006-07 Summary

33
Overview

• A subset of the AEIS
• Governed by its own statute (TEC 39.052) and
  Commissioners Rule (TAC 61.1021)
• Intent is for this report to get to the homes of
  each child

34
Delivery Notification from TEA

• A website release only. Paper copies not mailed.
• Web products are accessible through the AEIS site
  no separate TEASE release.
• Target release date December 11.
• Superintendents and principals notified of
  availability via email.

35
District Responsibilities

• Districts must provide SRCs to their campuses.
• Must be disseminated to parents within six weeks
  after districts are notified by TEA.
• The district winter break doesnt count toward
  the six week period.
• There are various ways to achieve the
  distribution requirements (see TAC 61.1021).
• Supplemental materials are provided by TEA
• Sample cover letters to parents (English and
  Spanish)
• Definitions (English and, as soon as available,
  Spanish)

36

• Public Education Grant (PEG) Program 2008-09
  Summary

37
Overview

• A statutorily-mandated program of school choice
• (TEC Ch. 29, Subchapter G, 29.201-29.205).
• Statute addresses campus identification, funding
  issues, and student eligibility issues.

38
Criteria

• Partially tied to accountability ratings, but not
  aligned with either the state system, AYP, or the
  TAT list.
• PEG criteria are tougher on the evaluation of
  science and math results than the state standards
  currently are.
• There is a 3 year moving time period, so even
  improved schools stay on the list if they were AU
  in any of the previous three years.
• The number of campuses anticipated this year is
  expected to be lower than last year. Last year
  there were 924 schools identified.

39
Calendar and Notification

• Planned release on December 6 via TEASE to all
  districts with one or more campuses on the list.
• List will be posted to agency website on December
  12.
• An online FAQ is available through the Division
  of Performance Reporting Resources link
  http//www.tea.state.tx.us/perfreport/resources/in
  dex.html

40
District Responsibilities

• Statute requires that districts notify parents of
  the 2008-09 list by February 1 of 2008.
• List is based on 05, 06, and 07 performance,
  but is in effect for the 2008-09 school year.

41
2008 AEA Campus Registration Process - Reopened
42
2008 AEA Campus Registration Process - Reopened

• The initial 2008 AEA campus registration process
  was conducted online using the TEASE
  Accountability website September 10-21, 2007.
• An e-mail message was sent on September 7, 2007
  informing district superintendents of the 2008
  AEA registration process. Due to a network
  problem, this e-mail was not delivered until
  September 27, after AEA registration had closed.
• To ensure an AEA registration process that is
  administered fairly and consistently for all
  campuses, the online 2008 AEA campus registration
  process is reopened November 12-28, 2007.

43
2008 AEA Campus Registration Process - Reopened
(continued)

• Forms submitted online during the September 10-21
  registration window will remain in effect for the
  2007-08 school year. Do not resubmit 2008 AEA
  registration or rescission forms submitted
  September 10-21.
• Verify that AECs are pre-registered using the
  2008 Pre-Registered AEC List at
  http//www.tea.state.tx.us/aea.
• AECs requesting AEA registration must complete an
  electronic 2007-08 AEA Campus Registration Form.
• AECs for which 2007 AEA registration was
  rescinded due to not meeting the at-risk
  registration criterion must submit an electronic
  2007-08 AEA Campus Registration Form if the AEC
  wishes to request AEA registration in 2008.

44
2008 AEA Campus Registration Process - Reopened
(continued)

• AECs wishing to rescind AEA registration must
  complete an electronic 2007-08 AEA Campus
  Rescission Form.
• AEA rescission and registration forms submitted
  via TEASE Accountability must be printed and
  maintained by superintendents as official
  documentation of AEA campus registration
  requests.
• The reopened 2008 AEA campus registration process
  closes at 500 p.m. CDT on November 28, 2007.
  AEA registration and rescission forms will not
  be processed after this time.
• The 2008 Registered AEC List will be posted
  online at http//www.tea.state.tx.us/aea in
  December.

45
Federal Accountability Update
46
2007 AYP Release Schedule

• Tuesday, December 11 (target date)
• AYP Appeals letters mailed
• Appeal letters posted on TEASE
• Tuesday, December 18 (target date)
• AYP release on TEA public website

47
2008 Assessments and AYP

• TAKS
• Same as 2007
• LAT TAKS
• Same as 2007
• TAKS-Accommodated
• Included in AYP for Reading and Math

48
2008 Assessments and AYP

• TAKS-Modified
• Included in AYP for Reading and Math
• Students taking TAKS-M are
• included in Participation,
• included in Performance subject to a 2 cap on
  proficient results
• TAKS-Alternate
• Included in AYP for Reading and Math
• Students taking TAKS-Alt are
• included in Participation,
• included in Performancesubject to a 1 cap on
  proficient results

49
2008 Assessments and AYP

• TELPAS Reading
• Same as 2007
• Students in their First Year in US Schools are
• Included in Participation
• Excluded from Performance
• Students in their Second or Third year (or more)
  of enrollment in U.S. schools are
• Not counted as participants (Non-Participants)
• Excluded from Performance

50
2008 AYP Preview Federal Cap

• In general, the federal cap process has been
  applied to Texas schools in the following steps
• Determine the districts total participation
  count, based on the school districts total
  participation denominator for the Reading/English
  Language Arts and Mathematics. This count is
  based on students identified as enrolled on the
  day of testing in grades 3 8 and 10 only.
• Apply the percentage to the total participation
  count for the cap limit on 1 or 2 proficient
  results.District Participation Denominator x
  .01 TAKS-Alt LimitDistrict Participation
  Denominator x .02 TAKS-M Limit

51
2008 AYP Preview Federal Cap (continued)

• In past years, TEA determined how many proficient
  scores could be included in the performance rates
  for each district based on a sorting priority.
• All students in the school district were sorted
  in the order of priority regardless of the campus
  identification. 

52
2008 AYP Preview Federal Cap (continued)

• Proficient scores that remain after the district
  cap was reached were counted as non-proficient
  for AYP purposes only.
• Since the limit of proficient results in the
  federal cap has been based on the school district
  participation count, it is difficult to determine
  the specific campus results of the federal cap
  calculation.

53
2008 AYP Preview Federal Cap (continued)

• An Important Note about Alternate Test
  Administration
• It should be emphasized that the federal cap
  relates to counting students as proficient for
  AYP purposes only and does not provide direction
  to ARD committees regarding how students with
  disabilities should be assessed. For students
  with disabilities receiving special education
  services, state policies and procedures related
  to assessment decision-making are detailed in the
  TEA publication titled Admission, Review, and
  Dismissal (ARD) Committee Decision-Making Process
  for the Texas Assessment Program.
• It is important that local school districts
  ensure that appropriate assessments are selected
  and administered to students with disabilities.

54
2008 AYP Preview Federal Cap (continued)

• The protocol for determining which students are
  included or excluded in AYP if the 1 or 2 caps
  are exceeded has not yet been determined. 
• Ongoing research to determine how other states
  are planning to process proficient results that
  exceed the cap.

55
2008 AYP Preview Federal Cap (continued)

• The USDE federal regulation released in April
  2007 provides specific guidelines on the
  implementation of the federal cap
• Districts cannot exceed the 1 cap for TAKS-Alt. 
  However, if they do not fully use the 1 cap,
  then they can exceed the 2 cap (up to 3). 
• In other words, TAKS-M proficient scores may
  spill over beyond the cap, but the TAKS-Alt may
  not.

56
2008 AYP Preview Federal Cap (continued)

• One Possible Scenario
• Subject Area Reading/ELA
• Total Number of AYP Participants in District
  742
• (Grades 3 8 10 only)1 x 742 7.42 8
  students may be counted as proficient in AYP from
  TAKS-ALT 2 x 742 14.8415 students may be
  counted as proficient in AYP from TAKS M3 is
  the total number of students, or 23

57
2008 AYP Preview Federal Cap (continued)

• Second Scenario
• Subject Area Reading/ELA
• Total Number of AYP Participants in District
  742
• (Grades 3 8 10 only)1 x 742 7.42 from
  0 - 8 students may be counted as proficient in
  AYP from TAKS-ALT 2 x 742 14.84from 15 - 23
  students may be counted as proficient in AYP from
  TAKS MThe combined total is 23 students, or 3

58
2008 AYP Preview

• Timeline
• Standard setting for the TAKS-M assessment will
  not be completed until August 2008.
• Discussions have begun with the USDE to modify
  the 2008 AYP timeline.
• Texas will request that the preliminary 20072008
  AYP status and the corresponding 20082009 School
  Improvement Program (SIP) status be released
  after the beginning of the 20082009 school year. 

59
2008 AYP Preview (continued)

• The 2008 Adequate Yearly Progress (AYP) Guide
  will include the details of the federal cap
  process and 2008 timeline.
• The AYP Guide will be available on the Texas
  Education Agency website in late spring 2008.
• Examples like those in the AYP Information
  Packet, available from the TEASE Accountability
  website, may be incorporated into the AYP Guide
  federal cap process description.

60
State and Federal Accountability 2007-08 School
Year
61
TAKS (Accommodated)
62
TAKS-Modified (TAKS-M)
63
TAKS-Alternate (TAKS-Alt)
64
TETN Accountability Update Sessions 2008 Dates
and Tentative Agenda Topics

• February 29 Update on Accountability Development
• April 3 Accountability Decisions for 2008
  Beyond
• June 11 Accountability Manuals State and AYP
• August 14 Accountability Results for 2008
• November 13 Accountability Ratings Update
• Gold Performance Acknowledgments
• AEIS Reports
• School Report Cards
• PEG List
• The above dates are for 1 p.m. to 3 p.m.

65
Accountability Resources

• Email the Division of Performance Reporting at
  performance.reporting_at_tea.state.tx.us.
• Phone the Division of Performance Reporting at
  [phone].
• ESC Accountability Contacts.
• Online
• ACCT http//www.tea.state.tx.us/perfreport/accoun
  t/
• AEA http//www.tea.state.tx.us/aea/
• AYP http//www.tea.state.tx.us/ayp/