A1258150171zFUcJ - PowerPoint PPT Presentation


PPT – A1258150171zFUcJ PowerPoint presentation | free to view - id: 1afd85-ZDc1Z


The Adobe Flash plugin is needed to view this content

Get the plugin now

View by Category
About This Presentation



Senate Bill 1906 Alternative Credit Pilot Program. Senate Bill 1908 Many Initiatives: Writing ; Norm-referenced tests; Test Prep; ... – PowerPoint PPT presentation

Number of Views:11306
Avg rating:3.0/5.0
Slides: 202
Provided by: daphne3


Write a Comment
User Comments (0)
Transcript and Presenter's Notes

Title: A1258150171zFUcJ

  • Victoria Ash
  • Victoria.Ash_at_fldoe.org
  • (850) 245-0788

K-12 Assessment Link
  • K-12 Assessment and General Information are
    available online at
  • www.fldoe.org/asp/

FCAT Contractors Contact List
  • Emails filtered through Leads
  • DOE
  • Victoria Ash Bureau Chief
  • Jackie Mueller Director, Scoring and Reporting
  • Lynn Ann Tabeling End-of-Course
  • Daphne Csonka Administration
  • Mario Zuniga Scoring and Reporting
  • TDC
  • Vince Verges Director
  • Steve Ash Mathematics
  • Lyla Springfield Reading
  • Linda Oravetz Science
  • Trish Lyons Interpretive Products

Assessment Schedules
  • 2008-09 and 2009-10 FCAT Schedules
  • 2008-09 Assessment Calendar
  • Updates
  • 2008-09 FCAT Schedule
  • Test Dates
  • March 10 19
  • March 3 12 (Optional Schedule)
  • Notification Deadline to the Department
    September 15
  • Kira.Sullivan_at_fldoe.org
  • Grade 11 Science
  • Day 1, Day 2, Day 3, Day 4, or Day 5
  • Must be a DISTRICT (not a school-by-school)
  • Notification Deadline to the Department
    September 15
  • Kira.Sullivan_at_fldoe.org
  • Test Materials Shipment and Pickup Schedule

Whats New for 2008-09
  • Recycling
  • Current Strategies
  • Recycling versus Reuse

Whats New for 2008-09
  • No NRT administration
  • No computer-based Retake
  • High School Competency Test (HSCT)
  • No contract for 2009 administration
  • FCAT Retake administrations
  • Concordant Study in progress

Whats New for 2008-09
  • FCAT Writing
  • NO multiple-choice sessions at any grade level
  • Unsealed four-page folder
  • No test group codes for the 2009 Writing
  • Planning Sheets

Whats New for 2008-09
  • FCAT Reading, Mathematics, and Science
  • Test group codes on ALL answer documents,
    including Grades 3 and 4
  • RETAKE PreID Labels
  • One Reading Retake set
  • One Mathematics Retake set
  • No PINK Return Labels for Science
  • All TO BE SCORED documents will be packaged with
    RED, PEACH, or BLUE return labels.

Whats New for 2008-09
  • Electronic Devices
  • Testing Guidelines
  • If a student starts a test and leaves campus
    without finishing (for an appointment, illness,
    etc.), he or she will NOT be allowed to complete
    the test.
  • NO EXCEPTIONS will be made once the student
    leaves the campus therefore, if you have
    concerns about a student, you should not allow
    the student to begin.
  • Consider administering the test to that student
    on one of the make-up days.
  • Use ALL of the allotted time in each session.
  • Test administrators must NOT administer the FCAT
    to their family members.

  • Students to be Tested
  • All students enrolled in Grades 3 11
  • Certificate of Completion Students
  • Home Education Program Students
  • Students MAY participate in the FCAT
    administration if their parent or guardian has
    identified the FCAT as the selected measure of
    their childs annual progress.
  • McKay Scholarship Program Students
  • Students enrolled in PRIVATE schools MAY
  • Students enrolled in PUBLIC schools ARE REQUIRED
    to participate in statewide assessments as
    outlined in their IEPs.
  • Corporate Tax Credit (CTC) Scholarship Program
  • A private school student enrolled in the CTC
    Scholarship Program MAY participate in the
    statewide assessments.
  • A parent/guardian is responsible for contacting
    the district to register the student for the
    selected assessments and for transporting the
    student to and from the district-assigned

  • Students to be Tested (continued)
  • Florida K-8 Virtual School Program Students
  • Connections Academy and Florida Virtual Academy
  • Do not confuse these students with Home Education
    Program students or high school students enrolled
    in classes with the Florida Virtual School.
  • English Language Learners (ELLs)
  • ALL ELLs are expected to participate in FCAT
    Reading and Writing however, if an ELL has been
    receiving services for one year or less AND the
    LEP committee determines that it is appropriate,
    the student may be exempt but must participate in
    an alternate assessment.
  • ALL ELLs are expected to participate in the FCAT
    Mathematics and Science tests no matter how long
    these students have been receiving services.

  • Forms located at www.ctb.com/fcat
  • Comment FormsEnsure that the online comment
    forms are reviewed BEFORE testing so that
    feedback will address the concerns of the FDOE
    and the contractor.
  • Test Administrator
  • School Coordinator
  • District Coordinator
  • Required Administration Information
  • Missing Materials
  • Administration Irregularities and Breaches

  • Florida Statute 1007.35(5)
  • Pre-college entrance examinations for enrolled
    Grade 10 students in public high schools
  • Test Dates
  • PSAT October 15 and 18, 2008
  • PLAN September to December, 2008
  • Contacts
  • PSAT Jesus Jara, The College Board, (850)
  • PLAN Jacque Twiggs, ACT-Atlanta, (404) 231-1952
  • Jenine Brewer, (850) 878-2729
  • Broward, Dade, Duval, Hernando, Hillsborough,
    Manatee, Orange, Palm Beach, Pasco, Pinellas
  • Ginger Green, (850) 878-2729
  • All other districts

Comprehensive English Language Learning
  • CELLA Test Dates
  • April 14 May 15
  • ContactsAcademic Achievement through Language
  • Mark Drennan (850) 245-0893
  • Pat Faircloth (850) 245-0885

K-12 Test AdministrationContact List
  • Daphne Csonka, Supervisor (850) 245-9203
  • Tamika Brinson, FCAT(850) 245-0786
  • Susie Lee, FCAT(850) 245-0785
  • Linda Rhea, FCAT ESE(850) 245-0742
  • Kira Sullivan, FCAT, PSAT/PLAN(850) 245-0784

Misc. Assessment Topics
  • Dr. Cornelia S. Orr
  • Office of Assessment
  • Florida Department of Education

Misc. Assessment Topics
  • Senate Bill 1906 Alternative Credit Pilot
  • Senate Bill 1908 Many Initiatives Writing
    Norm-referenced tests Test Prep Transitions to
    New Assessments Testing Schedules End-of-Course
    Assessments Expanded College Readiness Testing
  • Assessment Appropriations
  • MAP Clearinghouse
  • FTCE Fee Increase

Legislative Update SB 1906
  • Senate Bill 1906 Alternative Credit Pilot
  • DOE approve end-of-course assessments and minimum
    passing scores
  • Limited to assessments for Algebra 1a, Algebra
    1b, Algebra 1, Geometry, and Biology
  • Assessments
  • developed by the Florida Virtual School, or
  • end-of-course statewide standardized assessments
    for these courses which may be adopted or
    developed by the department

Senate Bill 1908 Writing
  • SB 1908 Removes MC items beginning 08-09
  • SBE Concurrence (4/15/08) Remove the MC items
    from the FCAT Writing tests and delay its use as
    a graduation requirement.
  • Rationale
  • Budget Reduction Multiple-choice questions do
    not impact our state or federal accountability
  • Technical concerns Inconsistencies in 2007
    between scores on the essay and MC questions,
    making the combination into a single score
    problematic for high stakes student decisions
  • Next Steps
  • Revise SBE Rule 6A-1.09422 to delay FCAT Writing
    graduation requirement
  • Prepare for future implementation of a revised
    writing test
  • Revise pupil progression plans

Senate Bill 1908 Writing
  • Beginning with the 2008-2009 school year, the
    commissioner shall discontinue administration of
    the selected response test items on the
    comprehensive assessments of writing. Beginning
    with the 2012-2013 school year, the comprehensive
    assessments of writing shall be composed of a
    combination of selected-response test items,
    short-response performance tasks, and
    extended-response performance tasks, which shall
    measure a student's content knowledge of writing,
    including, but not limited to, paragraph and
    sentence structure, sentence construction,
    grammar and usage, punctuation, capitalization,
    spelling, parts of speech, verb tense, irregular
    verbs, subject verb agreement, and noun-pronoun

Senate Bill 1908 Other Issues
  • NRT removes the requirement that the statewide
    assessment program include norm-referenced tests
  • Impact on Progression Plans local plan
    revisions needed
  • Reading Retention Rule being revised
  • Corporate Tax Credit Scholarship
  • Test Prep - prohibits suspending regular
    curricula in order to administer practice tests
    or engage in other test-preparation activities
    for a statewide assessment (i.e., FCAT or
    end-of-course assessment). However, schools are
    permitted to
  • Distribute sample tests and answer keys published
    by the Department of Education
  • Provide individualized instruction for students
    who score at Level 1 or Level 2 on the FCAT or
    who are identified through diagnostic assessments
    as having deficiencies in the assessed content
  • Include test-taking strategies in curricula for
    intensive reading and mathematics courses.

Senate Bill 1908 Other Issues
  • Transitions to New Assessments
  • Directs the Commissioner to establish procedures
    for transitioning to new assessments that impact
    the testing requirements for high school
  • Testing Schedules - Beginning in 2010-2011
  • Writing no earlier than the week of March 1 and
    other subjects no earlier than the week of April
  • Statewide end-of-course assessments within the
    last two weeks of a course
  • Student test results reported by the final day of
    the regular school year for students

Senate Bill 1908 Other Issues
  • End-of-Course Exams
  • SB 1908 allows the Commissioner to incorporate
    end-of-course assessments into the statewide
    assessment program
  • Current Plans Include
  • Algebra II Pilot in 2008-09 (Handout)
  • Other State Developed (Handout)
  • Other State Implemented TBD

Senate Bill 1908 Other Issues
  • Expanded Postsecondary Readiness Assessment for
    11th graders
  • Requires the evaluation of the college readiness
    of selected students prior to grade 12, beginning
    with the 2008-2009 school year, based on minimum
    college placement test scores determined by the
  • High schools, to the extent practicable, must
    provide 12th grade students access to remedial
    instruction prior to graduation.
  • Students achieving minimum scores upon exit from
    remedial instruction and enrolling in a community
    college within 2 years, will not be required to
    enroll in remediation courses.

Misc. Assessment Topics
  • Assessment Appropriation Cut 30
  • Less Paper
  • Fewer Products
  • Move to more computer-based testing
  • MAP Clearinghouse
  • Request for Application Clearinghouse
  • Invitation to Bid Item Bank

New Fees for First-time Takers New Fees for First-time Takers New Fees for First-time Takers
  PEd, SAE, or GK   FELE
PBT Regular On time 50 85
PBT Regular Late 50 15 85 30
PBT Regular Emergency 50 125 85 125
PBT Supplemental 50 100 85 100
CBT 50 85
  • January 1, 2009

Current Fees Current Fees Current Fees
  PEd, SAE, or GK   FELE
PBT Regular On time 25 50
PBT Regular Late 25 15 50 30
PBT Regular Emergency 25 125 50 125
PBT Supplemental 25 100 50 100
CBT 25 50
New Fees for Retakes New Fees for Retakes New Fees for Retakes
  PEd, SAE, or GK   FELE
PBT Regular On time 100 100
PBT Regular Late 100 15 100 30
PBT Regular Emergency 100 125 100 125
PBT Supplemental 100 100 100 100
CBT 100 100
Misc. Assessment Topics
  • Questions?

Next-Generation Sunshine State
StandardsAssessments and Interpretive Products
  • Vince Verges
  • Executive Director
  • Test Development Center

  • Test Development Center Staff Changes
  • Reading, Mathematics, Science, and Writing
  • Interpretive Products
  • Content Focus Report 2008
  • Florida Reads! Writes! Solves! Inquires! CD
  • Science Lessons Learned
  • Released Tests
  • Item Specifications for Grades 3-5, 6-8, High
  • Other Assessment News
  • Questions

Staff Changes at the Test Development Center
  • Lissa Cone, FCAT Writing Coordinator
  • Sheila Veatch, FCAT Writing Specialist

Mathematics Standards Update
  • Next Generation Standards
  • Math standards were adopted in September 2007
  • TDC Math Assessment Transition Crosswalk was
    released to district coordinators on June 4th
  • New Assessment Timeline
  • Currently developing items to match the new item
    specifications for the new standards will be
    reviewed by Item Review Committee in fall 2008
    will become field test items for 2010 test
  • 2011 baseline year for new mathematics assessment

High School Mathematics Tests
  • At this time, FDOE is preparing an Algebra I End
    of Course (EOC) test and a Grade 11 Comprehensive
  • Grade 11 test topics may include Algebra topics
    related to number sense, concepts and operations
    Discrete Math Financial Literacy Geometry
    Probability Statistics and Trigonometry. The
    assessed benchmarks would be made available with
    the release of the FCAT Mathematics Test Item
    Specifications to be discussed later in this
    presentation. This test would not include
    performance tasks.
  • Rule changes are being developed to address
    this effort to ensure that students are
    graduating with exposure to rigorous content
    outlined in the Next Generation SSS.

New Science Standards
  • Adopted by State Board February 2008
  • K-8 grade-level standards grouped into four
    Bodies of Knowledge (BOK) which are subdivided
    into Big Ideas
  • High School standards organized by BOK
  • The Nature of Science
  • Earth and Space Science
  • Physical Science
  • Life Science

New Science Standards
  • The Office of Mathematics and Science developed a
    crosswalk showing the transition between the old
    and new benchmarks. Available at
  • The Office of Mathematics and Science in
    conjunction with Florida science educators
    revised the science course descriptions to match
    new standards (draft available at
  • State Board of Education is expected to review
    the proposed descriptions at their October

New Science Assessment Timeline
  • 2010 2011 last year for FCAT Science
  • 2010 2011 field test new items written to new
  • 2011- 2012 baseline (first) year of new
    standards assessment grades 5, 8, and EOC Biology
  • 2012 2013 Standard Setting and reporting of
    achievement levels

High School End-of-Course (EOC) Science Exams
  • At this time the Department is preparing to
    develop EOC for Biology (baseline 2011- 2012) and
    another science (baseline 2012- 2013)

New Science Standards Assessments
  • Grade 5 and 8 Science Assessments will be
  • Grade 5 assessment will have items representing
    benchmarks for grades 3-5
  • Grade 8 assessment will have items representing
    benchmarks for grades 6-8

New Science Standards Assessment
  • Benchmarks are likely to be grouped or clustered
    by content and designated as annually assessed or
    content sampled
  • Florida Standards Content Advisory Committee
    began reviewing and making recommendations for
    assessment of new standards in April (follow up
    meetings are scheduled for September 2008 and
    January 2009)

Released FCAT Science Test
  • 2007 FCAT Science Grade 8 Test and Answer Key
  • Answer Key has percentage of students who
    answered correctly, option statistics for
    multiple-choice items, benchmark and content
    focus information, and the cognitive difficulty
    (cognitive complexity) for each item

Released Student Responses for Grade 8 FCAT
Science 2007 Extended Response Item
  • B131 Golf Ball Energy from 2007 Released FCAT
    Science Test currently on DOE website
  • Scoring criteria (annotations) and student papers
  • Example of a top-score response
  • Three student examples of a 4-point response
  • Three student examples of a 3-point response
  • Three student examples of a 2-point response
  • Three student examples of a 1-point response
  • Two student examples of a 0-point response

Released Student Responses for Grade 8 FCAT
Science 2007 Extended Response Item
  • Will include letter explaining intent and use of
    student responses
  • FCAT Rubric for extended response
  • Reader Bias
  • Item Development and Handscoring Flowcharts
  • To be posted to ww.fass.cecs.ucf.edu Fall 2008

FCAT Explorer
  • FCAT Explorer for grades 5, 8, and 11 are now
    available on DOE website

FCAT Science Lessons Learned
  • A look at student performance on FCAT Science
    2003 2006
  • Purpose is to provide guidance to educators that
    can be used to effect positive change and enhance
    program effectiveness
  • Available in print late fall 2008

FCAT Science Lessons Learned
  • Includes Results by Cluster
  • Mean percent correct for each reporting cluster
    for each year (2003 2006)
  • Observations and information on what students are
    successful are able to do and what students have
    the greatest difficulty doing
  • Sample items and performance statistics
  • Suggestions for instruction

Language Arts Social Studies Standards Update
  • Next Generation SSS Standards
  • Language Arts standards will be revised again
  • SB 1908 states that plan for accomplishing this
    should be in place by Dec. 31, 2008
  • Social Studies standards will be revised
  • At this time there is no plan for an FCAT in
    Social Studies

Language Arts Sunshine State Standards
  • December 31, 2008- Review and establish an
    expedited schedule for adoption of the Next
    Generation Sunshine State Standards.

Sunshine State Standards . . .
  • Specific requirements are prescribed for language
    arts, science, mathematics, and social studies
  • December 31, 2011 The Next Generation Sunshine
    State Standards must be adopted for each subject
    by the State Board of Education.
  • Language Arts standards that were adopted in 2007
    must be reviewed and must identify significant
    literary genres and authors that encompass a
    comprehensive range of historical periods.

New Tests in Reading
  • Last FCAT Reading Test - 2010
  • Field Test new benchmarks - 2010
  • New Assessment in Reading - 2011
  • Performance tasks at grades 4, 8, 9.No
    Performance Tasks (PTs) at grade 10
  • Retakes remain the same, no PTs

Proposed Graduation Progression
08-09 09-10 10-11 11-12 12-13 13-14
FCAT Only 9th 10th 11th 12th
FCAT/ New Test 9th 10th 11th 12th
New Test Only 9th 10th 11th 12th
Requirements for Grade 10, 2011 passing scores
are still TBD. In Grade 11, the 2013 cohort
would need to take an FCAT Retake because no
Retake would exist for the new assessment yet. A
policy for the Grade 12 students might include
offering FCAT or new test retake.
Writing Update
  • Presently, writing as a graduation requirement
    has been delayed indefinitely.
  • Writing test multiple-choice items will be
    removed from test beginning in 2008-2009 due to
    budget and concerns over year-to-year linking of
    MC and essays in the current design.
  • New Writing Assessment in 2012-2013 will have MC,
    SR, and ER items in a way that provides stable
  • New Writing Assessment will move to grades 4, 7,
    and 11
  • Grades 7 and 11 are intended to be
    computer-based tests

When will FCAT Writing be administered?
  • Field Test December 2-3, 2008
  • Census Test February 10-12, 2009
  • Tests will be given using unsealed Writing
    folders to avoid scanning errors

Writing Lessons Learned
  • FCAT Writing Lessons Learned 2001-2008 Data
    Analyses and Instructional Implications
  • Scheduled for delivery to districts in December
  • PDF file posted To FDOE website after ADA
    compliance requirements - districts will be
    notified when it is available

Florida Reads!, Writes!, Solves!, Inquires! CD
  • Delivered to Districts in July
  • Packaged and labeled for each school
  • Contains the released performance task for each
    grade and each subject
  • Includes general information about scoring, the
    FCAT rubrics, the actual test item, an example of
    a top-score response, anchor papers,
    qualification papers, and annotations (scoring

Test Item Specifications
  • Appendix B for Reading and Mathematics to be
    released this Fall
  • Spring release of Next-Generation Assessments
    Reading and Math Test Item Specifications after
    2009 testing

2008 FCAT Content Focus Report
  • Now available on the DOE website
  • Has the benchmarks and content focus for each
    item that counted towards student scores on the
    2008 FCAT
  • Has total points for each reporting
  • Identifies the benchmarks that had performance
  • Reading, Mathematics, Writing have old to new
    benchmarks crosswalks

2009 Sample Test Materials
  • Reading, Mathematics, and Science Reprints of
    08 materials
  • No Writing STM
  • Shipments to districts in early Nov. 08
  • Per Legislature, delivery to schools should be
    after Jan. 1, 2009
  • PDFs posted to DOE website in Jan. 09

Print Materials Delivery Times
  • Keys to FCAT
  • Print delivery and web posting mid-Jan. 09
  • Understanding FCAT Reports
  • Print delivery and web posting late April 09

FCAT Results Folder
  • Reduced quantities
  • Distribution
  • Grade 3 students
  • Overage for mobility
  • Delivery early May 09

Projected Product Delivery Timeframes
Projected Product Delivery Timeframes Projected Product Delivery Timeframes Projected Product Delivery Timeframes
Product Due in District Posted to Web
Science Lessons Learned Early Nov. 08 Sept. 08
2009 Sample Test Materials Early Nov. 08 Jan. 09
Keys to FCAT 2009 Mid-Jan. 09 Mid-Jan. 09
Understanding FCAT Reports Late April 09 Late April 09
Results Folder Early May 09 Not posted
Math Test Item Specifications May 09 May 09
Reading Test Item Specifications May 09 May 09
09 FRWSI CD Late July 09 Not posted
DOE is going green!
  • FCAT contractors already use eco-friendly
    production methods.
  • DOE is now actively promoting recycling.
  • Florida Recycles logo and
  • statement will appear on non-secure FCAT
  • Support the effort in your district!

FCAT Interpretive ProductsOn the Web
website www.fcat.fldoe.org
DOE website www.fldoe.org
FCAT 2009 NonscannableTest Book Covers
FCAT 2009 NonscannableTest Book Covers
FCAT 2009 NonscannableTest Book Covers
FCAT Interpretive ProductsContact Information
Trish Lyons Publications Coordinator (850)
922-2584 ext. 227 SunCom 292-2584 ext. 227
Other Contact Information
  • Lyla Springfield, FCAT Reading Coordinatorspringf
  • Steve Ash, FCAT Mathematics Coordinator
  • Renn Edenfield, Interim FCAT Writing Coordinator
  • Linda Oravetz, FCAT Science Coordinator
  • Vince Verges, Executive Director Test
    Development Center vergesv_at_mail.leon.k12.fl.us

Florida Alternate AssessmentDistrict Assessment
Coordinators Mtg. September 3, 2008
Inspirational Quote
The human brain starts working the moment you are
born and never stops until you stand up to speak
in public. George Jessel
2008 Standard Setting
Initial Standard Setting
  • April 7-11
  • Field test data
  • 14 standard setting panels
  • Panels of special educators, general educators,
    administrators and parents
  • Alternate achievement standards set for all grade
    levels and content areas

Initial Standard Setting
  • Using descriptors of Levels of Complexity and
    Performance Level Descriptors
  • Panelists set cuts for Levels of Complexity (LOC)
  • Panelists set Performance Level cuts within each
    of the LOCs

Standard Setting
What are the Performance Levels?
  • Basic Students at the basic performance level
    have little success with the challenging access
  • Proficient Students at the proficient level are
    having some success mastering the access points
  • Advanced Students at the advanced level are very
    successful with the access points
  • At each grade level and content area these are
    tied to specific access points measured on the

Standard Setting Validation
  • July 15-18
  • Operational test data
  • Same procedures
  • Panelists set Performance Level cuts within each
    of the LOCs
  • Preliminary results under review

Standard Setting - Next Steps
  • State Board Rule under development
  • Establishes the cut scores
  • Out for comment in the Fall
  • Revision to performance level descriptors and
    labels based on feedback from standard setting
    and Technical Advisory Committee

2008 Results
Spring 2008 Administration
  • 27,683 answer sheets scanned
  • 3,616 not assessed for various reasons
  • 734 duplicates or invalid bubble
  • 126 cannot be scored in any content area
  • 23,207 students have at least one valid content

Spring 2008 Administration
  • Invalid Records
  • Incomplete scoring within a content area
  • Double bubbles
  • Grade level and content area mismatch
  • Invalid bubble filled in on document

Spring 2008 Administration
  • Districts Received
  • Individual student reports
  • School reports
  • District reports

Student and Parent Report
Student and Parent Report
Alternate Assessment Reading Participation
Alternate Assessment Reading Proficiency
Alternate Assessment Math Participation
Alternate Assessment Math Proficiency
Students with Disabilities Taking the Alternate
Spring 2008 - 1 Cap
  • Calculation
  • Numerator Number of SWD reported as proficient
    or advanced on Florida Alternate Assessment in
    grades 3-10
  • Denominator Number of students participating in
    an assessment in grades 3-10
  • Calculated separately for reading and mathematics
  • Calculated at the district level

Spring 2008 - 1 Cap
  • Decision Rules
  • If district exceeds cap, students with a primary
    exceptionality of specific learning disability
    and no other exceptionalities are reverted to
  • Calculations are re-run
  • If district still exceeds the cap, they may apply
    for a waiver

Spring 2008 - 1 Cap
  • Waiver consideration is given to districts who
    submit data in support of the following
  • House multi-district programs for students with
    significant cognitive disabilities
  • Are very small, such that a slight change in
    number of students produces a large change in

Spring 2008 - 1 Cap
  • Waiver consideration is given to districts who
    submit data in support of the following
  • House high-quality, research based programs for
    students with significant cognitive disabilities
    that attract families from around the state and

Spring 2009 - 1 Cap
  • Districts will need to submit waiver requests by
    May 15, 2009
  • Decisions about waiver requests will be made
    prior to final AYP calculations

Inspirational Quote
The more things change, the more they remain...
insane. Michael Fry and T. Lewis
2008-2009 Activities
  • June 23 24
  • Provided updated materials and information
  • Reading fluency items
  • Renaming of materials
  • Test book wording Teacher will script
  • Four field test items per content area

Content/Bias Review
  • June 25 26
  • Approximately 120 participants
  • Panelists include content expects (general and
    special education teachers, and administrators
  • New item review
  • Eight items per grade in Reading, Mathematics,
    and Writing
  • Twenty-five Items for Science based on newly
    approved standards

Item Specs for New Development
  • Reading
  • Readability not to exceed 3 years below tested
    grade maximum is 6th grade
  • Addition of Reading fluency strand
  • Elementary letter and word identification
  • Secondary range from reading sentences to one
    to two paragraphs

  • Accommodations Workgroup
  • Met via conference call on August 13
  • Approximately 25 special education teachers and
    administrators participated in one of three
    conference calls
  • Developed recommendations for additional
    accommodations for VI, DHH, ASD, MH and ELL

Web-Base Ordering
  • Available through Piedra Data Services website
  • Braille and tactile graphics for students with
    visual impairments
  • One sided response booklets
  • One sided materials will allow teachers to cut
    out items to have flexibility in item placement

Web-Base Ordering
  • Available September 4-17, 2008
  • http//www.piedradata.com/VIS/Login.php

Practice Materials
  • Released items from Spring 2008 administration
  • Delivery to school district alternate assessment
    coordinators week of September 8th
  • Includes two items per content area and grade

Practice Materials
  • All grades and content areas packaged together
  • Test Booklet
  • Response Booklet
  • Passage Booklet
  • Cards Packet
  • Strips Packet

Administration Manuals
  • Teacher administration manuals will be delivered
    along with practice materials to school district
    alternate assessment coordinators
  • Teachers should keep their binders and replace

Science Field Test
  • Administration window October 13 24
  • Demographics for student participation e-mailed
    to AA Coordinators in July
  • 25 new items based on approved Sunshine State
    Standards Access Points

2009 Assessment
  • Administration Window
  • January 12 through February 27
  • Assessment now has two forms (Form A and B)
  • Each form will have 16 core items and four
    embedded field test items per content area for a
    total of 20 items

Project to Support Instruction
  • Discretionary project to support teachers in
    curriculum/instruction and support implementation
    of alternate assessment
  • Steering committee met in July to identify and
    prioritize needs
  • National Inclusive Large Scale Standards and
    Assessment (ILSSA) Project assisting us

Inspirational Quote
I am easily satisfied with the very best. Winston
Peer Review Status
Peer Review
  • July, 2008 submission
  • Results from April standard setting
  • Individual, school, and district reports
  • Planned studies
  • Waiting for response letter

Peer Review
  • Plan for December, 2008 submission
  • Final standard setting results and cut scores
  • Technical Manual
  • Alignment study report

Peer Review
  • Planned studies
  • Alignment Fall 2008
  • UNC Charlotte Links to Academic Learning Model
  • Reliability - Spring 2009
  • Videotapes of 2009 administrations independently
  • Classroom walk through tool development
  • Validity Spring 2009
  • Teacher judgment and assessment performance

Inspirational quote
Not a shred of evidence exists in favor of the
idea that life is serious. Brendan Gill
Thank youBambi Lockman, Bureau ChiefBureau of
Exceptional Education and Student Services
  • Those districts participating in NAEP 2009 need
    to pick up their Resource Binders at the
    registration counter during the lunch break.

Scoring and Reporting
  • Jackie Mueller
  • Director

Data about the 2008 FCAT tests
  • Number of students with test scores reported
  • 1.77 million
  • Number of individual tests scored and reported
  • SSS - 4.4 million
  • NRT - 3.1 million
  • Number of Spring 2008 Retake students passing
    after manual rescore process completed
  • 3 Reading and 20 Math
  • Summer 2008 4 Math

Data Verification Processes
  • Validation of scoring
  • Analyzing data to detect scoring anomalies.
  • We spend a large amount of our time trying to
    chase down correct information for a small
    portion of the students who tested
  • Resolving duplicate testers
  • Virtual School Students in correct schools
  • Correcting SIDs

Common Test Administration Problems
  • Examples
  • Use of label with incorrect grade information gt
    Off-grade level testing flag - Score Reported
    Flag of 7
  • Incorrect use of label with hand-gridded
    information for different studentgt duplicate
    records Score Reported Flag of 6
  • Missing or incomplete hand-griddinggt missing
    SID, Name, Grade, other important information
  • Testing in two separate documents gt Does not
    meet attemptedness - Score Reported Flag of 2
  • Missing test group code information gt May
    require holding more students than necessary for
    investigations if this is missing

Fair Warning We are Trying to Reduce Time
until Reporting
  • Off-Grade Level Testers NR7 In years past we
    have attempted to clean these up prior to
    reporting. We can no longer commit to trying to
    do that. It will be up to districts to check to
    see whether these students really tested in the
    correct grade level and should be reported. This
    should be one thing you check as soon as you
    receive your DSR.
  • Example from this year We attempted to have
    districts supply missing SIDs when the SIDs were
    completely blank. This netted in our attempting
    to update about 7,700 SIDs. We will not be doing
    this again. Due diligence on the part of
    districts should be able to minimize this
    problem. We will check into whether we may be
    able to give districts early warning about which
    students have missing SIDs so they can be ready
    to update the accountability files.

  • Posting DSR files to Navigator
  • Posting summary files to Navigator
  • Posting .pdf files of reports
  • Printing limited to
  • Individual Student Reports
  • School Lists of Students
  • Grade 10 and Retake Results Labels
  • Certificates of Achievement

Fall 2009 Retake
  • Results Delivery Target
  • November 21, 2008
  • Due in District (DID) November 26, 2008

2009 Reporting Targets
  • Results Delivery Targets
  • Writing
  • May 7, 2009 and DID May 14, 2009
  • Spring Retakes
  • May 7, 2009 and DID May 14, 2009
  • Reading and Mathematics Grade 3
  • May 18, 2009 and DID May 26, 2009
  • Reading and Mathematics Grades 4-10
  • May 29, 2009 and DID June 05, 2009
  • Science Grades 5, 8, and 11
  • May 29, 2009 and DID June 5, 2009

Scoring and Reporting Issues
  • New Demographic Websitehttps//app1.fldoe.org/FCA
  • Beginning with three years of data
  • Will eventually expand to cover years 2000-2008
  • Similar features to the old website
  • Old website http//www.fcatresults.com/demog/
    will be active until November 2008
  • Years 2000-2007

New Demographic Website
New Demographic Web site Screen Shots
New Demographic Web site Screen Shots
New Demographic Web site Screen Shots
New Demographic Web site Screen Shots
New Demographic Web site Screen Shots
New Demographic Web site Screen Shots
New Demographic Web site Screen Shots
New Demographic Web site Screen Shots
New Demographic Web site Screen Shots
New Demographic Web site Screen Shots
New Demographic Web site Screen Shots
New Demographic Web site Screen Shots
New Demographic Web site Screen Shots
New Demographic Web site Screen Shots
New Demographic Web site Screen Shots
Contact Information
  • Jackie Mueller, Director
  • Jackie.Mueller_at_fldoe.org
  • 850-245-0775
  • Mario Zuniga, Supervisor
  • Mario.Zuniga_at_fldoe.org
  • 850-245-9059

FCAT Scoring Inquiry System
  • Mario Zuniga
  • Supervisor

  • FCAT Scoring Inquiry System TA Paper (Draft)
  • Types of Score Inquiries
  • Score Anomalies (Desk Audits)
  • Not Reported Scores
  • Missing Scores
  • Procedures for Submitting Score Inquiries
  • New Web-Based System
  • Implementation Time-Line
  • Screen Shots of System
  • Contact Information

Technical Assistance Paper
  • Types of Score Inquiries
  • Score Anomalies (Desk Audits)
  • Is poor performance by itself an anomaly?
  • Criteria for automatic audit and manual rescoring
    of Retake scores
  • Within 25 scale score points of passing
  • Anomalies are red flags based on previous student
    trends or large difference in performance
    compared to other measures
  • May represent a bad assessment day for the
  • Investigated by staff to eliminate possible
    scoring errors or student bubbling errors

Technical Assistance Paper
  • Types of Score Inquiries (continued)
  • Not Reported (NR) Scores
  • RMS Codes on Individual Student Report
  • NR2 Did not meet attemptedness
  • NR3 Marked as Do Not Score
  • NR6 Recorded as duplicate record
  • NR7 Grade mismatch
  • NR8 Invalidated/held by FDOE for further review
  • Writing Codes on Individual Student Report
  • A Blank answer document
  • B Off-topic
  • C Illegible, Incomprehensible, or Insufficient
  • D Foreign Language
  • U Response Unscorable

Technical Assistance Paper
  • Types of Score Inquiries (continued)
  • Missing Scores
  • Student is shown as present on the schools
    attendance record but is shown as Not Tested
    (NT), or is not shown at all, on score reports
  • Procedures for Submitting Score Inquiries
  • Score inquiries should not be submitted for Not
    Reported scores
  • Score inquiry submission deadlines established
    for each administration
  • Score audits require additional documentation

New Web Based System
  • System Walk-Through Ongoing
  • FDOE Review
  • District/Contractor Beta-Test
  • Roll-Out Timeline
  • Goal is to have this system available for the
    Fall 08 Retake administration
  • Sept/Oct Beta Test
  • Early Nov Final Design Approved
  • Late Nov
  • Districts provided User ID/Passwords
  • System live by November 26, 2008

New Web Based System
  • Benefits
  • Available through secure FDOE web site
  • System tracks inquiry FDOE and Contractor
    response time
  • Auto-assigned tracking number
  • Real-time status check available to districts
  • Individual or batch submissions available
  • Score audit documentation kept on file at
    district level
  • Auto-assigned to FDOE specialist
  • Eliminates FAX handling and manual tracking
  • Risks
  • Resistance to change
  • Score audit documentation filed in the district
  • User ID/Password security

Screen Shots of Web Based System
  • Logon Screen
  • Email address for user name
  • User reset password
  • One logon per district

Screen Shots of Web Based System
  • Main Menu for District Use

Screen Shots of Web Based System
  • Main Menu for District Use

Screen Shots of Web Based System
  • Contact Information Form
  • Maintain District Coordinator of Assessment
    Contact Information
  • Potential to Update other FDOE Rosters from
    this Information

Screen Shots of Web Based System
  • Main Menu for District Use

Screen Shots of Web Based System
  • K-12 Missing Score/Desk Audit Inquiry

Drop Down Menus
Screen Shots of Web Based System
  • Main Menu for District Use

Screen Shots of Web Based System
  • Submit a Batch File of Inquiries

Excel Files Only File Format will be provided.
Screen Shots of Web Based System
  • Main Menu for District Use

Screen Shots of Web Based System
  • Track status of submitted inquiries

Screen Shots of Web Based System
  • Track status of submitted inquiries

Sort on any column
Screen Shots of Web Based System
  • Track status of submitted inquiries

Email to request a correction
Screen Shots of Web Based System
  • Track status of submitted inquiries

Automatic reference to the student record log
Screen Shots of Web Based System
  • Track status of submitted inquiries

Screen Shots of Web Based System
  • Main Menu for District Use

Screen Shots of Web Based System
  • On the FDOE and Contractor Side

Contact Information
  • If you have any questions, please contact
  • Mario Zuniga
  • mario.zuniga_at_fldoe.org
  • 850-245-9059
  • Bernard Stevens
  • bernard.stevens_at_fldoe.org
  • 850-245-0778

Florida Parent Network
  • District Coordinators Meeting
  • Orlando, Florida
  • September 3, 2008

  • FCAT Parent Network Overview
  • Statistics
  • Release Schedule
  • Login Letters
  • Release of Results
  • Non PreID Process

FCAT Parent Network Overview
  • Started in Spring 2006 allows secure online
    access to FCAT results for Florida parents
  • Subjects Reading, Mathematics, Science, Writing,
    R/M Retakes
  • Individual secure logins generated for all tested
    students for each test administration
  • Results available in HTML and PDF format
  • State Resources
  • FAQs in English, Spanish and Haitian-Creole

  • 14 releases of data to date
  • From March 2006 to present
  • More than 6 million visits
  • More than 158 million hits
  • Spring and Summer 2008 so far
  • More than 2.3 million visits
  • More than 61 million hits
  • Most active date 6/12/08 5,297,211 hits

Spring and Summer 2008
Home Page
  • Updated when new results are available
  • Expected release dates
  • Available until dates
  • English, Spanish Haitian Creole

Results Page
  • Overview of Results
  • Scale Score
  • Performance Level
  • Standard Error Measure
  • PDF of Student Report
  • Copy of ISR that will be received in print
  • Separate tab for each test
  • Reading Mathematics
  • Writing (when applicable)
  • Science (when applicable)
  • Retakes (when applicable)

Release Overview
  • Step 1 Login Letters
  • 2-3 weeks prior to release for fall and Spring
  • 1-2 weeks prior to testing for summer
  • Step 2 Release of Results
  • 48 hours after release of results to districts
    and schools
  • Step 3 Non PreID Logins
  • Available on Navigator site by the day of the
    results release

Step 1 Login Letters
  • 2-3 weeks prior to release for Fall and Spring
  • 1-2 weeks prior to testing for Summer
  • Shipment includes
  • District Coordinator Letter
  • Principal Letter
  • Login Lists for each school (PDF also available
    on Navigator)
  • Sample Parent Letter
  • Parent Letter with unique login and password for
    each student in the PreID file
  • Login Page updated with expected data release
  • New logins activated and parents receive a
    message indicating that results are not yet

Step 2 Release of Results
  • 48 hours after release of results to districts
    and schools
  • Home Page updated to state that results are now
    available and expected timeframe for next release
  • Results available at the same time for all
    students in the state (PreID and Non PreID)
  • Results from previous administration (Fall,
    Spring, Summer) no longer available home page
    includes expected to be available until dates

Step 3 Non PreID Logins
  • Available on Navigator site the day of the
    results release
  • PDF lists of logins and passwords provided for
    district and school access to be distributed to
    parents (includes 5 of students across the
  • Includes all students who do not have results in
    the data file associated with a PreID label
    (generated from final approved data file)
  • Students not enrolled at the time of PreID
  • Students who were in PreID, but label did not get
  • Students who were in PreID, but student moved to
    a new school or district prior to testing
  • Students will receive a separate login for each
    subject that they did not have a PreID
    indicated in the data file
  • Allows all students in the state to access their
    results on Parent Network

Navigator Website
  • PDFs of Reports
  • State Report of Districts (districts only)
  • District Report of Schools
  • School Report of Students
  • District Summary
  • PDF Copies of Parent Network PreID Login Lists
  • Ex. Summer 08 Parent Network PreID Logins
  • Ex. Summer 08 Parent network Non-PreID Logins
  • PDFs of Non PreID Login Lists

Grow Customer Support
  • support_at_grow.net
  • 1-800- 481-GROW

Customer Support Rep, Miranda
National Assessment of Educational Progress
(NAEP) 2009 Assessments
District Assessment Coordinator Annual
Meeting September 2008
Michele Sonnenfeld NAEP State Coordinator Florida
Department of Education
State-Level NAEP Administrations in Florida
  Gr 4 Reading Gr 8 Reading Gr 4 Math Gr 8 Math Gr 4 Science Gr 8 Science Gr 4 Writing Gr 8 Writing Gr 12 Reading and Math
1998 X X           X  
2002 X X         X X  
2003 X X X X     X X  
2005 X X X X X X      
2007 X X X X       X  
2009 X X X X X X     X
  • In 2009, Florida will also be participating in
  • Internet Computer Tasks (ICT)
  • Hands-on Tasks in Science (HOTS)
  • High School Transcript Study (HSTS)
  • Miami-Dade will receive results as part of the
    Trial Urban District Assessment (TUDA).

NAEP Special Studies for 2009
  • Interactive Computer Tasks (ICT)-Westat will
    provide 15 laptop computers and flash drives
  • Hands on Tasks (HOTS)-Westat provides kits that
    students will use in performing experiments
  • High School Transcript Study (HSTS)
  • Florida is the only state that will participate
    electronicallyno burden to the schools

NAEP 2009 Assessments
  • Grade 12 Assessment
  • In 2009, NAEP will administer a Grade 12 Pilot
    assessment in 11 states, including Florida, that
    were chosen to participate. This will be the
    first time state results will be available for
    Grade 12 in reading and mathematics.
  • Florida will be able to compare its Grade 12
    reading and mathematics scores with those of
    Idaho, South Dakota, Iowa, Illinois, Arkansas,
    West Virginia, New Jersey, Massachusetts,
    Connecticut, and New Hampshire.

NAEP 2009 Assessments
  • Trial Urban District Assessment (TUDA)
  • TUDA is designed to report on the performance of
    Grades 4 and 8 public school students at the
    district level
  • 2002 Atlanta, Chicago, Houston, Los Angeles,
    New York City
  • 2003 added Boston, Charlotte, Cleveland, San
  • 2005 added Austin
  • 2009 added Baltimore, Detroit, Fresno,
    Louisville, MIAMI-DADE, Milwaukee, and
  • Washington, D.C. is also included as a TUDA

NAEP 2009Assessment Components
  • Assessment Window January 26 March 4, 2009
  • Subjects to be Assessed
  • Grades 4, 8, and 12 Reading, Mathematics, or
  • Grades 4, 8, and 12 Science Interactive
    Computer Tasks (ICT) or Hands-on Tasks (HOTs)
  • Grades 4, 8, and 12 U.S. History, Civics, or
  • FLDOE will not select schools chosen for NAEP to
    be calibration schools for the FCAT

Contact Information
Contact Information
Michele Sonnenfeld NAEP State Coordinator Florida
Department of Education (850) 245-0787 Michele.Son
National Assessment of Educational Progress
(NAEP) 2009 Assessments
Selected District Assessment Coordinators
September 2008
Michele Sonnenfeld NAEP State Coordinator Florida
Department of Education
NAEP 2009 Assessment Components
  • Assessment Window January 26 March 4, 2009
  • Subjects to be Assessed
  • Grades 4, 8, and 12 Reading, Mathematics, or
  • Grades 4, 8, and 12 Science Interactive
    Computer Tasks (ICT) or Hands-on Tasks (HOTs) (31
  • Grades 4, 8, and 12 U.S. History, Civics, or
  • Most selected schools will participate in the
    Reading, Mathematics, or Science assessments. In
    Florida, 47 schools will also participate in the
    U.S. History, Civics, or Geography assessments.

Prior to the NAEP Assessment
  • You were notified in July of the schools in your
    district that have been selected to parti
About PowerShow.com