A1258150171zFUcJ - PowerPoint PPT Presentation

1 / 201
About This Presentation
Title:

A1258150171zFUcJ

Description:

Senate Bill 1906 Alternative Credit Pilot Program. Senate Bill 1908 Many Initiatives: Writing ; Norm-referenced tests; Test Prep; ... – PowerPoint PPT presentation

Number of Views:11360
Avg rating:3.0/5.0
Slides: 202
Provided by: daphne3
Category:

less

Transcript and Presenter's Notes

Title: A1258150171zFUcJ


1
WELCOME!
2
K-12 ASSESSMENT
  • Victoria Ash
  • Victoria.Ash_at_fldoe.org
  • (850) 245-0788

3
K-12 ADMINISTRATION
4
K-12 Assessment Link
  • K-12 Assessment and General Information are
    available online at
  • www.fldoe.org/asp/

5
Communication
FCAT Contractors Contact List
6
Communication
  • Emails filtered through Leads
  • DOE
  • Victoria Ash Bureau Chief
  • Jackie Mueller Director, Scoring and Reporting
  • Lynn Ann Tabeling End-of-Course
  • Daphne Csonka Administration
  • Mario Zuniga Scoring and Reporting
  • TDC
  • Vince Verges Director
  • Steve Ash Mathematics
  • Lyla Springfield Reading
  • Linda Oravetz Science
  • Trish Lyons Interpretive Products

7
Assessment Schedules
  • 2008-09 and 2009-10 FCAT Schedules
  • 2008-09 Assessment Calendar
  • Updates
  • 2008-09 FCAT Schedule
  • Test Dates
  • March 10 19
  • March 3 12 (Optional Schedule)
  • Notification Deadline to the Department
    September 15
  • Kira.Sullivan_at_fldoe.org
  • Grade 11 Science
  • Day 1, Day 2, Day 3, Day 4, or Day 5
  • Must be a DISTRICT (not a school-by-school)
    decision
  • Notification Deadline to the Department
    September 15
  • Kira.Sullivan_at_fldoe.org
  • Test Materials Shipment and Pickup Schedule

8
Whats New for 2008-09
  • Recycling
  • Current Strategies
  • Recycling versus Reuse

9
Whats New for 2008-09
  • No NRT administration
  • No computer-based Retake
  • High School Competency Test (HSCT)
  • No contract for 2009 administration
  • FCAT Retake administrations
  • Concordant Study in progress

10
Whats New for 2008-09
  • FCAT Writing
  • NO multiple-choice sessions at any grade level
  • Unsealed four-page folder
  • No test group codes for the 2009 Writing
    administration
  • Planning Sheets

11
Whats New for 2008-09
  • FCAT Reading, Mathematics, and Science
  • Test group codes on ALL answer documents,
    including Grades 3 and 4
  • RETAKE PreID Labels
  • One Reading Retake set
  • One Mathematics Retake set
  • No PINK Return Labels for Science
  • All TO BE SCORED documents will be packaged with
    RED, PEACH, or BLUE return labels.

12
Whats New for 2008-09
13
Reminders
  • Electronic Devices
  • Testing Guidelines
  • If a student starts a test and leaves campus
    without finishing (for an appointment, illness,
    etc.), he or she will NOT be allowed to complete
    the test.
  • NO EXCEPTIONS will be made once the student
    leaves the campus therefore, if you have
    concerns about a student, you should not allow
    the student to begin.
  • Consider administering the test to that student
    on one of the make-up days.
  • Use ALL of the allotted time in each session.
  • Test administrators must NOT administer the FCAT
    to their family members.

14
Reminders
  • Students to be Tested
  • All students enrolled in Grades 3 11
  • Certificate of Completion Students
  • Home Education Program Students
  • Students MAY participate in the FCAT
    administration if their parent or guardian has
    identified the FCAT as the selected measure of
    their childs annual progress.
  • McKay Scholarship Program Students
  • Students enrolled in PRIVATE schools MAY
    participate.
  • Students enrolled in PUBLIC schools ARE REQUIRED
    to participate in statewide assessments as
    outlined in their IEPs.
  • Corporate Tax Credit (CTC) Scholarship Program
    Students
  • A private school student enrolled in the CTC
    Scholarship Program MAY participate in the
    statewide assessments.
  • A parent/guardian is responsible for contacting
    the district to register the student for the
    selected assessments and for transporting the
    student to and from the district-assigned
    location.

15
Reminders
  • Students to be Tested (continued)
  • Florida K-8 Virtual School Program Students
  • Connections Academy and Florida Virtual Academy
  • Do not confuse these students with Home Education
    Program students or high school students enrolled
    in classes with the Florida Virtual School.
  • English Language Learners (ELLs)
  • ALL ELLs are expected to participate in FCAT
    Reading and Writing however, if an ELL has been
    receiving services for one year or less AND the
    LEP committee determines that it is appropriate,
    the student may be exempt but must participate in
    an alternate assessment.
  • ALL ELLs are expected to participate in the FCAT
    Mathematics and Science tests no matter how long
    these students have been receiving services.

16
Forms
  • Forms located at www.ctb.com/fcat
  • Comment FormsEnsure that the online comment
    forms are reviewed BEFORE testing so that
    feedback will address the concerns of the FDOE
    and the contractor.
  • Test Administrator
  • School Coordinator
  • District Coordinator
  • Required Administration Information
  • Missing Materials
  • Administration Irregularities and Breaches

17
PSAT and PLAN
  • Florida Statute 1007.35(5)
  • Pre-college entrance examinations for enrolled
    Grade 10 students in public high schools
  • Test Dates
  • PSAT October 15 and 18, 2008
  • PLAN September to December, 2008
  • Contacts
  • PSAT Jesus Jara, The College Board, (850)
    521-4909
  • PLAN Jacque Twiggs, ACT-Atlanta, (404) 231-1952
  • Jenine Brewer, (850) 878-2729
  • Broward, Dade, Duval, Hernando, Hillsborough,
    Manatee, Orange, Palm Beach, Pasco, Pinellas
  • Ginger Green, (850) 878-2729
  • All other districts

18
Comprehensive English Language Learning
Assessment
  • CELLA Test Dates
  • April 14 May 15
  • ContactsAcademic Achievement through Language
    Acquisition
  • Mark Drennan (850) 245-0893
  • Pat Faircloth (850) 245-0885

19
K-12 Test AdministrationContact List
  • Daphne Csonka, Supervisor (850) 245-9203
  • Tamika Brinson, FCAT(850) 245-0786
  • Susie Lee, FCAT(850) 245-0785
  • Linda Rhea, FCAT ESE(850) 245-0742
  • Kira Sullivan, FCAT, PSAT/PLAN(850) 245-0784

20
Misc. Assessment Topics
  • Dr. Cornelia S. Orr
  • Office of Assessment
  • Florida Department of Education

21
Misc. Assessment Topics
  • Senate Bill 1906 Alternative Credit Pilot
    Program
  • Senate Bill 1908 Many Initiatives Writing
    Norm-referenced tests Test Prep Transitions to
    New Assessments Testing Schedules End-of-Course
    Assessments Expanded College Readiness Testing
  • Assessment Appropriations
  • MAP Clearinghouse
  • FTCE Fee Increase

22
Legislative Update SB 1906
  • Senate Bill 1906 Alternative Credit Pilot
    Program
  • DOE approve end-of-course assessments and minimum
    passing scores
  • Limited to assessments for Algebra 1a, Algebra
    1b, Algebra 1, Geometry, and Biology
  • Assessments
  • developed by the Florida Virtual School, or
  • end-of-course statewide standardized assessments
    for these courses which may be adopted or
    developed by the department

23
Senate Bill 1908 Writing
  • SB 1908 Removes MC items beginning 08-09
  • SBE Concurrence (4/15/08) Remove the MC items
    from the FCAT Writing tests and delay its use as
    a graduation requirement.
  • Rationale
  • Budget Reduction Multiple-choice questions do
    not impact our state or federal accountability
    systems.
  • Technical concerns Inconsistencies in 2007
    between scores on the essay and MC questions,
    making the combination into a single score
    problematic for high stakes student decisions
    (10th).
  • Next Steps
  • Revise SBE Rule 6A-1.09422 to delay FCAT Writing
    graduation requirement
  • Prepare for future implementation of a revised
    writing test
  • Revise pupil progression plans

24
Senate Bill 1908 Writing
  • Beginning with the 2008-2009 school year, the
    commissioner shall discontinue administration of
    the selected response test items on the
    comprehensive assessments of writing. Beginning
    with the 2012-2013 school year, the comprehensive
    assessments of writing shall be composed of a
    combination of selected-response test items,
    short-response performance tasks, and
    extended-response performance tasks, which shall
    measure a student's content knowledge of writing,
    including, but not limited to, paragraph and
    sentence structure, sentence construction,
    grammar and usage, punctuation, capitalization,
    spelling, parts of speech, verb tense, irregular
    verbs, subject verb agreement, and noun-pronoun
    agreement.

25
Senate Bill 1908 Other Issues
  • NRT removes the requirement that the statewide
    assessment program include norm-referenced tests
  • Impact on Progression Plans local plan
    revisions needed
  • Reading Retention Rule being revised
  • Corporate Tax Credit Scholarship
  • Test Prep - prohibits suspending regular
    curricula in order to administer practice tests
    or engage in other test-preparation activities
    for a statewide assessment (i.e., FCAT or
    end-of-course assessment). However, schools are
    permitted to
  • Distribute sample tests and answer keys published
    by the Department of Education
  • Provide individualized instruction for students
    who score at Level 1 or Level 2 on the FCAT or
    who are identified through diagnostic assessments
    as having deficiencies in the assessed content
    and
  • Include test-taking strategies in curricula for
    intensive reading and mathematics courses.

26
Senate Bill 1908 Other Issues
  • Transitions to New Assessments
  • Directs the Commissioner to establish procedures
    for transitioning to new assessments that impact
    the testing requirements for high school
    graduation
  • Testing Schedules - Beginning in 2010-2011
  • Writing no earlier than the week of March 1 and
    other subjects no earlier than the week of April
    15
  • Statewide end-of-course assessments within the
    last two weeks of a course
  • Student test results reported by the final day of
    the regular school year for students

27
Senate Bill 1908 Other Issues
  • End-of-Course Exams
  • SB 1908 allows the Commissioner to incorporate
    end-of-course assessments into the statewide
    assessment program
  • Current Plans Include
  • Algebra II Pilot in 2008-09 (Handout)
  • Other State Developed (Handout)
  • Other State Implemented TBD

28
Senate Bill 1908 Other Issues
  • Expanded Postsecondary Readiness Assessment for
    11th graders
  • Requires the evaluation of the college readiness
    of selected students prior to grade 12, beginning
    with the 2008-2009 school year, based on minimum
    college placement test scores determined by the
    SBE.
  • High schools, to the extent practicable, must
    provide 12th grade students access to remedial
    instruction prior to graduation.
  • Students achieving minimum scores upon exit from
    remedial instruction and enrolling in a community
    college within 2 years, will not be required to
    enroll in remediation courses.

29
Misc. Assessment Topics
  • Assessment Appropriation Cut 30
  • Less Paper
  • Fewer Products
  • Move to more computer-based testing
  • MAP Clearinghouse
  • Request for Application Clearinghouse
    Management
  • Invitation to Bid Item Bank

30
FTCE/FELE Fees
New Fees for First-time Takers New Fees for First-time Takers New Fees for First-time Takers
  PEd, SAE, or GK   FELE
PBT Regular On time 50 85
PBT Regular Late 50 15 85 30
PBT Regular Emergency 50 125 85 125
PBT Supplemental 50 100 85 100
CBT 50 85
  • January 1, 2009

Current Fees Current Fees Current Fees
  PEd, SAE, or GK   FELE
PBT Regular On time 25 50
PBT Regular Late 25 15 50 30
PBT Regular Emergency 25 125 50 125
PBT Supplemental 25 100 50 100
CBT 25 50
New Fees for Retakes New Fees for Retakes New Fees for Retakes
  PEd, SAE, or GK   FELE
PBT Regular On time 100 100
PBT Regular Late 100 15 100 30
PBT Regular Emergency 100 125 100 125
PBT Supplemental 100 100 100 100
CBT 100 100
31
Misc. Assessment Topics
  • Questions?

32
Next-Generation Sunshine State
StandardsAssessments and Interpretive Products
  • Vince Verges
  • Executive Director
  • Test Development Center

33
Topics
  • Test Development Center Staff Changes
  • Reading, Mathematics, Science, and Writing
    Updates
  • Interpretive Products
  • Content Focus Report 2008
  • Florida Reads! Writes! Solves! Inquires! CD
  • Science Lessons Learned
  • Released Tests
  • Item Specifications for Grades 3-5, 6-8, High
    School
  • Other Assessment News
  • Questions

34
Staff Changes at the Test Development Center
  • Lissa Cone, FCAT Writing Coordinator
  • Sheila Veatch, FCAT Writing Specialist

35
Mathematics Standards Update
  • Next Generation Standards
  • Math standards were adopted in September 2007
  • TDC Math Assessment Transition Crosswalk was
    released to district coordinators on June 4th
  • New Assessment Timeline
  • Currently developing items to match the new item
    specifications for the new standards will be
    reviewed by Item Review Committee in fall 2008
    will become field test items for 2010 test
  • 2011 baseline year for new mathematics assessment

36
High School Mathematics Tests
  • At this time, FDOE is preparing an Algebra I End
    of Course (EOC) test and a Grade 11 Comprehensive
    test.
  • Grade 11 test topics may include Algebra topics
    related to number sense, concepts and operations
    Discrete Math Financial Literacy Geometry
    Probability Statistics and Trigonometry. The
    assessed benchmarks would be made available with
    the release of the FCAT Mathematics Test Item
    Specifications to be discussed later in this
    presentation. This test would not include
    performance tasks.
  • Rule changes are being developed to address
    this effort to ensure that students are
    graduating with exposure to rigorous content
    outlined in the Next Generation SSS.

37
New Science Standards
  • Adopted by State Board February 2008
  • K-8 grade-level standards grouped into four
    Bodies of Knowledge (BOK) which are subdivided
    into Big Ideas
  • High School standards organized by BOK
  • The Nature of Science
  • Earth and Space Science
  • Physical Science
  • Life Science

38
New Science Standards
  • The Office of Mathematics and Science developed a
    crosswalk showing the transition between the old
    and new benchmarks. Available at
    http//www.fldoestem.org/page362.aspx
  • The Office of Mathematics and Science in
    conjunction with Florida science educators
    revised the science course descriptions to match
    new standards (draft available at
    http//www.floridastandards.org/index.aspx)
  • State Board of Education is expected to review
    the proposed descriptions at their October
    meeting.

39
New Science Assessment Timeline
  • 2010 2011 last year for FCAT Science
  • 2010 2011 field test new items written to new
    standards
  • 2011- 2012 baseline (first) year of new
    standards assessment grades 5, 8, and EOC Biology
  • 2012 2013 Standard Setting and reporting of
    achievement levels

40
High School End-of-Course (EOC) Science Exams
  • At this time the Department is preparing to
    develop EOC for Biology (baseline 2011- 2012) and
    another science (baseline 2012- 2013)

41
New Science Standards Assessments
  • Grade 5 and 8 Science Assessments will be
    comprehensive
  • Grade 5 assessment will have items representing
    benchmarks for grades 3-5
  • Grade 8 assessment will have items representing
    benchmarks for grades 6-8

42
New Science Standards Assessment
  • Benchmarks are likely to be grouped or clustered
    by content and designated as annually assessed or
    content sampled
  • Florida Standards Content Advisory Committee
    began reviewing and making recommendations for
    assessment of new standards in April (follow up
    meetings are scheduled for September 2008 and
    January 2009)

43
Released FCAT Science Test
  • 2007 FCAT Science Grade 8 Test and Answer Key
  • Answer Key has percentage of students who
    answered correctly, option statistics for
    multiple-choice items, benchmark and content
    focus information, and the cognitive difficulty
    (cognitive complexity) for each item

44
Released Student Responses for Grade 8 FCAT
Science 2007 Extended Response Item
  • B131 Golf Ball Energy from 2007 Released FCAT
    Science Test currently on DOE website
  • Scoring criteria (annotations) and student papers
  • Example of a top-score response
  • Three student examples of a 4-point response
  • Three student examples of a 3-point response
  • Three student examples of a 2-point response
  • Three student examples of a 1-point response
  • Two student examples of a 0-point response

45
Released Student Responses for Grade 8 FCAT
Science 2007 Extended Response Item
  • Will include letter explaining intent and use of
    student responses
  • FCAT Rubric for extended response
  • Reader Bias
  • Item Development and Handscoring Flowcharts
  • To be posted to ww.fass.cecs.ucf.edu Fall 2008

46
FCAT Explorer
  • FCAT Explorer for grades 5, 8, and 11 are now
    available on DOE website

47
FCAT Science Lessons Learned
  • A look at student performance on FCAT Science
    2003 2006
  • Purpose is to provide guidance to educators that
    can be used to effect positive change and enhance
    program effectiveness
  • Available in print late fall 2008

48
FCAT Science Lessons Learned
  • Includes Results by Cluster
  • Mean percent correct for each reporting cluster
    for each year (2003 2006)
  • Observations and information on what students are
    successful are able to do and what students have
    the greatest difficulty doing
  • Sample items and performance statistics
  • Suggestions for instruction

49
Language Arts Social Studies Standards Update
  • Next Generation SSS Standards
  • Language Arts standards will be revised again
  • SB 1908 states that plan for accomplishing this
    should be in place by Dec. 31, 2008
  • Social Studies standards will be revised
  • At this time there is no plan for an FCAT in
    Social Studies

50
Language Arts Sunshine State Standards
  • December 31, 2008- Review and establish an
    expedited schedule for adoption of the Next
    Generation Sunshine State Standards.

51
Sunshine State Standards . . .
  • Specific requirements are prescribed for language
    arts, science, mathematics, and social studies
    standards.
  • December 31, 2011 The Next Generation Sunshine
    State Standards must be adopted for each subject
    by the State Board of Education.
  • Language Arts standards that were adopted in 2007
    must be reviewed and must identify significant
    literary genres and authors that encompass a
    comprehensive range of historical periods.

52
New Tests in Reading
  • Last FCAT Reading Test - 2010
  • Field Test new benchmarks - 2010
  • New Assessment in Reading - 2011
  • Performance tasks at grades 4, 8, 9.No
    Performance Tasks (PTs) at grade 10
  • Retakes remain the same, no PTs

53
Proposed Graduation Progression
08-09 09-10 10-11 11-12 12-13 13-14
FCAT Only 9th 10th 11th 12th
FCAT/ New Test 9th 10th 11th 12th
New Test Only 9th 10th 11th 12th
Requirements for Grade 10, 2011 passing scores
are still TBD. In Grade 11, the 2013 cohort
would need to take an FCAT Retake because no
Retake would exist for the new assessment yet. A
policy for the Grade 12 students might include
offering FCAT or new test retake.
54
Writing Update
  • Presently, writing as a graduation requirement
    has been delayed indefinitely.
  • Writing test multiple-choice items will be
    removed from test beginning in 2008-2009 due to
    budget and concerns over year-to-year linking of
    MC and essays in the current design.
  • New Writing Assessment in 2012-2013 will have MC,
    SR, and ER items in a way that provides stable
    links.
  • New Writing Assessment will move to grades 4, 7,
    and 11
  • Grades 7 and 11 are intended to be
    computer-based tests

55
When will FCAT Writing be administered?
  • Field Test December 2-3, 2008
  • Census Test February 10-12, 2009
  • Tests will be given using unsealed Writing
    folders to avoid scanning errors

56
Writing Lessons Learned
  • FCAT Writing Lessons Learned 2001-2008 Data
    Analyses and Instructional Implications
  • Scheduled for delivery to districts in December
    2009
  • PDF file posted To FDOE website after ADA
    compliance requirements - districts will be
    notified when it is available

57
Florida Reads!, Writes!, Solves!, Inquires! CD
  • Delivered to Districts in July
  • Packaged and labeled for each school
  • Contains the released performance task for each
    grade and each subject
  • Includes general information about scoring, the
    FCAT rubrics, the actual test item, an example of
    a top-score response, anchor papers,
    qualification papers, and annotations (scoring
    notes)

58
Test Item Specifications
  • Appendix B for Reading and Mathematics to be
    released this Fall
  • Spring release of Next-Generation Assessments
    Reading and Math Test Item Specifications after
    2009 testing

59
2008 FCAT Content Focus Report
  • Now available on the DOE website
  • Has the benchmarks and content focus for each
    item that counted towards student scores on the
    2008 FCAT
  • Has total points for each reporting
    cluster/category
  • Identifies the benchmarks that had performance
    tasks
  • Reading, Mathematics, Writing have old to new
    benchmarks crosswalks

60
2009 Sample Test Materials
  • Reading, Mathematics, and Science Reprints of
    08 materials
  • No Writing STM
  • Shipments to districts in early Nov. 08
  • Per Legislature, delivery to schools should be
    after Jan. 1, 2009
  • PDFs posted to DOE website in Jan. 09

61
Print Materials Delivery Times
  • Keys to FCAT
  • Print delivery and web posting mid-Jan. 09
  • Understanding FCAT Reports
  • Print delivery and web posting late April 09

62
FCAT Results Folder
  • Reduced quantities
  • Distribution
  • Grade 3 students
  • Overage for mobility
  • Delivery early May 09

63
Projected Product Delivery Timeframes
Projected Product Delivery Timeframes Projected Product Delivery Timeframes Projected Product Delivery Timeframes
Product Due in District Posted to Web
Science Lessons Learned Early Nov. 08 Sept. 08
2009 Sample Test Materials Early Nov. 08 Jan. 09
Keys to FCAT 2009 Mid-Jan. 09 Mid-Jan. 09
Understanding FCAT Reports Late April 09 Late April 09
Results Folder Early May 09 Not posted
Math Test Item Specifications May 09 May 09
Reading Test Item Specifications May 09 May 09
09 FRWSI CD Late July 09 Not posted
64
DOE is going green!
  • FCAT contractors already use eco-friendly
    production methods.
  • DOE is now actively promoting recycling.
  • Florida Recycles logo and
  • statement will appear on non-secure FCAT
    materials.
  • Support the effort in your district!

65
FCAT Interpretive ProductsOn the Web
website www.fcat.fldoe.org
DOE website www.fldoe.org
66
FCAT 2009 NonscannableTest Book Covers
67
FCAT 2009 NonscannableTest Book Covers
68
FCAT 2009 NonscannableTest Book Covers
69
FCAT Interpretive ProductsContact Information
Trish Lyons Publications Coordinator (850)
922-2584 ext. 227 SunCom 292-2584 ext. 227
lyonst_at_mail.leon.k12.fl.us
70
Other Contact Information
  • Lyla Springfield, FCAT Reading Coordinatorspringf
    ieldl_at_mail.leon.k12.fl.us
  • Steve Ash, FCAT Mathematics Coordinator
    ashs_at_mail.leon.k12.fl.us
  • Renn Edenfield, Interim FCAT Writing Coordinator
    edenfieldr_at_mail.leon.k12.fl.us
  • Linda Oravetz, FCAT Science Coordinator
    oravetzl_at_mail.leon.k12.fl.us
  • Vince Verges, Executive Director Test
    Development Center vergesv_at_mail.leon.k12.fl.us

71
Florida Alternate AssessmentDistrict Assessment
Coordinators Mtg. September 3, 2008
72
Inspirational Quote
The human brain starts working the moment you are
born and never stops until you stand up to speak
in public. George Jessel
73
2008 Standard Setting
74
Initial Standard Setting
  • April 7-11
  • Field test data
  • 14 standard setting panels
  • Panels of special educators, general educators,
    administrators and parents
  • Alternate achievement standards set for all grade
    levels and content areas

75
Initial Standard Setting
  • Using descriptors of Levels of Complexity and
    Performance Level Descriptors
  • Panelists set cuts for Levels of Complexity (LOC)
  • Panelists set Performance Level cuts within each
    of the LOCs

76
Standard Setting
77
What are the Performance Levels?
  • Basic Students at the basic performance level
    have little success with the challenging access
    points
  • Proficient Students at the proficient level are
    having some success mastering the access points
  • Advanced Students at the advanced level are very
    successful with the access points
  • At each grade level and content area these are
    tied to specific access points measured on the
    assessment

78
Standard Setting Validation
  • July 15-18
  • Operational test data
  • Same procedures
  • Panelists set Performance Level cuts within each
    of the LOCs
  • Preliminary results under review

79
Standard Setting - Next Steps
  • State Board Rule under development
  • Establishes the cut scores
  • Out for comment in the Fall
  • Revision to performance level descriptors and
    labels based on feedback from standard setting
    and Technical Advisory Committee

80
2008 Results
81
Spring 2008 Administration
  • 27,683 answer sheets scanned
  • 3,616 not assessed for various reasons
  • 734 duplicates or invalid bubble
  • 126 cannot be scored in any content area
  • 23,207 students have at least one valid content
    score

82
Spring 2008 Administration
  • Invalid Records
  • Incomplete scoring within a content area
  • Double bubbles
  • Grade level and content area mismatch
  • Invalid bubble filled in on document

83
Spring 2008 Administration
  • Districts Received
  • Individual student reports
  • School reports
  • District reports

84
Student and Parent Report
85
Student and Parent Report
86
Alternate Assessment Reading Participation
87
Alternate Assessment Reading Proficiency
88
Alternate Assessment Math Participation
89
Alternate Assessment Math Proficiency
90
Students with Disabilities Taking the Alternate
Assessments
91
Spring 2008 - 1 Cap
  • Calculation
  • Numerator Number of SWD reported as proficient
    or advanced on Florida Alternate Assessment in
    grades 3-10
  • Denominator Number of students participating in
    an assessment in grades 3-10
  • Calculated separately for reading and mathematics
  • Calculated at the district level

92
Spring 2008 - 1 Cap
  • Decision Rules
  • If district exceeds cap, students with a primary
    exceptionality of specific learning disability
    and no other exceptionalities are reverted to
    non-proficient
  • Calculations are re-run
  • If district still exceeds the cap, they may apply
    for a waiver

93
Spring 2008 - 1 Cap
  • Waiver consideration is given to districts who
    submit data in support of the following
    explanations
  • House multi-district programs for students with
    significant cognitive disabilities
  • Are very small, such that a slight change in
    number of students produces a large change in
    percentage

94
Spring 2008 - 1 Cap
  • Waiver consideration is given to districts who
    submit data in support of the following
    explanations
  • House high-quality, research based programs for
    students with significant cognitive disabilities
    that attract families from around the state and
    country

95
Spring 2009 - 1 Cap
  • Districts will need to submit waiver requests by
    May 15, 2009
  • Decisions about waiver requests will be made
    prior to final AYP calculations

96
Inspirational Quote
The more things change, the more they remain...
insane. Michael Fry and T. Lewis
97
2008-2009 Activities
98
Train-The-Trainer
  • June 23 24
  • Provided updated materials and information
  • Reading fluency items
  • Renaming of materials
  • Test book wording Teacher will script
  • Four field test items per content area

99
Content/Bias Review
  • June 25 26
  • Approximately 120 participants
  • Panelists include content expects (general and
    special education teachers, and administrators
  • New item review
  • Eight items per grade in Reading, Mathematics,
    and Writing
  • Twenty-five Items for Science based on newly
    approved standards

100
Item Specs for New Development
  • Reading
  • Readability not to exceed 3 years below tested
    grade maximum is 6th grade
  • Addition of Reading fluency strand
  • Elementary letter and word identification
  • Secondary range from reading sentences to one
    to two paragraphs

101
Accommodations
  • Accommodations Workgroup
  • Met via conference call on August 13
  • Approximately 25 special education teachers and
    administrators participated in one of three
    conference calls
  • Developed recommendations for additional
    accommodations for VI, DHH, ASD, MH and ELL
    students

102
Web-Base Ordering
  • Available through Piedra Data Services website
  • Braille and tactile graphics for students with
    visual impairments
  • One sided response booklets
  • One sided materials will allow teachers to cut
    out items to have flexibility in item placement

103
Web-Base Ordering
  • Available September 4-17, 2008
  •  
  • http//www.piedradata.com/VIS/Login.php

104
Practice Materials
  • Released items from Spring 2008 administration
  • Delivery to school district alternate assessment
    coordinators week of September 8th
  • Includes two items per content area and grade

105
Practice Materials
  • All grades and content areas packaged together
  • Test Booklet
  • Response Booklet
  • Passage Booklet
  • Cards Packet
  • Strips Packet

106
Administration Manuals
  • Teacher administration manuals will be delivered
    along with practice materials to school district
    alternate assessment coordinators
  • Teachers should keep their binders and replace
    contents

107
Science Field Test
  • Administration window October 13 24
  • Demographics for student participation e-mailed
    to AA Coordinators in July
  • 25 new items based on approved Sunshine State
    Standards Access Points

108
2009 Assessment
  • Administration Window
  • January 12 through February 27
  • Assessment now has two forms (Form A and B)
  • Each form will have 16 core items and four
    embedded field test items per content area for a
    total of 20 items

109
Project to Support Instruction
  • Discretionary project to support teachers in
    curriculum/instruction and support implementation
    of alternate assessment
  • Steering committee met in July to identify and
    prioritize needs
  • National Inclusive Large Scale Standards and
    Assessment (ILSSA) Project assisting us

110
Inspirational Quote
I am easily satisfied with the very best. Winston
Churchill
111
Peer Review Status
112
Peer Review
  • July, 2008 submission
  • Results from April standard setting
  • Individual, school, and district reports
  • Planned studies
  • Waiting for response letter

113
Peer Review
  • Plan for December, 2008 submission
  • Final standard setting results and cut scores
  • Technical Manual
  • Alignment study report

114
Peer Review
  • Planned studies
  • Alignment Fall 2008
  • UNC Charlotte Links to Academic Learning Model
  • Reliability - Spring 2009
  • Videotapes of 2009 administrations independently
    scored
  • Classroom walk through tool development
  • Validity Spring 2009
  • Teacher judgment and assessment performance

115
Inspirational quote
Not a shred of evidence exists in favor of the
idea that life is serious. Brendan Gill
116
Thank youBambi Lockman, Bureau ChiefBureau of
Exceptional Education and Student Services
117
Reminder
  • Those districts participating in NAEP 2009 need
    to pick up their Resource Binders at the
    registration counter during the lunch break.

118
Scoring and Reporting
  • Jackie Mueller
  • Director

119
Data about the 2008 FCAT tests
  • Number of students with test scores reported
  • 1.77 million
  • Number of individual tests scored and reported
  • SSS - 4.4 million
  • NRT - 3.1 million
  • Number of Spring 2008 Retake students passing
    after manual rescore process completed
  • 3 Reading and 20 Math
  • Summer 2008 4 Math

120
Data Verification Processes
  • Validation of scoring
  • Analyzing data to detect scoring anomalies.
  • We spend a large amount of our time trying to
    chase down correct information for a small
    portion of the students who tested
  • Resolving duplicate testers
  • Virtual School Students in correct schools
  • Correcting SIDs

121
Common Test Administration Problems
  • Examples
  • Use of label with incorrect grade information gt
    Off-grade level testing flag - Score Reported
    Flag of 7
  • Incorrect use of label with hand-gridded
    information for different studentgt duplicate
    records Score Reported Flag of 6
  • Missing or incomplete hand-griddinggt missing
    SID, Name, Grade, other important information
  • Testing in two separate documents gt Does not
    meet attemptedness - Score Reported Flag of 2
  • Missing test group code information gt May
    require holding more students than necessary for
    investigations if this is missing

122
Fair Warning We are Trying to Reduce Time
until Reporting
  • Off-Grade Level Testers NR7 In years past we
    have attempted to clean these up prior to
    reporting. We can no longer commit to trying to
    do that. It will be up to districts to check to
    see whether these students really tested in the
    correct grade level and should be reported. This
    should be one thing you check as soon as you
    receive your DSR.
  • Example from this year We attempted to have
    districts supply missing SIDs when the SIDs were
    completely blank. This netted in our attempting
    to update about 7,700 SIDs. We will not be doing
    this again. Due diligence on the part of
    districts should be able to minimize this
    problem. We will check into whether we may be
    able to give districts early warning about which
    students have missing SIDs so they can be ready
    to update the accountability files.

123
Reporting
  • Posting DSR files to Navigator
  • Posting summary files to Navigator
  • Posting .pdf files of reports
  • Printing limited to
  • Individual Student Reports
  • School Lists of Students
  • Grade 10 and Retake Results Labels
  • Certificates of Achievement

124
Fall 2009 Retake
  • Results Delivery Target
  • November 21, 2008
  • Due in District (DID) November 26, 2008

125
2009 Reporting Targets
  • Results Delivery Targets
  • Writing
  • May 7, 2009 and DID May 14, 2009
  • Spring Retakes
  • May 7, 2009 and DID May 14, 2009
  • Reading and Mathematics Grade 3
  • May 18, 2009 and DID May 26, 2009
  • Reading and Mathematics Grades 4-10
  • May 29, 2009 and DID June 05, 2009
  • Science Grades 5, 8, and 11
  • May 29, 2009 and DID June 5, 2009

126
Scoring and Reporting Issues
  • New Demographic Websitehttps//app1.fldoe.org/FCA
    TDemographics/
  • Beginning with three years of data
  • Will eventually expand to cover years 2000-2008
  • Similar features to the old website
  • Old website http//www.fcatresults.com/demog/
    will be active until November 2008
  • Years 2000-2007

127
New Demographic Website
https//app1.fldoe.org/FCATDemographics/
128
New Demographic Web site Screen Shots
129
New Demographic Web site Screen Shots
130
New Demographic Web site Screen Shots
131
New Demographic Web site Screen Shots
132
New Demographic Web site Screen Shots
133
New Demographic Web site Screen Shots
134
New Demographic Web site Screen Shots
135
New Demographic Web site Screen Shots
136
New Demographic Web site Screen Shots
137
New Demographic Web site Screen Shots
138
New Demographic Web site Screen Shots
139
New Demographic Web site Screen Shots
140
New Demographic Web site Screen Shots
141
New Demographic Web site Screen Shots
142
New Demographic Web site Screen Shots
143
Contact Information
  • Jackie Mueller, Director
  • Jackie.Mueller_at_fldoe.org
  • 850-245-0775
  • Mario Zuniga, Supervisor
  • Mario.Zuniga_at_fldoe.org
  • 850-245-9059

144
FCAT Scoring Inquiry System
  • Mario Zuniga
  • Supervisor

145
Overview
  • FCAT Scoring Inquiry System TA Paper (Draft)
  • Types of Score Inquiries
  • Score Anomalies (Desk Audits)
  • Not Reported Scores
  • Missing Scores
  • Procedures for Submitting Score Inquiries
  • New Web-Based System
  • Implementation Time-Line
  • Screen Shots of System
  • Contact Information

146
Technical Assistance Paper
  • Types of Score Inquiries
  • Score Anomalies (Desk Audits)
  • Is poor performance by itself an anomaly?
  • Criteria for automatic audit and manual rescoring
    of Retake scores
  • Within 25 scale score points of passing
  • Anomalies are red flags based on previous student
    trends or large difference in performance
    compared to other measures
  • May represent a bad assessment day for the
    student
  • Investigated by staff to eliminate possible
    scoring errors or student bubbling errors

147
Technical Assistance Paper
  • Types of Score Inquiries (continued)
  • Not Reported (NR) Scores
  • RMS Codes on Individual Student Report
  • NR2 Did not meet attemptedness
  • NR3 Marked as Do Not Score
  • NR6 Recorded as duplicate record
  • NR7 Grade mismatch
  • NR8 Invalidated/held by FDOE for further review
  • Writing Codes on Individual Student Report
  • A Blank answer document
  • B Off-topic
  • C Illegible, Incomprehensible, or Insufficient
    Writing
  • D Foreign Language
  • U Response Unscorable

148
Technical Assistance Paper
  • Types of Score Inquiries (continued)
  • Missing Scores
  • Student is shown as present on the schools
    attendance record but is shown as Not Tested
    (NT), or is not shown at all, on score reports
  • Procedures for Submitting Score Inquiries
  • Score inquiries should not be submitted for Not
    Reported scores
  • Score inquiry submission deadlines established
    for each administration
  • Score audits require additional documentation

149
New Web Based System
  • System Walk-Through Ongoing
  • FDOE Review
  • District/Contractor Beta-Test
  • Roll-Out Timeline
  • Goal is to have this system available for the
    Fall 08 Retake administration
  • Sept/Oct Beta Test
  • Early Nov Final Design Approved
  • Late Nov
  • Districts provided User ID/Passwords
  • System live by November 26, 2008

150
New Web Based System
  • Benefits
  • Available through secure FDOE web site
  • System tracks inquiry FDOE and Contractor
    response time
  • Auto-assigned tracking number
  • Real-time status check available to districts
  • Individual or batch submissions available
  • Score audit documentation kept on file at
    district level
  • Auto-assigned to FDOE specialist
  • Eliminates FAX handling and manual tracking
  • Risks
  • Resistance to change
  • Score audit documentation filed in the district
  • User ID/Password security

151
Screen Shots of Web Based System
  • Logon Screen
  • Email address for user name
  • User reset password
  • One logon per district

152
Screen Shots of Web Based System
  • Main Menu for District Use

153
Screen Shots of Web Based System
  • Main Menu for District Use

154
Screen Shots of Web Based System
  • Contact Information Form
  • Maintain District Coordinator of Assessment
    Contact Information
  • Potential to Update other FDOE Rosters from
    this Information

155
Screen Shots of Web Based System
  • Main Menu for District Use

156
Screen Shots of Web Based System
  • K-12 Missing Score/Desk Audit Inquiry

Drop Down Menus
157
Screen Shots of Web Based System
  • Main Menu for District Use

158
Screen Shots of Web Based System
  • Submit a Batch File of Inquiries

Excel Files Only File Format will be provided.
159
Screen Shots of Web Based System
  • Main Menu for District Use

160
Screen Shots of Web Based System
  • Track status of submitted inquiries

161
Screen Shots of Web Based System
  • Track status of submitted inquiries

Sort on any column
162
Screen Shots of Web Based System
  • Track status of submitted inquiries

Email to request a correction
163
Screen Shots of Web Based System
  • Track status of submitted inquiries

Automatic reference to the student record log
number
164
Screen Shots of Web Based System
  • Track status of submitted inquiries

165
Screen Shots of Web Based System
  • Main Menu for District Use

166
Screen Shots of Web Based System
  • On the FDOE and Contractor Side

167
Contact Information
  • If you have any questions, please contact
  • Mario Zuniga
  • mario.zuniga_at_fldoe.org
  • 850-245-9059
  • Bernard Stevens
  • bernard.stevens_at_fldoe.org
  • 850-245-0778

168
Florida Parent Network
  • District Coordinators Meeting
  • Orlando, Florida
  • September 3, 2008

169
Agenda
  • FCAT Parent Network Overview
  • Statistics
  • Release Schedule
  • Login Letters
  • Release of Results
  • Non PreID Process

170
FCAT Parent Network Overview
  • Started in Spring 2006 allows secure online
    access to FCAT results for Florida parents
  • Subjects Reading, Mathematics, Science, Writing,
    R/M Retakes
  • Individual secure logins generated for all tested
    students for each test administration
  • Results available in HTML and PDF format
  • State Resources
  • FAQs in English, Spanish and Haitian-Creole

171
Statistics
  • 14 releases of data to date
  • From March 2006 to present
  • More than 6 million visits
  • More than 158 million hits
  • Spring and Summer 2008 so far
  • More than 2.3 million visits
  • More than 61 million hits
  • Most active date 6/12/08 5,297,211 hits

Spring and Summer 2008
172
Home Page
  • Updated when new results are available
  • Expected release dates
  • Available until dates
  • English, Spanish Haitian Creole

173
Results Page
  • Overview of Results
  • Scale Score
  • Performance Level
  • Standard Error Measure
  • PDF of Student Report
  • Copy of ISR that will be received in print
  • Separate tab for each test
  • Reading Mathematics
  • Writing (when applicable)
  • Science (when applicable)
  • Retakes (when applicable)

174
Release Overview
  • Step 1 Login Letters
  • 2-3 weeks prior to release for fall and Spring
  • 1-2 weeks prior to testing for summer
  • Step 2 Release of Results
  • 48 hours after release of results to districts
    and schools
  • Step 3 Non PreID Logins
  • Available on Navigator site by the day of the
    results release

175
Step 1 Login Letters
  • 2-3 weeks prior to release for Fall and Spring
  • 1-2 weeks prior to testing for Summer
  • Shipment includes
  • District Coordinator Letter
  • Principal Letter
  • Login Lists for each school (PDF also available
    on Navigator)
  • Sample Parent Letter
  • Parent Letter with unique login and password for
    each student in the PreID file
  • Login Page updated with expected data release
    dates
  • New logins activated and parents receive a
    message indicating that results are not yet
    available

176
Step 2 Release of Results
  • 48 hours after release of results to districts
    and schools
  • Home Page updated to state that results are now
    available and expected timeframe for next release
  • Results available at the same time for all
    students in the state (PreID and Non PreID)
  • Results from previous administration (Fall,
    Spring, Summer) no longer available home page
    includes expected to be available until dates

177
Step 3 Non PreID Logins
  • Available on Navigator site the day of the
    results release
  • PDF lists of logins and passwords provided for
    district and school access to be distributed to
    parents (includes 5 of students across the
    state)
  • Includes all students who do not have results in
    the data file associated with a PreID label
    (generated from final approved data file)
  • Students not enrolled at the time of PreID
  • Students who were in PreID, but label did not get
    used
  • Students who were in PreID, but student moved to
    a new school or district prior to testing
  • Students will receive a separate login for each
    subject that they did not have a PreID
    indicated in the data file
  • Allows all students in the state to access their
    results on Parent Network

178
Navigator Website
  • PDFs of Reports
  • State Report of Districts (districts only)
  • District Report of Schools
  • School Report of Students
  • District Summary
  • PDF Copies of Parent Network PreID Login Lists
  • Ex. Summer 08 Parent Network PreID Logins
  • Ex. Summer 08 Parent network Non-PreID Logins
  • PDFs of Non PreID Login Lists

179
Grow Customer Support
  • support_at_grow.net
  • 1-800- 481-GROW

Customer Support Rep, Miranda
180
Florida
National Assessment of Educational Progress
(NAEP) 2009 Assessments
District Assessment Coordinator Annual
Meeting September 2008
Michele Sonnenfeld NAEP State Coordinator Florida
Department of Education
181
State-Level NAEP Administrations in Florida
  Gr 4 Reading Gr 8 Reading Gr 4 Math Gr 8 Math Gr 4 Science Gr 8 Science Gr 4 Writing Gr 8 Writing Gr 12 Reading and Math
1998 X X           X  
2002 X X         X X  
2003 X X X X     X X  
2005 X X X X X X      
2007 X X X X       X  
2009 X X X X X X     X
  • In 2009, Florida will also be participating in
  • Internet Computer Tasks (ICT)
  • Hands-on Tasks in Science (HOTS)
  • High School Transcript Study (HSTS)
  • Miami-Dade will receive results as part of the
    Trial Urban District Assessment (TUDA).

182
NAEP Special Studies for 2009
  • Interactive Computer Tasks (ICT)-Westat will
    provide 15 laptop computers and flash drives
  • Hands on Tasks (HOTS)-Westat provides kits that
    students will use in performing experiments
  • High School Transcript Study (HSTS)
  • Florida is the only state that will participate
    electronicallyno burden to the schools

183
NAEP 2009 Assessments
  • Grade 12 Assessment
  • In 2009, NAEP will administer a Grade 12 Pilot
    assessment in 11 states, including Florida, that
    were chosen to participate. This will be the
    first time state results will be available for
    Grade 12 in reading and mathematics.
  • Florida will be able to compare its Grade 12
    reading and mathematics scores with those of
    Idaho, South Dakota, Iowa, Illinois, Arkansas,
    West Virginia, New Jersey, Massachusetts,
    Connecticut, and New Hampshire.

184
NAEP 2009 Assessments
  • Trial Urban District Assessment (TUDA)
  • TUDA is designed to report on the performance of
    Grades 4 and 8 public school students at the
    district level
  • 2002 Atlanta, Chicago, Houston, Los Angeles,
    New York City
  • 2003 added Boston, Charlotte, Cleveland, San
    Diego
  • 2005 added Austin
  • 2009 added Baltimore, Detroit, Fresno,
    Louisville, MIAMI-DADE, Milwaukee, and
    Philadelphia
  • Washington, D.C. is also included as a TUDA

185
NAEP 2009Assessment Components
  • Assessment Window January 26 March 4, 2009
  • Subjects to be Assessed
  • Grades 4, 8, and 12 Reading, Mathematics, or
    Science
  • Grades 4, 8, and 12 Science Interactive
    Computer Tasks (ICT) or Hands-on Tasks (HOTs)
  • Grades 4, 8, and 12 U.S. History, Civics, or
    Geography
  • FLDOE will not select schools chosen for NAEP to
    be calibration schools for the FCAT

186
Contact Information
Contact Information
Michele Sonnenfeld NAEP State Coordinator Florida
Department of Education (850) 245-0787 Michele.Son
nenfeld_at_fldoe.org
187
Florida
National Assessment of Educational Progress
(NAEP) 2009 Assessments
Selected District Assessment Coordinators
September 2008
Michele Sonnenfeld NAEP State Coordinator Florida
Department of Education
188
NAEP 2009 Assessment Components
  • Assessment Window January 26 March 4, 2009
  • Subjects to be Assessed
  • Grades 4, 8, and 12 Reading, Mathematics, or
    Science
  • Grades 4, 8, and 12 Science Interactive
    Computer Tasks (ICT) or Hands-on Tasks (HOTs) (31
    schools)
  • Grades 4, 8, and 12 U.S. History, Civics, or
    Geography
  • Most selected schools will participate in the
    Reading, Mathematics, or Science assessments. In
    Florida, 47 schools will also participate in the
    U.S. History, Civics, or Geography assessments.

189
Prior to the NAEP Assessment
  • You were notified in July of the schools in your
    district that have been selected to parti
Write a Comment
User Comments (0)
About PowerShow.com