New York State Grade 38 Testing in English Language Arts

1
New York StateGrade 3-8 Testing in English
Language Arts MathematicsPreparations For
Scoringrevised September 26, 2005
2
OVERVIEW

• When and how long will the tests take to be
  administered?
• What will these tests look like?
• What information will be available to help
  schools prepare?
• Who will score these tests?
• What support will be available for scoring
  training?
• How will scoring sites be set up?
• What support will be available for statewide
  scoring?

3
Testing Timeline 2006 English Language Arts

• Jan. 9 Jan. 13
• Jan. 17 Jan. 20
• Jan. 17 Jan. 20
• Jan. 23 Jan. 27
• Jan. 23 Jan. 27

• G3,4,5 ELA Statewide Tests
• G3,4,5 ELA Make-up Tests
• G6,7,8 ELA Statewide Tests
• G6,7,8 ELA Make-up Tests
• G3-8 ELA Field Tests

4
Testing Timeline 2006 Mathematics

• Mar. 6 Mar. 10
• Mar. 13 Mar. 17
• Mar. 13 Mar. 17
• Mar. 20 Mar. 24
• Mar. 20 Mar. 24

• G3,4,5 Math Statewide Tests
• G3,4,5 Math Make-up Tests
• G6,7,8 Math Statewide Tests
• G6,7,8 Math Make-up Tests
• G3-8 Math Field Tests

5
Testing Times for Grades 3, 5, 7 ELA Mathematics
6
Testing Times for Grades 4, 6, 8 ELA
Mathematics
Session 1 and Session 2 will be given on one
day both ELA and math.
7
II. What Will These Tests Look Like?

• The NYS tests are designed to measure student
  achievement in English Language Arts (ELA) and
  Mathematics in grades 3 through 8.
• The tests reflect New York State content/process
  standards in each grade and subject area.
• For ELA independent writing prompts have been
  removed across all grades editing paragraph has
  been added in grades 3, 5, 7.
• All items will be grade specific no overlapping
  items will be included.
• Tests in both subjects will be similar in format
  to existing Grade 4 and 8 assessments.

8
Grades 4, 6, 8 ELA Test Design

• Session 1 (Reading)
• Format
• 4 to 5 passages (literary and informational)
• 26 to 28 multiple choice items
• Standards 1, 2, 3 measured
• Session 2 (Listening/Writing)
• Format
• 1 listening selection (literary in 4, 6
  informational in 8)
• 2 to 3 constructed response items
• 1 extended response item
• Standard 2 measured in 4, 6 Standard 1 in 8
• Session 3 (Reading/Writing)
• Format
• 2 paired passages
• 3 constructed response items
• 1 extended response item
• Standard 3 measured
• For grade 8, Session 1 and Session 2 are
  administered on the same day.

9
Grades 3, 5, 7 ELA Test Design

• Session 1 (Reading)
• Format
• 3 to 4 passages in 3, 5 (literary and
  informational) and 4 to 5 passages in 7 (literary
  and informational)
• 20 (3, 5) and 26 (7) multiple choice items
• 1 (3, 5) and 2 (7) constructed response item(s)
• Standards 1, 2, 3 measured
• Session 2 (Listening/Writing)
• Format
• 1 listening selection (literary in 3
  informational in 5, 7)
• 4 multiple choice items
• 2 (3, 7) and 1 (5) constructed response item(s)
• 1 editing paragraph
• Standards 1, 2, 3 measured in 3 Standards 1 2
  in 5, 7

10
Grades 3, 5, 6, 7 Mathematics Test Design

• Session 1
• Format
• 25 to 30 multiple choice items (varies by grade)
• Standard 3 Mathematics measured
• Session 2
• Format
• 4 (3, 5, 7) or 6 (6) constructed response items
• 2 (3) or 4 (5, 6, 7) extended response items
• Standard 3 Mathematics measured

11
Grade 4 8 Mathematics Test Design

• Session 1
• Format
• 27 - 30 multiple choice items
• Standard 3 Mathematics measured
• Session 2
• Format
• 4 (8) or 7 (4) constructed response items
• 2 extended response items
• Standard 3 Mathematics measured
• Session 3
• Format
• 7 (4) or 8 (8) constructed response items
• 2 (4) or 4 (8) extended response items
• Standard 3 Mathematics measured

12
III. What Information Is Available To Help
Schools Prepare?

• 1. A Guide to the NYS Grade 38
• Testing Program
• 2. Sample Tests
• 3. Parent Brochure

13
IV. How Will These Tests Be Scored?

• Scoring should be conducted by NYS
• teachers immediately following test
• administration to all eligible students
• SED guidelines for scoring will focus on
• scoring training rather than the model
• for scoring (e.g., regional, district,
• school)

14
Selection of Scorers

• Criteria for the selection of scorers is being
  finalized by SED
• Using NYS teachers
• Looking to open criteria for
• potential scorers (e.g., retirees)
• Implementing the use of qualifying
• sets

15
Qualifying Sets

• Helps to establish reliable scoring
• Uses a uniform pre-selected set of student papers
  statewide to qualify scorers/readers
• Creates a baseline - all scorers must meet set
  requirements prior to participation in scoring
• Supports scoring consistency during the beginning
  of scoring

16
V. What Support Will Be Provided To Prepare For
Scoring?

• Scoring Train the Trainer Workshops
• Points of Contact
• Scoring Training Materials for
• Train the Trainer Workshops

17
Scoring Train the Trainer Workshops

• Directed toward training the trainer
• Twelve full-day sessions for each content area
  held throughout the state
• Scheduled for ELA in September, 2005 and for
  Mathematics in November, 2005

18
Dates and Sites For ELA Scoring Train the Trainer
Workshops

• Upstate Team
• 9/19 - Ulster 9/20 -
  Albany
• 9/21 Jefferson Lewis 9/26 - Rochester
• 9/27 Syracuse 9/29 -
  Buffalo
• Downstate team
• 9/19 - NYC 9/20
  - Yonkers
• 9/22 Nassau 9/23 -
  Suffolk
• 9/28 Putnam Westchester 9/29 - NYC

19
Dates and Sites For Math Scoring Train the
Trainer Workshops

• Upstate Team
• 11/02 - Albany 11/04 Jefferson Lewis
• 11/07 Rochester 11/08 Syracuse
  
• 11/09 Erie 2 11/10-Erie 1
• Downstate team
• 10/27 - NYC 10/28 - NYC
• 11/01 - Ulster 11/02 - Yonkers
  
• 11/04 - Suffolk 11/07 Nassau

20
Points of Contact

• Will coordinate details of scoring workshop sites
  and work with regions to arrange for trainers
• Will be provided basic templates for scheduling
  the scoring training session
• Agenda for Train the Trainer workshops
• Invitation to potential scoring trainers
• Will be provided scoring training materials for
  their workshop

21
Scoring Trainers

• Recruitment of scoring trainers for the workshops
  will be the responsibility of the Point of
  Contact
• Should be limited to 60 70 per site
• Generally include the most experienced scoring
  personnel

22
Tentative Agenda For Scoring Train the Trainer
Workshops

• 730 800 Breakfast and General Session
• 800 100 Full Training (3 rooms, 1/grade
  band)
• 100 200 Lunch
• 200 300 Wrap-up and QA (for 3 groups)
• 300 400 Highlights I (Issues
  Discussions)
• 400 500 Highlights II (Issues
  Discussions)

23
Scoring Training Materials For Train the Trainer
Workshops

• Scoring leader handbook
• Annotated set of training papers
• Set of training papers for scorers being trained
• Qualifying set of student papers

24
VI. How Will Scoring Sites Be Set Up?

• Using the Scoring Site Operations Manual
• SCDN scoring subcommittee being used for feedback
  of the updated manual
• Final Scoring Site Operations Manual will be
  distributed during a scoring operations
  walk-through
• Adapting sample scoring site approaches used by
  others

25
Dates and Sites for Scoring Operations
Walk-Through

• August 23 Rockland BOCES
• August 25 Monroe II BOCES

26
Sample Scoring Site Approaches

• Two NYS areas
• Barbara Tomasso Monroe II BOCES
• Melissa Evingham Erie 2 BOCES
• Provide examples of the highlights and pitfalls
  of establishing NYS scoring sites

27
VI. What Supports Will Be Available For Statewide
3 - 8 Scoring?

• Scoring Training Materials
• Scoring Training Videotapes/DVDs
• Scoring Helpline
• Q A on the SED Website

28
KEY CONTACTS
Office of Curriculum, Instruction, and
Instructional Technology Website www.emsc.nysed.go
v/ciai Curriculum Questions can be sent to
emscurric_at_mail.nysed.gov
Office of State Assessment www.emsc.nysed.gov/osa/
Testing Questions can be sent to
emscassessinfo_at_mail.nysed.gov
29
For the Latest Information
Go to www.nysed.gov and click on Latest
Information
30
Test Designs - ELA
31
Grade 3 ELA Test Design

• Session 1 (Reading)
• Format
• 3 to 4 passages (literary and informational)
• 20 multiple choice items
• 1 constructed response item (1 minute)
• Standards 1, 2, 3 measured
• Session 2 (Listening/Writing)
• Format
• 1 listening selection (literary)
• 4 multiple choice items
• 2 constructed response items (1.5 minutes each)
• 1 editing paragraph (.5 minutes)
• Standards 1, 2, 3 measured

32
Grade 4 ELA Test Design

• Session 1 (Reading)
• Format
• 4 to 5 passages (literary and informational)
• 28 multiple choice items
• Standards 1, 2, 3 measured
• Session 2 (Listening/Writing)
• Format
• 1 listening selection (literary)
• 2 constructed response items
• 1 extended response item (Cluster 2.5 minutes)
• Standard 2 measured (ER also contributes to
  Writing Mechanics score)
• Session 3 (Reading/Writing)
• Format
• 2 paired passages
• 3 constructed response items (Cluster 2.5
  minutes)
• 1 extended response item (ER also contributes to
  Writing Mechanics score)
• Standard 3 measured

33
Grade 5 ELA Test Design

• Session 1 (Reading)
• Format
• 3 to 4 reading passages (literary and
  informational)
• 20 multiple choice reading items
• 1 constructed response item (1 minute)
• Standards 1, 2, 3 measured
• Session 2 (Listening/Writing)
• Format
• 1 listening selection (informational)
• 4 multiple choice listening items
• 1 constructed response item (1 minute)
• 1 editing paragraph (.75 minute)
• Standards 1 and 3 measured

34
Grade 6 ELA Test Design

• Session 1 (Reading)
• Format
• 4 to 5 passages (literary and informational)
• 26 multiple choice items
• Standards 1, 2, 3 measured
• Session 2 (Listening/Writing)
• Format
• 1 listening selection (literary)
• 3 constructed response items
• 1 extended response item (Cluster 2.5 minutes)
• Standard 2 measured (ER also contributes to
  Writing Mechanics score)
• Session 3 (Reading/Writing)
• Format
• 2 paired passages
• 3 constructed response items
• 1 extended response item (Cluster 2.5 minutes)
• Standard 3 measured (ER also contributes to
  Writing Mechanics score)

35
Grade 7 ELA Test Design

• Session 1 (Reading)
• Format
• 4 to 5 passages (literary and informational)
• 26 multiple choice items
• 2 constructed response items (1.5 minutes each)
• Standards 1, 2, 3 measured
• Session 2 (Listening/Writing)
• Format
• 1 listening selection (informational)
• 4 multiple choice items
• 2 constructed response items (1.5 minutes each)
• 1 editing paragraph (.75 minutes)
• Standards 1and 3 measured

36
Grade 8 ELA Test Design

• Session 1 (Reading)
• Format
• 4 to 5 passages (literary and informational)
• 26 multiple choice items
• Standards 1, 2, 3 measured
• Session 2 (Listening/Writing)
• Format
• 1 listening selection (informational)
• 3 constructed response items
• 1 extended response item (Cluster 2.5 minutes)
• Standard 1 measured (ER also contributes to
  Writing Mechanics score)
• Session 3 (Reading/Writing)
• Format
• 2 paired passages
• 3 constructed response items
• 1 extended response item (Cluster 2.5 minutes)
• Standard 3 measured (ER also contributes to
  Writing Mechanics score)
• Sessions 1 and 2 will be given on one day

37
Test Designs - Mathematics
38
Grade 3 Mathematics Test Design

• Session 1
• Format
• 25 multiple choice items
• Standard 3 Mathematics measured
• Session 2
• Format
• 4 constructed response items (23 seconds each)
• 2 extended response items (30 seconds each)
• Standard 3 Mathematics measured

39
Grade 4 Mathematics Test Design

• Session 1
• Format
• 30 multiple choice items
• Standard 3 Mathematics measured
• Session 2
• Format
• 7 constructed response items (23 seconds each)
• 2 extended response items (30 seconds each)
• Standard 3 Mathematics measured
• Session 3
• Format
• 7 constructed response items (23 seconds each)
• 2 extended response items (30 seconds each)
• Standard 3 Mathematics measured

40
Grade 5 Mathematics Test Design

• Session 1
• Format
• 26 multiple choice items
• Standard 3 Mathematics measured
• Session 2
• Format
• 4 constructed response items (25 seconds each)
• 4 extended response items (35 seconds each)
• Standard 3 Mathematics measured

41
Grade 6 Mathematics Test Design

• Session 1
• Format
• 25 multiple choice items
• Standard 3 Mathematics measured
• Session 2
• Format
• 6 constructed response items (25 seconds each)
• 4 extended response items (35 seconds each)
• Standard 3 Mathematics measured

42
Grade 7 Mathematics Test Design

• Session 1
• Format
• 30 multiple choice items
• Standard 3 Mathematics measured
• Session 2
• Format
• 4 constructed response items (35 seconds each)
• 4 extended response items (50 seconds each)
• Standard 3 Mathematics measured

43
Grade 8 Mathematics Test Design

• Session 1
• Format
• 27 multiple choice items
• Standard 3 Mathematics measured
• Session 2
• Format
• 4 constructed response items (35 seconds each)
• 2 extended response items (50 seconds each)
• Standard 3 Mathematics measured
• Session 3
• Format
• 8 constructed response items (35 seconds each)
• 4 extended response items (50 seconds each)
• Standard 3 Mathematics measured
• Sessions 1 and 2 will be given on one day