Michigan Merit Examination

1

• Michigan Merit Examination -
• Plans and Prospects
• Edward Roeber, Mike Radke Jim Griffiths, MDE
• Diane Walters John Nelson, ACT

2
Current MEAP High School Test

• Spring testing (March-April, 2006)
• Fall retesting (late October-early November,
  2006)
• English Language Arts (Reading and Writing),
  Mathematics, Science count for the Merit Award
• Social Studies also assessed but does not count
  for the Merit Award

3
Current Program

• Grade 10
• Students take the MEAP High School Assessment to
  qualify for dual enrollment (assessment in fall
  or spring)
• Grade 11
• Students take the MEAP High School Assessment to
  qualify for dual enrollment (in the fall) and the
  Merit Award
• All students take the MEAP in the spring (if they
  have not already passed the MEAP)
• Grade 12
• Students take the MEAP in the fall or spring to
  qualify for the Merit Award

4
Current Program

• Merit Award 2,500 for passing the English
  language arts tests (readiang and writing),
  mathematics and science at the high school level
• Merit Award 500 for passing the same subjects
  in grade 7 and 8 (each is assessed in each of
  these two grades)
• The Merit Award program may change
• Please contact the Michigan Department of
  Treasury with ALL Michigan Merit Award questions
• www.michigan.gov/meritaward or 1-888-4-GRANTS

5
MME Legislation

• PA 592 of 2004 - MME inserted into Career and
  Technical Preparation Act
• PA 593 of 2004 - Replaces high school MEAP with
  MME in School Aid Act
• PA 594 of 2004 - Replaces high school MEAP with
  MME in Postsecondary Enrollment Options Act
• PA 595 of 2004 - Replaces high school MEAP with
  MME for determining Merit Award Scholarships
• PA 596 of 2004 - Replaces the high school MEAP
  with MME in the School Code

6
Steps Used to Implement MME

• Visited potential vendors to share/obtain ideas
• Competitively bid the MME program
• Reviewed the bids
• Selected new contractor(s) - Pearson/ACT
• Determined the content of each MME test
• Conducted statistical alignment study (pilot
  test)

7
Spring 2006 Pilot High Schools
8
Steps Needed to Implement MME

• Conduct additional content alignment studies
  needed
• Set cut scores on MME and MEAP Grade 11, to be
  used for the Merit Award and NCLB AYP
• Prepare revisions to the NCLB Accountability
  Workbook
• Establish PLAN and PSAT cut scores for dual
  enrollment purposes

9
Steps Needed to Implement MME

• Submit application for approval to U.S.
  Department of Education by July 1, 2006
• November 1 is the drop-dead date for the MME
  versus MEAP HST decision for Spring 2007
• Receive approval from USED prior to drop-dead
  date OR continue MEAP High School Assessment (if
  approval is not received by that date)
• Implement the MME in grade 11 in the 2006-07
  school year maintain MEAP HST for Grade 12 only

10
MME Assessment Design

• Grade 10 College entrance readiness test (PLAN
  and PSAT - local school/student choice)
• Grades 11 and 12 Michigan Merit Examination
• English Language Arts - ACT Reading, Writing, and
  English WorkKeys Reading for Information
  Michigan Social Studies constructed response item
• Mathematics - ACT Mathematics items from ACT
  Science WorkKeys Applied Mathematics Michigan
  items
• Science - ACT Science Michigan items
• Social Studies - Michigan items

11
Michigan Merit Examination Components and Score
Contributions
12
MME Assessment Administration (Spring 2007)

• Grades 11 and 12 - Spring Administration
• March 13 - ACT Plus Writing
• March 14 WorkKeys, Reading Michigan
  Mathematics
• March 14-21 - Michigan Science and Social Studies
• March 27 - Makeup ACT Plus Writing
• March 28 - Makeup WorkKeys Michigan Mathematics
• March 28-April 4 Makeup Michigan Science and
  Social Studies

13
MME Assessment Administration (Fall 2007)

• Grades 11 and 12 - Fall Administration
• Saturday, October 27, 2007 (ACT National Test
  Date) - ACT Plus Writing
• Tuesday, October 30, 2007 - WorkKeys Michigan
  Math
• October 30 -November 6 - Michigan Science and
  Social Studies

14
Future Administration Dates
15
MME Test Center Establishment

• Review several key documents (Spring 2006)
• Standard Testing Requirements
• School Schedule and Site Options for
  Administration of the 2007 Michigan Merit
  Examination
• Summary of Test Administration Policies
• Qualifications and Responsibilities for Test
  Supervisors and Back-up Test Supervisors
• Qualifications for Test Accommodations
  Coordinators
• Consider staffing requirements and decide
  possible staff to fill these positions
• Plan for testing rooms/facilities

16
MME Test Center Establishment (Fall 2006)
17
MME Test Center Establishment (Fall 2006)
18
Assessment Sites

• Preferred site is in a quiet wing of the high
  school
• School in session for all students, or
• School for juniors only
• Off-site administration
• Community College
• ISD/RESA
• Other public facility
• Church
• Other private facility
• Each site must be approved by ACT

19
Assessment Facilities

• Choice of testing rooms for standard time
  administration
• Uncrowded seating prefer classrooms with 25-30
  examinees
• Manageable security prefer no more than 100
  examinees in one room (if more than 100, see
  personnel requirements)
• Good lighting, comfortable temperature, quiet
  atmosphere

20
Assessment Facilities

• Adequate writing surfaces
• No lapboards permitted temporary surfaces
  resting on chair arms or back of chair in front
  must be reviewed and approved by ACT
• Must accommodate both test booklet and answer
  document

21
Assessment Facilities

• Seating arrangements (Applies Equally to Desks
  and Tables)
• Seats must be assigned by testing staff as
  students enter room
• Minimum of 3 feet apart side-to-side (measured
  shoulder-to-shoulder)
• Minimum of 3 feet apart front-to-back (measured
  head-to-head)
• All students must face the same direction,
  directly behind one another

22
Assessment Facilities

• Freedom from distractions
• No one not involved in testing may be in the room
• Uninterrupted testing period required for all
  days of testing
• No unnecessary noises (bells, public address
  systems, etc. must be turned off)
• Testing rooms must be separated from regular
  school activities

23
Assessment Personnel

• Required number of qualified assistants per room
• 1 room supervisor required for each room,
• Plus 1 proctor for every 25 examinees in the room
  after the first 25 (i.e., 26-50 1
• 51-75 2 76-100 3)
• Testing staff may not be
• Involved in test preparation outside of normal
  teaching responsibilities
• Enrolled in high school

24
Avoiding Conflicts of Interest

• Test (and Back-up) Test Supervisors have access
  to secure test materials prior to testing.
• To avoid the appearance of a conflict of
  interest, and to protect relatives (siblings,
  children, step-children, grandchildren, nieces,
  nephews) and wards from allegations of
  impropriety
• Test (and Backup) Supervisors may not be related
  to any examinee taking the ACT/WorkKeys in
  2006-2007 anywhere in Michigan.
• Room supervisors and proctors may not assist in a
  room where any relative is being tested

25
Adequate Training for all Staff

• ALL Test Supervisors (TS), Back-up Test
  Supervisors (Back-up TS), and Test Accommodations
  Coordinators (TAC) are REQUIRED to attend
  training in November-December, 2006.
• Testing staff must have read and be familiar with
  both the Day 1 and Day 2 supervisors manuals
  (included with training materials)

26
Adequate Training for all Staff

• A local training session for all staff is
  required before testing (conducted by the Test
  Supervisor at each school)
• Each room supervisor must have a complete copy of
  that day's supervisors manual in the test room

27
Attentiveness

• During testing, the testing staff must
• Focus on monitoring testing (reading, grading
  papers, other personal work is not permitted)
• Circulate frequently around the room to monitor
  examinees
• Recognize the potential for cheating and take
  action as instructed in supervisors manuals
• Exact compliance with supervisors manuals is
  requiredincluding reading spoken instructions
  verbatim

28
Assessment Administration

• All test sites must test on the designated days
• The testing activity should be the first activity
  of the day for students
• Assessment administration staff will need to
  review procedures 30 minutes prior to the start
  of testing.
• No food or drink are permitted in testing room(s)
  this applies to both staff and examinees.

29
Security

• Receipt, check-in, and verification of test
  booklets are by serial numbers
• Restricted access at all times from moment of
  receipt to return (documented chain of custody)
• Answer documents not returned to students after
  test responses are gridded
• All test sites must test on the designated test
  days with testing as the first activity of the
  morning.
• Immediate and complete return of all Day 1
  materials to ACT and all Day 2 materials to
  Pearson

30
Security

• Proper identification of examinees by room
  supervisor (personal recognition or photo ID)
• Direct consultation with ACT to handle testing
  irregularities
• Unannounced observation of assessment
  administration in selected schools

31
Exact Timing of the Tests

• More than one timepiece must be used in each room
  to ensure back-up
• Time remaining may not be posted
• Five-minute warning must be read verbatim from
  the supervisors manuals

32
Documentation of Test Day Procedures

• State Testing Staff List returned with answer
  documents
• Seating Diagram, Test Book Count Form, and
  Testing Time Verification Form returned for each
  room
• Supervisors Report Form (Day 1) and School ID
  Sheet (Day 2) completed accurately
• Testing Irregularity Report Form(s) returned with
  answer documents

33
MME Year-by-Year Implementation

• 2005-2006
• Fall - MEAP HST (grades 10, 11, 12)
• Spring - MEAP HST plus statistical pilot linking
  ACT to the MEAP HST (grade 11 only)
• 2006-2007 (Assuming Federal Approval)
• Grade 10 - use PLAN or PSAT for dual enrollment
• Local district selects test state sets
  qualification score(s)
• Student or school district pays the testing cost
  (no state reimbursement)
• Grade 11 - Offer MME in the Spring for Merit
  Award
• Grade 12 - Offer MEAP HST to complete Merit Award
  (one year only) OR MME

34
MME Year-by-Year Implementation

• 2007-08 (No More MEAP)
• Grade 10 - use PLAN or PSAT for dual enrollment
• Local district selects test state sets
  qualification score(s)
• Student or school district pays the testing cost
  (no state reimbursement)
• Grade 11 - Offer MME in the Spring for Merit
  Award
• Grade 12 - Offer MME in the Fall and Spring
• Students get one free (state-paid) re-take

35
Key 2006-07 MME Dates

• March 6, 2006 - Video conference on MME
  assessment accommodations (DVD/videotape
  available from Wayne RESA videostreamed as well
  http//www.mistreamnet.com, click on 'Archived
  Stream.)
• April 27, 2006 - Video conference on 2006-2007
  MME plans (DVD/videotape available from Wayne
  RESA videostreamed as well http//www.mistreamn
  et.com, click on 'Archived Stream.)
• May - June 2006 - Analyze pilot school
  information prepare application to USED to
  change to MME
• July 2006 - Submit application to USED
• July-August, 2006 - Select Michigan items

36
Key 2006-07 MME Dates

• September 12, 2006 - Statewide video conference
  on 2007 MME
• September-October 2006 - ACT establishes schools
  as test centers
• September-October 2006 Home school students
  notify district high school of intent to test
• November 1, 2006 - Drop-dead date for USED
  approval to implement the MME use MEAP HST if
  approval not received
• November-December 2006 - Mandatory training for
  Test Supervisors, Backup Test Supervisors, and
  Test Accommodations Coordinators

37
Key 2006-07 MME Dates

• December 1, 2006 - ACT-approved accommodations
  requests due to ACT for Day 1 Testing (ACT Plus
  Writing)
• January 10, 2007 - State-allowed accommodations
  requests due to ACT for Day 1 Testing (ACT Plus
  Writing)
• For Day 2 (WorkKeys Michigan Mathematics) Day
  2-7 (Michigan Science and Social Studies), tests
  accommodations should be similar to those
  approved for Day 1
• Accommodations decisions for Day 2 and Day 2-7
  are the local school district responsibility
• Dates also apply to home school and non-public
  school students

38
Key 2006-07 MME Dates

• January 10, 2007 (Estimated) - Materials orders
  for ALL students are due for Day 2 (WorkKeys
  Michigan Mathematics) Day 2-7 (Michigan Science
  and Social Studies tests)
• Submitted via Pearson School House for all
  students
• November 2006-January 2007 (Estimated) -
  Non-public school students using test centers
  registered for the MME
• February 2007 - Accommodations determined and
  materials ordered
• February-March 2007 - Test Supervisors train test
  administrators and proctors

39
Key 2006-07 MME Dates

• MME Testing
• Day 1 - ACT Plus Writing (March 13, 2007)
• Day 2 - WorkKeys Michigan Math (March 14, 2007)
• Day 2-7 - Michigan Science and Social Studies
  (March 14-21, 2007)
• Special Testing Windows (March 13-28, 2007)

40
Key 2006-07 MME Dates

• MME Makeup Testing
• Day 1 - ACT Plus Writing (March 27, 2007)
• Day 2 - WorkKeys Michigan Math (March 28, 2007)
• Day 2-7 - Michigan Science and Social Studies
  (March 28-April 4, 2007)
• Special Testing Windows (March 27-April 11, 2007)

41
Key 2006-07 MME Dates

• May-July, 2007
• Students receive their reports
• Regular ACT reports (college-reportable)
• WorkKeys reports
• MME score reports
• Schools receive ACT, WorkKeys, and MME score
  reports
• MME scores used for EducationYES! accreditation
  and NCLB AYP accountability purposes

42
Key 2006-07 MME Dates

• August-September - Students register for MME
  October Retake via ACT (using a voucher
  available at their school)
• MME Fall Retake
• Day 1 - ACT Plus Writing (Saturday, October 27,
  2007)
• Day 2 - WorkKeysMichigan Math (Tuesday, October
  30, 2007)
• Days 2-7 - Michigan Science and Social Studies
  (Tuesday, October 30-Wednesday, November 6, 2007)
• Special Testing (October 27-November 13, 2007)

43
How do Students benefit from taking the ACT?

• The ACT is universally accepted for college
  admission.
• The ACT is curriculum-based.
• The ACT is more than a test.

44
How do Schools benefit from taking the ACT?

• Evaluate student readiness
• Evaluate/inform instructional programs
• Document Progress and Success with the EPAS
  system
• Effectively advise guide students

45

• ...a foundational skills development system, best
  known for translating a vague statement like "we
  need more math" into a precise set of teachable
  skills really used in a career.
• Educators - tailor development plans and certify
  career readiness
• Employers - determine hiring qualifications and
  training needs
• Economic and workforce developers - match
  employers and communities

46
(No Transcript)
47
Getting Started Now

• Consider how and where the MME will be
  administered
• Make sure IEP teams are considering
  accommodations needed for both high school
  assessments
• MEAP HST
• MME
• Think about who will manage the MME
• Test Supervisor and Back-up Test Supervisor
• Test Accommodations Coordinator
• Review information posted on www.michigan.gov/mme
  website

48
Helping Students Prepare for MME

• Assure that the high schools curriculum is
  aligned to state standards and benchmarks, the
  new high school content expectations, and
  ACT-assessed standards
• Assure that course content matches course titles
• Encourage students to enroll in rigorous college
  preparatory classes (or equivalent ones that
  address the same content with the similar rigor)

49
Helping Students Prepare for MME

• Have students participate in reasonable ACT prep
  activities
• Use ACT or commercial products to practice taking
  a timed test
• Become comfortable with the test formats
• Focus on learning the skills defined in the
  standards and benchmarks rather than just
  practicing test-taking skills

50
Getting Started Now

• Review past ACT high school assessment reports
• What percent of students take the ACT?
• What percent of students take recommended college
  core courses?
• What is the performance of students taking
  college core versus those who did not?
• What are the trends over time?
• What are the implications of ACT results?
• For counselors - better course-taking advice?
• For academic departments - improved rigor of
  courses?
• For districts - More rigorous graduations
  requirements?

51
Challenges

• Assuring adequate assessment administration
  preparation - for very secure tests (ACT)
• Participation of students with disabilities
• What accommodations will be needed? See MME
  website Spring 2007 Michigan Merit Exam (MME)
  Accommodations Summary Table.
• Will MI-Access be used by some students?
• Participation of English language learners
• What accommodations will be offered and under
  what conditions? See MME website Spring 2007
  Michigan Merit Exam (MME) Accommodations Summary
  Table.

52
For Questions and Comments

• Edward Roeber
• [phone] voice
• Roebere_at_michigan.gov
• Mike Radke
• [phone] voice
• Radkem_at_michigan.gov
• Jim Griffiths
• [phone] voice
• Griffithsj_at_michigan.gov
• Michigan Department of Education
• Office of Educational Assessment Accountability
• P.O. Box 30008
• Lansing, MI 48909

53
For More Information

• For more information on MME
• www.michigan.gov/mme
• For MDE assessment questions
• (877) 560-TEST (8378)
• For ACT- or WorkKeys-specific questions
• mi.mme_at_act.org
• For Pearson Educational Measurement
• [phone]

54
Thank you!

• Video conference sites around Michigan
• Wayne RESA
• Mistreamnet and the Sustained Learning Regions
• Sam LoPresto
• Presenters and staff
• And You!

55

• VHS Copies 10.00 4.00 S HDVD Copies
  10.00 4.00 S HContact Brenda Hose,
  734-334-1437hoseb_at_resa.net
• Rebroadcast archived at http//www.mistreamnet.co
  m
• Powerpoint and attachments available on MME
  website
• http//www.michigan.gov/mme