Teaching and Assessing Science Core Concepts TASC2 Workshop

1
Teaching and Assessing ScienceCore Concepts
(TASC2) Workshop

• Science Core Concepts
• Enhancing an Instructional Unit with the 2007
  Weather Wonders Systems PCA
• Establish the Desired Results
• Essential Question Activity
• Assessment Targets
• Learning Plans
• Legislative Update, 2007 WASL Results the
  Crisis in Science Education
• What We Know About Successful Program

2
OSPI Science Assessment Team
Andy Boyd Assessment TOSA (PEM) andy.boyd_at_k12.wa.u
s
Roy Beven Assessment Manager roy.beven_at_k12.wa.us
Jonathan Frostad Assessment TOSA (PEM),
jonathan.frostad_at_k12.wa.us
Cinda Parton Assessment Specialist cinda.parton_at_k
12.wa.us
Molly Becker Miller Assessment
Support molly.becker-miller_at_k12.wa.us
Science Assessment Leadership Team (SALT) The
160 members of this team have developed deep
understanding of assessment and are available to
provided PD. Contact information will be the
science assessment webpage soon. OSPI Science
Assessment Webpage www.k12.wa.us/assessment/WASL
/Science
3
Teaching and Assessing Science Core Concepts
(TASC2)

• Activity Questions
• How is this system related to the core concept?
• What activities in your instructional materials
  are focused on this this core concept?
• How do you gather evidences of learning for this
  core concept in your classroom?
• What preconceptions and misconceptions might
  students have?

Capture ideas on chart paper and share
4
Teaching and Assessing Science Core Concepts
(TASC2)
Focus on a System Core Concept
Core Concept Components and Patterns of Earth
Systems ST04 1.2.4
Inquiry in Science
Related Concept Nature and Properties of Earth
Materials
Application of Science
5
Teaching and Assessing Science Core Concepts
(TASC2)
Research
Characteristics of Schools Showing the Greatest

by RMC Corporation
2007 Understanding by Design by Jay McTighe
Grant WigginsASCD 2004 ISBN 1-4166-0035-3 Science
Curriculum Topic Study by Page Keeley
NSTA/Corwin Press 2005 ISBN 1-4129-0892-2
6
Teaching and Assessing Science Core Concepts
(TASC2)

• Core Concept Handout page 2.
• Benchmarks for Science Literacy
• National Science Education Standards
• Benchmarks for Science Literacy
• Making Sense of Secondary Science Research Into
  Childrens Ideas

Take a minute and read page 2 of the handout. Any
similarities/differences from the chart paper?
7
Assessment Target
Powerful Classroom Assessment Weather
Wonders Elementary Systems Scenario
Please take 15 minutes to read the scenario and
write out responses to the 10 items
Please take 5 minutes to score the multiple
choice items using the Scoring Guide (yellow)
8
Assessment Target

• Core Concept Handout page 1.
• Core concept defined in the physical system
• Questions gather specified evidences of learning
• Item 6 of Weather Wonders Factors Affecting
  Precipitation

Take a minute and read page 1 of the handout.
Brainstorm any other system questions not a part
of the scenario on this core concept?
9
Learning Plan

• Core Concept ST04 Question
• What activities in your classroom could elicit
  these evidences of learning?

Capture ideas on chart paper and share
10
Teaching and Assessing Science Core Concepts
(TASC2)
CORE CONCEPT Components and Patterns of Earth
Systems (ST04)
What lessons in your instructional materials
focus on the Core Concept? Describe the
enhancements needed to ensure all students are
proficient on the targeted core concepts. (Group
work is also encourage)
Capture ideas on chart paper and share
11
Teaching and Assessing Science Core Concepts
(TASC2)

• Components
• Description of the system core concept
• Graphic organizer of the system core concept
• Description of the inquiry and application core
  concepts
• Enhancements to the learning plan of an
  instructional material to ensure students become
  proficient on the targeted core concepts
• System, inquiry, and application WASL-like
  scenarios as targets to develop diagnostic,
  formative, and summative assessment tools

12
WA Science Standards
13

• Core Concepts of Physical Systems
• Energy Transfers Transformations
• Forces to Explain Motion
• Conservation of Matter ( Energy)

• Core Concepts of Earth Space Systems
• Components Patterns of ES
• Processes Interactions in ES
• Interactions in the Solar System Beyond

• Core Concepts of Living Systems
• Life Processes the Flow of Matter Energy
• Interdependence of Life
• Biological Evolution

14

• Core Concepts
• Planning Conducting Safe Investigations
• Explaining (the results of an investigation)
• Evaluating Methods of Investigations

• Core Concepts
• Designing and Testing Solutions
• Evaluating Potential Solutions
• Environmental and Resource Issues

15
Measuring Proficiency to Improve Student Learning

• Guiding Principles
• Research Scenario Design, measure Application of
  Concepts and Processes
• Science Standards to focus Scenarios
• Science GLEs as Item Learning Targets
• Science Evidences of Learning as Item
  Specifications
• Washington Science Teachers as Writers (wisdom of
  practice)

16
Science Assessment
Scenario Test Map Point-balanced in Physical,
Earth/Space, Living Systems
1
Investigating a Physical System
2
Investigating an Earth/Space System
3
Investigating a Living System
4
Designing a Solution
5
Analyzing a System
6
Analyzing a System
Also, there is a Pilot Scenario with 5 items
toward the end of a session.
17
Science WSAL Items Points
18
A System PCA
Written with a reading level two grades below the
grade being tested, items ask students to
Identify System Properties
19
An Inquiry PCA
Written with a reading level two grades below the
grade being tested, items ask students to
Analyze a Student Investigation of a System
Nature of Science
20
An Application PCA
Written with a reading level two grades below the
grade being tested, items ask students to
Analyze a Student Scientific Design Process
21
Todays Science Powerful Classroom Assessments
(PCAs)
Problem Released Scenarios/Items being used as
models for classroom assessments instead of the
WASL Specifications Solution Show how powerful
the Science WASL writing templates are at
modeling the Science EALRs and helping people
learn the Science GLEs

• Rebuild the Released Scenarios print like the
  WASL
• Scenario Map Scoring Guide with Data (yellow
  paper)
• Ten Student Responses with Scoring Space (green
  paper)
• Annotations for Scoring Student Responses (blue
  paper)

Use PCA Workshops for Teachers and some
teachers adapted these workshops for their
students
22
OSPI Science Assessment Enhancements
OSPI Science Assessment produces Powerful
Classroom Assessment (PCAs) for teacher
workshops. PCAs are fine assessment targets from
which diagnostic, formative, and summative tools
can be developed. When teacher adapt PCAs for
their students, student proficiency increases.
Grade 5 PCAs Scenario, Scoring Guide, 10
annotated Student Responses for each of the 3
open-ended items Better Boiling Physical
System Inquiry 2007 WASL Weather Wonders Earth
System 2007 WASL Let Us Grow Living System 2006
WASL The Birds Living System Application 2006
WASL Hold That Soil Earth System Inquiry 2005
WASL Grass is Always Greener Living System
Inquiry 2004 WASL Acid Rain Living System
Inquiry STC
23
OSPI Science Assessment Enhancements
Grade 8 PCAs Scenario, Scoring Guide, 10
annotated Student Responses for each of the 3
open-ended items Wild About Radishes Living
System Inquiry 2007 WASL Soccer Soaker Earth
System Application 2007 WASL Respiratory System
Living System 2007 WASL Whats Your Angle Earth
System Inquiry 2006 WASL Clean Water Physical
System Application 2006 WASL School Garden
Living System Application 2005 WASL Pilot In
the Doghouse Physical System Inquiry
2005 Bubble Gum vs. Chewing Gum Living System
Inquiry 2003 Electricity to Light Physical
System Inquiry STC/MS
24
OSPI Science Assessment Enhancements

• High School PCAs Scenario, Scoring Guide, 10
  annotated Student Responses for each of the 3
  open-ended items
• Sliding Away Earth System Inquiry 2007 WASL
  Lifting a Load Physical System
  Application 2007 WASL
• Aquarium Systems Living System Inquiry
  2006 WASL
• Super Grow Living System Inquiry 2004 WASL
  Mousetrap Cars Physical System
  Application NSTA Press
• PCA Writing Templates for each grade and type of
  scenario
• Science Instructional Material Enhancement (SIME)
  Scenario Writing Templates for each grade and
  type of scenario with a focus core concept items

25
State Science Proficiencies
Crisis in Science Education For 5 yrs, 2 of 3
students did NOT understand science. What will be
different in the next 5 yrs?
26
Grade 5 Student Science WASL

• Students at Each Performance Level ()

2007
41.0
29.9
5.9
21.2
30,390
22,177
4,370
15,714
31.2
40.1
23.0
4.5
2006
17,260
30,097
23,391
3,360
27
Grade 8 Student Science WASL

• Students at Each Performance Level ()

34.7
29.4
23.7
9.4
2007
27,282
18,592
23,110
7,403
2006
2004
35.2
4.2
33.8
23.6
28
Grade 10 Student Science WASL

• Students at Each Performance Level ()

Advanced
Proficient
Basic
Below Basic
2007
2006
2005
2004
2003
-60.0
-40.0
-20.0
0.0
20.0
40.0
60.0
Percent of Students Who Took Test
29
What items make the difference between basic
(level 2) and proficient (level 3) students?
Analyzing Science WASL Results
30
What We Know About Successful Programs

• Districts needs a Science Plan and Leadership for
  Science
• Teachers must understand the core concepts and
  appropriate best practice
• Teachers need research-based instructional
  materials
• Instructional materials need a focus on core
  concepts and enhanced diagnostic, formative, and
  summative assessments

31
Enhancing Instruction to Improve Student Learning

• Focus on the Science EALRs Systems, Inquiry, and
  Application

• Evaluate Student Understanding - Describe energy
  transfers - Write a conclusion to an
  investigation - Plan for an investigation-
  Design a solution to a human problem

• Use Supported, Enhanced Instructional Materials

32
Legislative Update

• Federal NCLB Science to become part of AYP
• State Laws Actions
• 1. HB 1128 (appropriations bill)
• a. 2, 3, 5 additional PD days for science
  assessment literacy to implement new standards
  (talk to your district leadership)
• b. Quadruple LASER funding www.wastatelaser.org
• c. ESD science specialist 2008-09

33
Legislative Update

• 2. HB 1906 Strengthen Math Science Standards
• a. State Board of Education (SBE) to recommend
  revision to science standards via Science
  Advisory Panel (consultant via RFP) 6/08
  www.sbe.wa.gov
• b. OSPI to revise science standards by 12/08
  (consultant via RFP)
• c. OSPI to recommend 3 science instructional
  materials by 6/09 (consultant via RFP)
• d. 25 secondary science coaches 2008-09 (OSPI
  to accept district proposals)

34
Legislative Update

• 2. HB 1906 Strengthen Math Science Standards
  (continued)
• e. Science proficiency for graduation in 2013
  (this years 7th graders)
• f. Study End-of-Course tests for science and
  math (Governor request through OSPI via
  consultant from RFP, on-going)
• 3. OSPI new Assessment Contract Spring 2008
• a. Same science WASL
• b. Many new enhancements alternatives
  including end-of-course tests (if funded)

35
Crisis in Science Education2007 Grade 10 Student
Performance

• Data Notes from OSPI Website, School Report Card,
  WASL, Scale, 10th
• This data is for the 10th graders who took, or
  should have taken, the High School Science WASL
  (75,162 students), not the 9th, 11th, or 12th
  graders who took the test.
• Included in the Level 1 calculations are 9,092
  students (12.1) who received no score unexcused
  absence/refusal 3,708 students (4.9), other (no
  booklet, CSRS but no booklet, incomplete,
  invalidated, and out of grade level) 5,386
  students (7.2)
• 10th graders not included in this data include -
  WAAS portfolio 633 students, Excused Absence
  5,011 students, Exempt 1,884 students
• Excluding no score students, 41.1 of the 10th
  graders met standard

36
Crisis in Science Education2007 Grade 10 Student
Performance

• The Good News
• There were only 9 score points in Level 2 (Basic)
  this year.
• There is no difference in performance between
  Basic and Proficient students on MC questions, on
  Physical vs. Earth vs. Living system items, or on
  content vs. process items.
• Basic students earn an average of ½ a point on
  2-pt items, whereas, Proficient student earn an
  average of 1 point. (11 2-pt items, 22 pts)
• Basic students earn an average of 1 point on 4-pt
  items, whereas, Proficient student earn an
  average of 2 points. (3 4-pt items, 12 pts)

37
Crisis in Science Education
38
Crisis in Science Education
39
Crisis in Science Education2007 Grade 8 Student
Performance

• The Good News
• There were only 13 score points in Level 2
  (Basic) this year.
• There is no difference in performance between
  Basic and Proficient students on MC questions, on
  Physical vs. Earth vs. Living system items, or on
  content vs. process items.
• Basic students earn an average of ½ a point on
  2-pt items, whereas, Proficient student earn an
  average of 1 point. (11 2-pt items, 22 pts)
• Basic students earn an average of 1 point on 4-pt
  items, whereas, Proficient student earn an
  average of 2 points. (3 4-pt items, 12 pts)

40
Crisis in Science Education
41
Crisis in Science Education2007 Grade 5 Student
Performance

• The Good News
• There were only 16 score points in Level 2
  (Basic) this year.
• There is no difference in performance between
  Basic and Proficient students on MC questions, on
  Physical vs. Earth vs. Living system items, or on
  content vs. process items.
• Basic students earn an average of ½ a point on
  2-pt items, whereas, Proficient student earn an
  average of 1 point. (10 2-pt items)
• Basic students earn an average of 1 point on 4-pt
  items, whereas, Proficient student earn an
  average of 2 points. (2 4-pt items)

42
Crisis in Science Education
43
What We Know About Successful Programs

• Districts needs a Science Plan and Leadership for
  Science
• Teachers must understand the core concepts and
  appropriate best practice
• Teachers need research-based instructional
  materials with PD
• Instructional materials need a focus on core
  concepts and enhanced diagnostic, formative, and
  summative assessments

44
OSPI Science Assessment Enhancements
OSPI Science Assessment produces Powerful
Classroom Assessment (PCAs) for teacher
workshops. PCAs are fine assessment targets from
which diagnostic, formative, and summative tools
can be developed. When teacher adapt PCAs for
their students, student proficiency increases.
Grade 5 PCAs Scenario, Scoring Guide, 10
annotated Student Responses for each of the 3
open-ended items Better Boiling Physical
System Inquiry 2007 WASL Weather Wonders Earth
System 2007 WASL Let Us Grow Living System 2006
WASL The Birds Living System Application 2006
WASL Hold That Soil Earth System Inquiry 2005
WASL Grass is Always Greener Living System
Inquiry 2004 WASL Acid Rain Living System
Inquiry STC
45
OSPI Science Assessment Enhancements
Grade 8 PCAs Scenario, Scoring Guide, 10
annotated Student Responses for each of the 3
open-ended items Wild About Radishes Living
System Inquiry 2007 WASL Soccer Soaker Earth
System Application 2007 WASL Respiratory System
Living System 2007 WASL Whats Your Angle Earth
System Inquiry 2006 WASL Clean Water Physical
System Application 2006 WASL School Garden
Living System Application 2005 WASL Pilot In
the Doghouse Physical System Inquiry
2005 Bubble Gum vs. Chewing Gum Living System
Inquiry 2003 Electricity to Light Physical
System Inquiry STC/MS
46
OSPI Science Assessment Enhancements

• High School PCAs Scenario, Scoring Guide, 10
  annotated Student Responses for each of the 3
  open-ended items
• Sliding Away Earth System Inquiry 2007 WASL
  Lifting a Load Physical System
  Application 2007 WASL
• Aquarium Systems Living System Inquiry
  2006 WASL
• Super Grow Living System Inquiry 2004 WASL
  Mousetrap Cars Physical System
  Application NSTA Press
• PCA Writing Templates for each grade and type of
  scenario
• Science Instructional Material Enhancement (SIME)
  Scenario Writing Templates for each grade and
  type of scenario with a focus core concept items