DR-K12 PI Meeting Building the Knowledge Base of Teacher Learning in STEM Education

1
DR-K12 PI Meeting Building the Knowledge Base of
Teacher Learning in STEM Education

• A Framework and Suite of Adaptable Instruments
  for Examining Fidelity of Implementation

Jeanne Century Center for Elementary Mathematics
and Science Education University of
Chicago November 9th, 2009
2
Why measure Fidelity of Implementation (FOI)?
Determine if programs are effective
Determine which parts of programs are effective
Determine why and under what conditions parts of
programs are effective
3
Challenges
Instruments that could be used across multiple
programs
A suite of instruments that could be used alone
or in combination depending on resources and
goals
Provide detailed and specific information about
FOI
4
Definitions
FOI The extent to which an enacted program is
consistent with the intended program model
Critical Components The elements of a program
model that are essential to its implementation
FOI Operationalized The extent to which the
critical components of a program are present when
the program is enacted
5
FOI Framework
FOI of Instructional Materials FOI of Instructional Materials FOI of Instructional Materials FOI of Instructional Materials
Categories of Critical Components Categories of Critical Components Categories of Critical Components Categories of Critical Components
Structural Structural Instructional Instructional
Procedural Educative Pedagogical Student Engagement
6
FOI Framework and Critical Components
FOI of Instructional Materials FOI of Instructional Materials FOI of Instructional Materials FOI of Instructional Materials
Categories of Critical Components Categories of Critical Components Categories of Critical Components Categories of Critical Components
Structural Structural Instructional Instructional
Procedural Educative Pedagogical Student Engagement
Inclusion of all essential segments within a lesson Use of class structures Content background information Lesson Notes Teacher facilitation of group work Teacher facilitation of student autonomy Students contribute to small group work Students demonstrate autonomy
7
Instruments
Teacher Questionnaire Teacher Instructional
Observation Protocol Teacher Interview
Protocol Teacher Instructional Log Teacher
Attitude Questionnaire School Leader
Questionnaire School Leader Interview
Protocol School-wide Observation Protocol
8
Programs
Science and Technology for Children FOSS SEPUP IES
Everyday Mathematics Science Companion
9
FOI Framework and Differentiation
FOI of Instructional Materials FOI of Instructional Materials FOI of Instructional Materials FOI of Instructional Materials
Categories of Critical Components Categories of Critical Components Categories of Critical Components Categories of Critical Components
Structural Structural Instructional Instructional
Procedural Educative Pedagogical Student Engagement




Categories of Differentiation
Mathematics And Science
Science Only
Mathematics Only
Program Specific
10
Uses of the Framework and Measures
Impact of a single program Compare two or more
programs Compare programs to business as
usual Compare two versions of a program
FOI of Instructional Materials FOI of Instructional Materials FOI of Instructional Materials FOI of Instructional Materials
Categories of Critical Components Categories of Critical Components Categories of Critical Components Categories of Critical Components
Structural Structural Instructional Instructional
Procedural Educative Pedagogical Student Engagement




Categories of Differentiation
Common
Program A
Program B
Program C
Developers
U.S. Satellite, Inc. additional elements
Trailblazers look at a critical component in
more depth
Evaluators
Schoolbased change model Lindblom High
School Programmatic model E2SP
11
FOI Supplement Work
Researchers Without Borders
Resources FAQs Research Tools and Instruments
Learning Webinars Collaboration
Community Development Ning (researcherswithoutb
orders.ning.com) In-Person Meeting
Jeanne Century Center for Elementary Mathematics
and Science Education University of
Chicago jcentury_at_uchicago.edu www.researcherswitho
utborders.org/projects/enactment