Developing and Using an Instrument to Describe Instructional Design Elements of High School Online C

1
Developing and Using an Instrument to Describe
Instructional Design Elements of High School
Online Courses

• A dissertation presented by
• Christy Keeler

2
Presentation Overview

• Overview of study
• Online course descriptions
• Description of methodology
• Instrument description
• Findings and implications

3
Overview of Study

• Need for this study
• Research Questions
• What are the instructional design elements of
  high school online courses?
• What instructional design elements appear most
  commonly in high school online courses?
• What instructional design elements of high
  school online courses can be used to distinguish
  between online courses?
• Phases of Study

4
Course Descriptions and an Online Course Example
5
Online Course Descriptions Models of Online
Courses

• Guided collaboration model
• Virtual classroom model
• Attempts to duplicate traditional models by
  leveraging the abilities of the WWW
• Synchronous and asynchronous communication
• Multimedia interaction

6
Example School Homepage
7
Example Course Management System Course Homepage
8
Example Course Homepage
9
Example Unit Homepage
10
Example Lesson, page 1
11
Example Lesson, page 2
12
Example Lesson, page 3a
13
Example Lesson, page 3b
14
Example Lesson, page 3c
15
Example Lesson, page 4a
16
Example Lesson, page 4b
17
Example Lesson, page 5
18
Methodology
19
Methodology

• Theory-based instrument development
• Identification of elements
• Pilot testing
• Instrument refinement
• Validity and reliability testing
• Course reviews
• Reporting and discussing results

20
Methodology Theory-based Instrument Development

• Identification of elements
• Instrument descriptors

21
Methodology Theory-based Instrument Development

• Identification of elements
• Instrument descriptors
• Excluded elements

22
Methodology Theory-based Instrument Development

• Identification of elements
• Instrument descriptors
• Excluded elements
• Actual instrument

23
Methodology Theory-based Instrument Development

• Identification of elements
• Instrument descriptors
• Excluded elements
• Actual instrument
• Pilot testing

24
MethodologyInstrument Refinement

• Content validity testing
• Expert review process
• Inter-rater reliability testing
• First Stage
• Second Stage
• Booster session
• Final session

25
MethodologyInstrument Use

• Course Reviews
• Results Reporting
• Findings Discussion

26
Instrument Description
27
Instrument Schema
28
Review of InstrumentLesson Level
Go to Actual Instrument
29
Reporting Results and Discussing Findings
30
Results
31
Findings and Implications
32
Common Course Features

• Course Level
• Website Design
• Instructional Design
• Content Design
• Lesson Level
• Assessment Level

33
Uncommon Course Features

• Course Level
• Lesson Level
• Instructional Design
• Website Design
• Assessment Level

34
So What?

• Validates that contemporary courses display an
  identifiable instructional design structure
• Compares to and contrasts from instructional
  design literature
• Debunks many critics claims
• Recommendations for designers

35
New Research Questions

• Is there a difference between instructional
  design at various academic levels?
• What typologies exists?
• Which elements affect learning and retention?
• What instrument modifications could lead to an
  evaluative measure?

36
Developing and Using an Instrument to Describe
Instructional Design Elements of High School
Online Courses

• A dissertation presented by
• Christy Keeler