The Assessment of Teaching with Technology

1
The Assessment of Teaching with Technology

• Dan Talley
• Dakota State UniversityJune 4, 2004

2
Perspective on the Issue

• The study produced two pieces of bad news
• 1) The experimental group, using computer
  conferencing, showed no progress in their ability
  to compose an essay.
• 2) The control group, taught by traditional
  methods, showed no progress either.
• Paraphrased from a talk on an early use of
  computer conferencing in English composition
  courses.

3
Recommended Approach

• 2-step process to Assess Teaching with Technology
  (Ehrmann, 1995)
• Study which teaching and learning strategies are
  best (especially those that would not even be
  feasible without the newer technologies).
• Study which technologies best support those
  strategies.

4
Adapting Your Course to Include Assessment

• Instructional Design of the Course to Integrate
  Technology Use and Incorporate Assessment Tools
• Assessment of Student Use of Technology
• Assessment of Student Performance from Technology
  Use

5
Types of Course Assessment

• Classroom Assessment Used to provide information
  for the instructor about student progress while
  the course is ongoing. (Angelo Cross, 1993)
• Outcomes Assessment Used to provide information
  about student progress after the course is
  finished. May be shared with external reviewers.

6
Writing TwT Assessment Goals and Objectives

• Goal Wireless Mobile Computing Technology will
  be Integrated into my course to Promote Student
  Learning.
• ObjectivesThe objectives will vary from course
  to course, by faculty member.
• Common objectives can be identified.

7
Possible Objectives

• Encourage Contact between Students and Faculty
• Promote Collaborative Student Learning
• Promote Active Learning Techniques
• Provide Prompt Feedback

• Increase Student Time on Task
• Communicate High Expectations
• Respect Diverse Talents and Ways of Learning
• Encourage Creativity

8
Assessment of the Objectives

• Your Task Identify, Modify, or Develop
  Assessment Tools to Assess the Objectives
• Track Usage of Technology Tools(Laptop/Tablet
  PC, WebCT, etc.)
• Track Performance (Scores/Grades)
• Student Feedback
• Instructor (Self-)Feedback

9
Assessment Tools

• Computer-based Student Tech Use Tracking
  (WebCT?)
• Pre-Test / Post-TestExperimental Design
• Classroom Research (Control Section / Treatment
  Section)
• SOS, Tek.Xam, etc.

• Student Attitude Survey / Interview
• Faculty Self-Report Learning Strategies and Tech
  Use Tracking
• Student Self-Report Tech Use Tracking- Log or
  Journal

10
Subjects to Assess

• General Teaching and Learning
• Teaching, Learning and Technology
• Technology Use
• Student Satisfaction
• Course Satisfaction
• Satisfaction with Training
• Self-Reported Learning Outcomes
• Student Academic and Demographic Info

11
Assessment Using Wireless Mobile Computing

• Online Surveys and Tests
• Online Assessment Question Bank
• (WebCT-based?) Online Assessment Questionnaire
  Template
• Online Classroom Assessment Tools
• Resources Developed over the Summer

12
Written Analysis and Summary

• Close the Feedback Loop
• Qualitative Analysis of Results
• Quantitative Analysis of Results
• Simple Correlations between different measures
• More advanced techniques
• Summarize Your Findings and Suggest Ideas to
  Improve Future Results

13
Future Faculty Development

• A Team from DSU was chosen to attend The
  Collaboration 2004 Summer Institute.
• Design New Faculty Development Program for
  Laptop/Tablet Integration into Teaching and
  Learning
• Seven Faculty, Four Days
• Look for Faculty Orientation and Fall Semester
  Sessions