Closing the Loop : Evaluation of SLO Assessments

1
Closing the Loop Evaluation of SLO Assessments

• Salomón Dávila
• Engineering and Technology Division

2
Objectives

• Demonstrate the evaluation of two different
  assessments methods.
• Mid Term Exam
• Final Project Presentation
• Discuss how the evaluation affected course
  changes (closed the loop) towards SLO achievement
  and classroom activity.

3
Mid-term Exam Evaluation

• DRFTG 8A Students evaluated their exam before
  they received their grade based on
• Activities in class
• Relevancy of questions
• Feasibility of the exam.
• Time dedicated to material.
• Survey was taken anonymously with free online
  tool http//www.surveymonkey.com
• Graphs below are scaled to represent percentages
  of responses.

4
Rate how the class activities prepared you for
the exam.
5
How relevant were the questions in the exam to
the material covered?
6
Rate the feasibility of the exam.
7
Consider time for all class activities
8
Final Project Presentation

• Rubrics were used to evaluate each class SLOs
  during a final individual or group presentation
• Each SLO was broken down into subcategories
  (SPOs)
• Rubrics were handed out at the commencement of
  the final project

9
Sample Rubric Entry
10
DRFTG 8A Engineering Graphics Principles

• SLO 1 Analyze engineering and technical
  graphics by evaluating view representations,
  dimensions, and geometric relationships.
• SLO 2 Construct engineering and technical
  graphics through selection of sketching,
  instrument drawing and computer-aided design
  (CAD) techniques.
• SLO 3 Implement effective team problem-solving
  in developing engineering and technical graphics
  for designs.
• SLO 4 Present engineering and technical
  information by developing graphical, oral, and
  written forms of communications.

11
DRFTG 8A SLO Evaluation
12
DRFTG 8B Engineering Modeling and Working Drawings

• SLO 1 Construct updateable CAD parametric solid
  models for the production of engineering working
  drawings through constraining of sketches,
  features, planes, and assemblies.
• SLO 2 Analyze engineering and technical
  graphics to develop CAD parametric modeling
  procedures and strategies.
• SLO 3 Design a team project from standard
  mechanical components applying systematic
  engineering design methods.
• SLO 4 Develop team framework and management
  strategies for design and presentation of a team
  project.

13
DRFTG 8B SLO Evaluation
14
DRFTG 8C Engineering Product Development

• SLO 1 Develop complex CAD parametric solid
  models for the automotive, aerospace, machinery,
  and consumer product industry applying higher
  order modeling methods.
• SLO 2 Analyze CAD solid models and assemblies
  applying strength and motion tests.
• SLO 3 Design and Develop a prototype for a
  product applying systematic engineering design
  methods.
• SLO 4 Select materials and manufacturing
  processes by analyzing design and cost
  requirements for products.
• SLO 5 Present the development of a product
  justifying design methods through information
  research and prototyping.

15
DRFTG 8C SLO Evaluation
16
Closing the Loop

• Changed textbook for DRFTG 8A for better
  readings.
• Added dimensional analysis component in
  assignments.
• Reworded questions but left the time limit the
  same. (average was an 85)
• Added more isometric sketching problems and
  approached visualization exercises with hands-on
  activities.
• Teamwork and presentations skills will need to be
  developed through out semester using WAC
  activites
• Develop stronger assignments for 8C SLOs through
  industry and library collaboration.

17
Last Thoughts on Evaluation

• Students were made aware of expectations and
  appreciated that their opinion mattered.
• Students completed rubrics for peers but were not
  considered for final grade
• Evaluations methods and peer review of SLOs were
  well received.
• SLO Success Rates
• 8A - 84.6
• 8B 81.9
• 8C 75.3