Using Calibrated Peer Review CPR to Improve Students Ability to Evaluate Technical Posters in a Bioe - PowerPoint PPT Presentation

Loading...

PPT – Using Calibrated Peer Review CPR to Improve Students Ability to Evaluate Technical Posters in a Bioe PowerPoint presentation | free to view - id: 20c32a-ZDc1Z



Loading


The Adobe Flash plugin is needed to view this content

Get the plugin now

View by Category
About This Presentation
Title:

Using Calibrated Peer Review CPR to Improve Students Ability to Evaluate Technical Posters in a Bioe

Description:

Using Calibrated Peer Review CPR to Improve Students Ability to Evaluate Technical Posters in a Bioe – PowerPoint PPT presentation

Number of Views:51
Avg rating:3.0/5.0
Slides: 36
Provided by: tracy163
Category:

less

Write a Comment
User Comments (0)
Transcript and Presenter's Notes

Title: Using Calibrated Peer Review CPR to Improve Students Ability to Evaluate Technical Posters in a Bioe


1
Using Calibrated Peer Review (CPR) to Improve
Students Ability to Evaluate Technical Posters
in a Bioengineering Laboratory
  • Tracy Volz, Ph.D.
  • Ann Saterbak, Ph.D.
  • Rice University

2
Cain Project Collaboration
  • Course planning
  • Communication instruction
  • Instructional materials
  • Evaluation
  • Individual coaching

3
Tissue Culture Lab (BIOE 342)
  • Junior-level course
  • Required for Bioengineering majors
  • Learn sterile technique
  • Perform 6 expts
    using fibroblast cells
  • Technical poster is major
    assignment
  • Taught since 2001
  • CPR implemented in 2006

4
Why CPR?
  • Poster assignment started in 2001.
  • One poster
  • Saterbak grades
  • Poster refinement started in 2002.
  • Draft and final posters
  • Saterbak and Volz grade
  • Noticed that students have difficulty with
  • Technical argument
  • Logical presentation
  • Graphs and tables
  • Drawing appropriate results, conclusions

5
Add CPR to Course
  • Implemented CPR in 2006
  • Give students practice to improve skills in noted
    areas of difficulty
  • Maintained draft and final posters
  • Saterbak and Volz grade
  • NOT used to replace instructor grading

6
Key Points
  • Adapted CPR for PowerPoint.
  • Calibration material is key to success.
  • Peer evaluation tracks with instructor
    evaluation.
  • Student self-evaluation does not track with
    instructor or peer evaluation.
  • Students perceive that their technical critiquing
    skills improve.

7
Agenda
  • Poster project description
  • CPR implementation
  • CPR results
  • Survey data
  • Lingering issues

8
Rationale for Teaching Poster Design
  • Posters require students to
  • Think critically about experiments
  • Synthesize results
  • Distill key points
  • Display graphs, tables
  • Write succinctly
  • Common communication mode
  • 75 undergraduates doing research

9
Poster Assignment
  • Objective
  • Develop poster summarizing results of
    experiments with fibroblast cells.
  • Assignments
  • Draft poster (10 of grade)
  • CPR component (10 of grade)
  • Final poster (20 of grade)

10
Sample Poster
11
Coaching on Poster Design
  • Implementation
  • CP gives 30 min presentation on What makes a
    good poster.
  • Students revise 2-3 panels.
  • Students view several excellent posters.
  • Emphasis on 16 CPR questions.

12
CPR Questions (of 16)
13
CPR Questions (of 16)
14
Effect of Serum Concentration on Cell
Proliferation
Faster cell proliferation in 10 FBS
CPR guiding question Graphs have the appropriate
scale, labels and units, and chart junk has
been eliminated.
10 FBS
5 FBS
1 FBS
Slower cell proliferation in 1 FBS
15
Effect of Serum Concentration on Cell
Proliferation
Reviewer 1 A. Well, you did all this, so you get
an A.
Reviewer 2 A. Graphs are very clear,
well-labeled, and consistent.
Faster cell proliferation in 10 FBS
10 FBS
Instructor A. Good size font and bullets data
labels ? missing t 4 hr (day 0) time point
not sure the equations need to be bold.
Reviewer 3 B. The equations of the lines are
extra information that isn't really needed
clutters the graph a little.
5 FBS
1 FBS
Slower cell proliferation in 1 FBS
16
Anti-PCNA Staining and Cell Proliferation Assays
  • Anti-PCNA Staining Assay assesses stage of cell
    cycle at one instance (day 2)
  • Cell Proliferation Assay measures proliferation
    over time period (7 days)
  • Together, assays suggest that cells in 10 FBS
    reach the S phase and proliferate faster than in
    1 or 5 FBS
  • Hypothesize cells reaching S phase earlier also
    advance through cell cycle quicker and thus
    proliferate faster

CPR guiding question The results from similar
experiments are compared and synthesized.
17
Anti-PCNA Staining and Cell Proliferation Assays
Reviewer 2 Yes. The Anti-PCNA Staining and Cell
Proliferation Assays slide is good but make sure
that the S phase hypothesis is supported by the
experiment.
Reviewer 1 Yes. I kinda like how you posed the
hypothesis that cells proliferate faster because
they enter the S phase, but at the same time I am
a little uneasy about that.
  • Anti-PCNA Staining Assay assesses stage of cell
    cycle at one instance (day 2)
  • Cell Proliferation Assay measures proliferation
    over time period (7 days)
  • Together, assays suggest that cells in 10 FBS
    reach the S phase and proliferate faster than in
    1 or 5 FBS
  • Hypothesize cells reaching S phase earlier also
    advance through cell cycle quicker and thus
    proliferate faster

Instructor No. Logic flawed. No real evidence.
Could it be that more cells are proliferating?
Reviewer 3 Yes. Linked cell proliferation and
anti-PCNA very well.
18
Coaching in CPR
  • Handouts
  • Timeline
  • Quick reference guide
  • Users guide
  • Evaluation rubric
  • Real-time CPR demo

19
PowerPoint Procedure
  • Logs into CPR
  • Continue to Text Entry Stage
  • Copies and pastes contents of email in Text Entry
    box
  • Submits text
  • Removes students name
  • Assigns distinct url
  • Uploads PPT file to Rice server
  • Sends email to student

Student
Instr. Designer
Email Message url
This is my poster ltBRgtltA href
http//www/owlnet.rice.edy/cainproj/BIOE
342/sample4.htmlgt http//www/owlnet.rice.edy/cai
nproj/BIOE 342/sample4.htmllt/Agt
Save text
Submit text
20
First Implementation in 2006
  • Investment
  • Developed instructional materials
  • Devised process to support PPT files
  • Created a CPR users guide
  • Added a training session
  • Outcome
  • All students failed calibrations

21
Key Improvements in 2007
  • Investment
  • Located appropriate journal article
  • Replaced calibration samples
  • Training
  • Saterbak walked through poster evaluation on CPR
  • Helped establish calibration scale
  • Encouraged students to record calibration
    responses

22
Key Improvements in 2007
  • Reset CPR Scoring Template
  • Miss 8 of 16 calibration questions
  • Relaxed standard deviation (3)
  • Peer reviews
  • Self assessment
  • Outcome
  • 79 passed all 3 calibration posters
  • 21 failed 1 of 3 calibration posters

4.7
2
23
Parts of CPR Grades
24
How Self-Evaluations and Peer-Evaluations Compare
25
Instructor Peer Grades Track
26
Instructor Self-evaluation Grades Do NOT Track
27
Self- Peer-Evaluations Grades Do NOT Track
28
Calibration prepared me to review peers posters.
29
Rate consistency of peer and instructor feedback
30
Insights gained as a result of reviewing peers
posters
31
Insights gained as a result of reviewing peers
posters
32
Rate how participation in CPR affected ability to
evaluate and critique tech poster
97
59
38
3
33
Does CPR add value to course?
79
21
34
Lingering Issues
  • Instructors
  • 3 point scale
  • Logistics
  • Students
  • Grading
  • Timing

35
Next Phase of Collaboration
  • Focus on argument structure
  • Raise standards
  • Report research findings
About PowerShow.com