Using Pretests and Posttests to Assess Database Searching Instruction

1
Using Pretests and Posttests to Assess Database
Searching Instruction Danielle Carlock, MLS
Jonna Anderson, RN, MSN Arizona State University
at the Polytechnic campus
CONTROLLED VOCABULARY MODULE N71
CONTROLLED V MODULE N71
By Age

INTRODUCTION The use of pretests and posttest
allow an instructor to (1) accurately measure
students prior knowledge and (2) assess the
effectiveness of instruction. Our tests included
both multiple choice questions and a standardized
search which was designed to measure real world
searching ability. These searches were graded
against a rubric.
Scores by Degree Level
DATA TRENDS



Confidence level as a indicator of skill

• METHODS
• In Spring 2007, two 3 hour modules were developed
  to teach BSN students CINAHL and MEDLINE
  searching skills (on the Ovid platform).
• 1st module taught keyword searching
• 2nd module taught controlled vocabulary searching
• Each module was preceded by a pretest
• Hands on instruction and graded in-class
  exercises were used to teach the content.
• Posttests were administered immediately following
  instruction
• 80 students in a year-round BSN program
  participated

CONCLUSIONS The modules were successful in
teaching database searching skills. However, we
do not know whether students retained the skills.
Whenever feasible, a second posttest should be
administered several months after
instruction. Prior to instruction, about a
quarter of the students rated themselves in the
confident spectrum for conducting a controlled
vocabulary search. However those students
performed very poorly in the pretest, which
demonstrates that they overrated their searching
ability. After instruction, students seemed to
rate their skill level more accurately. Millenials
and Gen-Xers scored a little better on the
pretests and posttests than did baby boomers
however the small sample size of baby boomers
does not allow any definitive conclusions to be
made. Students represented a wide range of
educational attainment, but regardless of degree
level students mastered the material.


Scores by Age level
TEST RESULTS Keyword, n77
Controlled Vocab., n71