Student Success through Libraries: A Mixed-Methods Model for Assessing and Demonstrating Library Value

1
Student Successthrough LibrariesA
Mixed-Methods Model for Assessing and
Demonstrating Library Value

• Jamie Edwards
• Library Research Innovative Practice Forum
• June 4, 2015

2
Overview

• Background
• Problem
• Methods
• Findings
• Implications
• Recommendations
• Conclusions

University of Maryland Jamie Edwards June 4,
2015
Student Success through Libraries
3
Background

• Library value to the community
• Serving the learning and research mission of the
  institution
• Services and resources
• Learning and accountability
• Assessment in academic libraries
• Student success

University of Maryland Jamie Edwards June 4,
2015
Student Success through Libraries
4
Problem

• How can libraries demonstrate and improve their
  role in helping students achieve success
• Intersections of the library and the student
  experience
• Physical and electronic collections
• Space
• Skills training and workshops
• Variety of methods
• Holistic model

University of Maryland Jamie Edwards June 4,
2015
Student Success through Libraries
5
Methods

• Used ACRL guidelines and research to identify
  areas of library impact on student success
• Created rubric of REAL student outcomes
• Recruitment/retention/graduation
• Engagement/experience
• Achievement
• Learning

University of Maryland Jamie Edwards June 4,
2015
Student Success through Libraries
6
Methods

• Used EBSCO Library Information Science Source
• Found 489 relevant records from 2010 to 2015
• Chose 50 studies based on the REAL rubric
• Analyzed the studies, created concept matrix
• Used matrix and findings to recommend holistic
  model

University of Maryland Jamie Edwards June 4,
2015
Student Success through Libraries
7
Findings

• Recruitment, Retention, and Graduation
• Nine studies mostly quantitative methods
• Library resources (collections, staff, expenses,
  etc.)
• Most looked at retention
• Existing data sets surveys
• Quantitative found weak, but statistically
  significant and positive correlations of library
  usage and retention, etc.
• Qualitative found positive student perceptions

University of Maryland Jamie Edwards June 4,
2015
Student Success through Libraries
8
Findings

• Engagement and Experience
• Sixteen studies mostly qualitative methods
• Relationship between needs and perceptions
• Use of library space, services, resources
• Nearly all used surveys and questionnaires
• Several used methods similar to ethnographic
  study (e.g., observations, focus groups,
  interviews, etc.)
• Qualitative methods provided rich results in
  identifying needs perceptions very positive

University of Maryland Jamie Edwards June 4,
2015
Student Success through Libraries
9
Findings

• Achievement
• Nine studies only quantitative methods
• GPA as proxy for achievement
• E-resources, book loans, instruction
• Existing library and campus data sets
• Data privacy
• Weak, but statistically significant and positive
  correlations of library usage and GPA

University of Maryland Jamie Edwards June 4,
2015
Student Success through Libraries
10
Findings

• Learning
• Sixteen studies mostly qualitative methods
• Information literacy
• Library instruction delivery method
  effectiveness
• Direct measures pre/post tests, assignments,
  citation analysis
• Indirect measures surveys, focus groups,
  interviews
• Qualitative largely positive reflections of
  learning
• Quantitative mixed results

University of Maryland Jamie Edwards June 4,
2015
Student Success through Libraries
11
Implications

• Trends
• Recruitment/retention/graduation mostly
  quantitative methods with existing data sets
• Engagement/experience mostly qualitative methods
  similar to ethnography on student
  needs/perceptions
• Achievement quantitative analysis of
  relationship between library use and GPA
• Learning mostly qualitative analysis of
  information literacy and perception of library
  instruction

University of Maryland Jamie Edwards June 4,
2015
Student Success through Libraries
12
Implications

• Gaps
• Some studies used mixed-methods, though not
  always meaningfully
• Recruitment/retention/graduation and achievement
  studies could use more qualitative methods to
  provide richer stories and triangulation to
  support data
• Engagement/experience and learning studies could
  use more quantitative methods to provide big
  picture numbers and data to support personal
  stories

University of Maryland Jamie Edwards June 4,
2015
Student Success through Libraries
13
Recommendations

• Collaborate with stakeholders
• Data managers, student advisors, faculty,
  administrators, library staff, and students
• Holistic framework
• Align library mission and values with institution
• Identify key student outcomes critical to
  priorities
• Align assessment plan with outcomes and priorities

University of Maryland Jamie Edwards June 4,
2015
Student Success through Libraries
14
Recommendations

• Identify complementary methods for triangulation
• Recruitment/retention/graduation use data sets
  to look for correlations between library use and
  student progress support with surveys, focus
  groups, interviews
• Engagement/experience use ethnographic studies
  to look at use of library space, services,
  resources supplement with survey and correlation
  data
• Achievement use data sets to look for
  correlations between library use and GPA support
  with surveys of student and faculty perceptions
• Learning use pre/post tests and citation
  analysis to study effects of library instruction
  on info lit supplement with survey and
  correlation data

University of Maryland Jamie Edwards June 4,
2015
Student Success through Libraries
15
Recommendations

1. Partner with stakeholders on campus
2. Collaborate within the library to increase
   engagement and strategic use of assessment
3. Consider data quality, privacy, visualization
4. Communicate results inside and outside the
   library share best practices and encourage
   further research
5. Use feedback to inform further learning and
   strategy
6. Incorporate learning, strategy, and communication
   into planning initiatives

University of Maryland Jamie Edwards June 4,
2015
Student Success through Libraries
16
Conclusions

• Wealth of new research on assessment of student
  success and libraries
• Harness this data to create and improve research
  models
• Identify key student outcomes align priorities
  (strategic assessment)
• Use mixed-methods approach for triangulation
• Help libraries improve their support of students
  and demonstrate their value

University of Maryland Jamie Edwards June 4,
2015
Student Success through Libraries
17
Thank you!

• Questions?
• For more information, contact Jamie at
  jamyung_at_umd.edu

University of Maryland Jamie Edwards June 4,
2015
Student Success through Libraries