Maximizing Your Investment in NSSE Through Data Integration

1
Maximizing Your Investment in NSSE Through Data
Integration

• NASPA Assessment and Retention Conference
• Atlanta, Georgia
• June 3, 2005

Download This Presentation
Theodore W. Elling, Ed.D. Associate Vice
Chancellor for Student Affairs Research Systems
Development University of North Carolina at
Charlotte twelling_at_uncc.edu http//www.uncc.edu/st
uaffairs/research.htm
2
Program Abstract

• The program will describe the methodology and
  outcomes associated with integrating NSSE data
  with multiple institutional data sources in order
  to better understand issues associated with
  retention, program evaluation, and time to degree
  studies. Particular attention will be paid to
  the data sharing and reporting processes between
  academic and student affairs.

3
Program Plan

• This program will guide participants through a
  collaborative planning, data collection and data
  integration model between academic and student
  affairs that has been used successfully through
  two administrations of the NSSE instrument.
  Additional attention will be paid to the
  processes of data analysis, reporting and sharing
  significant findings to the university community
  through a variety of forums and methods.

4
Institutional CharacteristicsUniv. of North
Carolina at Charlotte

• Anticipated Fall 2005 Headcount 20,000
• Public Four Year University - Doctoral Intensive
  Funding Status
• Collaborative First Year Program Structures
• Participated in NSSE 2001 and 2004
• High Interest Level in Freshmen Retention Issues
• Freshman Year Experience Team
• 1997-2003 Longitudinal Research Study

5
Freshmen Research ConstructModified Tinto
Attrition Model
6
NSSE Participation 2001Stakeholders

• State Funded Participation No Cost To Us
• Stakeholders Limited in 2001
• New Student Orientation
• Freshman Seminar
• Get Connected to UNC Charlotte Program
• SAFE Program
• Residence Life Housing
• Primarily Student Affairs Interests
• Relatively Small Sample Size (750 FR 750 SR)
• Limited Use of Customized Reports Due to Sample
  Size
• Results Helpful but Not Widely Shared

7
NSSE Participation - 2004Stakeholders

• Funded Locally
• Office of Student Success and Retention
• Assessment Task Force Project Catalyst
• Director of Assessment Faculty Governance
• Office of Institutional Research
• Structured First Year Programs
• All 2001 Groups
• Learning Communities
• Student Affairs Research
• The Undergraduate Experience Discussion Group
• High level response group for low returning
  student retention rate issues
• Larger Sample Size (1500 FR 1500 SR)
• More Stakeholders, Results Widely Shared At High
  Levels

8
Collaborative Planning ModelBreaking Down Data
Silos

• Identifying Articulating Need for Multiple
  Types of Data
• Crafting IRB Proposal
• Multiple Investigators
• Data Integration Statement Built into NSSE Survey
  Proposal
• Crossing Divisional Boundaries
• Academic Affairs
• Student Affairs
• Articulating Benefits of Data Sharing
• Trading Data Sharing for Customized NSSE Results
• Keeping Data Secure
• Centralized Integrated Dataset
• Centralized Reporting

9
Collaborative Planning ModelData Types Sources

• Pre-Entry Attributes
• Undergraduate Admissions (SIS)
• Entering Student Survey
• Office of Institutional Research (Database)
• Structured First Year Programs (Databases SIS)
• Orientation Dean of Students Office
• Freshman Seminar College of Arts Sciences
• Get Connected to UNC Charlotte Get Connected
  Matrix Team
• SAFE Program Dean of Students Minority
  Student Service (AIMS) Offices
• Living On Campus Residence Life Housing
• Learning Communities Office of Student Success
  Retention (OSSR)
• Student Demographic Data
• Office of the Registrar (SIS)
• Academic Performance Retention Data
• Registrar Institutional Research (SIS)
• National Survey of Student Engagement (NSSE)
• OSSR Assessment Task Force (NSSE dataset)

10
Integrated Freshmen Cohort DatasetFall 2003
Entering Freshman Survey
NSSE
2001 2004
Integrated Dataset
Data Analysis Reports
Student Demographic Data
First Year Program Participation
Academic Performance Data
Student Retention Data
11
Collaborative Planning ModelProject Timeline

• Summer 2003
• Obtain Administrative Funding Support for
  Project
• Craft Submit IRB Proposal
• Submit NSSE Application
• Fall 2003
• Build FR Cohort Dataset
• Submit Participant Data to NSSE with Student
  Identifier
• Develop Administration Strategy with Incentives
• Spring 2004
• Administer Survey (Web and Paper Over Sample)
• Augment FR Cohort Dataset Academic Performance
  Data
• Fall 2004
• Obtain Report Templates Data From NSSE
• Augment FR Cohort Dataset Retention Data
• Generate Customized Reports Presentations

12
Collaborative Planning ModelWorking with your
NSSE Data

• Utilizing the Standardized NSSE Report Templates
• Institutional Summary
• Carnegie Classification Comparison
• National Comparison
• Cohort Group Comparison
• Benchmarking
• Working with your NSSE Data
• FR-SR Comparison
• Place of Residence (see handout)
• Entering Status (FR-TR) Comparison for Graduating
  Seniors
• Academic Advising Satisfaction Group
  Characteristics
• Using your Integrated Data
• FR One Year Retention-Attrition Comparison (see
  handout)
• SR Time to Degree Comparison (see handout)
• Structured First Year Program Participation
  Analysis
• Comparison by College
• Demographic Analysis

13
Collaborative Planning ModelData Analysis Tips

• Drill Down into your Data
• Sample Size Limitations
• Transform Data Elements for Additional Clarity
• Student Employment (Y-N)
• Academic Advising Satisfaction Level Groups
  (High-Low)
• Control for Variance
• Key Demographics (Place of Residence)
• Remember your Promises
• Structured First Year Program Participation
  Analysis

14
Collaborative Planning ModelReporting Tips

• Utilize the NSSE Report Excel Template
• Benefits of Report Standardization
• Report Significant Findings Only
• Avoid Data Overload
• Color Code Differences
• Distribute Globally Print Locally
• Post all Reports to Common Website
• Work with Local Groups to Interpret Their
  Findings
• Minimize Central Narrative Reporting
• Encourage Local Summary Efforts

15
Collaborative Planning ModelWebsite Snapshot
16
Collaborative Planning ModelPresentation Tips

• Get Key Reports Presentations to the Highest
  Levels First
• Division
• College
• Department
• Report Key Findings to Faculty Governance Other
  Groups
• Faculty Executive Council
• Faculty Council
• Department Chairs
• Supplement Institutional Data with NSSE Findings
• Encourage use of NSSE Findings in Other Reporting
  Structures
• End of Year Reports
• Institutional Effectiveness Reports
• Accreditation Reports

17
Maximizing Your Investment in NSSE Through Data
Integration

• Sharing Other Practices?
• Questions?
• Additional information on customized NSSE Reports
  and Presentations can be found at the following
  URL
• http//www.uncc.edu/stuaffairs/research.htm