Institutional Effectiveness in a Changing Environment: Building a Dynamic System that can Flex in Ch

1
Institutional Effectiveness in a Changing
Environment Building a Dynamic System that can
Flex in Challenging Times

• SACS December 09 - Atlanta

2

• Introduction
• Dr. Jon Kulaga, Provost

3
Asbury College

• Small private liberal arts Christian college
• 51 academic and support services departments
• 46 Undergrad majors
• 3 Adult education programs
• 2 Masters degree programs
• 1 Associate Arts Degree
• Multi-site campus (Kentucky, Florida)
• Total enrollment 1600
• In rolling hills of the Bluegrass, 20 minutes
  south of Lexington Kentucky

4
SACS Reaffirmation Class of 2009

• Current status
• Completed our Reaffirmation
• Completed 4 Substantive Changes
• Two Offsite campuses
• One new graduate program
• 100 Online/Distance Education
• Completed QEP
• Waiting to hear.Tuesday!

5
Building Flexible and Enduring Institutional
Strategic Capacity

• Systemic process
• Institutional Effectiveness
• Strategic Planning Process
• Institutional Research and Assessment
• Program development
• Accreditation
• Continuous improvement cycle
• Building a sustained culture of evidence

6
Presentation Outcomes

• Develop an agile strategic plan
• Develop vibrant institutional effectiveness
  process
• Develop integrated performance assessment system
• Ways we are focusing assessment and data to
  inform policy, practice, and budget at our
  institution.

7
1. Agile Strategic Visioning

• Dr. Sandra Gray, President

8
Institutional Vocation

• Institutional Calling
• Vision Mission
• Institutional Journey
• Distinctives
• Capacities
• Resources
• Opportunities
• Institutional Wholeness
• Eliminate Institutional Impulsivity
• Sustain Institutional Integrity

9
(No Transcript)
10
Presidents Strategic Visioning Cycle

• Dreaming Visioning
• Understandings, passion, mission
• Alignment with Mission and Institutional Fit
• Balance of Institutional Capacities
• Strategic Infrastructure and systems
• Intellectual Competence, Expertise, Growth
• Resource Finance, Physical Plant, Technology,
  Human
• Spiritual Theological underpinnings, care,
  servanthood
• Setting the Stage for Flexibility

11
(No Transcript)
12
Presidents Strategic Visioning Cycle - Cont.

• Strategic Planning Process
• Big Picture and Questions
• Environment Scan
• Strategic Issues
• Building Flexible 5-year plans
• into a 30-year visioning plan

13
(No Transcript)
14
Presidents Strategic Visioning Cycle - Cont.

• Institutional Goals
• Assessment processes
• Analysis (Department, IEC, SRC)
• Integrating Annual Assessment for Flexibility

15
(No Transcript)
16
Presidents Strategic Visioning Cycle - Cont.

• Establishing Actions and Priorities
• Setting Timelines
• Implementation Actions
• Annual Implementation for Flexibility

17
(No Transcript)
18
2. Develop Vibrant Institutional Effectiveness
Process

• Dr. Verna Lowe
• Assistant to the President
• for IE Strategic Planning

19
Institutional Effectiveness Structure

• Strategic Plan
• Institutional Assessment
• Annual Report by Departments
• Assessment Day
• Audit
• Five-year reviews
• Institutional Research
• Comparison with other institutions
• Committee Structure
• Institutional Effectiveness Committee
• Strategic Review Committee
• Strategic Planning Committee
• Accreditation
• Program Development

20
Institutional Big Questions

• How well do we fulfill our mission?
• How well do we provide a high quality educational
  experience?
• How well do we provide a spiritually vital
  community?
• How well do we equip our students for a lifetime
  of learning, leading, and service?
• How well do we prepare our students to engage
  their culture(s) and advance the cause of Christ?
• How well do we provide appropriate resources for
  fulfilling our institutional mission?

21
Institutional Goals

• Student Outcome Goals
• Academic excellence
• Spiritual vitality
• Leadership and service
• Health and wellness
• Cross-cultural appreciation and understanding
• Capacity Goals
• Vital Christian environment
• High quality programs
• Expanding missional influence
• Mission-driven resourcing

22
Multiple checkpoints

• Strategic Planning Committee Ongoing committee
  for strategic planning development, assessment,
  and program development.
• Institutional Effectiveness Committee Examines
  program, departmental and institutional level
  data to determine Institutional Effectiveness.
  IEC evaluates all campus assessment plans, and
  analyzes and aggregates data for institutional
  review.

23
Multiple checkpoints

• Strategic Review Committee Consists of
  President, Cabinet, SACS Liaison, Faculty
  Vice-Chair, Board member, and Dir IR.
• Assessment results from IEC go to SRC and drive
  budget decisions and institutional planning.
• Aggregate data from all areas to inform how well
  we have met Institutional Goals and the BIG
  Questions.
• Possible outcomes include tweaking the Strategic
  Plan, revising assessment processes, and
  organizational restructuring.

24
3. Develop Integrated Performance Assessment
System (IPAS)

• Dr. Gay Holcomb
• Director of Institutional
• Research and Assessment

25
Multi-dimensional Approach

• Multiple levels program, department,
  institutional
• Multiple CheckpointsIEC, SPC, SRC
• Multiple measures Quantitative and
  QualitativeExternal and InternalDirect and
  Indirect

26
Bi-Directional Feedback Loops

• Through forward design, assessment informs
  various entities, budgets, and policy-making
  Board. Through backward design, Board and
  administration can generate initiatives that
  inform tweak system. Similar design at
  department level also.

27
Common Assessment Goals

• All Academic depts
• Knowledge
• Skills
• Attitudes, Beliefs, and Values
• All support services departments
• Customer Service
• Effectiveness
• Student Learning (if relevant)
• Community Impact (if relevant)

28
Annual Reporting Process

• Alignment to Strategic Plan
• Student Outcome Goals
• Capacity Goals
• Departmental Objectives
• Measures
• Findings
• Analysis
• Triangulate, summarize, aggregate, disaggregate
• Trend Data
• Action Plans

29
Data Collection

• Common data sets
• For aggregation
• Academic Departments
• Nationally-normed exams/surveys
• Internal instruments
• Course Evaluations
• Focus groups
• Alumni surveys
• Capstone senior papers/projects/recitals/exhibitio
  ns
• Support Services Departments
• Satisfaction surveys
• Exit interviews
• Track service usage data
• Focus groups
• Alumni surveys

30
Data Collection

• Common scaling
• 4-point Likert scale (eliminates no opinion
  option)
• Aggregate common data
• Course evaluations
• GPA
• Internal assessment instruments
• Campus-wide scoring rubrics
• Senior capstone papers/projects/recitals/exhibitio
  ns
• Reviews of assessment plans
• Portfolios
• Exit interviews
• Focus groups
• Departmental Institutional Analysis through
  triangulation

31
Data centrally housed in

• Robust platform that optimizes all facets of IPAS
  
• Framework that undergirds Asburys culture of
  evidence
• emphasizes continuous improvement
• clearly aligns program objectives to our 9
  Institutional Goals and their Targets
• dynamically reflects current state of assessment
  and planning at all institutional levels
• tracks actions over time
• monitors costs of program improvements
• facilitates reporting across programs and
  departments
• archives data when a cycle is completed

32
4. Ways we are focusing assessment and data to
inform policy, practice, and budget at our
institution.

• All Presenters

33
Informing Policy, Practice Budget

• New Assessments (Dr. Holcomb)
• Assessment Day (Dr. Holcomb)
• Institutional Audit (Dr. Lowe)
• Strategic Review Committee (Dr. Kulaga)
• University Structure (Dr. Gray)

34
New Assessments

• Student Assessments
• QEP FSI
• General Ed Proficiency Profile (MAPP)
• Faculty Staff Assessments
• Faculty Retreat Course Evaluations

35
Assessment Day

• Inaugural Assessment Day
• Student and Faculty, Staff, Administrators
  Trustees
• No classes
• Completed assessment and analysis on the process
  of Assessment Day

36
Institutional Audit

• Institutional Audit
• Program Evaluation
• 360-degree online survey of all constituents
• Learning Walkthroughs
• Structured interviews
• Published Results
• Identify talents, resources, capacities, new ideas

37
Strategic Review Committee

• Rethink the timing of the annual reports SRC
• Institutional Audit of programs and services,
  existing and new.
• Begin next 5-year plan
• New Visioning and Strategic Plan 30-year and
  5-year phases
• Annual Implementation Plan

38
University Status

• From Departments to Schools
• College of Arts and Sciences
• School of Communication Arts
• School of Education
• School of Graduate and Professional Studies
• New Budgeting Structure
• Name Change

39
Website

• Office of the Provost
• http//www.asbury.edu/provost/

40

• Building an
• Agile Strategic Planning System
• for Challenging Times