Follow the Rainbow to the Pot of Gold: Embedding GE Assessment in Program Review

1
Follow the Rainbow to the Pot of Gold Embedding
GE Assessment in Program Review

• Dr. Norv Wellsfry, Cosumnes River College
• Dr. Rory OBrien, Cabrillo College
• Marcy Alancraig , Cabrillo College
• Dr. Janet Fulks, Bakersfield College

2
Breakout Description

• Embedding GE assessment in Program Review can
  make it both more rewarding (financially and
  otherwise) and risky for the departments
  involved. Yet, assessments tie to planning and
  budgeting is one of the key themes in the new
  accreditation standards. Three schools share
  their assessment method, its role in program
  review and the results of the entire process.

3
Breakout Flow

• 15 minutes on process from 3 colleges, discussing
  linkages of outcomes to planning and budgeting
• Activity How does it work on your campus?
• Activity What does ACCJC expect?

4
Beyond Program Review

• Program Overview and Forecast
• PrOF
• Cosumnes River College
• Dr. Norv Wellsfry

5
Incentives to develop PrOF

• Perspective on ACCJC/WASC findings
• Program Review (insufficient)
• Needs to be based on data/evidence
• Informs decision making process
• SLOs
• Planning
• Integration of Program Review SLO Assessments
  into Planning

6
PrOFProgram Overview and Forecast

• Central Questions
• How to shift perspective from reflection to
  projection change the focus to planning
• How to link Student Learning Outcomes into
  Program Review and Planning processes
• Clarify Program definitions roles and functions

7
PrOFProgram Overview and Forecast

• Key Issues
• Utilize assessments to identify planning
  initiatives
• Formalize Program SLOs
• Development, assessments, implications
• Track Course SLOs
• Assess progress on College-wide SLOs
• Integrate assessments of other planning efforts
  into planning
• Strategic Plan, Cultural Competence

8
Program Overviewand ForecastKey Elements

• Program Identification
• Strategic and Cultural Competence Plan
• College-wide SLOs
• Program SLOs
• Data Review and Analysis
• Curriculum Review Report

9
Program Overviewand ForecastKey Elements

• Program Delivery Support Services Review
• Program Strengths Challenges
• Planning Agenda Action Plan
• Near Term Forecast Planning
• Long Term Resource Planning

10
Implementing PrOF

• Reporting and Using PrOF
• PrOF includes a Planning Process that informs
  both Unit Plans and the Colleges broader
  Resource Allocation Processes
• PrOF conclusions are integrated into college-wide
  planning processes (Through Strategic Planning)
• Identification of universal or broad based
  strategies and needs
• Revision of College-wide Plans, College Strategic
  Plan
• Institutional planning evolves as a result to
  PrOF to enable response plans through expanded
  resources or re-allocations

11
PrOF FormProgram SLOs
These areas were not required for 2005/06 Reports
will be part of next cycle
12
Program SLO MatrixHealth
13
Implementing PrOF

• Mapping of the Alignment of Program SLOs and
  Course SLOs
• Courses will be aligned with the Program SLOs
  that are supported by individual courses
• Courses will be identified as to the level of
  intensity that they address/satisfy Program SLOs
• Introduction
• Practice and reinforcement
• Mastery

14
PrOF FormProgram SLOs Alignment
15
Program SLO AlignmentBiology
16
Program Overviewand ForecastDescription of
Elements

• V. Data Review and Analysis
• Data Descriptions
• Program Demographics
• Program Characteristics
• Student Achievement Data

17
PrOF FormData Review Analysis
18
Data Review AnalysisAccounting
19
Program Overviewand ForecastDescription of
Elements

• VI. Curriculum Review Status Report
• Status of Curriculum Review (status Matrix)
• Status Report on Course SLOs (Matrix)
• Identification of Course SLOs
• Assessment Process for Course SLOs
• Analysis of effectiveness of Course SLOs

20
PrOF Issues and Challenges

• Response rate (all programs done at same time)
  some reports still being submitted
• Complexity Program SLO development was
  concurrent/integral to first review cycle
• Data availability Initial data was based on TOP
  codes programs identified required more
  discrimination/detail
• FORMS Too many? Redundancy and reiteration
• Diversity of required responses Strategic Plan,
  Cultural Competence, College-wide SLOs, and
  Program specific data
• Communication More needed about the process and
  the Whys of the information requested

21
Program Overview and ForecastPrOF

• For Additional Information contact
• Dr Norv Wellsfry
• Cosumnes River College
• 8401 Center Parkway
• Sacramento, CA 95823
• wellsfn_at_crc.losrios.edu
• PrOF Forms and guidelines are available at the
  program review link in the Colleges research
  site
• http//research.crc.losrios.edu/
• You will also find SLO information in this area.

22
Departmental Processes
Course SLO Assessments
Program SLO Assessments
PrOF (Program Overview and Forecast
UNIT PLAN
23
Institutional Processes
UNIT PLAN
STRATEGIC PLAN
BUDGET PROCESS
PrOF
CLASSIFIED STAFFING
FACULTY PRIORITIZATION
OTHER NEEDS
24
PrOF Reports

• Planning Committee
• Comment on report
• Identification of College-Wide Implications
• College Dialog

• Budget Planning Committees
• Resource Allocation Planning
• Planning Implications

• Internal Assessment and Response by Department
• Inclusion in Unit Planning Processes

• College-Wide Dialogue
• Implications of Program SLOs
• Discussion of College-Wide SLOs, Strategic Plan,
  and CCE

25
BAKERSFIELD COLLEGE

• JANET FULKS

26
(No Transcript)
27
(No Transcript)
28
BC Budget Criteria

• Student Centered
• Fair
• Understandable
• Stable
• Living Document
• Production Based
• Efficient and Effective
• Priority Driven The allocation model supports
  cooperative budget priorities as developed
  through cooperative strategic planning processes.
• Because this is priority driven, our planning
  drives budgeting rather than budgeting driving
  planning

29
Attempt to Link

• Budget subcommittee analyzes data and informs
  people. The committee drives prioritization
  which is reviewed by stakeholders
• Directors and chairs are educated on the use of
  data data drives prioritization
• Directors and Chairs prioritize budget based on a
  rubric of budgeting priorities

30
Cabrillo College

• Dr. Rory OBrien
• Marcy Alancraig

31
Cabrillo Guiding Principle

• Kiss method
• Keep It Simple, Sweetheart

32
Key Decisions

• Course-embedded method
• Does not require extra work from students or
  (mostly) faculty
• Adjuncts and full-time faculty participate
• Is part of the Departmental Review process

33
College Core Competencies

• Communication
• Critical Thinking and Information Competency
• Global Awareness
• Personal Responsibility and Professional
  Development

34
Cabrillos Core 4

• SLOs for AA and AS degree
• SLOs for General Education Program
• SLOs for all campus departments, even those that
  only indirectly aid instruction

35
Assessment Method The Small Picture

• Faculty choose 1 assignment in 1 class
• Create rubric to measure it
• Grade the assignment using rubric
• Analyze the results
• How well are students achieving this outcome?
• What student needs and issues are revealed?
• Faculty member alters classroom teaching or
  assignment if necessary

36
Method Bigger Picture

• Assignment, rubric and results
• shared in a department meeting
• Department analyzes what are the student issues
  occurring across all courses?
• How can they be addressed?
• Results of discussion recorded on simple form
• Analysis used as basis for funding requests in
  departmental review

37
Method Biggest Picture

• All department results forwarded to SLO
  Assessment Review Committee
• Identifies campus trends, overall student issues
  and needs writes yearly report
• If necessary, initiates campus dialogue on a
  pressing issue or need
• Archives everything for accreditation

38
Revolving Wheel of Assessment in Program Planning

• Year One Assess course SLOs
• Year Two Assess course SLOs
• Year Three Assess 2 core competencies
• Year Four Assess 2 Core competencies
• Year Five Write Program Plan

39
Program Planning
Write Program Plan
Present Plan to CIP ask for
Dialogue
Assess SLOs
College Planning Council and other budgetary
committees- allocation
Review by ARC
40
College Planning Process
Faculty and Staff Hiring Prioritization Process
College, Facilities, Technology, Watsonville
Master Plans
College Mission and Core 4
College Planning Council
Accreditation Self Study
41
Activity

• Draw a flow chart of the Program Review process
  on your campus
• Insert where the SLO assessment might go
• Insert where the allocation process might link
  to assessment

42
Activity

• Assess your schools program review process using
  the new rubric from the ACCJC