KSU System for Quality assurance of education at the Norwegian University of Life Sciences

1
KSUSystem for Quality assurance of education
at the Norwegian University of Life Sciences

• Quality arises in the meeting of students and
  UMB

2
Norwegian University of Life Sciences

• Higher Agricultural School 1859
• Scientific university college
• (Agricultural University of Norway) 1897
• University (UMB) 2005
• 2800 students
• 250 doctorate students
• 870 employees of which 440 scientific
• Offers Bachelors (3 years),
• Masters (5 years) and Ph.D.
• degree programmes

3
Studies

• Annually, about 2800 students study at UMB
• Study programmes of three and five years
• 13 Bachelors and 37 Masters degree programmes
• 40 50 PhDs per year
• Research-based theoretical education with
  emphasis on practical experience

4
International studies

• 280 of 2800 students are foreign citizens
• 30 percent of the students take a study period
  abroad
• 30 percent of the courses at UMB are offered in
  English
• Broad cooperation with approximately 80 foreign
  universities
• Own department of international environment and
  development studies, NORAGRIC

5
Research

• Strong connection between research and
  educational activities
• Responsibility for long-term basic research
• Important areas- Environment - Food -
  Biotechnology - Aquaculture - Industrial
  development

6
The quality system process at UMB

• A pilot project in 2001 was a soft start
• Study quality has been an important area for
  several years
• Reference group managed by rector
• Employees participated in making and testing
  quality assurance activities
• Internal discussion in various fora and hearings
  laying the foundations for KSU

7
Motivation for development of a quality system

• Requirements in national laws and regulations
• Also We think that quality culture is important
  for our own development
• - Continuous improvement culture
• - Awareness of teaching process
• - Optimising resource use
• - Tool in Internationalisation
• - Transparency and responsibility

8

• The Norwegian Agency for
• Quality Assurance in Education (NOKUT)
• and the Universities and Colleges Act
• Regulation on accreditation, evaluation and
  recognition pursuant to the Act relating to
  universities and colleges and private
  institutions
• Proposal for revised regulation on accreditation,
  evaluation and recognition pursuant to the (new)
  Universities and Colleges Act (consultation
  deadline 24 June 2005)

9
NOKUTs 10 criteria for quality assurance
systems

• The system should include
• Clarification of how quality improvement work is
  integrated into the institutions strategic work.
  
• Definition of the institutions goals for quality
  work
• Involvement of the leadership at all management
  levels in the organisation.
• Organisation of the work in routines and measures
  that ensure broad participation, with defined
  areas of responsibility and authority.
• Collection and compilation of information from
  any evaluations needed to adequately assess of
  the quality of all units of study, aggregated to
  the institutional level.

10
NOKUTs 10 criteria contd

• Analysis of the information and assessment of the
  degree to which the goals for quality work have
  been attained.
• Use of the results to formulate decisions and
  take steps to ensure and enhance programme
  quality.
• Clarification of how quality work impacts
  resource allocation and priorities at the
  institution (human resources , infra-structure,
  service).
• Active participation of students in the quality
  work and focus on the total learning environment.
• An annual report to the board of the institution
  providing an overview of quality development
  activities and an overall assessment of
  educational quality at the institution

11
Perception by faculty

• Quality systems can be compared to Cod Liver Oil
• The language is strange
• It tastes awful
• It is difficult to get children to take
• It is toxic in large amounts
• - But when you have become addicted you cannot
  live without it!

12
Expected results of quality work and quality
culture

• Improved educational programmes
• Satisfied students
• Competitive advantage
• Achievement of UMBs goals

13
KSU at UMB

• Focus on the students learning experience
• Includes academics, learning environment and
  welfare
• Does not include organisation and research (for
  the present)
• Implemented through UMBs existing organisational
  map and management instruments
• A system in continual development
• Presentation on the web for greater transparency
  and participation
• www.umb.no/kvalitet

14

• The quality assurance system shall
• ensure that quality standards are met
• promote quality development
• document quality work
• detect problem areas

• LONG-TERM GOAL
• Guarantee that the time students spend at UMB
  is used effectively, and that the intended
  educational results are achieved

15
KSU in practice (1)

• Systematic collection of information,
  documentation of measures and results
• student evaluation of all courses
• external examiners in all courses
• international evaluation of study programmes
• improved routines for course and programme
  descriptions and approval
• annual report on educational quality and
  educational strategy.

16
KSU in practice (2)

• The Committee for the Learning Environment (LMU)
  is responsible for the health, environment and
  safety of the students
• Routines for quality assurance of academic
  guidance, student research, studies taken at
  other institutions
• Increased focus on staff development (scientific,
  pedagogical, language, ICT)

17
How to develop wide ownership?

• Involve teachers, students and management in
  developing the system
• Ensure that the leadership is engaged and sends
  clear signals that quality assurance has high
  priority
• Provide staff follow-up in cases of poor
  evaluations
• Reward departments or groups that demonstrate
  ability to improve

18
Documentation of quality work

• The system should be intuitive and user-friendly
• Web-presentation with tools for users (glossary
  of terms, responsibility chart, document archive,
  quality requirements/standards, descriptions of
  routines, links to databases)
• Document the systems effect quality
  requirements, follow-up actions and improvement
• Focus on students experiences and feedback
• The Annual Report on Educational Quality should
  give an honest, self-critical appraisal of
  strengths and weaknesses

19
Høgskolestyret - påser at UMBs utdanning og
forskning holder høy kvalitet- godkjenner
systemer for kvalitetssikring
Responsibility for quality assurance follows
UMBs new organisational map

• University Board
• Rector
• Committee for academic affairs
• Department Head
• Head of Education
• Responsible teacher
• Instructor
• Student
• University Board
• Rector
• Director
• Committee for the learning environment
• University Foundation for Student Life
• Division Head

20
The students Our partners and co-citizens in
the university community

• Political participation representation in all
  university decision-making bodies regular
  meetings with the university leadership
• Social participation Students are responsible
  for student societies and activities
• Academic participation daily classroom contacts
  between teachers and students

21
Anonymous, web-based course evaluations   
UMB students evaluated 400 courses annually, for
3 years
22
Important issues can be identified
23
Examples of improvement activities Physical and
psychosocial learning environment

• The Committee for the Learning Environment (LMU)
  identified these activities to be carried out in
  2006
• Bicycle racks
• Ventilation in classrooms
• Acoustic improvement in classrooms
• Student center in Soils Science building
• Computer systems
• Classroom furnishings
• Budget framework 3 mill. NOK

24
Strategic work at UMB and educational quality

• The University Board has determined goals and
  quality standards for educational activities
• UMBs Strategic Plan and other plans contain
  quality goals
• Educational quality is included in departments
  annual plans and reports
• Strategies are implemented through our management
  cycle

25
Structure of UMBs system for quality assurance
of education EDUCATIONAL QUALITY QUALITY
AREAS KEY ELEMENT KEY ELEMENT KEY ELEMENT
Activity Activity Activity
Activity Activity Activity
Activity Activity
Activity
26
14 Quality areas

• 8. Information, ICT, library
• 9. Studies administration
• 10. Universal access for the disabled
• 11. Psychosocial learning environment
• 12. Student welfare
• 13. Governance for quality
• 14. Internationalisation

• 1. Educational offerings
• 2. Academic guidance
• 3. Work on MS theses
• 4. Work on PhD theses
• 5. Educational resources
• 6. Credit transfer
• 7. Physical learning environment

27
Quality area 1. Educational offerings

• Objective UMBs study programmes shall be
  research- based, maintain a high level of
  academic and pedagogical quality and prepare
  students for later service to society within
  UMBs areas of expertise.
• Overall responsibility Education Committee
• Key elements
• Regulations 7.
  New student introduction period
• Programmes of study 8. Teaching
  materials
• Courses
  9. Computer-based learning
• Quality of matriculating students
• Evaluation of student learning
• Academic quality of graduates

28
Key element 2. Programmes of study Quality
standard UMB shall offer programmes of study
having professional and social relevance and
holding a high academic and pedagogical
standard Activities 1.2 3.International
evaluation of programmes Implementation
Education Committee. Status A ( active)
29
Form describing Activity 1.2.3 External
evaluations of study programmes
Quality area 1. Educational offerings Key Function 2.Programmes of study Overall resposibility Education Committee
ACTIVITY 1.2.3 External evaluations of programmes of study Summary All programmes of study are subjcts to an external evaluation every 5 years in the period 2004-2008 All Departments and other plyers follow up the evalations by setting up an implementing action plan. Reporting and control are doing throught the management loop and in control dialogues
Links and documents Work description External evaluation of programmes of study Decision in the University Board case 179/2003, and decision in the Education Committee case 120/2003 Template for Terms of Reference, Template for action plan Guidelines for self-evaluation
Limination Applicable to all Bachelors and Masters degree programmes at UMB, including programmes offered for payment as fuirther education. External evaluation of UMBs offers of futher education is commented on in own routine
Method for collection of quality assurance data Dialogue-based Systematically periodic X Systematically continuous External X
30
Form describing Activity 1.2.3 contd
Quality standard UMB shall offer programmes of study that are academically and socially relevant and that have a high academic and pedagogic standard
Implementation Education Committee (SN)
Routine 1) The evaluation is carried out as a project with an introductory self-evaluation phase and an external evaluation committee. 2) The responsible department follows up the evaluation by setting up and implementing an action plan for follow-up. The action plan is recommended by the Department Board and approved by the Education Committee. 3) Players responsible for parts of the evaluation that are not the departments responsibility follow up the evaluation by setting up and implementing action plan. The action plan is adopted by the unit in question and is approved by the Education Committee or the Learning Environment Committee (LMU). The work on other players follow-up is coordinated by the Director of Academic Affairs. Details on how the work is done can be found in the Work description
Control -SN, or possibly LMU, approves the follow-up plans of the departments and other players. -The departments annual plans shall include comments on future programme evaluations and larger planned measures in the follow-up of implemented evaluations. -The departments annual reports shall include comments on implemented evaluations, main results, action plans and implementation of action plans. -Other players annual reports shall include comments on evaluation results (within the area of responsibility), action plans and implementation of action plans. -The annual report on study quality includes comments on whether or not the evaluation routines have been followed, main results and the follow-up work.
Deviation treatment Implementation of the evaluations and the follow-up work are discu ssed in control dialogue meetings Activity prepeared by FB, AS Version 1.1 Approved by SN.11.10.05 case 57
31

• A last note of caution
• A quality assurance system
• is not a free lunch!

32
www.umb.no/kvalitet
General description of the quality assurance
systemkvalitetssystemet_at_umb.noThe Norwegian
University of Life Sciences (UMB) has defined
clear objectives for its quality assurance
system The system shall guarantee that students
spend their time at UMB effectively and receive
an education of high academic quality. This is
the description of The System for Quality
Assurance in Education at the Norwegian
University of Life Sciences. The web-pages are
under construction. UMB has defined 13 (14)
quality areas considered critical for the
students learning achievementsQUALITY
AREAS1 Educational offerings 2 Academic
guidance3 Work on MS theses 4 Work on PhD
theses 5 Educational resources6 Credit
transfer7 Physical learning environment8
Information, library and ICT9 Studies
administration 10 Universal access for the
disabled 11 Psychosocial learning environment12
Student welfare13 Governance for quality14
Internationalisation
Quality Assurance SystemAbout the
systemGeneral descriptionArchiveAnnual
reportNorwegian
More information- Studies- Research- Student
information centre- Students own website
Quality area 1
33
www.umb.no/kvalitet Quality Assurance
SystemAbout the systemGeneral
descriptionArchiveAnnual reportNorwegian
Quality area 1
Educational offeringskvalitetssystemet_at_umb.no
Objective(s) UMBs study programmes shall be
scientifically based, maintain a high level of
academic and pedagogical quality and prepare
students for later services to society within
UMBs area of expertise. Overall
responsibility Education Committee
 
Key elements for Educational offerings2.Program
mes of studyQuality standard UMB shall offer
programmes of study with high professional and
social relevance and keep a high academic and
pedagogical standard.Activities1. Approval of
programmes of study.Implementation Education
committee Status A2. Student evaluations of
programmes of study. Implementation Director of
Academic Affairs Status U3.External evaluation
of programmes of study.Implementation
Education committee Status A4. Follow-up of
evaluations of programmes of study
Implementation Director of Academic
Affairs/Departments Status A5. Annual revision
of portfolio of programmes of study offered
Implementation Education committee Status A6.
Other studentsurveys Implementation Director of
Academic Affairs Status A
Key element 2.
Key elements1.Regulations2.Programmes of
study3.Courses4.Quality of matriculating
students5.Evaluation of student
learning6.Academic quality of graduates7.New
student initiation period8.Instructional
materials and textbooks9.Computerbased
learningGeneral- All quality areas
Activity 3.