Where do you store your maintenance record

1
Where do you store your maintenance record?

• Practical issues for collecting, storing and
  using SLO data.

Gary J. Williams, Crafton Hills College Virginia
Moran, Victor Valley College Janet Fulks,
Bakersfield College
2
Todays Presentation

• Evidence, how do you get it and where do you
  store it?
• What type of evidence fuels the assessment cycle?
  
• How do you make the evidence collection cycle
  practical and safe?
• How do you present data in a way that stimulates
  and sustains the assessment process?

3
Learning Evidence

• Any learning activity that is core to a course or
  program can be a source of evidence.
• Concepts, Issues and Skills
• Authentic Assessment, Embedded Assessment,
  Artifacts
• Faculty determine the outcome, the criteria and
  the means by which evidence will be judged.

4
What kinds of evidence?

• Faculty evaluation of student evidence
  (scoresheets, exam results, rubrics)
• Embedded-item evaluations or exams
• Portfolios of student work
• Student self-evaluations
• External evaluation (such as internships or work
  experience courses)
• Student-created projects or artifacts.

5
What to do with all the data?

• How to collect it?
• How to organize and store the data?
• How do we ensure data quality?
• How do we protect and keep it safe?
• Questions about how and when to aggregate data?

6
What to do with all the data?

• How to understand and present data?
• How to put it in the hands of those who will use
  the data for improvement?
• WHO will be responsible? What roles need to be
  created?
• How do we create a sustainable, ongoing cycle of
  learning assessment?

7
What kinds of data?

• Course-level assessment data
• Program level outcomes data
• Institutional level outcomes
• Data linked to program review and planning
• How well are our students learning?
• How do we use these data to improve what were
  doing?

8
What solutions are there?

• Do Nothing . . .
• Create a system within the college using
  available tools (a.k.a. homegrown)
• Adopt a vendor-supplied data management system.
• Advantages/Disadvantages of each approach.

9
Possible solutions

• Everyone manages their own.
• Departments, courses, develop, assess and collect
  their own data.
• Advantages data stays at the level of change.
• Disadvantages
• Impossible to coordinate on a program and
  institutional level.
• Little or no dialogue takes place.
• Does not meet ACCJC standards.
• Challenges ALL personnel must be well-trained
  and seasoned in learning assessment to be
  autonomous.

10
Possible solutions

• Campus-driven, homegrown system.
• Using a platform such as Excel, Access, or a
  similar common desktop application.
• Advantages Low cost, using readily available
  tools
• Can be accomplished with planning and
  coordination.
• Can be adapted to suit institutional structures
  and needs.
• Fairly straightforward and simple.
• Disadvantages
• Must be created from scratch. All updates and
  adjustments are manually done.
• No support if system fails. Reports are also
  manually created.
• Challenges Burden on IT, IR or other campus
  structures to keep the system functioning.

11
Possible solutions

• Third-party commercial software platform.
• Web-based, scalable solutions with lots of
  customizable built-in tools.
• Advantages
• Provides a comprehensive, easy-to-use solution.
• Readily available support and integration with
  existing systems .
• User friendly built-in tools enable faculty and
  staff to get up to speed quicker than with
  homegrown systems.
• Disadvantages
• Cost Institutions must find a product that fits
  their fiscal constraints.
• Subscription-based products must be continually
  funded each year.
• Investment in computer hardware, IT costs to
  support the product.
• Challenges Introducing a new system to the
  campus and all the logistical challenges that
  brings.

12
eLumen

• Achievement-driven, web-based and user-friendly.
• Scalable to course, program, degree and
  institution level, and customizable to
  assessments at all levels.
• Scorecard layout makes assessment simple for
  faculty.
• Built-in tools for reporting.

13
(No Transcript)
14
(No Transcript)
15
(No Transcript)
16
(No Transcript)
17
TracDat

• Goal-directed, comprehensive institutional
  assessment solution.
• Connects institution-wide assessment efforts with
  strategic planning and alignment with
  institutional goals.
• Available add-ons can allow for Web-based
  portfolios.

18
(No Transcript)
19
(No Transcript)
20
(No Transcript)
21
Task Stream

• Competency/Outcomes Assessment
• Standards-based instruction with data bank of
  existing state and national standards
• Communication tools enabling online collaboration
  and communication between students and faculty.
• Universal toolset includes electronic portfolios
  and lesson builders.
• Subscription-based model on the student side.

22
(No Transcript)
23
(No Transcript)
24
(No Transcript)
25
(No Transcript)
26
Should you use a data management system?

• Pros
• Comprehensive solution
• Ongoing accessible support
• Built-in tools for collecting, reporting and
  storing evidence.
• Cons
• Cost finding an affordable solution that works
  for your institution.