Second Stage Evaluation within SONIC project

1
Second Stage Evaluation within SONIC project

• Richard Currie Internal Evaluator
• Carolyn Gibbon Project Manager
• Presentation to Steering Group 9/7/04

2
Background

• Pilot studies held on all four partner sites
• Change in focus as a result
• External support requested

3
People involved

• Richard, Ruth, Carolyn
• Initially Ken Philips Department of Education
  and Social Studies
• Devolved to Gary Heywood Everett and Joanne
  Doherty
• Also Pam Houghton Learning Development Unit
• Ranald Macdonald at e-mail level

4
Activities

• Meetings
• Development of Workbook and Guide
• Video
• Observation of students
• Focus Group

5
Areas for discussion

• Video
• Observations by facilitator
• Hopes and fears analysis
• Jottings
• Questionnaire
• Focus group

6
Video

• 2 students took part, whilst 11 other students
  agreed to be observed in a computer laboratory
  (total student group 20)
• 2 reports Richard, as PBL facilitator,
• Gary and Joanne focussing on learning styles

7
Observations

• Joanne some difficulties logging on
• Found materials easy to use
• Ease of navigation, though there was evidence of
  skimming. Returned to items of interest.
• Lack of confidence, but enjoyed animations, the
  quiz and the web links

8
Hopes and fears- expectations

• Accessible .from home
• Curiosity see what this has to offer
• Assistance/time saving not looking for hours
  on the internet for information when can get it
  in one place
• Learning styles I learn a lot quicker with
  visuals
• Support help with problems
• Specificity looking at what other universities
  have contributed

9
Hopes and fears - concerns

• Information lack/overload ..sometimes it can
  be overwhelming
• Irrelevance items being unclear
• Technical issues logging on (I always seem to
  have problems)
• Navigation/IT skills lots of computer and
  medical jargon

10
Jottings
11
1) Experience of using SONIC on this occasion

• Helped with my PBL work
• Looked at the PBL scenario again and found
  further information
• I dont like the Internet much, due to lack of
  knowledge but felt confident on the SONIC site

12
2) Any difficulties/frustrations

• On the animation the commentary could be clearer
  with maybe some arrows or commentary beside the
  animation

13
3) What have you gained by your learning
activities today?

• Animation excellent, able to understand more when
  demonstrated with visuals
• The area which highlights the process i.e.
  exactly what PBL is and what we are expected to
  do CLEARLY
• I found it easier to access information and
  realised how interesting the subjects are

14
4) Todays experience influencing your next
experience with SONIC

• Use it first
• The animation is really interesting and knowing I
  can keep going back to it with no difficulty
  until I fully understand the knowledge base is
  very helpful
• As I have a fear of computers todays exercise
  made me more confident to try again and research
  longer

15
Improving the resources

• More detailed labels on the animation because
  when it started moving with sodium particles I
  did not know what the animation was showing me.
• More self-tests
• More A P visuals

16
Questionnaires - profiles

• Age range 18 23 3
• 24 30 1
• over 37 4
• 1 male 7 female respondents
• All on diploma programme
• Entry quals 5 with GSCE
• 3 with A-level
• 2 GNVQ
• 2 NVQ3

17
Questionnaires

• Lack of information perhaps because of
  jottings?
• Majority accessed SONIC from home, only 1
  mentioned library
• Like preparation under supervision
• One student complained of spam/popups
• Claiming it to be UCLans fault.

18
Focus Group

• 13 out of 20 students attended
• Significant in that no knew information obtained.
• Wrong questions?
• Wrong time?
• Appropriateness?

19
Conclusions

• Generally positive responses from students
• Would appear to suit mature students
• Evaluate more deeply see proposal
• Compare with evaluations from partner sites/other
  institutions