Browsing Personal Images Using Episodic Memory

1
Browsing Personal Images Using Episodic Memory

Chufeng Chen School of Computing and Technology,
University of Sunderland Email
Chufeng.chen_at_sunderland.ac.uk
2
Related works

• What is episodic memory
• Abrams et al. (1998) Episodic memory in HCI
• Platt et al. (2002) Time clustering
• Naaman et al. (2004) Time and Location
  Classification
• Cooper et al. (2005) Time and Colour Clustering

3
Development of Time Location Clustering Model

• Time and location Clustering model
• Example of Data sets, and how to separate events
• User interface

4
Time and location Clustering model
5
Example of Data sets, and how to separate events
6
Example of User interface
7
User Centered Evaluation

• The hypothesis browsing features related to
  episodic memory, incorporated into our time and
  location combination browser would improve image
  searching of personal collections
• 10 Subjects (200 photo collections)
• Five Browsers
• Time and location combination browser
• BR's Photo-Archiver
• Canon Zoom-Browser-EX
• Unindexed browser (WinXp image browser)
• Time alone (Platt, 2002)

8
Experimental Design

• Latin-Square Design
• Scenario Searching Tasks
• General Searching Tasks (4 for each subject)
• Specific Searching Tasks (4 for each subject)
• Record Searching Time for each Scenario Tasks
• User Satisfaction Questionnaire for each System
• Five Likert scale questionnaires
• The questionnaire had been used in Platts (2002)
  user study

9
Experiment Results (scenario tasks searching time)
10
Experiment Results (Questionnaire analysis)
11
System Centre Evaluation

• Recall and Precision
• 1. user and machine place the image pair in the
  same event
• 2. user places the image pair in the same event,
  but the machine places them in different events
• 3. user places the image pair in different events
  but the machine places them in the same event
• 4 user and machine both place the image pair into
  separate events.
• Recall (pairs in 1) / (pairs in 1 pairs in 2)
• Precision (pairs in 1) / (pairs in 1 pairs
  in 3).

12
R P Results
13
Findings

• Time and location browser significantly better
  than other four standard browsers in both
  searching time and user satisfaction
• Time and location combination browser had greater
  retrieval effectiveness than the time alone
  browser
• Factors related to human episodic memory, time
  and location, can be used to help users search
  their personal photograph collections more easily

14
Works So Far

• Develop a Location Annotation System for Personal
  Images (annotating by location gazetteer)
• Develop a Keyword Search Engine of System
  Annotation and User Annotation
• Evaluation
• User study system annotation Vs. User Annotation
  Vs. T L Browsing
• Recall and Precision System annotation Vs. User
  annotation

15
Location Annotation Data
16
Search Engine Example