Automatic Image Annotation

1
Automatic Image Annotation

• Jiayu Tang
• J.Tang_at_ecs.soton.ac.uk
• Intelligence, Agents, Multimedia Group
• School of Electronics and Computer Science

2
Why?

• Object Recognition
• Predict words that describe the objects in
  images, say people, house.
• Image Retrieval
• Retrieve images through captions (words)

3
How?
Training Set (Images with Annotations)
Auto-annotation Methods (Statistical Inference,
Semantic Propagation)
Test Set (Un-annotated Images)
Annotations are predicted automatically
4
Finding Objects in Images
5
Objects


6
Useful Stuff

• Matlab
• Very convenient Ideal for research
• Not for industrial use.
• MPEG-7 XM Software
• Source code available online
• For extracting MPEG-7 multimedia descriptors
  (color, shape, texture etc.)
• Flickr (www.flickr.com)
• Photo sharing website
• Open API for anyone to build applications

7
Retrievr

• Search images on Flickr by doodling

8
Thank You-)