Image Annotation using XML and MPEG7

1
Image Annotation using XML and MPEG-7

• Manjeet Rege
• Department of Computer Science
• Wayne State University
• rege_at_wayne.edu

2
Introduction

• Problem Statement
• Medical Image queries
• Find the possible diagnosis based on the
  features of the medical image.
• For a given diagnosis, retrieve all the medical
  images that have the same diagnosis.
• Proposed Solution
• Medical Image Annotation using MPEG-7.

3
Overview of MPEG-7

• MPEG-7 files are XML files that contain a
  reference to the location of the corresponding
  image file.
• MPEG-7 gives us the ability to combine and store
  the semantic information with the visual features
  extracted from the image in one XML file.

4
Example
Patient name John Doe Physician name Dr Smith
Year 2002 Location National Hospital
5
MPEG-7 representation
6
MPEG-7 representation
7
Advantages of Annotating Medical Images using
MPEG-7

• Annotation for querying with Demographic
  Information
• Find all images of patient John Doe treated by
  Dr Smith in the year 2002 at National Hospital.
• Annotation for querying with Medical Information
• Find all image slices of patient John Doe
  containing Cortex insularis in the year 2002.

8
Related Publications

• Manjeet Rege, Ming Dong, Farshad Fotouhi,
  Mohammad-Reza Siadat and Lucia Zamorano, "Using
  MPEG-7 to build a Human Brain Image Database for
  Image-guided Neurosurgery", in proc. of SPIE
  International Symposium on Medical Imaging 2005.
• Manjeet Rege, Ming Dong and Farshad Fotouhi, "XML
  Path based Relevance Model for Automatic Image
  Annotation", in proc. of IEEE International
  Conference on Multimedia Expo (ICME) 2005.