International Workshop on Semantic Web Annotations for Multimedia (SWAMM)

1
International Workshop on Semantic Web
Annotations for Multimedia (SWAMM)

• Workshop Organizers
• Raphaël Troncy (CWI, Amsterdam)
• Jacco van Ossenbruggen (CWI, Amsterdam)
• Giorgos Stamou (NTUA, Athens)
• Vassilis Tzouvaras (NTUA, Athens)

2
SWAMM Web page

• http//multimedia.semanticweb.org/
• Presentations will be online
• Proceedings will be online and published by CEUR
• A selection of some of the papers will be revised
  for a special issue in the JWS

3
What's going on ?

• Various EU funded projects
• aceMedia http//www.acemedia.org/
• K-Space http//www.k-space.eu/
• MESH, X-Media,
• Various related W3C groups
• XG Web Content Labeling, Multimedia Semantics
• WG SWBPD, Vocabulary Management
• Workshops and Conferences
• MMSW'05, EWIMT'04-05
• SAMT http//www.samt2006.org/

4
What's going on ?

• Multimedia ontology
• Call for requirements by Paola Hobson and Yiannis
  Kompatsiaris (aceMedia)
• Towards a Common Multimedia Ontology Framework
• http//www.acemedia.org/aceMedia/files/multimedia_
  ontology/cfr/MM-Ontologies-Reqs-v1.3.pdf

5
Multimedia and the SW

• What does the Semantic Web bring ?
• Global identity everything is a a resource
• Shareable metadata
• Machine-processable and understandable data
• Multimedia why bother with Semantics?
• Folksonomies communities
• "Weak" tagging à la flick.com, delicious,

6
Multimedia and the SW issues

• Interoperability issue
• Many formats, used in various communities and all
  have their own merits
• SW adding a "semantic layer" (RDF) on top of
  these numerous formats
• Shareability issue
• No needs to own content to annotate it
• (Copy)Right issue
• Sensible for multimedia

7
Multimedia and the SW issues

• Possible (ideal) multimedia description of a
  picture
• its metadata is expressed in Dublin Core,
• its structure is represented in MPEG-7/XML,
• its associated rights make use of Creative
  Commons,
• packaged in a NewsML2 container,
• its content is tagged by a folksonomy
  communities, using some personal scheme, SKOS
  thesaurus, OWL ontology,

? Solution distributed RDF annotations
8
Start Up discussion

• Re-using as much as possible the existing
  vocabularies / resources
• NewsML, MPEG-7,
• CIDOC, AAT, GETTY, WordNet, Wikipedia,
  GeoTagging,
• interoperability issue ? RDF is it THE solution ?
• Re-using as much as possible the existing
  metadata (produced by devices, obtained by
  context, )
• Photocopain (EXIF, GPS, iCal, logging
  information, )
• Formality of the ontologies
• do we need for very formalized ontologies (OWL
  DL, rules) ?
• how to deal with weaker tagging approaches
  (flick, thesaurus) ?
• Web 2.0

9
Start Up discussion

• Semantic gap
• how to use SW technologies with multimedia
  feature analysis?
• using DL reasoning as a filter before
  content-based search?
• How to annotate the multimedia documents?
• using some natural language processing on texts
  related to the multimedia documents

10
Start Up discussion

• What tools should we use ? Common requirements
  are deal with multimedia SW technologies
  support
• Advene framework for annotating and manipulating
  hypervideo
• PhotoStuff image annotation tool
• aceMedia application automatic annotation of
  images and videos, based on a user study
  (interview of potential users)
• AKT Tool http//www.dcs.shef.ac.uk/ajay/html/cre
  search.html
• Meditate building a KB about TV Shows,
  Characters, Books and export the RDF into DBin

11
Multimedia Semantics XG
W3C Multimedia Semantics Incubator Group
http//www.w3.org/2005/Incubator/mmsem/
Please, join the Public Mailing List
http//lists.w3.org/Archives/Public/public-xg-mmse
m/
12
MMSEM XG Objectives

• Use SW technologies to integrate existing
  multimedia metadata standards
• Leverage and combine existing approaches
• Show the added value of the SW formal semantics
• Practical applications and services that provide
  extra functionality by using, for example,
  subsumption reasoning or rule-based approaches
• Multi-platform applications, adapted to any
  device that accesses the web
• Provide best practices for annotating and using
  multimedia content on the Web
• Practical use cases that identify the users, the
  type of content and the type of metadata that
  they want to provide

13
Social Event Kendra

• Who?
• SWAMM Workshop Tagging Workshop MMSEM XG
  Folks
• Organized by Kendra "Media Industry Special
  Event", or in other words, Ceilidh!
• sponsored by Google, BCSWomen, Women_at_CL and
  Kendra Initiative
• Where and When ?
• Doors of The 3 Sisters will open at 1730. A fine
  food buffet will be provided. Dress casual and
  don't forget your dancing shoes.
• How ?
• Register now at http//www.kendra.org.uk/www2006-
  register.php

14
Social Event Dinner

• Kalpna Indian Vegetarian restaurant
• tel [phone], 2-3 St Patrick Square
• http//www.list.co.uk/restaurants/edinburgh/search
  .php?qu,v173,wkalpna
• Tonight, 1930 PM,
• meeting in the restaurant,
• the table has been booked, name Hardman