mWeaver : a media representation in DE space

1
mWeaver a media representation in DE space

• Peng Wu
• Photo-Video Solutions
• Imaging Technology Department

2
Outline

• metadata overview
• mWeaver overview
• mWeaver vs. MPV

3
metadata overview

• Why another metadata effort?

MPV media presentation
MPEG21 transcoding
MPEG7 content description
4
Media flow in DE
Capture
Edit
Render
Distribute
5
Media flow in DE

• Characterizations of media flow
• Media as object
• Media as operand

M( data (t), metadata (t) )
Non-invasive operator (NO)
Invasive operator (IO)
Cut ( M )
Display ( M )
Merge ( M1, M2, )
Print ( M )
Annotate ( M )
Query ( M )
Scale ( M )
6
Media flow in DE

• Media object and media operator
• Case I NO ( M )
• Case II IO ( M ( data, metadata (t) ) )
• Case III IO ( M (data (t), metadata (t)) )

capture, display, print, query, distribute
annotate, present
author, reproduce
7
metadata overview
Case I NO ( M (data, metadata )
Exif, MPEG-7, DPX, Dig35, MPEG-21
Case II IO ( M ( data, metadata (t) ) )
MPV, (Adobe) XMP, MPEG-7
Case III IO ( M (data (t), metadata (t) ) )
mWeaver
8
mWeaver overview

• mWeaver an object oriented design of media
  representation

M (data (t), metadata (t) )
operation
mWeaver media object members data(t),
metadata(t) methods operation
9
mWeaver overview design concept
Capture
Edit
Application
Render
Distribute
10
mWeaver overview design concept

• Applications operate on data/metadata through
  operation -gt assure synchronization between data
  and metadata
• Allow flexible description of object
  relationship derivation, super class, friend,
  ...

11
Current activity video metadata

• metadata opportunities
• categories
• capture metadata aperture, light source, zoom,
  pan
• stream metadata motion, frame type
• archive, access strategies
• Applications
• video advisor on camera/printer
• video editing/keyframe extraction (media hub)
• Reference
• Technical Report HPL-2004-162, Personal Video
  Manager toward better accessibility and
  reusability of personal video content, Wu, Peng
  Obrador, Pere

12
Current activity Edit on the Go

• Cross device media interoperability

Home Media Platform
Memorable Media Storage HP Revenue

• Edit on the Go
• More accessible media
• Edit anywhere, anytime

13
Edit on the Go HMP - PDA
Edited media
User interaction
metadata
media metadata
PDA
HMP
14
Edit on the Go

• mWeaver concepts
• data/metadata synchronization cut, trim, etc.
• media object relation description full
  resolution video vs. low resolution video

15
mWeaver vs. MPV

• MPV presenting collection of media objects
• mWeaver object oriented representation of media
  objects

MPV presentation
16
mWeaver vs. MPV

• MPV presenting collection of media objects
• mWeaver object oriented representation of media
  objects

MPV presentation
synchronization
mWeaver representation
error prone