Introduction to MPV: Framework, Design Concept, and Application

1
Introduction to MPV Framework, Design Concept,
and Application

• Peng Wu
• Imaging Technology Department
• November 8, 2002

2
Outline

• MPVs impact on digital imaging
• MPV Overview
• Design concept
• Application
• Summary and future of MPV

3
Outline

• MPVs impact on digital imaging
• MPV Overview
• Design concept
• Application
• Summary and future of MPV

4
Example Content Organization on a CD
Only required file or directory
5
Example index.pvm
6
MultiPhoto/Video in Action Digital Imaging
System, No Computer
Original data MPV
DVD Recorder Memory card slot(s)

• MPV ADVANTAGES
• Add-on MPV file is the only change to camera or
  disc
• Enables uniform access to camera and disc content
• Organizes disc content into easy-to-use albums

Original data MPV
storage media
7
DI PC Software Opportunity ExampleUse Same
Album For Many Tasks
MultiPhoto/Video specification at work
Original data MPV
Original data MPV
Original data
Original data MPV
Camera-specific unloader

• PROBLEMS SOLVED
• Plays back as captured from original files
• One album works across many apps
• Collections withstand file renaming and reorg

Original data MPV
8
Outline

• MPVs impact on digital imaging
• MPV Overview
• Design concept
• Application
• Summary and future of MPV

9
MPV Overview

• What is MPV?
• MultiPhoto/Video (MPV) is an open specification
  to enhance interoperability, ease-of-use, and
  abilities to play and manipulate collections of
  photo/video content, including still images,
  still with audio, still sequences, video clips,
  audio-only clips, and related files.
• Why MPV?
• Maintain persistent structure of content across
  devices
• Provide metadata of content and navigational data
  about how to use it

10
Objective as a specification

• Extensibility MPV should be highly extensible,
  allowing anyone to create proprietary or open
  extensions to MPV without modifying the MPV
  specification itself.
• Interoperability Adding extensions should not
  damage interoperability of the basic collection
  information.
• Separability Specifications that are
  fundamentally separable concepts should be
  separated.
• Non-Invasiveness MPV should not define alternate
  representations where mainstream representations
  exist.

11
Key concepts to understand MPV

• Schema define the structure of MPV content,
  providing a precise grammar and vocabulary of
  expression. MPV uses XML-Schema
• Practices define required and recommended
  behaviors in prose or pseudo code. Practices are
  a critical component to interoperability because
  they establish expectations and processes for how
  MPV content is handled.
• Profiles are a set of Schema and Practices and
  additional content and are the principle unit of
  formal specification, of specification
  implementation and of specification compliance.
  Each profile in MultiPhoto/Video defines only
  those schema and practices that are necessary for
  the key tasks targeted by the profile.

12
Key concepts to understand MPV
Schema
Practice
Profile
Function prototype
Library
Grammar
13
MultiPhoto/Video Specification Architecture
Based on
Makes Use Of
14
MultiPhoto/Video Core Spec Basic Profile
Collection
Metadata

• Manifest
• Wraps all components of a MPV collection
• Practices for manifest file naming and location
• Asset List
• An unordered set of assets
• Mark List
• An ordered set of asset references
• primary, selected, hidden, ltapp-specific
  extensionsgt
• Simple Assets
• Still, Video, Audio, Text, Print, Document,
  ManifestLink
• Composite Assets
• StillWithAudio, StillMultishotSequence,StillPanor
  amaSequence, Par, Seq
• Renditions
• master, screen, thumbnail, subsampled, lowRes,
  highRes, show, print, proof, draft, alt,
  targetSystem

• Any Metadata
• Holds arbitrary XML-formatted metadata
• Useful for pre-existing schema
• NMF Metadata
• Recommended for new metadata schema
• Interoperable across XML Schema, RDF Schema and
  database environments.
• XML-Schema-based validation
• NMF Dublin Core
• Common metadata about assets title, creator,
  created date, etc.

Identification

• Identifiers
• LastURL path to the object
• InstanceID unique per object
• DocumentID same for all renditions
• ContentID Content-based Identification

15
MultiPhoto/Video Presentation Profile
Album
Presentation Control

• Album
• Defines a presentation-oriented view of a
  collection
• Foreground Background
• Ordered sequence of objects, grouped by purpose
• Renditions and Related Documents
• Album-level renditions and related documents,
  e.g. index sheet, slideshow video
• Mark Lists
• Marked objects in the album
• AlbumLink
• Links one album to another

• Metadata
• Background color, duration, scaling fit,
  transitions, repeats, etc.

16
Profiles

• Profile defines only those formats and practices
  that are necessary for the key tasks targeted by
  that profile
• Basic Profile defining content collections,
  renditions, identifiers, and access to other
  metadata
• Presentation Profile 1) viewing a slideshow and
  2) interactively browsing content collections
• Internet Profile interacting with and sending
  collections of photo-video content over the web
  and email
• Capture Profile writing new content to storage
  media and updating the collection info
• Disc Archive Profile interoperability of photo
  archives on recordable optical discs
• Editing Profile modifying existing collections
  of photo-video content.
• Printing Profile printing collections of
  photo-video content
• Container Profile storing photo-video content
  collections in containers
• Core Spec defines the overall framework of all
  profiles

17
Structure of MPV document .pvm
ltfileManifestgt ltapp1Profilegt
lt/app1Profilegt ltapp2Profilegt
lt/app2Profilegt ltmpvAssetListgt
lt/mpvAssetListgt lt/fileManifestgt
Top level wrapper defined in NMF, required by
XML Manifest
Defined in XML Manifest
Required by XML Manifest, defined and exposed by
Basic Profile
XML Manifest Practice require at least on
AssetList
18
Outline

• MPVs impact on digital imaging
• MPV Overview
• Design concept
• Application
• Summary and future of MPV

19
Design concept

• Four pillars of MPV

Non-Invasiveness
Separability
Extensibility
Interoperability
20
How to build the pillars?

• Tools
• XML
• NMF

21
XML
or
HTML
SMIL
22
NMF Normalized Metadata Format

• NMF an approach to structuring metadata
• Why NMF
• Interchangeable across several important metadata
  encodings XML, RDF, SQL
• NMF enables
• a simple, flexible way to define and interchange
  metadata using mainstream XML tools and
  technologies.
• a mechanical schema-less mapping between a subset
  of the Resource Description Format (RDF) based
  metadata and NMF.
• a straight-forward mechanical mapping to
  relational databases.

23
NMF in action
Based on
Make use of
24
Pillar I Extensibility
Profile1
Profile2
Extensibility MPV should be highly extensible,
allowing anyone to create proprietary or open
extensions to MPV without modifying the MPV
specification itself.
Based on
Make use of
25
Pillar II Interoperability
Interoperability Adding extensions should not
damage interoperability of the basic collection
information
ltfileManifestgt ltapp1Profilegt
lt/app1Profilegt ltapp2Profilegt
lt/app2Profilegt ltmpvAssetListgt
lt/mpvAssetListgt lt/fileManifestgt
App2
App1
Doesnt understand the App1 custom profile but
can process the OSTA manifes and
mpvAssetList App2 can store its own state in
the same Manifest without disturbing
App1s Profile.
Represents its state as an OSTA manifest and
mpvAssetList plus a custom profile. Still able
to read Its own Profile after App2s Profile
has been added.
26
Pillar III Separability
Separability Specifications that are
fundamentally separable concepts should be
separated
ltfileManifestgt ltapp1Profilegt
lt/app1Profilegt ltapp2Profilegt
lt/app2Profilegt ltmpvAssetListgt
lt/mpvAssetListgt lt/fileManifestgt
Profile separate metadata based on tasks
AssetList/Profile separate content and use of
content
27
Pillar IV Non-Invasiveness
Non-Invasiveness MPV should not define alternate
representations where mainstream representations
exist.
ltmpvmetadatagt
ltnmfmetadatagt
Based on
tunnel in
Make use of
28
Outline

• MPVs impact on digital imaging
• MPV Overview
• Design concept
• Application
• Summary and future of MPV

29
MultiPhoto/Video Enables GoodDigital Imaging on
Photo/Video Players

• Rapid startup on disc / memory card insertion
• One top-level MPV entry point provides access to
  disc/card contents
• Fast performance for displaying images
• MPV supports screen thumbnail renditions for
  hi-res files videos
• Playback of stills video with background music
• MPV albums organize contents for playback with
  music
• Organizes content on CD DVD
• MPV albums organize 100s to 1000s of files for
  easy access to files anywhere on the disc
• Implement one firmware to handle content from any
  digital camera or CD/DVD maker
• MPV provides a single control format (manifest)
  that represents any of the content organizations
  coming from any DSC or CD/DVD.

30
MultiPhoto/Video Enables Interoperability and
New Products

• Interchange representation for DSC content
• DSC maker can organize and name files in any
  manner desired fully DCF compatible URLs and
  user-specified long filenames are supported.
• (DCF Design rule for Camera File system)
• MPV adds on to existing implementations
• Keep existing file content, directory layout,
  metadata formats
• Use with any storage media, file system, or
  internet
• Original data MPV works anywhere avoids
  format conversions
• Collections span devices, applications, and
  services
• Includes metadata and associated data fully
  extensible
• Robust albums withstand filename location
  changes
• Identifiers enable pathname fixup essential for
  PC-based use
• Playback on WinXP systems or any IE 5.5 browser
• No software installation required

31
Outline

• What does MPV do for you?
• MPV Overview
• Design concept
• Application
• Summary and future of MPV

32
Summary

• MPV is a specification for photo/video collection
  management and navigation
• MPV as a metadata specification four pillars
• Extensible
• Interoperable
• Separable
• Non-Invasive
• MPV is still under development and its success is
  to be tested

33
Goal 2003
DVD Player (Firmware)MPV Deployment Browse
Watch Albums
Original data MPV
MPV-aware Photo Viewer Firmware Application
Supports some or all of JPEG, MP3, WAV, MPEG, AVI
MJPEG, MOV PJPEG, WMV

• ADVANTAGES
• Fast, friendly experience
• Watch slideshow or browse photos,
• Plays back as captured from original files
• Views original data without MPV, but less well

Original dataDPOF on card or USBprinter driver
Some players will support printing
print
34
Goal 2003
Digital Camera Software MPV Deployment
Generate Album at Unload
browse, enhance, organize
Original data
print
Original data MPV
Camera-specific unloader

• ADVANTAGES
• MPV support at low-cost no camera firmware
  change
• Every unload MPV-enabled
• Make archive CD that also plays in DVD player or
  PC

browse watch
print
35
Goal 2003
Imaging SoftwareMPV Deployment
Browse/Watch/Use Albums
IE 5.5 Web Browser / WinXP
Original data MPV IE Stylesheet
browse, enhance, organize
Original data MPV
print
MPV-aware Imaging Software

• ADVANTAGES
• Fast, friendly experience
• Watch or browse, but also print, share, enhance,
  
• Customize look/feel of IE-based playback
• Use albums from anywhere camera unload, other
  apps

Original data MPV
36
Goal 2003
Internet Photo ServicesMPV Deployment Album
Enhances Interaction
Original data MPV
1. Initiate Conversation
MPV Local Location Of MPV Manifest
Server- Specific Logic
2. Server-specific interaction
Typical Session ID MPV Local Location Of MPV
Manifest
Device with Web Browser
Typical Session ID Local Asset Refs

• ADVANTAGES
• Use albums from anywhere camera unload, other
  apps
• Enhances web server interaction by enabling
  access to client-local data
• Web server determines user interaction

Spec Watch I3A CPXe project specing MPV
use with photo websites for print ordering
37
Goal 2003
Digital CameraMPV Deployment Make Album In
Camera
MPV-aware Firmware Application

• Capture Mode
• Click captures data and adds entry to MPV file
• Browse Mode
• Delete Image deletes data and removes entry
  from MPV file

Original data MPV

• ADVANTAGES
• Album always available to describe captured
  content
• Enables playback by any vendor exactly as
  captured
• Required foundation for a computer-free DI
  solution
• Adds easily to existing DCF / other file
  structures

38
References

• OSTA MPV Website
• http//www.osta.org/mpv/public/index.htm
• Presentations from Pieter van Zee (MPV
  Specification Editor, HP DI Covallis)
• http//acme.cv.hp.com/projectStandards/

39
(No Transcript)