OMMMA: An Object-Oriented Approach for Modeling Multimedia Information Systems

1
OMMMA An Object-Oriented Approach for Modeling
Multimedia Information Systems
Stefan Sauer Gregor Engels University of
Paderborn, Germany Information Systems
Group sauer_at_uni-paderborn.de MIS99 Indian
Wells, CA October 22nd, 1999
Stefan Sauer, University of Paderborn
2
Outline

• Multimedia Software Engineering
• Multimedia Information Systems
• OMMMA Object-Oriented Modeling of MultiMedia
  Applications
• Adapted Model-View-Controller Paradigm
• OMMMA-L The Language extending UML
• OMMMA Multimedia Information Systems

3
Motivation
4
Motivation
5
Multimedia Information Systems
User Interface
Application Layer
Application
Service Layer
Content Analysis
Content-Based Retrieval
Playout Control
Synchronization
. . .
Database Management System
Multimedia Query Lang./Proc.
Transaction Management
Query Optimization
System Layer
Media Servers
Operating System
Communication
Storage
Quality of Service
Network
Buffering
6
Modeling Multimedia Systems

• integrated model accounting for
• application structure functionality
• temporal behavior of continuous media objects
• interactivity
• graphical multimedia user interface
• system characteristics
• as a basis for straightforward implementation
• traditional database design data modeling
• models focussing on specific aspects,
• e.g. temporal relations

7
Objective
Diagrammatic modeling language for
object-oriented modeling of multimedia
information systems based on the Unified Modeling
Language (UML) enabling integrated specification
of all relevant aspects
8
Method
Multimedia Aspects
Software Architecture MVCMM
Modeling Language OMMMA-L
Prototype Implementation OMMMA-Tool
9
Example
10
Aspects of a MM Application

• (1) Logical Structure
• application domain objects
• associated media objects
• (2) Spatial Presentation (Layout)
• (3) Predefined Temporal Behavior
• (4) Interactive Control

11
Interrelations between Aspects
MVC (Model - View - Controller) -
Paradigm
(4) Interactive Control
(1) Logical Structure
Controller
Modelstatic
Model

• (2) Spatial Presentation

• (3) Predefined Temporal
• Behaviour

Modeldynamic
View
12
Intermezzo MVC

• Model-View-Controller (MVC)
• software architecture for interactive systems
• Model core functionality and data
• View display information to user
• Controller handling user inputs

(presentation) output
presentation manipulation
(user) input
read write access
change propagation
change propagation
13
UML

• UML (Unified Modeling Language)
• standardized object-oriented modeling language
• accepted as industrial standard by
• OMG (Object Management Group) in
  1997
• current version 1.3
• formally defined abstract and concrete syntax
• informally defined semantics
• comprises 8 different (already known!) diagram
  types

14
UML Diagram Types
(1) Use Case Diagrams (2) Class Diagrams (3)
Statechart Diagrams (4) Activity Diagrams (5)
Sequence Diagrams (6) Collaboration
Diagrams (7) Component Diagrams (8) Deployment
Diagrams
15
UML Diagram Types vs. Multimedia Aspects
(1) Use Case Diagrams (2) Class Diagrams (3)
Statechart Diagrams (4) Activity Diagrams (5)
Sequence Diagrams (6) Collaboration
Diagrams (7) Component Diagrams (8) Deployment
Diagrams

• (1) logical structure
• application domain objects
• associated media objects
• (2) spatial presentation
• (3) predefined temporal behavior
• (4) interactive control

16
Class Diagram Example
media classes
application classes
Media
MMApplication
1
1
1..
1..
ContinousMedia
DiscreteMedia
ApplicationUnit
Animation
Text
Image
Graphics
Video
Audio
ComposerEntry
1
1
1
1
1..
1..
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
2..
2..
0..2
0..2
1
1
1..3
1..3


1
1
TextEntry
Portrait
MusicSheet
MusicPiece
Film
0..1
0..1


1
1
1
1
1
1
1
1
1
1
media type hierarchy
application model
17
UML Diagram Types vs. Multimedia Aspects
(1) Use Case Diagrams (2) Class Diagrams (3)
Statechart Diagrams (4) Activity Diagrams (5)
Sequence Diagrams (6) Collaboration
Diagrams (7) Component Diagrams (8) Deployment
Diagrams

• (1) logical structure
• application domain objects
• associated media objects
• (2) spatial presentation
• (3) predefined temporal behavior
• (4) interactive control

18
Extended Sequence Diagram
Music int MTitle
KNMn MusicSheet
KNMa MusiPiece
Highlight Marker
T s
0
L
R
MTitel Mozart1
max 0,5
035
HBox1
HBox2
035
ltKNMtrackAudiogt
ltKNMgGraphicsgt
HBox3
035
HBox4
025
ImageVideoBox
19
UML Diagram Types vs. Multimedia Aspects
(2) Class Diagrams (3) Statechart
Diagrams (5) Sequence Diagrams

• (1) logical structure
• application domain objects
• associated media objects
• (2) spatial presentation
• (3) predefined temporal behavior
• (4) interactive control

?
20
Extension of UML OMMMA-L
Object-Oriented Modeling of MultiMedia
Applications - the Language

• (1) logical structure
• application domain objects
• associated media objects
• (2) spatial presentation
• (3) predefined temporal behavior
• (4) interactive control

OMMMA-L Class Diagrams Statechart
Diagrams Presentation Diagrams Extended Sequence
Diagrams
21
Example
22
Spatial Presentation (Layout)
End
Alphabet
ArrowAnimation
ImageVideoBox
HypertextBox
ImageBox
Prev
Rew
Stop
Play
Pause
Ffw
Next
Prev1
Next1
23
OMMMA-L Presentation Diagram
End
Alphabet
ArrowAnimation
L
ImageVideoBox
HypertextBox
ImageBox
R
Prev
Rew
Stop
Play
Pause
Ffw
Next
Prev1
Next1
24
OMMMA-L covers all aspects
MVC (Model - View - Controller) -
Paradigm
(4) Interactive Control
(1) Logical Structure
Controller
Modelstatic
Statechart Diagram
Class Diagram
Model

• (2) Spatial Presentation

• (3) Predefined Temporal
• Behaviour

View
Modeldynamic
Ext. Sequence Diagram
Presentation Diag.
25
(No Transcript)
26
MIS Challenges

• What does a multimedia application
• need to know about the
• underlying (database) system and accessible
  services?
• What are implications of an application model on
  the
• (database) system and services?
• account for these aspects during analysis and
  design

27
Findings OMMMA-L MIS

• OMMMA-L model of MIS application layer
• static model
• media type hierarchy
• application classes
• dynamic model
• sequence diagram
• predefined temporal behavior
• state transition

• MIS service / system layer
• (e.g. AMOS)
• object-oriented data model
• DB server persistent data types
• DB client external schema (view)
• presentation plan
• playout scheduling
• query (as form of user interaction)

28
Summary

• OMMMA-L
• object-oriented modeling language for
  multimedia applications
• extending standard UML (Unified Modeling
  Language)
• formally defined abstract and concrete syntax
• based on UML meta model
• OMMMA-Tool available (extension of Rational
  Rose 98)
• stepping from OMMMA to OMMMIS

29
Industrial Application
Modeling Automotive MIS Car navigation
system joint project with DaimlerChrysler goal
development of Automotive UML for
requirements specification of automotive
components
example navigation system
30
(No Transcript)
31
Research Goal

• Modeling Language for Multimedia
  Applications
• Language Requirements
• covers all aspects of a MM application
• graphical / visual
• already familiar to software developers

comprehensive easy to understand easy to learn
32
Research Goal

• Modeling Language for Multimedia
  Applications
• Language Requirements
• covers all aspects of a MM application
• graphical / visual
• already familiar to software developers

comprehensive easy to understand easy to learn
33
Multimedia Information SystemsAMOS Reference
Architecture
User Interface
Application
MM Playout Mgr.
SM Pres.
Client
STI Script Interpr.
Continous Obj.Mgr.
Network
DBMS Interface, API
Query Proc.
Script Gen.
Retrieval Eng.
Server
Transaction Manager
Obj. Mgr.
Ext. M. Serv.
Contin. Obj. Mgr.
34
Multimedia Information Systems
User Interface
Application Layer
Application
Service Layer
Content Analysis
Group Communication
Documents
Synchronization
. . .
Database System
Programming Environment
System Layer
Media Servers
Operating System
Communication
Network
Quality of Service
Storage
35
MIS Research
Multimedia information systems research
topics database system services supporting
multimedia applications in distributed
environments

• system
• multimedia query languages
• storage management
• buffer allocation
• . . .

• services
• content-based retrieval
• playout scheduling control
• . . .

36
Multimedia Information Systems
User Interaction
Server Access
Server
Operating System
MMDBMS Interface
Network
Query Processor
Client
File Manager
Operating System
37
Multimedia Information Systems
Multimedia Application
System Software
Multimedia System
Media Control Interface
Low-level Functions
Multimedia Hardware Drivers
Media Control Interface Drivers
Hardware Drivers
Media Storage
38
Modeling Multimedia Software

• Aspects
• application structure functionality
• user interface
• system characteristics
• distribution
• stream control
• resource management
• communication
• database system
• network

39
Extended Sequence Diagram
Music int MTitle
KNMn Score
KNMa MusicPiece
Highlight Marker
T s
0
L
R
MTitel Mozart1
max 0,5
max 0,2
HBox1
035
HBox2
ltKNMtrackAudiogt
ltKNMgGraphicsgt
035
210
HBox3
035
HBox4
025
ImageVideoBox
40
Music int MTitle
KNMn MusicSheet
KNMa MusiPiece
Sym42a MusicPiece
Sym42n MusicSheet
Highlight Marker
MTitle Mozart2
T s
0
L
R
L
R
MTitle Mozart1
max 0,5
max 0,2
HBox1
035
HBox2
ltKNMtrackAudiogt
035
ltKNMgGraphicsgt
ltSym42trackAudiogt
ltSym42gGraphicsgt
HBox3
035
HBox4
025
ImageVideoBox
025
ImageVideoBox
41
playMusic als Op von CompEntry
Linie
42
Findings OMMMA-L MIS

• OMMMA-L model of MIS application layer
• static model
• media type hierarchy
• application classes
• dynamic model
• sequence diagram
• predefined temporal behavior
• state transition
• control view

• MIS service / system layer
• (e.g. AMOS)
• object-oriented data model
• DB server persistent data types
• DB client external schema (view)
• presentation plan
• playout scheduling
• query (as form of user interaction)
• (merely implementation)