Outline - PowerPoint PPT Presentation

Loading...

PPT – Outline PowerPoint presentation | free to download - id: fd06e-ZDc1Z



Loading


The Adobe Flash plugin is needed to view this content

Get the plugin now

View by Category
About This Presentation
Title:

Outline

Description:

cuneiform. time line. user. provided. annotation. MPEG 7. encoded annotation. 13 ... cuneiform. time line. annotation. generated. from. desktop. presentation ... – PowerPoint PPT presentation

Number of Views:28
Avg rating:3.0/5.0
Slides: 33
Provided by: Joe58
Learn more at: http://users.minet.uni-jena.de
Category:

less

Write a Comment
User Comments (0)
Transcript and Presenter's Notes

Title: Outline


1
(No Transcript)
2
  • Outline
  • Introduction
  • Automated Annotation of Multimedia Presentations
    and Content Based Search
  • Lecture Recording and Automated Annotation
  • Content Based Search in Recorded Lectures
  • Collaborative Annotation of Multimedia Data
  • Conventional Search vs. Social Tagging
  • MPEG 7 and Collaborative Annotation
  • Collaborative Lecture Annotation

3
  • Searching Multimedia
  • keyword based search
  • keyword generation
  • manual
  • automatic

4
  • Searching Multimedia
  • keyword based search
  • keyword generation
  • manual
  • automatic

5
  • Searching Multimedia
  • keyword based search
  • keyword generation
  • manual
  • Automatic
  • keywords provided by
  • resource author
  • expert
  • non-expert (all others)

6
  • Searching Multimedia
  • keyword stands for entire resource
  • but, what if you are only interested in a small
    part of the resource ?
  • e.g. recorded lecture
  • duration 90 minutes
  • interesting parts 5 minutes

7
  • Automated and Collaborative Multimedia Document
    Annotation

8
  • Outline
  • Introduction
  • Automated Annotation of Multimedia Presentations
    and Content Based Search
  • Lecture Recording and Automated Annotation
  • Content Based Search in Recorded Lectures
  • Collaborative Annotation of Multimedia Data
  • Conventional Search vs. Social Tagging
  • MPEG 7 and Collaborative Annotation
  • Collaborative Lecture Annotation

9
  • Lecture Recording
  • Media-Streaming
  • synchronizedvideo and desktoprecording
    withnavigation
  • encoded with SMIL orMPEG 4

10
  • Lecture Recording and Automated Annotation
  • Automatic Scene Detection
  • cut points
  • changes in perspective
  • motion detection,
  • Automatic Feature Extraction
  • statistical features
  • coloring
  • shape detection
  • lighting,

(e.g., video recording of a lecture)
11
  • Lecture Recording and Automated Annotation
  • Analysis of Audio Data
  • speaker independent speechrecognition
  • unreliability / errors
  • Determination of context
  • relevance of topics
  • change of topic(start / end)
  • comments

(e.g., video recording of a lecture)
12
  • Manual Annotation of Recorded Lectures

time line
00000.0
00342.2
00511.3
01306.0
userprovidedannotation
  • welcome address
  • short repetition of previous lecture
  • speech
  • development of speech
  • hominids
  • primates
  • writing
  • pictogram
  • ideogram
  • phonogram
  • writing
  • hieroglyphes
  • cuneiform

MPEG 7 encoded annotation
13
  • Automatic Annotation of Recorded Lectures
  • use all available resources
  • video recording, desktop recording, presentation
    slides, audio recording,

desktoppresentation
time line
00000.0
00342.2
00511.3
01306.0
annotationgeneratedfromdesktoppresentation
  • lecture title
  • author name
  • speech
  • development of speech
  • hominids
  • primates
  • writing
  • pictogram
  • ideogram
  • phonogram
  • writing
  • hieroglyphes
  • cuneiform

14
  • Automatic Annotation of Recorded Lectures
  • from presentation to annotation
  • Start 000342.2
  • End 000511.6
  • Title1 computer as universal communication
    medium
  • Ebene1 history of communication medium
  • Ebene2 developmnent of speech
  • Fett/Farbig speech
  • Ebene3 voice box
  • Ebene4 larynx
  • Fett/Farbig larynx

15
  • Automatic Annotation of Recorded Lectures
  • from presentation to annotation

lt!xml version1.0 encodingiso-8859-1gt ltMpeg7
xmlnsurnmpegmpeg7schema2001
gt ltAudioVisualSegmentgt ltTextAnnotation
typeheading xmllangdegt
ltFreeTextAnnotationgt The Computer as Universal
Communication Medium lt/FreeTextAnnotation
gt lt/TextAnnotationgt .. ltMediaTimegt
ltMediaTimePointgt T000342.2 lt/MediaTimePointgt
ltMediaDurationgt PT1M28.6S lt/MediaDurationgt
lt/MediaTimegt .
16
  • Outline
  • Introduction
  • Automated Annotation of Multimedia Presentations
    and Content Based Search
  • Lecture Recording and Automated Annotation
  • Content Based Search in Recorded Lectures
  • Collaborative Annotation of Multimedia Data
  • Conventional Search vs. Social Tagging
  • MPEG 7 and Collaborative Annotation
  • Collaborative Lecture Annotation

17
  • Searching Multimedia Lectures
  • Keywords generated from content

Results
Search Engine
Query String z.B. hieroglyphs
MPEG 7Database
Sack, Waitelonis, MTG 2006
Media Server
18
  • Outline
  • Introduction
  • Automated Annotation of Multimedia Presentations
    and Content Based Search
  • Lecture Recording and Automated Annotation
  • Content Based Search in Recorded Lectures
  • Collaborative Annotation of Multimedia Data
  • Conventional Search vs. Social Tagging
  • MPEG 7 and Collaborative Annotation
  • Collaborative Lecture Annotation

19
  • Social Taging Systems

fruit
fruit
apple
user
breakfast
apple
author
authormetadata
snack
toBuy
usermetadata
  • keyword based search vs. tag browsing
  • social networking

20
  • Outline
  • Introduction
  • Automated Annotation of Multimedia Presentations
    and Content Based Search
  • Lecture Recording and Automated Annotation
  • Content Based Search in Recorded Lectures
  • Collaborative Annotation of Multimedia Data
  • Conventional Search vs. Social Tagging
  • MPEG 7 and Collaborative Annotation
  • Collaborative Lecture Annotation

21
  • Integration of Tagging Information into MPEG 7
  • temporal decompositionof video data
  • annotation ofsingle video segments

ltMpeg7 xmlns"..."gt ltDescription
xsitype"ContentEntityType"gt ...
ltMultimediaContent xsitype"VideoType"gt
ltVideogt ltMediaInformationgt ...
ltTemporalDecompositiongt ltVideoSegmentgt...lt/V
ideoSegmentgt ltVideoSegmentgt...lt/VideoSegmentgt
... lt/TemporalDecompositiongt
lt/Videogt lt/MultimediaContentgt
lt/Descriptiongt lt/Mpeg7gt
22
  • Integration of Tagging Information into MPEG 7
  • temporal decompositionof video data
  • annotation ofsingle video segments

ltMpeg7 xmlns"..."gt ltDescription
xsitype"ContentEntityType"gt ...
ltMultimediaContent xsitype"VideoType"gt
ltVideogt ltMediaInformationgt ...
ltTemporalDecompositiongt ltVideoSegmentgt...lt/V
ideoSegmentgt ltVideoSegmentgt...lt/VideoSegmentgt
... lt/TemporalDecompositiongt
lt/Videogt lt/MultimediaContentgt
lt/Descriptiongt lt/Mpeg7gt
23
  • Integration of Tagging Information into MPEG 7
  • annotation facilities of MPEG7
  • keyword
  • freetext
  • structure
  • define start / end

ltVideoSegmentgt ltCreationInformationgt...lt/Creation
Informationgt ... ltTextAnnotationgt
ltKeywordAnnotationgt ltKeywordgtcatlt/Keywordgt
ltKeywordgtmouselt/Keywordgt lt/KeywordAnnotationgt
ltFreeTextAnnotationgt billy the cat is catching
a mouse lt/FreeTextAnnotationgt
lt/TextAnnotationgt ltMediaTimegt
ltMediaTimePointgtT0005050F25lt/MediaTimePointgt
ltMediaDurationgtPT00H00M31S0N25Flt/MediaDurationgt
lt/MediaTimegt lt/VideoSegmentgt
Problem personalized annotation
24
ltCreationInformationgt ltClassificationgt
ltMediaReviewgt ltRatinggt ltRatingValuegt9.1lt/R
atingValuegt ltRatingScheme style"higherBetter
"/gt lt/Ratinggt ltFreeTextReviewgt tag1,
tag2, tag3 lt/FreeTextReviewgt
ltReviewReferencegt ltCreationInformationgt
ltDategt...lt/Dategt lt/CreationInformation
gt lt/ReviewReferencegt ltReviewer
xsitype"PersonType" gt ltNamegtHarald
Sacklt/Namegt lt/Reviewergt lt/MediaReviewgt
ltMediaReviewgt...lt/MediaReviewgt
lt/Classificationgt lt/CreationInformationgt
  • Integration of Tagging Information into MPEG 7

use MPEG 7 ltMediaReviewgt-Tagto encode
personalized tagging information
encode tagging information as ( tag set, user,
date, rating )
25
  • Outline
  • Introduction
  • Automated Annotation of Multimedia Presentations
    and Content Based Search
  • Lecture Recording and Automated Annotation
  • Content Based Search in Recorded Lectures
  • Collaborative Annotation of Multimedia Data
  • Conventional Search vs. Social Tagging
  • MPEG 7 and Collaborative Annotation
  • Collaborative Lecture Annotation

26
  • Collaborative Lecture Annotation
  • Prerequisites
  • keep user interface as simple as possible (!)
  • Annotation of entire resource
  • similar as existing social tagging systems
  • Annotation of partial resources
  • one-button solution pressing button during
    replay marks predefined video segment that
    can be tagged
  • video segmentation - each slide defines a new
    video segment (fine) - if available, use table
    of contents for segment definition

27
  • Collaborative Lecture Annotation
  • Annotation of partial resources
  • video segmentation - each slide defines a new
    video segment (fine grain
    segmentation) - if available, use table of
    contents for segment definition

segments defined by TOC
28
  • Collaborative Lecture Annotation
  • Annotation of partial resources
  • video segmentation - each slide defines a new
    video segment (fine grain
    segmentation) - if available, use table of
    contents for segment definition

current TOC segment
Interestingness of segments
fine grain segmentation
tag cloud of current segment
most interesting slide of current segment
29
(No Transcript)
30
  • Future Work
  • Extension for general (time dependent) media
    tagging based on MPEG7
  • automatic segmentation by
  • scene detection, scene analysis, object trace,
  • audio analysis
  • Extension for general partial document tagging
    (time independent media)
  • only difference to conventional tagging systems
    is identification and adressing of single
    document parts
  • identification and addressing of partial
    documents can be achieved with XPointer / XPath
    expressions

31
  • Outline
  • Introduction
  • Automated Annotation of Multimedia Presentations
    and Content Based Search
  • Lecture Recording and Automated Annotation
  • Content Based Search in Recorded Lectures
  • Collaborative Annotation of Multimedia Data
  • Conventional Search vs. Social Tagging
  • MPEG 7 and Collaborative Annotation
  • Collaborative Lecture Annotation
  • Thank your for your attention!

32
  • Architektur

DB Index
Annotation (MPEG-7) Repository
Video Repository
Import Export
Search Query Search Results
Desktopstream
Video Stream
Collab. Tags, Notes, Custom- Segmentation
Media Processing System
Web-Server
Annotation Adaption
Search Application
Administration Interface
User Interface
Search Query/ Search Results
Collab. Tags, Notes Custom-Segmentation
PPT/PDF/... Logfile/Stream URL/...
User
About PowerShow.com