Highlevel Computer Vision: Video Processing and Analysis

1
High-level Computer Vision Video Processing and
Analysis
Tiecheng Liu Department of Computer Science and
Engineering University of South Carolina
2
Current Research Work

• Video indexing and summarization.
• Analysis and learning of video data.
• Instructional video content analysis
• Video hyperlink link video content to Internet.

3
Video Indexing and Summarization

• Visual summarization based on video content.
• Video indexing for content retrieval.
• On-line and off-line video summarization
• Temporal scalable video coding.

4
Video Indexing and Summarization Example
Time-constrained video buffer model for dynamic
video summarization.
5
Analysis and Learning of Video Data

• Video structure analysis shot and scene
  segmentation.
• Video genre and style classification.
• Machine learning techniques for video data.

Example video style analysis based on HMM.
6
Instructional Video Content Analysis

• Video summarization of instructional videos.
• Cross-referencing of video data.
• Document analysis and handwriting recognition.

1. Blackboard
3. Hand-written slides
2. Electronic slides
4. Web pages
6. Audience/Discussion
5.Talking head
7
Instructional Video Content Analysis Example
Result example An automatically generated
summary of an instructional video, with teaching
topics recognized and emphasis detected
8
Video Hyperlink Link Video Content to Internet
Segmentation
Add hyperlinks
Authoring tool
Link video object to html/videos
Application in education, entertainment, and
commercial.