Title: Virtualized%20Classroom
1Virtualized Classroom Automated Production
Media Integration and User-Customized
Presentation
- Zhigang Zhu1,2, Chad McKittrick1 and Weihong Li2
- Video Computing Laboratory
- Department of Computer Science
- 1City College and 2Graduate Center
- The City University of New York
2Outline
- Background
- A Bigger Picture
- Multimedia Virtual Classroom (UMassCCNY)
- CCNY Virtualized Classroom
- Automatic capture
- intelligent media integration
- user-customized presentation
- Conclusions and Discussions
3In cooperation with
- W. Richards Adrion
- James F. Kurose
- Edward M. Riseman
- RIPPLES Group and Vision Lab
- University of Massachusetts Amherst
- Dr. Parviz Kermani
- e-Learning Lecture Navigator (ELN)
- Polytechnic University of New York
- and IBM T.J. Watson Research Center
4hypothesis, strategy motivation
pedagogy
5CUNY and CCNY
- CUNY 20 colleges
- Ph.D. programs in GSUC
- CCNY 20, 000 students
- MS programs only
- Minority Serving Institute
- In 2002, URM 66 in engineering, 35 in CS
- US News 2003 No 2 in diversity
- large percentage of work students
- Questions
- Effective learning tools for recruiting and
retention
6MANIC (UMASS)
Multimedia Asynchronous Networked Interactive
Courseware
CMPSCI 453 PPT slides ECE 566 handwriting
7CD-MANIC the best of both worlds
- CDs
- for bandwidth intensive content
- internet for
- content updates
- logging student behavior
- collaboration
- search
- external links
- overcomes any bandwidth constraints provides
convenience - contents dont change often
- use anywhere
- planes, trains, behind firewalls
8Outline
- Background
- A Bigger Picture
- Multimedia Virtual Classroom (UMassCCNY)
- CCNY Virtualized Classroom
- Automatic capture
- intelligent media integration
- user-customized presentation
- Conclusions and Discussions
9Multimedia Virtual Classroom
- Automatic data collection and indexing
- Audio/video
- PPT, handwriting
- online materials, etc
- Collaborative Learning Environment (CLE)
- Active
- Coversational
- Constructive reflective
- Intentional contextual
10MVC as an active CLE
- active
- Goal active interface, navigation
- base index, simple search
- extended search, active objects (text,
images) - learner-controlled interface
11MVC as an conversational CLE
- conversational
- goal support collaboration
- base threaded discussions
- CLIMANIC
12MVC as a constructive reflective CLE
- constructive reflective
- goal notation, collaboration
- base none
- notes on slides, threaded discussions, save
CLIMANIC collaborations, integrated reporting
13MVC as an intentional contextual CLE
- intentional complex contextual
- goal problem-focused pedagogy active classroom
strategy, realistic problem domains - base problem-focused learning
- CASA, on-campus distance learning
integration, design tools environment
integration
Integrated Tools
14MVC supporting learner logger
- important tool for assessment
- goal assessing individual and course learning
goals - base quizzer, logger
- integrate with new tools extended search,
notation, collaboration - extend to integrated design tools environment
- integrate with CMS (OWL, WebCT, Blackboard)
15Outline
- Background
- A Bigger Picture
- Multimedia Virtual Classroom (UMassCCNY)
- CCNY Virtualized Classroom
- Automatic capture
- intelligent media integration
- user-customized presentation
- Conclusions and Discussions
16CCNY Virtualized Classroom
- Automated MM data capture
- Sensing, synchronization and recording
- Intelligent MM data integration
- Video, PPT slides, Mimio handwriting pages
- Flexible User Interface
- Course adaptive, user customized
- Virtualized Classroom (VC)
- A new e-learning environment generated and
enhanced from materials captured from real
classrooms.
17VC Automatic MM capture
18Outline
- Background
- A Bigger Picture
- Multimedia Virtual Classroom (UMassCCNY)
- CCNY Virtualized Classroom
- Automatic capture
- intelligent media integration
- user-customized presentation
- Conclusions and Discussions
19VC Media Integration
- PPT_at_ Slide Mimio page registration
- Pre-calibration
- Dynamic calibration
- Panoramic Video Mosaicing
- From a panning camera
- PPT_at_ Slide video image registration
- Toward a 3D virtual environment
20VC Media Integration (1)
- PPT_at_ Slide Mimio page registration
A simple approach mark four corners
21VC Media Integration (1)
- PPT_at_ Slide Mimio page registration
A simple approach mark four corners
22VC Media Integration (1)
- PPT_at_ Slide Mimio page registration
Question What if one of the devices move?
23VC Media Integration (1)
- Dynamic registration of PPT_at_ Slide Mimio page
because - Hard to mark in some cases
- due to occlusion and height
- Instructor may forget to do it
- Devices may not be able to keep stationary
- Camera, projector, Mimio capture bar
- completely automatic and mind-free approach
24(No Transcript)
25VC Media Integration (2)
Panoramic mosaic from video
26VC Media Integration (2)
Panoramic mosaic from video
27VC Media Integration (3)
Replacing the slide projections
28VC Media Integration (3)
Image Alignment
From Video
From Digital Slide (PPT)
29VC Media Integration (3)
Image Alignment
30VC Media Integration (3)
Instructor Extraction
31VC Media Integration (3)
Instructor Extractionraw
32VC Media Integration (3)
Instructor Extractionrefined
33VC Media Integration (3)
Instructor Extractioncontour
34VC Media Integration (3)
Instructor Extractionand integration
video
image
shadow
contour
35VC Media Integration
Toward an immersive VC interface
Question Window, ToC, etc
36Outline
- Background
- A Bigger Picture
- Multimedia Virtual Classroom (UMassCCNY)
- CCNY Virtualized Classroom
- Automatic capture
- intelligent media integration
- user-customized presentation
- Conclusions and Discussions
37User Customized Presentation
- Virtualized Classroom Presentation System (VCPS)
in Java, consists of - An authoring tool VCPS creator
- An presentation interface - VCPS player
- Features
- Customized sizes and locations
- Pop up ToC for indexing
- Synchronized play, next, last
38User Customized Presentation
- PPT panoramic view popup ToC
39User Customized Presentation
- PPT Mimio integrated Popup ToC
40User Customized Presentation
- PPT Mimio Combined New buttons
41User Customized Presentation
- PPT Mimio Combined New buttons ToC
42User Customized Presentation
- PPT Mimio Combined images New Buttons
43User Customized Presentation
- PPT Mimio Combined images New Buttons
44User Customized Presentation
- PPT Mimio Combined images New Buttons
45User Customized Presentation
- PPT Mimio Combined images New Buttons
46User Customized Presentation
- PPT Mimio Combined images New Buttons
47User Customized Presentation
- PPT Mimio Combined images New Buttons
48Outline
- Background
- A Bigger Picture
- Multimedia Virtual Classroom (UMassCCNY)
- CCNY Virtualized Classroom
- Automatic capture
- intelligent media integration
- user-customized presentation
- Conclusions and Discussions
49Conclusions and Discussions
- CCNY Virtualized Classroom
- automatic MM capture
- intelligent media integration
- user-customized presentation
- Multimedia Virtual Classroom (UMassCCNY)
- Active and collaborative learning
- Content-based searching and indexing
- Pedagogy and assessment
50Thank you !
Questions?
51AutoAuditorium Interface
52Just-In-Time (CMU)
53Virtualized Classroom
video transformation
Remote Reality
Omnidirectional Camera