Aucun titre de diapositive

1
Activity presentation
Director Jean Caelen (DR CNRS) Vice-Director
Catherine Berrut (Prof. UJF)
Jean.Caelen_at_imag.fr www-clips.imag.fr
2
Institutions
UMR 5524
3
Research Topics
Man-Machine Interaction(s) Collaborative
interactions with machines Speech, Image,
Language Processing E-Learning Perceptive Rooms
and Augmented Reality Multimedia Document
Indexing Man Machine Interaction
Engineering Speech Recognition and Natural
Language Dialogue Collaborative and Multimodal
Interfaces Information Retrieval Machine
Translation Language Processing
4
Structure
Direction

• Technical staff
• Maintenance
• Projects

• Research
• ARCADE
• GEOD
• GETA
• IIHM
• MRIM

Direction council
Laboratoty council

• Administration
• Secretariat
• People Management
• Financial
• Subsistance
• Communication

• Valorisation
• MultiCom

People 72 (staff PhD students) UJF, CNRS,
INPG, UPMF, US
5
Research Teams
ARCADE (J.P. Peyrin, prof. UJF) e-Learning
(Ateliers de Réalisation et de Conception
dApplications Destinées à lEducation) GEOD
(J.F. Serignat, MCF INPG) Speech Group (Groupe
dEtude sur lOral et le Dialogue) GETA (C.
Boitet, prof. UJF) Machine Translation Group
(Groupe dEtude sur la Traduction
Automatique) IIHM (J. Coutaz, prof. UJF) Man
Machine Interaction Engineering (Ingénierie de
lInteraction Homme-Machine) MRIM (M.F. Bruandet,
prof. UJF) Multimedia Information Retrieval
(Modélisation et Recherche dInformations
Multimédia)
6
People 1/1/2002
Regular Staff 73 (a) Profs
Researchers 29 (b) Engineers Admin. 11 (c)
PhD Post-docs 26 (d) Under contracts 7 (e)
Masters and others 24 (g) Invited 10 Total
107
7
Technological transfert
MultiCom Usability platform for the design and
the evaluation of interactive systems Start-up
creations 1998 NOVADIS, ergonomics, cognitive
engineering 1999 ARLYS (MENRT, CARMI,
Microsoft, Axe et Cible), e-learning, education
software development 2000 DMAILER, e-mail
indexing and processing
8
MultiCom

• Technological Platform
• To study human factors in situated tasks
• To design and evaluate innovative and interactive
  services (or systems)
• by,
• Real usage experimentation
• Simulation (Woz for instance)
• Partnership
• Linguists, Sociologists, Ergonomists

User centered
9
Relationship and contracts

• MultiCom
• 6 industrial (Schneider, France-Télécom,
  Leti-CEA, STM),
• 2 european SIRLAN IST 5th PCRD, ADAMOS,
  Finlandia
• 2 regional SHIVA RRA 99 et Thématique 2000
• Research
• 6 industrial (Thalès, France-Télécom, EDF,
  Alcatel) in RNRT, RNTL, CTI CNET, DGA
• 2 international C-STAR, UNL (17 countries)
• 5 european NESPOLE, TACIT, TIPS, ARIADNE,
  GLOSS, CAMELEON, FAME
• 3 research networks CNRS (french networks)
• 2 regional
• 5 local (C-STAR, RICOM, RESIDE-HIS, EPIC,
  e-Xpérience)

10
Projects
11
Multi-team projects
C-STAR/NESPOLE! Face to face speech translation
(GEOD, GETA) RICOM Multimodal interaction
for Multimedia information retrieval (GEOD, IIHM,
MRIM) Smart Rooms disable people monitoring,
home services (GEOD, IIHM) FORMID e-learning,
virtual teaching (ARCADE, IIHM)
12
Dialogue, multilinguism C-STAR Nespole!
C-STAR Consortium for Speech Translation
Advanced Research (Japan, Corea, USA, Germany,
Italy, France) NESPOLE! (IST project)
NEgotiating through SPOken Language in
E-commerce
13
Projet C-STAR Speech translation Applications to
tourism, hot line, e-commerce
14
2 ways possible
speaking
Speech recognition
source
Translation
IF coding
texte IF
Generation
target
listening
Speech synthesis
15
Interchange Format

• Meaning representation
• Based on
• Speech acts
• What to want or to do
• Concepts
• What to say
• Arguments
• Discourse predicates

give-information
availabilityroom
room-type(single double)
16
The 22th july 1999 at Grenoble



17
RICOM Halpin CoVitesse
RICOM Information Retrieval Interactive,
Collaborative and Multimodale HALPIN
Man-Machine Dialogue CoVitesse Information
Representation
18
HALPIN
Man-Machine Dialogue speech recognition
dialogue management information retrieval
speech synthesis
19
History of dialogue
Outputs
Documents
Input
Speech Recognition
Speech Buttons
20
Collaborative surfing
Trace of navigation
Document annotation
Session control
Collected documents
21
Perceptive room
RESIDE-HIS Smart Home for disable people COMEDI
Informal Communication
22
RESIDE-HIS
23
Telemonitoring
Home bus
Modem
Physiological and biological sensors Microphones
Monitoring on Events Alarms Statistics
24
Plan HIS
25
CoMedi Informal communication
Awareness, Focus
Feed-back control
Feed-back, privacy control
Acces control
26
Example of filters
EigenSpace
Poster
27
EigenSpace filter Main Component Analysis
Image base
Eigen Space
Eigen vector
ArgMin(distance)
Image captured
Image to send
28
e-Learning
FORMID FORmation Interactive à Distance Magic
Board Collaborative Space and augmented reality
29
FORMID
FORMID Toolkit for teaching by example I learn
what I do.
GeneSimu Oasis
30
Magic Board
31

Platform for design and evaluation of
interactive systems
MultiCom
32
Lifecyle
33
Objectives
To anticipate the usage and to predict the
usability To design and to evaluate interactive
systems along the lifecycle
using
Participatory design method And simulation
techniques (as Moz) for the experimentation and
the test
34
A good starting point enrich the first idea
Taking into account all the criteria about (a)
sociological, (b) ergonomical, (c)
economical, (d) technological points of view
Functions
Diagnostic
Observation
Idea
Specifications
Mockup
Validation
Evaluation
Scenario
35
Sociology

• Practice analysis
• Usage meaning
• By questionnaire
• By interviews
• By recording practices
• Applying sociological criteria
• ? Recommendations for the design

36
Ergonomics...

• Simulation, Woz, Scenarios
• Test human perceptive
• Test human behavior (after capture) under
  definite and limited scenarios
• Task and activity analysis
• ? Recommendations for the design

37
The first cycle ends

• Functionalities definition
• Design constraints
• Criteria Evaluation definition
• Specifications
• Then development can start along a second
  iterative cycle

38
The hardware platform
Devices for observation
User
Control video
Multimedia recording
Interactive devices
Wizard 1 Wizard 2
39

• Conclusion CLIPS-IMAG is
• A research lab on interactive systems
• Open on the technological transfert
• Focused on user centered design methods