AR

1
AR Authoring for UrbanPlanning
and Product Design
VR-NET Seminar on Virtual Reality Visualisation
and Modelling of Cities and Terrains Northumbria
University, 28th January 2005

• Eng. Pedro Santos
• pedro.santos_at_iscte.pt
• Prof. Miguel Dias
• miguel.dias_at_iscte.pt
• ADETTI/ISCTE/Portugal - Jan 2005
• This work is part of an Msc thesis in
• Computer and Telecom. Engineering Computer
  Graphics

www.adetti.pt
www.iscte.pt
www.magic-reality.com
2
Summary

• State-of-the-art
• Tangible interaction for Architectural and
  Industrial Design
• Authoring tools for AR Design applications
• The Performance Plaza AR authoring tool
• User requirements
• System architecture
• Conclusion

3
State-of-the-art
Tangible interaction for Architectural
and Industrial Design
4
Augmented Urban Planning Workbench Overlaying
Drawings, Physical Models and Digital Simulation
Hiroshi Ishii, John Underkoffler Dan Chak, Ben
Piper MIT Media Laboratory Eran Ben-Joseph, Luke
Yeung, Zahra Kanji MIT School of Architecture
and Planning

• Luminous Table Augmented Reality Workbench
  that integrates multiple forms of physical and
  digital representations.
• 2D drawings, 3D physical models, and digital
  simulation are overlaid into a single information
  space in order to support the urban design
  process.

5
Inexpensive Non-Sensor Based Augmented Reality
Modeling of Curves and Surfaces in Physical Space

• Augmented reality system where a user can model
  surfaces with his hands, and without expensive
  sensing systems.
• The system uses computer vision based methods for
  the tracking of the users head and hand
  position.
• Using a glove and the tracking system, the user
  can draw smooth lines or surfaces with her hands
  in a physical space.

Adrian David Cheok, Neo Weng Chuen Edmund and Ang
Wee Eng National University of Singapore
6
MagicCup A Tangible Interface for Virtual
Objects Manipulation in Table-Top AR

• City-planning system based on augmented reality
  with tangible interface.
• Tangible interface for virtual object
  manipulation in table-top augmented reality based
  on ARToolKit.
• User holds a transparent cup upside down and can
  pick up, move or delete a virtual object by using
  it.

Hirokazu Kato, Keihachiro Tachibana, Masaaki
Tanabe, Takeaki Nakajima, Yumiko Fukuda. Osaka
University, Hiroshima City University, Knack
Images Production Center, Hiroshima Institute of
Technology
7
Interactive Mediated Reality

• Mediated reality describes the concept of
  filtering our vision of reality, typically using
  a head-worn video mixing display.
• Proposes a generalized concept and new tools for
  interactively mediated reality.
• First prototype system for painting, grabbing and
  glueing together real and virtual elements.

Raphael Grasset, Jean-Dominique
Gascuel iMAGIS/GRAVIR France Dieter
Schmalstieg Vienna University of
Technology Vienna, Austria
8
Collaborative Augmented Sketching

• Software prototype using AR Toolkit for
  collaborative augmented reality sketching in
  architectural design.
• Non-intrusive interaction technique developed for
  this prototype.
• Sketching and distribution mechanisms are
  discussed and illustrated.

Hartmut Seichter Department of Architecture The
University of Hong Kong
9
Collaborative Mixed Reality Visualization of an
Archaeological Excavation

• VITA (Visual Interaction Tool for Archaeology)
  tool.
• Experimental collaborative mixed reality system
  for offsite visualization of an archaeological
  dig.
• System allows multiple users to visualize the dig
  site in a mixed reality environment.
• Tracked, see-through, head-worn displays are
  combined with a multi-user, multi-touch,
  projected table surface, a large screen display,
  and tracked hand-held displays.

Hrvoje Benko, Edward W. Ishak, Steven
Feiner Columbia University
10
State-of-the-art
Authoring tools for AR Design applications
11
Mix It

• ADETTI.
• Visual interface for authoring AR/MR.
• Magic Book metaphor. Books are made of markers
  and associated 3D models.
• Editor AR Viewer.
• Virtual Flashlight live demo.

12
AMIRE

• A Mixed Reality Authoring tool.
• The main objective of AMIRE is to enable
  non-expert researchers
• to use Mixed Reality (MR) for their applications
• to create and modify these MR applications with
  the support of dedicated tools that foster an
  efficient authoring process for MR.
• http//www.amire.net/

13
Authoring of a Mixed Reality Assembly Instructor
for Hierarchical Structures

• Mixed Reality based step-by-step furniture
  assembly application.
• Context related actions are given to the user to
  install elements.
• Intuitive way for authors to create new MR based
  assembly instructions.

Jurgen Zauner, Michael Haller, Alexander
Brandl Upper Austria University of Applied
Sciences (MTD), Austria Werner
Hartmann Institute for Applied Knowledge Processin
g (FAW), Austria
14
DART The Designers Augmented Reality Toolkit

• Designers Augmented Reality Toolkit (DART).
• Allows users to easily create augmented reality
  (AR) experiences.
• Can be used by technologists, designers and
  students alike.
• Rapidly prototype AR applications without
  extensive programming and content creation as
  well as knowledge of technical topics involving
  cameras, trackers, and 3D geometry.
• http//www.gvu.gatech.edu/dart/

Blair MacIntyre, Maribeth Gandy, Jay Bolter,
Steven Dow, Brendan Hannigan Georgia Institute of
Technology, Atlanta, GA
15
Immersive Authoring of Tangible Augmented Reality
Applications

• New approach for authoring tangible augmented
  reality applications, called immersive
  authoring.
• Allows the user to carry out the authoring tasks
  within the AR application being built.
• The development and testing of the application
  can be done concurrently throughout the
  development process.

Gun A. Lee a Claudia Nelles ß Mark Billinghurst ß
Gerard Jounghyun Kim a a Pohang University of
Science and Technology ß New Zealand, University
of Canterbury
16
DesignAR

• DesignAR allows a way of authoring augmented
  reality environments without needing to write
  code in C or other programming languages.
• The environment centers around Touch Designer, a
  commercial 3D modelling package by Derivative.
• http//www.mis.atr.co.jp/rodney/designAR/index.ht
  m

Rod Berry ATR Media Information Science
Laboratories
17
The Performance Plaza AR authoring tool
18
User requirements

• Project partner (User Requirements)
• NOA - Design agency in Germany.
• Develops modern 3D products in the context of
  market, communication, technology and production.

• Specification of the core technology MxToolkit
• Handles user interaction, hardware interfaces,
  system management, etc
• Independent of application to be developed
  provides generic programming language mechanisms
  for VR/AR/MR applications.
• Specification of a new AR authoring tool
  Performance Plaza
• Based in MxToolkit.
• Geared towards designers and 3D artists.
• Proposes a visual and intuitive new
  Human-Computer Interaction technique.
• Two different work paradigms design and
  presentation
• Design interactively prepare 3D models for
  presentation.
• Presentation show and interact with 3D animated
  models in AR.

19
User requirements

• Design phase
• Highlight and select subscenegraphs of 3D models.
• Transform, measure, cut and change appearance of
  models.
• Insert text and voice anotations.
• Allow model version control based in product
  development timeline. E.g. problem level model,
  concept level model, design level model,
  realization level model.
• With these operations author a powerpoint-style
  3D presentation
• Timeline based.
• Users (designer, architect, engineer, marketeer)
  actions trigger events.
• Create automatic or event-based animations.

20
User requirements

• Presentation phase
• Users interact with models (view, pick, move
  around, etc).
• Arrange models in a life-situation.
• Show or hear, select and change text and voice
  annotations.
• See/switch between time-related and
  speciality-related (architect, designer,
  engineer, marketeer) model versions.
• Launch presentation prepared in Design phase
  trigger events and animations.

21
System architecture

• Hardware
• Peripherals webcam(s), microfone, speaker.
• Input devices human hand, AR fiduccial
  marker(s), keyboard (or equivalent for text
  anotations).
• Output devices computer monitor, HMD, Paycheck
  screen.
• Software

22
System architecture

• Physical set-up Paycheck, the movie.

23
AR Authoring for Urban Planning and Product Design
Thank you for your attention!
Eng. Pedro Santos Prof. Miguel Dias
pedro.santos_at_iscte.pt miguel.dias_at_iscte.pt ADET
TI/ISCTE/Portugal - Jan 2005
www.adetti.pt
www.iscte.pt
www.magic-reality.com