Interaction between small size device and large screen in public space

1
Interaction between small size device and large
screen in public space

• Department of Computer Science
• University of Tsukuba, Japan
• Chunming Jin, Shin Takahashi, Jiro Tanaka

2
Large screen display

• Become more popular in public space
• e.g. plazas, subway stations, etc
• Display information dynamically
• Shown by many users at the same time
• No user interaction allowed
• Note Large screen display means wall-sized
  display in this research

3
Small size devices

• Portable
• Can handle the information anywhere and anytime
• Can access the network
• Cannot display much information in a single screen

4
Comparison
Combine advantages of large screen displays and
small size devices
5
Goal of this work

• Use a small size device as an input device of
  large screen display
• Make the large screen display interactive
• Exchange information simply and intuitively
  between large screen display and small size
  device
• User can interact with large screen display in a
  simple and intuitive way

6
Approach

• Use QR Code to provide connection information to
  users
• Provide a part of screen to a user, let the user
  use it as extended screen of his small size device

Small size device
7
Usage case

• A user is looking at information displayed on a
  large screen display which situated in subway
  station while wait for a subway
• The subway is coming in when the user look at
  information he feel interest
• The user can take out his small size device,
  connect with large screen display simply and save
  the information in his device

8
System overview
Large Screen in public space
Wireless Network
Server of Large Screen
QR Code
Send Information to Server
Read QR Code
Camera
Small size device
9
Interact with large screen
Camera
Small size device
10
Interact with other users
Personal screen area
11
Connection information

• Server information
• Server ip address, port number
• Position information
• A part of large screen display that a user wants
  to use
• Password
• Used for avoid users connect to a large screen
  display remotely

12
Advantage of QR Code

• A simple way to connect with large screen display
• Provide position information intuitively
• QR Code can be encoded much information
• Dont need a special device to read QR Code

13
Personal screen area

• Exchange information intuitively
• Handle information in users small size devices
  with a large screen
• Observe the whole large screen display
• Communicate with other users that is not
  connected
• Etc.

14
Demonstration
15
Related work

• Sweep and point and shoot phonecam-based
  interaction for large public display, CHI05
• Exploring Mobile Phone Interaction with situated
  displays. PERVASIVE 2005
• Dynamo A public interactive surface supporting
  the cooperative sharing and exchange of media,
  UIST03

16
Summary

• Proposed a connection method to interact with
  large screen display with the aid of QR code.
• Proposed a personal screen area for each user to
  exchange information
• Introduced system overview

17
Future work

• Develop large screen display intensive
  application that can be used by the proposed
  system
• e.g. Explorer, Image editor
• User management
• Authenticate server
• Published data management
• How to display those published data
• System performance evaluation
• System performance enhancing

18

• Thank you for your attention