Speckled%20Computing

1
Speckled Computing

• D.K. Arvind
• Director
• Research Consortium in Speckled Computing
• School of Informatics, University of Edinburgh
• (dka_at_inf.ed.ac.uk)

Convivio Summer School, Edinburgh, 16th Aug. 2006
2
Lecture Series so far .

• Irene McAra McWilliams
• Personal View of Interaction Design
• Anxo Cereijo Roibas
• Evaluation Methodologies of Pervasive Interactive
  Multimedia Systems
• Nina Sabnani
• Peripatetic Storyteller
• Animated Story

3
Overview of this Lecture

• Part I
• Specks, Specknets, and Speckled Computing
• Interaction Design
• Live Demonstration
• Part II
• Historical Perspective
• Case Studies

4
Interaction Design

• Specks, Specknets, and Speckled Computing
• Example Applications
• Specknet Platforms
• Brainstorming ideas

5
The future Internet

• The Internet is 1 Billion strong today
• The future IPv6 will support gt 35 Trillion
  separate subnetworks
• Each sub-network, in turn, will connect millions
  of devices

We are moving towards a world of connectedness
and interaction between people and smart
objects i.e. CONTEXT-SENSITIVE and LOCATION-AWARE
6

• Endow everyday objects with sensing, processing
  and wireless networking capabilities
• Link the sensory data from the physical world to
  the virtual world of networks of computers and
  the Internet

Specks bridge the physical and virtual worlds
7
Specks are programmable semiconductor devices
which can sense, compute, and network wirelessly.

• Specks communicate wirelessly over a few cms
• Size of a matchstick head (5X5X5mm) with limited
  power
• Specks bought by the weight yellow specks -
  temperature sensor,
• 
  black specks - pressure sensor
• Specks are assumed to be non-static and
  unreliable

8
Specknets and Speckled Computing

• Thousands of specks collaborate as dense
  programmable network Specknet
• Sensory data processed collaboratively, and
  information extracted in situ fine-grained
  distributed computation
• Encapsulation of sensing, processing and wireless
  networking in a single chip

Enabler technology for ubiquitous computing
9
Specks come in different sizes

8-bit (med) client 32-bit (large) microserver
8-bit 5mm cube client
8-bit mobile client

• Heterogeneous - three classes
• of platforms
• Static and Mobile clients

64 node testbed accessible over the internet
Speckled Computing
10
5CubeOTS When Size Matters
Sensor, Processor, Wireless Networking and
Battery in 5X5X5mm
11
Speckled Computing

• New models of unencumbered interaction with the
  digital world, in which the physical world is the
  primary site of interaction
• Computation and Collaboration at the edges to
  extract information locally and effect actuation
• Specknet on the person, say a dancer
• Sensory data such as RPM during rotation (sensory
  data))
• Track the movement of the limbs (sensing,
  collaboration)
• A robot mimics the actions of the dancer
  (sensing, collaboration and actuation)
• This information can be accessed and manipulated
  remotely over the internet

Specknet the last millimeter of the Internet
12
Real-time Tracking of Breakdancers - Video
13
Existing System for Posture Tracking

• Joint angle sensors
• Physically covers the subjects joints
• Restricts movement
• May provide the most accurate track

http//www.measurand.com/products/ShapeWrap.html
14
Specknets to track movement of limbs
15
Effect a robot wirelessly to mimic the movements
of the human
16
Interaction Design
Dynamics of Interaction b/w System User
Program and Understand the dynamics
Description of Behaviour over Time
Choreograph Behaviour
Empower User To Customise Behaviour
Visualise Form
Aesthetics of Use
Tangible
Particular Affordances
Malleable
Create the Overall Interactive System
17
Music from Motion

• Orient Speck consists of 3-axis Accelerometer,
  3-axis Gyro, 3-axis Magnetometer, and 5 bend
  sensors, coupled with processor and wireless
  networking
• The hand motion determines the fundamental
  frequency of the sound with finer movements of
  the fingers determining the harmonics
• A musical composition is created in real-time
  using physical gestures
• Sensor data is fed to a neural network which is
  trained for physical gestures

18
Observations

• A network of Orient specks attached to the limbs
  the human body as the interface in the
  Interaction System
• Blurring the sharp distinction between Dance and
  Music
• The user trains the neural network for different
  physical movements
• The specknet can actuate different entities a
  diaphragm to create sound, a motor to effect
  movement, ..
• Tangible, Malleable, Empower the user to
  customise behaviour
• Demonstration