Video and Sensor Network Architecture and Displays

1
Video and Sensor Network Architecture and Displays

• Douglas Fidaleo
• Mohan Trivedi (PI)

Center for Wireless COMMUNICATIONS
2
Overview

• Sensor data can be overwhelming especially with
  visual (video) sensors
• Transmission of higher level semantic content
  rather than low level detail
• Network architecture in support of this goal

3
Network Architecture Goals
Data warehouse

• Flexibility
• Reconfigurability
• Easily Scalable
• Bi-directional communication
• Simulated sensor-to-sensor communication

Sensors
4
Network Architecture
Clients

• General framework
• Thin clients
• XML data packets
• Bi-directional communication
• Independent video server

Server
5
Mobile Visual Communicator
Clients
Clients
Tablet PC

• Wireless transmission and visualization of user
  position
• Remote mobile video observations

GPS
Server
Server
6
Demo application
7
Current Implementation

• Server built on top of Fortress online game
  server
• Secure client authentication
• Secure communication channels
• Added sensor network Java API
• Thin client
• Data descriptors
• Message routing and filtering

8
Visualization and Interfaces

• Direct visualization of data streams
• Temperature gauge
• Embedded visualization
• GPS location on a spatial map
• Video augmented 2D maps
• Data abstraction and interpretation

9
Data Abstraction The SimCity Analogy

• City is populated with sensors
• Advisors make sense of data
• Provide feedback to operator (Mayor)

10
Future Plans Short Term

• Security and Privacy
• Client-server architecture enhancement
• Sensor control API
• Application APIs
• Interface existing capture and analysis modules
• Face recognition, Body posture analysis, Body
  tracking
• Integrate a wider variety of sensors and
  processing clients
• RFIDs, PDAs, Cell phones

11
Future Plans Longer Term

• Large scale data abstraction and human
  interfacing (aka the SimCity model)
• Sensor data archiving (DB)