NEES 4th Annual Meeting Washington D.C., June 2123, 2006

1
NEES 4th Annual MeetingWashington D.C., June
21-23, 2006
Current Status and Future Directions for NEES
Cyberinfrastructure
Anke Kamrath (kamratha_at_sdsc.edu) Lelli Van Den
Einde (lellivde_at_sdsc.edu) Shannon Whitmore
(swhitmor_at_sdsc.edu) Ahmed Elgamal
(elgamal_at_ucsd.edu) http//it.nees.org
2
Overview

• Overview of the Year for NEESit (Anke Kamrath)
• NEES Cyberinfrastructure Vision, Priorities, and
  People
• Accomplishments during FY06
• NEESit _at_ Annual Meeting
• Demonstration of Data and Telepresence
  Capabilities (Lelli Van Den
  Einde Shannon Whitmore)
• Background Use Case Groups
• Case Study Pre-NEESR Soil-Foundation-Structure-In
  teraction Project
• NEES End to End Workflow
• NEES Data Model
• NEEScentral Overview
• Telepresence Overview
• Roadmap for Remainder of FY06
• Future Directions for NEES Cyberinfrastructure
  (Ahmed Elgamal)

3
Overview of the Year for NEESit Anke Kamrath
4
NEES Cyberinfrastructure Vision and Priorities

• NEES CI Vision
• Drive the cutting-edge of fundamental and
  transformative research in earthquake engineering
  through the application of information technology
• Broaden impact of research to researchers,
  practice and education through IT.
• Information Technology Priorities
• Robust remote participation environment
• World class data repository
• Collaboratory to enable integration of
  wide-ranging tools and applications (through web
  services) to facilitate new paradigms of usage,
  collaboration, and discovery

5
NEES Cyberinfrastructure -People Make it Happen
NEESinc BOARD OF DIRECTORS
IT Strategy Committee
NEESinc HQExecutive Director Chief IT
Officer Data Librarian Web Master
NEES CyberinfrastructureCenter SDSC partners
Equipment Sites 1-2 IT Personnel per site
SW Development
Production IT Support Security Officer
Software Architect
Telepresence, Collaboration and QA
Data Development
Infrastructure Outreach
SubKs
SubK
Contractor
Contractor
6
NEES Cyberinfrastructure
Community Databases Data Collections Data
management, sharing, queries, mining and
preservation
Infrastructure Middleware
DAQ Systems, Networks, Storage, Servers,
Security, Middleware
EDcentral
PeopleNEES consortium, researchers, equipment
sites, practitioners, NEESit
NEESCyberinfrastructure
flexTPS
Simulation HPC allocations, large-scale data
analysis, simulation, and modeling
RDV
SoftwareWeb Services, Tools, Applications, and
Community Codes
Education Earthquake Engineering education and
training
OutreachCollaboration and community leadership
with other large-scale projects
REU
7
FY06 Highlights

• NEEScentral Growing data system with active data
  management
• Significant NEEScentral Usage
• 450 Accounts, 40 Research Projects
• https//central.nees.org
• Database backend with growing metadata model and
  user interfaces (Currently 100 fields)
• In-depth overview later in this session
• Collaboration and Outreach Tools
• WebEx (https//nees.webex.com) deployed Oct 2005
  
• Quickly adopted as key planning tool for NEESR
  teams
• NEES Site Activities (NAWI) deployed Nov 2005
• https//central.nees.org/activities
• Watch whats happening at all the equipment
  sites!
• Videoconferencing via Internet2 deployed May 2006

8
More Highlights

• High-end Computing
• 200K Allocation received for SDSC DataStar and
  Teragrid resources Oct 2005
• Active Usage from 12 research groups
• Largest run using 2048 processors
• OpenSees w/ custom domain objects and 25M
  elements
• Available to NEES community http//it.nees.org/sup
  port/supercomputing/index.php
• Telepresence Enhancements
• Expansion of tabular panel (spreadsheet style
  display of sensors)
• Load/save a configuration
• Pan/Tilt/Zoom support for video
• In-depth overview later in this session
• Automated Build and Test Environment
• Deployed Jan 2006
• Support high-quality, iterative development
  process

9
Highlights Technology Outreach

• Community Code Repository (NEESforge)
• http//neesforge.nees.org (deployed Dec 2005)
• 25 Hosted Projects and 41 Registered Users
• Environment for researchers to manage code on
  their own
• Bug / feature tracking and discuss forum /
  mailing list
• Version control system and documentation
• Download
• All open source
• Pipeline for bringing community development
  efforts into NEES CI
• NEESit User Support Services
• Guaranteed one business day response
• Toll free 866-260-4100,
• Email it-support_at_nees.org
• Web http//it.nees.org/support,
  https//central.nees.org/help
• All issues logged in Fogbugz tracking systems

10
More Outreach Highlights

• Strong International Partnerships
• E-Defense (Japan), SAMCO (EU), KOCED (Korea),
  NCREE (Taiwan), and others
• All groups interested in standardized data models
  for sharing data across distributed data
  repositories
• Strong Interest in sharing software solutions and
  joint development efforts
• EDcentral already deployed!
• EU leveraging NEES DataTurbine and Telepresence
  solutions
• Strategy Lets not compete over the CI rather
  focus competition in research arena

11
NEESit _at_ Annual Meeting

• Booth
• 800am-500pm, Wednesday and Thursday.  
• No booth on Friday.
• Demos  NEEScentral and RDV (punching bag)
• "Meet a NEESit Expert
• Sign up sheet at the booth to schedule 10-15
  minute meetings with Lelli, Shannon, Wei
• Training Workshop
• Friday 1pm-515pm
• Accepting reservations until COB Weds (Today).
  Stop by booth or register on-line at
  http//it.nees.org/support/workshops/workshop_endu
  ser.php
• Overview of NEESit Software Services, Organize
  and Manage Data, Participate in a Remote
  Experiment, Collaborate in a Distributed Project,
  Simulation and Hybrid Simulation

For more info about NEESit see http//it.nees.org
12
Demonstration of Data and Telepresence
Capabilities Lelli Van Den Einde Shannon
Whitmore
13
Background

• Use Case Groups
• Data SFSI pre-NEESR project
• Sharon Wood, Bruce Kutter, Dan Wilson, Adolfo
  Matamoros, Mahadevan Ilankatharan (Lanka)
• Coordinated research project to study
  soil-foundation-structure interaction
• Test different components of a two-span bridge
  assemblage at different scales with different
  boundary conditions
• Project utilizes 3 NEES Equipment Sites
  (Centrifuge, Shake Table, and Field), Purdue
  Structural Tests, and UW and UC Berkeley
  Simulation
• Focus for June release UC Davis Data Report
• Telepresence
• Sri Sritharan, Laura Lowes, Jerry Hajjar
• UMN-MAST pre-NEESR T-Wall test
• WebEx meetings with each group every 2 weeks
• Feedback informs development

14
Prototype Structure
Computational Models UW, UCB, UCD
Data Kansas
Outreach SJSU
15
Case Study SFSI Pre-NEESR Project
Prototype Structure
ComputationalModels
Centrifuge Tests
Structural Tests
Shaking Table Tests
Field Tests
16
NEES End-to-End Workflow
17
NEES Data Model

• Goal Preserve and organize all data necessary to
  reproduce experiment
• Structured vs. Unstructured data
• Driving forces
• SFSI Pre-NEESR project (emphasis on Centrifuge/UC
  Davis Data Report)
• NEES Reference Data Model by Peng and Law
• Geotechnical Data Model by Bardet/Swift/Kutter/Wil
  son
• Tsunami Data Model by NACSE/OrSt
• 70 of the model is common across all
  disciplines
• Current data model being passed around now
• NEESit seeking feedback from researchers on this
  model
• What works? What is missing?
• Write down comments and return them to NEESit
  booth or send feedback to it-support_at_nees.org

18
Page 3 of Handout
19
Page 4 of Handout
20
Page 5 of Handout
21
Page 6 of Handout
22
NEEScentral Overview

• Facility (SSDB migrated to NEEScentral)
• Contact Info/Staff/Training and Certification
• Equipment
• Sensor Inventory and Calibrations
• Research
• Data IN
• Project metadata (Page 8 of Handout)
• Experiment metadata (Page 9 of Handout)
• Setup Material Properties (Page 10 of Handout)
• Setup Coordinate Spaces (Page 11 of Handout)
• Setup Sensor Location Plan (Page 12 of Handout)
• Setup Model (Page 12 of Handout)
• Setup Equipment Inventory (Page 13 of Handout)
• Setup Scale Factors (Page 14 of Handout)
• Trial metadata
• Setup Channel List (Page 15 of Handout)
• Setup Input Motion (Page 15 of Handout)
• Search Data (Page 16 of Handout)
• Experiment Report (Starting on Page 18 of Handout)

NEEScentral Demo...
23
Telepresence Overview

• Researcher and/or Outreach Tools
• NEES Activities Web Interface (NAWI)
• Promotes outreach of NEES research
• Integrates real-time video streams via flexTPS
• https//central.nees.org/activities
• flexible TelePresence System (flexTPS)
• Real-time video from an equipment site
• Developed by Christopher Stanton
• http//assam.mast.umn.edu/portal
• Real-Time Data Viewer (RDV)
• Real-time data viewing during an experiment
• Collaborative development effort between NEESit
  and University at Buffalo (Jason Hanley)
• http//it.nees.org/software/rdv/index.php
• Telepresence Middleware
• Data Turbine
• NEESdaq

24
Telepresence Kudos

• MAST pre-NEESR T-Wall test
• Invited remote researchers to participate in
  various phases of testing
• Industry Partner (Susie Nakaki)
• With guidance from Wei, I found RDV very easy to
  use, and especially like the drag and drop
  plots that allowed me to look at information that
  interested me, independent of what the research
  team was viewing. This tool allowed me to
  participate over the course of several days, with
  minimal disruption to my business.

• European Union ELSA Laboratory, Italy (Pierre
  Pegon)
• I am very happy with this version of RDV. I am
  now using telepresence for almost every test we
  are performing.
• University of Auckland, NZ
• From Sri Sritharan The Auckland faculty were
  impressed
  test via WebEx, watching Wei's demonstration of
  RDV

25
Feedback from Use Case Groups
26
Roadmap for Remainder of FY06Data Management
Highlights

• NEEScentral 1.6 (August)
• Support for field data model
• Support for simulation data model
• Bulk upload phase I
• Sensor location plan
• Channel List/DAQ
• Significant extension of web services
• To enable equipment site specific software for
  data ingestion
• Advanced reporting capabilities
• Generate Data Report in different formats (PDF,
  Excel, etc)
• Generate spreadsheet from any table
• Print from any web page

• NEEScentral 2.0 (October)
• Support for shake table data model
• Support for tsunami data model
• Curate and publish experiment
• Improved structured search
• More metadata search options
• Advanced unstructured search
• Search files using Google search engine
• Bulk upload phase II
• Coordinate Spaces
• Others as needed
• Bulk download

27
Roadmap for Remainder of FY06Telepresence/Hybrid
Simulation Highlights

• DataTurbine 3.4 (July)
• Extracted from NEESpop distribution
• Repackaged as RPM
• Bug fixes to Server and NEES utilities
• Significant improvement to documentation

• RDV 2.0 (October)
• High Resolution Still Images
• Time-lapse movies
• Extract X frames/second
• Integration with NEEScentral
• Save experiment data to repository
• Replay experiment data from repository

• RDV 1.4 (August)
• Discontinuous timeline
• Filter downtime from display
• Replay archived experiment data
• Event Annotations
• Mark events of interest

• Hybrid Simulation
• Communications Framework (September)
• Protocol
• Library
• Server

28
Looking For Feedback

• Return comments on data model
• Contact Us!
• it-support_at_nees.org
• Toll Free 866-260-4100
• Submit bugs/feature requests http//it.nees.org/s
  upport

29

• Future Directions for NEES Cyberinfrastructure
• Ahmed Elgamal