Title: The GEON LiDAR Workflow: CyberinfrastructureBased Data Distribution and Processing
1The GEON LiDAR WorkflowCyberinfrastructure-Based
Data Distribution and Processing
- Christopher J. Crosby, J Ramón Arrowsmith
- Jeffrey Connor, Newton Alex
- Efrat Jaeger-Frank, Vishu Nandigam,
- Ashraf Memon, Chaitan Baru
- Han S. Kim
GEON Cyberinfrastructure Summer Institute for
Geoscientists August 15, 2007
2LiDAR (LIght Detection And Ranging) a.k.a ALSM
(Airborne Laser Swath Mapping)
- Airborne pulsed laser scanning system
differential GPS inertial measurement unit
(IMU) - 30,000 points/second
- Ground sampled at multiple points/sq. meter
- 15 cm vertical accuracy
- 300 - 500 per sq. km acquisition cost
http//coastal.er.usgs.gov/hurricanes/mappingchang
e/
3LiDAR point cloud
- x,y,z attributes
- Filtering algorithms allow classification by
return type - Ground, vegetation, building
4- Geomorphic studies
- Landscape response to tectonics
- Landslide and hillslope processes
- Natural hazards
- Flood inundation mapping (FEMA Map Modernization)
Ecology and Forestry - Canopy and biomass
characterization
Engineering Applications
5The Challenge of Community LiDAR data
LiDAR coverage of the southern San Andreas and
San Jacinto faults
- 3.7 billion LiDAR returns, 1.9 TB - Very
high-res., supports 25-50 cm DEMs
6The Challenge of Community LiDAR data cont.
- National LiDAR Initiative
- Rough calculation using a NASA high
- elevation acquisition approach
- Land area of US 9,161,923 sq km
- Assuming
- 2 laser pulses per sq meter
- an average of 1.5 returns per pulse
- 35 data bytes per return
- 1 x 10
- 15 bytes of point cloud data
- 1 petabyte (1,000 terabytes)
For comparison, that is 3 times more data than
produced by all the instruments combined on
NASAs flagship Earth Observing System Satellite,
Terra (ASTER, MODIS etc.) , over the course of a
full year.
Stoker et al., 2007, Report of the First National
Lidar Initiative Meeting, February 14-16, 2007,
Reston, Va., U.S.G.S. Open File Report,
2007-1189.
7Complete LiDAR Workflow
1. Survey
3. Interpolate / Grid
USGS Coastal Marine
2. Point Cloud x, y, z,
4. Analyze / Do Science
8- Multi-institution collaboration between IT and
Earth Science researchers - Funded by NSF large ITR program
- GEON Cyberinfrastructure provides
- Authenticated access to data and Web services
- Registration of data sets and tools, with
metadata - Search for data, tools, and services, using
ontologies - GEON was designed as an equal collaboration
between Information Technology (IT) and
Geoscience researchers, with the goal of
developing an enabling IT platform to facilitate
the next generation of Geoscience research.
- Scientific workflow environment
- Data and map integration capability
- - Visualization and GIS mapping
Distributed Network
GEON / ASU node
9The Vision
Conceptual GEON LiDAR Workflow
- Utilize cyberinfrastructure developed by GEON to
offer online data distribution, DEM generation,
and analysis of large LiDAR datasets. - Completely internet-based workflow
- Point cloud to visualization
- Utilize modular web services to complete a
variety of processing and analysis tasks. - Offer users control of processing and analysis
parameters.
10Current GLW features
- Interactive polygon data selection via WMS map
- Attribute selection (ground returns, vegetation
returns) - Rapid estimate of points within selection area
- Point cloud download
- DEM generation via two pathways
- local binning algorithm
- Spline interpolation algorithm (GRASS GIS web
service) - User defined grid resolution and processing
parameters - Products produced in multiple, user-defined,
file formats
- User provided job title and description
- Dynamically generated and customized metadata
file - Email notification
11Pt. Density
IDW DEM
12Implementation Overview
- Spatial databases IBM DB2 on DataStar _at_ SDSC
- GRASS Open Source GIS
- Spline interpolation derivative products,
format conversions - Custom local binning algorithm for DEM generation
- Kepler Workflow Manager
- Integration of heterogeneous local and remote
tools - Job submission and monitoring
- Error tracking and failure recovery
13GEON LiDAR Workflow Architecture
14(No Transcript)
15Current GLW Status
Source
- Datasets online
- Northern San Andreas Fault
- West Rainier Seismic Zone
- E. California Shear Zone (Mike Oskin, UNC, PI)
- 4. Full B4 Dataset (Southern SAF and SJF)
- Total of 6.4 billion LiDAR returns available
via GLW - Use Statistics
- 42.2 billion returns processed
- 1953 unique jobs submitted
- 111 registered GLW users
16A cyberinfrastructure-based model for integrated
access to community LiDAR datasets
17Implications
- GLW will be distribution pathway for forthcoming
GeoEarthscope LiDAR datasets - 5 more B4-style data acquisitions in next 2 years.
- GLW is a proof of concept for utilization of
cyberinfrastructure to democratize access to the
next generation of community geoscience datasets
and processing tools. - Generic and scaleable GEON architecture
applicable to numerous (geo) science datasets. - Architecture enables integration of
non-centralized datasets and processing
resources.
18Moving Forward Integrated Imagery and topography
data stack for earth systems research
- Increasingly common for users to integrate
various resolution DEMs and remotely sensed
imagery to study landscape and geology at various
spatial scales. - Datasets
- Landsat, ASTER, DOQQs, Aerial Photography etc.
- NED SRTM 90, 30, 10m Aerial and terrestrial
LiDAR datasets
19Moving Forward Application of Cyberinfrastructure
to Remotely Sensed Data (in GEON 2.0)
- Structural and spatial integration of
heterogeneous datasets from various sources - Geographic and organizationally distributed hosts
- Various data organization schemes, file formats
and access protocols - Perform standard processing operations (i.e.,
spectral band combinations for common products
(RGB, NDVI etc.)), or generate a DEM and its
derivatives. - Spatially operate (subset, mosaic, merge,
project, etc.), reformat, visualize, archive,
share, and download, all the while producing
updated accompanying metadata.
20GEON LiDAR Workflow Access Instructions http//po
rtal.geongrid.org/lidar More Information http/
/lidar.asu.edu/ Contact chris.crosby_at_asu.edu
21http//lidar.asu.edu/LViz.html
22http//lidar.asu.edu/points2grid.html