The Next Generation McIDAS A Look Towards the Future 21st IIPS 8.2 San Diego, CA - 11 January 2005

1
The Next Generation McIDASA Look Towards the
Future21st IIPS 8.2 San Diego, CA - 11 January
2005

• Dave Santek
• Tom Whittaker
• Thomas Achtor

Space Science Engineering Center (SSEC) ,
University of Wisconsin - Madison
2
Outline

• Basic functionality of McIDAS-X
• History of McIDAS and current user base
• The next generation McIDAS-V
• VisAD
• IDV (Integrated Data Viewer)
• Data servers ADDE and OpenADDE

3
What is McIDAS ?(Man computer InteractiveData
Access System)

• Collection of user programs and libraries
• for visualizing and analyzing geophysical data
  (focus on
• environmental satellites)

• UNIX, PC Mac capable
• A synergistic tool that integrates numerous data
  types into one system
• First developed in the early 1970s
• Still in use world-wide at research, operational,
  educational, and commercial sites

4
Key McIDAS Attributes

• Access to extensive geophysical database
• Core package plus user-written applications
• Diverse functionality through software (1
  million lines of code)
• Extensive visualization capabilities
• Satellite and NOAAPORT data ingest

5
McIDAS Functionality

• Digital Image Processing
• GIS Applications
• Weather and Climate Data Analysis and
  Applications
• Graphical Displays of Data Information
• Gridded Data Processing and Analysis Tools
• Display Process Control Utilities

6
(No Transcript)
7
(No Transcript)
8
History of McIDAS
9
McIDAS Users

• NOAA NESDIS, AWC, SPC, TPC, etc.
• NASA STS, LaRC, MSFC, JPL
• Unidata 130 universities and colleges
• International EUMETSAT, ECMWF, Spain, Greece,
  Mexico, Australia
• Industry Boeing, Honeywell, Weathernews,
  Universal Weather, Meteorlogix, etc.

10
Why Change?

• McIDAS software (written in Fortran 77 and C) has
  a 30 year heritage resulting in limited
  extensibility potential
• New visualization concepts cannot be incorporated
  (4D)
• Forthcoming environmental satellite data cannot
  be utilized in the best way (GOES-R NPOESS
  operational systems)

11
The road to the next generation Geostationary
Sounders ( of channels)
ABS/HES (operational)
(1600)
GIFTS (experimental)
(1600)
CrIS (operational)
IASI (operational)
(2400)
AIRS (operational)
GOES Sounder (operational)
(18)
Aircraft data (experimental), IMG
(12)
VAS (experimental)
The ABS/HES is the next step from experimental or
low spectral resolution to operational
high-spectral resolution, high temporal sounders.
Ground-based (exp)
HIRS (operational)
IRIS (experimental)
Pioneering work (theory)
time
12
Hyperspectral Altitude Resolved Water Vapor Winds
GOES R - IHOP simulation 1830z 12 June 02  
GOES-8 winds 1655z 12 June 02 
Simulated GOES-R winds (left) versus GOES current
operational winds (right)
13
McIDAS-V Looking to the Future

• We seek to advance the functionality of McIDAS to
  meet the challenges of the future while retaining
  its current capabilities, including
  user-developed code.
• We are investigating a means to transition
  existing McIDAS applications to operate in a new
  environment that does not have the limitations of
  the current McIDAS system.

14
IDV The CandidateTransition System

• IDV (Integrated Data Viewer)
• Based on SSECs VisAD package
• Has a data model that is inherently capable of
  working with data types, both now and in the
  future
• Developed for the education community by Unidata
• Designed to replace McIDAS-X and GEMPAK at
  universities

15
What is VisAD?

• Open-source, Java library for building
  interactive and collaborative visualization and
  analysis tools
• Features include
• Powerful mathematical data model that embraces
  virtually any numerical data set
• General display model that supports 2- and 3-D
  displays, multiple data views, direct
  manipulation
• Adapters for multiple data formats (netCDF,
  HDF-5, FITS, HDF-EOS, McIDAS, Vis5D, etc.) and
  access to remote data servers through HTTP, FTP,
  DODS/OPeNDAP, and ADDE protocols

16
VisADs Data Model

• Designed to support virtually any numerical data
• Metadata can be integrated into each data object
  (units, errors, coordinates, etc.) carried
  along through mathematical operations
• Supports mathematical operations as well as
  evaluation and resampling of data
• Supports spatial and temporal co-location of data
• Supports data sharing among different users,
  different data sources and different scientific
  disciplines

Gully erosion/deposition from VisAD-based
DEMViewer
17
What is the IDV?

• Unidata developed scientific analysis and
  visualization tool
• Freely available Java framework and reference
  application
• Provides 2- and 3-D displays of geo-scientific
  data (plus, of course, animations)
• Stand-alone or networked application

http//www.unidata.ucar.edu/idv
18
IDV Features

• Integrated displays of a variety of data types
• Support for a variety data access methods
• Interactive probes
• User defined formulas and functions
• Bundling of user preferences
• Integrated HTML viewer
• Easy configuration
• Integrated documentation

19
Supported Data Formats

• The IDV can integrate displays of a variety of
  geo-scientific and other data including

• Scientific
• Geo-referenced netCDF data (local or remote)
• McIDAS/ADDE
• Societal
• GIS - ESRI shapefiles (polygons)
• Educational
• HTML
• Quicktime

NO2 concentrations over Berlin, Germany data
from netCDF, maps from shapefile
20
Surface observations with Jet Stream winds
21
EOS AIRS Hyperspectral Data Analysis Applications
22
Current Efforts at SSEC

• A mechanism to transform McIDAS graphical
  displays into the geo-referenced VisAD / IDV
  display
• A unified user interface to access image data via
  ADDE and OPeNDAP
• The capability to run IDV processes in a
  background mode
• A mode to run heritage McIDAS applications
• OpenADDE ADDE data servers available as Open
  Source

23
What is ADDE?

• Abstract Data Distribution Environment
• Key data access method for McIDAS-V
• Data transfer and reformatting
• All data returned in common format not as stored
• Sectorizing by geographic coverage and spectral
  bands
• TCP/IP remote access through registered port 112
• Compressed transmission
• Variety of clients can access the servers
• In use for 10 years

24
What servers are available?

• McIDAS format Image, grid, point, text
• netCDF as grid and point
• HDF as point
• MODIS Level 1b and products as images
• AIRS Level 1b
• AMSR-E Level 1b
• Level III NEXRAD
• AWIPS image
• GRIB

25
What clients can be used?

• McIDAS-X
• McIDAS-Lite
• IDV
• Matlab
• IDL

26
What is OpenADDE?

• Open Source version of the ADDE servers and
  required McIDAS-X library routines
• Another method for data providers to serve data
• McIDAS sites non-McIDAS sites
• Subsecting
• Encourage data providers to write servers for new
  data types
• Code provided under the GNU Lesser General Public
  License

27
What is OpenADDE?

• Initial release are only the image read servers
• McIDAS Area, MODIS AIRS HDF, NEXRAD, GINI,
  AWIPS (?)
• McIDAS library routines
• Navigation and calibration modules, utilities
• 30 of the McIDAS-X library code
• Available at http//www.ssec.wisc.edu/openadde
• Source code, installation and configuration
  scripts, sample data

28
Wheres the data?

• Servers at NOAA, NASA, SSEC, Unidata
• Realtime global GOES
• Realtime global MODIS Level 1b
• GOES product files
• Polar composites of satellite data

29
The Next Generation McIDASA Look Towards the
Future21st IIPS 8.2 San Diego, CA - 11 January
2005

• Questions about McIDAS-V or OpenADDE?

Stop down to the University of Wisconsin booth
406