Data Grid Services Based on SRB for National Digital Archives Programs

1
Data Grid Services Based on SRB for National
Digital Archives Programs the SRB use cases in
Taiwan

• Huimin Lin, Wei-Long Ueng, Eric Yen
• Academia Sinica Grid Computing Center
• February 2, 2006

2
The SRB Use Cases in Taiwan

• The SRB Deployment Projects
• Data Grid Services based on SRB for National
  Digital Archives Program Academia Sinica
• The SRB Atmosphere Databank Deployment Project
  ASCC ,NTUAS, NCUAS, NTUES
• The SRB application integration
• The Atmosphere Science application and its
  integration with SRB the DODS-SRB integration
• The SRB related software development
• Client tool Sync package
• Administration tool System Report Generator
• Web user interface PHPmySRB

3
Data Grid Services Based on SRB for National
Digital Archives Program(1)

• Objective
• To provide Grid services for long-term
  preservation and unified data access
• Data Collection Status
• File size 29,717,937,638,104 bytes
• File count 1,441,969

4
Data Grid Services Based on SRB for National
Digital Archives Program (2)
5
SRB System Report Generator (1)

• Objective
• To facilitate the resource management tasks for
  the system manager
• Features
• Display the resource usage information based on a
  user defined template (e.g. disk usage or user
  usage)
• Enable the resource control management
• Be easy to be deployed and integrated into other
  data visualization programs or data analysis tool

6
SRB System Report Generator (2)
7
SRB System Report Generator (3)
8
SRB System Report Generator (4)
9
SRB Sync Package (1)

• Objective
• To simplify the backup procedures for end users
• Features
• Synchronize the data between a local copy (local
  file system) and the copy stored in SRB or
  between two SRB copies
• Log every events while synchronizing
• Email the logs to the users and the managers
• Be Available for both windows and Linux/Unix
  users

10
SRB Sync Package (2)
11
Web User Interface - PHPMySRB
12
The Atmosphere application and its integration
with SRB - the SRB-DODS integration (1)

• What is DODS ?
• DODS is a software framework that simplifies all
  aspects of scientific data networking
• Allow the users to access remote data using their
  familiar data analysis and visualization packages
  ,such as Matlab, Grads, LAS
• The DODS-SRB integration
• Manage the datasets with SRB
• Provide an interface between DODS and SRB to
  enable the transmission of datasets from SRB
• The joined SRB research nodes
• ASGC. NTU . NCU. NTNU

13
The Atmosphere application and its integration
with SRB - the SRB-DODS integration (2)
14
The Atmosphere application and its integration
with SRB - the SRB-DODS integration (3)
Enable GrADs and LAS to access the dataset stored
in the SRB system
15
The SRB training and dissemination activities

• Host the SRB end user training seminars for the
  users from
• National Digital Archive Program (several
  institutes in Academia Sinica)
• Atmosphere Science (NTU, NCU, NTNU)
• Bioinformatics (YMU)
• Compile the Scommands manual - the revised
  Chinese edition

16
References

• TWGrid
• http//www.twgrid.org
• SRB_at_TWGrid
• http//srb.grid.sinica.edu.tw
• System Report Generator
• http//srb.grid.sinica.edu.tw/asmss/
• PHPMySRB
• http//srb.grid.sinica.edu.tw/phpmysrb/

17
Thanks for your attention