China National Grid A Practice in Grid Research and Development in China

1
China National GridA Practice in Grid Research
and Development in China

• Qian Depei
• Xian Jiaotong University
• May 17, 2004

2
Outline

• Increasing demand for grid technology
• Overview of the 863 key project
• Progress of the China National Grid

3
China is experiencing a rapid development period

• Huge investment on information infrastructure
• Networks
• High performance computers
• Servers
• Software
• Great effort in developing applications
• Operations are being transferred to network
  environment
• People more and more rely on network and computers

4
Problems we are facing

• Waste of resources
• Huge investment every year to buy new computers
  and software while at the same time many machines
  are idle or under-utilized
• Economically undeveloped areas lack of computing
  resources

5
Problems we are facing

• Information exchange and sharing are obstructed
  by information island
• Applications are isolated and unable to talk to
  each other
• Precious data are owned by organizations and
  difficult to share
• Applications requiring comprehensive data are
  hard to develop

6
Problems we are facing

• High complexity of development restricts the
  applications
• Distributive, heterogeneous, versatile, and
  dynamically changing network environment makes
  the development of applications difficult
• Lack of talent people for development

7
Problems we are facing

• High operation cost is intolerable
• Frequent upgrading of hardware and software is a
  heavy burden of enterprises and organizations
• Dedicated operation team has to be maintained by
  each enterprise or organization

8
E-everything is expensive!

• Initial cost
• Computers
• Networks
• Software
• Computer rooms
• Operation cost
• Staff
• Electricity
• maintenance
• Short life cycle of equipment

9
Why Grid?

• Lower the complexity in development
• Lower the cost of operation
• Lower the threshold for technical staff

10
What is Grid?

• Inherently support resource sharing and
  cooperative work
• Characterized by the service nature
• Support virtual organizations

11
Is the grid concept new?

• The goals the grid pursue are what people have
  been working on in the past decades
• Grid is in growing stage

12
Can grid be the future information infrastructure?

• It has not reached that status
• Pervasiveness
• Ease of use
• Efficient management
• Robustness
• Support to applications

13
Overview of China National Grid

• A key project supported by the National High-Tech
  RD Program (the 863 program), continuing effort
  to the HPCE project
• 4-year effort
• 100 million fund from the Chinese government
  (MOST)
• Two to three times more associated funds from
  local governments, application organizations, and
  industry

14
Overview of China National Grid

• Enabling resource sharing and cooperative works
  under the Internet environment
• Providing the most powerful computing capability
  to research
• Exploring new models and patterns of applications
  and services in the Internet
• Promote Chinas industry in high performance
  computers and grids
• Training of talent people in the field of the grid

15
Major tasks of the project

• Develop a test-bed for the new information
  infrastructureChina National Grid (CNGrid)
• About 8 grid nodes across the country
• Interconnected by available networks
• Develop a 4TFlops high performance computer to
  equip the grid nodes
• Develop a grid software to support grid
  applications and grid operation and management
• Develop several application grids
• Productive systems
• Demonstrate the future grid applications

16
Three levels of activities
Research
Environment
Manufacturing
Service
Appl. Grids
Development Environment
Use Environment
Grid Software
Grid System Software
HPC
Database
Data
Apps
Grid Resources
Internet
17
Guidelines of the project

• Application driven
• The most important driving force
• Technological leaping
• patents
• standards

18
Guidelines and strategies of the project (con.)

• Multilateral cooperation
• Funds from
• 863 program
• Local government
• Application organizations
• Industry
• Cooperation of
• Research teams
• Application teams
• Management people
• Focus on the grid
• Complementary research efforts
• Integration into the grid testbed

19
The RD supported

• 19 projects are supported in the first round of
  the project
• The strategic and integration technology study
• The grid nodes construction (8 nodes)
• Grid software development (1 team)
• Application grids development (7 teams)
• High performance computer development (2 teams)

20
Grid test-bed development

• Build China National Grid (CDGrid)
• Eight nodes across the country
• CAS Network Centers (Beijing, major node)
• Shanghai Supercomputer Center (Shanghai, major
  node
• Tsinghua University (Beijing)
• Applied Physics Institute (Beijing)
• University of Science and Technology of China
  (Hefei, Anhui)
• Xian Jiaotong University (Xian, Shaanxi)
• UNDT (Changsha)
• Hong Kong University (Hongkong)

21
Requirement to grid nodes

• Major nodes
• gt1 Tflops
• Equipped with the machine developed by the
  project
• Ordinary nodes
• gt100GFlops
• Provided by the organization supporting the node

22
grid nodes across China
23
HPC development

• Two gt4TFlops machines are being developed
• Dawning computer
• AMD 64-bit Opteron processor
• 11 Tflops peak performance
• Lenovo computer
• Intel Itanium 2 processor
• 5.324 Tflops peak performance

24
Lenovo 6800

• Completed in Nov. 2003
• 2.6TB momory
• 81TB disks
• 4.183 Linpack performance (78.5 efficiency)
• Ranked at 14 in Top500 ranking
• Installation at CAS Network Center in the coming
  December

25
Lenovo 6800
26
Dawning 4000A

• Completed in Apr. 2004
• 640 nodes, 2560 2.2GHz AMD Opteron CPU
• 5TB memory
• 22.5TB local disks
• Three sets of networks
• Myrinet
• Gigabit Ethernet
• Fast Ethernet
• 7.638TFlops Linpack performance (67.8
  efficiency)

27
Grid software development

• Grid system software
• Interfacing to heterogeneous systems
• Basic resource management scheduling
• Communication
• Grid application development environment
• Remote debugging
• Performance tuning
• Grid user environment
• Grid browser
• GSML

28
Grid software position in OGSA
Grid software
29
(No Transcript)
30
Application grids development

• Selected areas
• Resource and Environment
• Research
• Services
• Manufacturing

31
Application Grids
32
Geological Survey Grid

• Undertaken by China National Geologic Survey
  Bureau
• Nation-wide productive grid
• Data exchange and sharing
• Resource evaluation services
• Shorten the evaluation time from 3 years to 3
  months
• Delivering achievements in
• North China ground water resources evaluation
• Mineral resources evaluation

33
Digital Forest Grid

• Undertaken by the Institute of Forest Resources
  Information
• Monitoring the status of forests in China
• Integration of remote sensing data, GIS
  information, and management information
• Evaluation of the process of turning the farmland
  back to forests
• Reflect true condition
• Guarantee the quality

34
Meteorological Service Grid

• Undertaken by China National Meteorological
  Center
• Three sites in Beijing, Guangdong, and Hunan,
  forming a grid
• Sharing of computing resources
• Platform for digital weather forecasting pattern
  research
• Provide new weather forecast services (time and
  location-specific)

35
Scientific Data Grid

• Undertaken by the Network Information Center of
  CAS
• Integration of more than 40 scientific databases
  across the country
• Virtual astronomical observatory

36
New drug discovery grid

• Undertaken by Shanghai Institute of Materia
  Medica CAS
• Compound screening for new drug discovery
• Anti-SARS drugs discovery
• New drug for diabetes
• Using HPC in P2P mode

37
Bio-informatics Grid

• Undertaken by Genomics Bioinformatics
  Institute, CAS
• Computing grid, data grid, and information grid
  for bio-information research in the country

38
Manufacturing Grid

• Undertaken by China Aviation industry Corporation
  II
• Support distributed design, simulation, and
  manufacturing
• CAD software sharing
• Data exchange and sharing
• Computing resource sharing

39
China Grid Forum

• Promote research and development
• Exchange experiences
• Propose standards
• Set up a bridge between academic community and
  industry

40
China Grid Forum

• Established on Oct. 24, 2002
• The first CGF conference on Sept. 12, 2003
• Organizational Structure
• Advisory Committee
• Executive Committee
• Working Groups
• Grid architecture
• Data grids
• Information Grids
• Grid Applications

41
International cooperation

• IBM and Platform have participated in the work of
  the project
• Grid software
• Application grids
• IBM signed MOU with the expert group of the
  project
• Joint research is encouraged
• China international cooperation projects
• UK e-Science

42
Expecting cooperation

• Interconnection with other grids
• Sharing of resources
• Computing power
• Application software
• Software tools
• Cooperation in proposing standards
• Personnel exchange
• Workshops

43
Thank you!