ChinaGrid: National Education and ChinaGrid: National Education and - PowerPoint PPT Presentation

ChinaGrid: National Education and ChinaGrid: National Education and Research Infrastructure in China Research Infrastructure in China Hai Jin Hai Jin Huazhong University of Science and Technology Huazhong University of Science and Technology hjin@hust.edu.cn hjin@hust.edu.cn

ChinaGrid in a Nutshell • China Education and Research Grid • Funded by Ministry of Education • As the pilot grid application supported by China National Grid (CNGrid) • Based on CERNET (China Education and Research Network) • First Phase � From 2003-2005 � 12 key universities as initiative � 20 key universities now 2 2

Network Infrastructure of ChinaGrid CERNET-1 To E ngl and To G erm any To C anada S henYang B ei Ji ng To A m eri ca To Japan X i A n N anJi n C hengD u S hangH ai W uH an G uangZhou Ext ernal Export Trunk N et w ork 3 R egi onal N et w ork 3

4 4 ChinaGrid (The First Phase)

5 5 ChinaGrid ( till now )

ChinaGrid Mission • Campus grid platform • Common platform for ChinaGrid • Grid application platform and representative grid applications � Image processing grid � Bioinformatics grid � Course on-line grid � Computational fluid dynamic grid � Large scale information processing grid 6 6

7 7 Architecture of ChinaGrid

Campus Grids and their Computing Power and Storage Capacity • HUST ： 0.8Tflops, 5TB • ZSU ： 1.3Tflops, 10TB • THU ： 1.3Tflops, 20TB • SDU ： 1.3Tflops, 18TB • PKU ： 1.5Tflops, 10TB • NWPU ： 0.4Tflops, 2TB • BUAA ： 0.7Tflops, 10TB • ZJU ： 0.6Tflops, 3TB • SCUT ： 0.9Tflops, 20TB • FUDAN ： 1.8Tflops, 6TB • SJTU ： 0.5Tflops, 9TB • TONGJI ： 0.2Tflops, 1TB • SEU ： 1.0Tflops, 19TB • USTC ： 1.2Tflops, 5TB • XJTU ： 0.1Tflops, 2.5TB • UESTC ： 0.3Tflops, 2TB • NUDT ： 0.2Tflops, 5TB • RUC ： 0.1Tflops, 0.5TB • NEU ： 0.8Tflops, 5TB • LZU ： 0.3Tflops, 1TB ChinaGrid ： >15Tflops, >150TB 8 8

Layered Infrastructure of ChinaGrid SJTU PKU XJTU NEU ZSU SCUT HUST BUAA NUDT SEU Remote Fluid Image education THU dynamics SDU processing grid grid Massive grid information Bioinformatics processing grid grid ChinaGrid Supporting Platform (CGSP) High performance computing environment (campus grid) 9 9

What’s CGSP? • ChinaGrid Supporting Platform , a grid middleware for ChinaGrid • Follow the WS-Resource Framework (WSRF) and Open Grid Service Architecture (OGSA) • CGSP 1.0 was released at Jan. 10, 2005 • CGSP 2.0 (beta) was released at April 25, 2006 • Developed by the joint working group from HUST, THU, PKU, BUAA, SJTU, and other universities in ChinaGrid 10 1 0

http://www.chinagrid.edu.cn/CGSP/index.htm Status of CGSP • CGSP 1.0 supports four major grid applications of ChinaGrid • Installed in all the ChinaGrid universities as campus grid environment • CGSP 2.0 (beta) download more than 350 times within 2 days after its release 11 1 1

12 1 2

13 1 3 CGSP Architecture

Main Features of CGSP 2.0 • More powerful � Multi-domain cooperation � Support various jobs � Integrate more kinds of resources • More flexible � Configurable � Loose-coupled • More stable • More open, more international • Easy to install 14 1 4

CGSP 2.0 Container • Runtime environment for CGSP • Based on GT4 Core � Hot deploy � Auto deploy � Remote deploy � Service Monitoring - CGSV � CGSP Security 15 1 5

16 1 6 CGSP 2.0 Container Architecture

Information Center • A logical center to publish and discover all kinds of information of resources in all domains • Functions � To connect all domains � Join/Quit the tree-like topology � To support powerful view of resources � all kinds of resources � a global view � user-related view 17 1 7

Components of Information Center • Domain Information Service (unique in domain) • Domain Registry Service (unique in domain) • Node Registry Service (in each nodes of the domain) • Schema Repository Service (unique in ChinaGrid) 18 1 8

Execution Management • Enables applications to have coordinated access to underlying resources • Support three types of job � Legacy binary program execution – atomic job � Service invoking – atomic job � Workflow execution – composite job • Support four types of job submission � GRS Application Submission (for legacy program) � JSDL Submission (for legacy program) � Generic Job Submission (for WS/WSRF) � Composite Job Submission (for workflow) 19 1 9

Execution Management • Fundamental job management � Job submission , Job monitoring, Job scheduling • Uniform interface of job creation and monitoring � WS, WSRF, JSDL, Workflow Service • Dynamic WSRF/WS service invocation • Distributed workflow engine management and workflow load balancing • Legacy application dynamic deployment and friendly application user interface • PBS and MPI are supported by GRS 20 2 0

ARCHITECTURE Job Workflow Job Workflow Submission Monitor Control Submission Monitor Control Deployment Submitter Deployment Submitter Workflow Job Monitor/Control Inter-domain State Workflow Job Monitor/Control Inter-domain State JMI Agent Queue Agent Agent JMI Database Agent Queue Agent Agent Database Workflow Manager Invoking Engine Workflow Manager Invoking Engine Job Job Manager Manager Load Balancer Database Load Balancer Database JSDL JSDL General Parser General Parser Workflow Workflow Service and Service and Invoker Invoker Invoker GRS Invoker GRS BPEL BPEL BPEL BPEL BPEL BPEL Invoker Invoker Engine Engine Engine Engine Engine Engine CGSP GT4.0.x CGSP Apache CGSP GT4.0.x CGSP Apache Job Job Service Java GRS Axis1.2.x Service Java GRS Axis1.2.x Executors Container WS Core Container Container Executors Container WS Core Container Container 21 2 1

Execution Management • Workflow Support � Follows BPEL4WS 1.1 specification � Functionality � Workflow execution, control and monitoring � Workflow load balancing � Dynamic workflow deployment � Support orchestrating WSRF services • JSDL Support 22 2 2

Execution Management • General Running Service (GRS) � Just a normal WSRF-compliant Web Service, providing computing service � Executing any executable program which can be portably transferred for CGSP . � Supporting MPI Programs with PBS supported cluster � Providing Execution Management and Task Scheduling � Deployment & Undeployment � Auto-deployment of Legacy program � One GRS per computing node 23 2 3

Data Management • Grid File System � Enable user to have his/her own data space over Grid � Make/Remove directories � Upload/Copy/Remove/Download files � Browse/Search files/directories • Data Storage & Transfer Support � GRS � GridPPI � HDB 24 2 4

Heterogeneous Database • Functions � Provide an uniform, flexible and service-based interface to access and integrate distributed, heterogeneous and structurally complex data resources • Virtual Table � It is a logic concept, like the concept of view in DBMS � It is only a mapping relationship between virtual table and physical table � More than one physical tables can register to the same virtual table � Users can submit queries performed on virtual table • Physical Table � It really exists in counterpart database 25 � Map reference columns to corresponding virtual table columns 2 5

26 2 6 • CGSP Programming Interface GridPPI � MPI-like API

27 2 7 AG4ChinaGrid ： GridAsia 2005

28 2 8 http://www.chinagrid.edu.cn

29 2 9 Bioinformatics Grid

BioGrid Applications • Protein target selection for rice genome • Multi-sequence alignment for ganoderma family • Gene joint for white mice • Cardiovascular disease research 30 3 0

31 3 1 Image Processing Grid

ImageGrid Applications • Three-dimension reconstruction of digital virtual human being (HUST) • Medical image diagnosis (ZSU) • Remote sensing image processing （ NUDT ） 32 3 2

33 3 3 CFD Grid

Pilot Applications based on CFD Grid • Shanhai JiaoTong University: Aircraft genetic optimization design system • Xi’an JiaoTong University: Parallel algorithm for molecular dynamics • Southern China University of Technology: Simulation and optimization techniques for metal powder figuration process • Northeast University: Large scale geological disaster forecasting system • Southeast University: Computational electromagnetism applications in airplane and automobile design 34 3 4

35 3 5 Course On-line Grid

Course Resource Contribution 474 500 450 400 332 332 350 283 300 251 250 213 205 202 200 117 150 113 100 32 12 50 0 0 PK TS XJ SJ DB SD HN HZ DN HK DZ BH ZS • • ； Number of hours: Number of courses: 233 233 ； Number of hours: 2566 2566 Number of courses: 36 3 6