Implementation of Geospatial Product Virtualization in Grid Environment Liping Di , Aijun Chen, Yuqi Bai, and Yaxing Wei Dr. Aijun Chen Center for Spatial Information Science and Systems (CSISS) George Mason University (GMU) CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 1
Outline � Introduction � Open Geospatial Consortium (OGC) Web Services � Geospatial Grid Services � Abstract Model and Grid Services Workflow � System Architecture of Geospatial Grid Framework � Testbed and System Implementation � Conclusion � Future Vision CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 2
Introduction � This research is funded by NASA AIST (AIST-02-0160) with the title “Integration of Grid and OGC Technologies for Earth Science Modeling and Applications”. PI is Dr. Liping Di . � Making NASA EOSDIS data easily accessible to Earth science modeling and applications communities by combining the advantages of both OGC and Grid technology. � Making Grid technology geospatial enabled and OGC standards compliant and making OGC technology Grid enabled. � Allowing researchers to focus on science and not issues with computing, storage and bandwidth resources, as well as data receipt, data format and data set manipulation . CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 3
Introduction (Cont.) � The project has two major work items: 1) Enable to access real data in the Grid environment with OGC protocols. 2) Study the approach for geospatial product virtualization in the Grid environment and develop a prototype. � Try to establish a service-oriented geospatial standard- compliant Grid framework for users to build up their specific application abstract model, execute it and get back their desired data products virtually through utilizing the OGC standard services and data and computing resources provided by Grid technologies. CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 4
The OGC Web Services � The Web Coverage Services (WCS) specification: defines the standard interfaces between web-based clients and servers for accessing coverage data. -- All imagery type of remote sensing data is coverage data. � The Web Feature Services (WFS) specification: defines the standard interfaces between web-based clients and servers for accessing feature- based geospatial data. -- vector and point data are feature data. � The Web Map Services (WMS) specification: define the standard interfaces for accessing and assembling maps from multiple servers . -- visualization of geospatial data � The Catalog Services for Web (CS/W) specification: defines the interfaces between web-based clients and servers for finding the required data or services from registries. It’s based on the ebRIM. � WCS, WMS, CSW, and WFS form the foundation for the interoperable geospatial data access and service environment. � The Grid-enabled standard Portals for the above OGC services. CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 5
Design of the Information Model (IM) of CS/W Extension of OGC CS/W for geospatial resources RegistryObject ClassificationSchema Service Service IM (ISO 19119) Classification ExtrinsicObject Association ServiceBindings CSWExtrinsicObject RepositoryItem …… RegistryEntry Dataset IM (ISO 19115) NASA EOS Core System (ECS) Slot ebRIM + OGC Catalogue Service for Web + OGC Catalogue Service for ISO 19115/19119 CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 6
Software Development for Integration - GCS/W � Designed and implemented Grid-enabled OGC Catalog Service for Web GCSW -- Information Model ISO 19115 Part one GCMD HDF-EOS metadata IM Service Type IM (getCapabilities and ISO 19115 Part two describeCoverage) (FGDC extension) CSISS-defined NASA ECS Data Type IM ISO 19119 ebRIM IM CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 7
Design of Data Registration of CS/W HDF File XML File (MODIS, (Based on ASTER, …) ISO19139) Read out 1 3 2 ISO Metadata ECS Metadata Modify Map Key/Value Key/Value Template XML File ECS – ISO b a (Based on Mapping Table ISO19139) a Create a mapping table between ECS metadata and ISO19139 metadata. Store it in MySQL database. Pre-steps b Create a template XML file based on the selected ISO19139 schemas. 1 Read out the ECS metadata from HDF files (MODIS, ASTER, …). Steps 2 Map the ECS metadata elements to ISO elements according to the selected ISO19139 schemas. 3 Modify the template XML file by inserting the mapped ISO elements. CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 8
Geospatial Grid Services and other Grid services � Grid-enabled Catalog Service for Web (GCS/W) � Grid-enabled Catalog Service Federation (GCSF) � Grid-enabled Web Coverage Service (GWCS) � Grid-enabled Web Map Service (GWMS) � Intelligent Grid Service Mediator (iGSM) � Replica and Optimization Service (ROS) � Data Transfer Service (DTS) � BPEL-compliant Grid INstantiation Service(GINS) � BPEL-compliant Grid Workflow Engine Service (GWES) � Other Grid Services for application CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 9
Grid Enabled Catalogue Service for Web (GCS/W ) Extended CS/W IM repositoryItem Dataset Metadata IM Client Requester UUID (logical ID) ProductName Send: ProductDateTime Data requirement …… Obtain: An optimal data service among the VO. Globus RLS IM ID Logical File Name Physical File Name Legend IM – Information Model Globus MDS IM CS/W – Catalogue Service for Web RLS – Replica Location Service Hostname MDS – Monitoring & Discovery Service Memory VO – Virtual Organization CPU …… Integration of Information Model of CS/W and Grid RLS/MDS CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 10
Software Development for Integration - GCSF � GCSF harmonizes user query among GMU CSW, ESG CS and ECHO. – Talked with NASA ECHO through GMU GCSF. CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 11
Intelligent Grid Service Mediator (iGSM) (iGSM: intelligent Grid Service Mediator) � Support WCS portal, WMS portal and Grid Virtual WCS to distribute their request to proper GWCS and GWMS. WMS Portal WCS Portal GWMS iGSM GVWCS GCSF DTS MDS ROS CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 12
Replica and Optimization Service � Replica and Optimization Service (ROS) ROS Index Service (MDS) RLS � Globus RLS as Grid Service RLI (Laits-data) RLI (Laits) LRC (Laits-data) LRC (Laits) LRC (Ames/LLNL) � Globus Index service � Globus MDS scripts modification CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 13
Data Transfer Service � Data Transfer Service (DTS) based on GridFTP as Grid Service Secure Request Machine B Machine A Globus Security Globus Security Data Machine A Globus Security Secure Request Secure Request Machine B Machine C Data Globus Security Globus Security CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 14
Concept Models of Virtual Data Products (VDP) modeling and virtual data services no service data service User Requested User Obtained Archived geo-object User geo-object Geospatial web/Grid services Intermediate geo-object Automated data transformation service(WCS/WFS) CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 15
Design of Abstract Model for Modeling VDP � Information Model of VDP • DTC: Data Type Catalogue. Data are classified into type based on their scientific meaning. e.g. DEM, Slope, SlopeAspect, Landslide etc. • STC: Service Type Catalogue. Services are classified into service types based on their scientific meanings. e.g. DEM2Slope, DEM2SlopeAspect, SlopeAspect2Landslide, DEM2Landslide etc. ServiceInstance DataType associates to ServiceType process uses Real Data input decides GVWCSInstance ServiceType Virtual Data a s s o output c i a associates to DataType t e s t o DataType DataInstance CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 16
Building up Virtual Data Products � Abstract Model based User interface for modeling VDP http://laits.gmu.edu/vdp CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 17
Registry of Abstract Model of VDP � Registration of Abstract Model to GridCSW CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 18
BPEL-compliant Grid Instantiation Service(GINS) � Instantiation of the Abstract Model to the Concrete Workflow AM Schema Abstract Model (AM) STC ServiceType DataType DTC WSDL ServiceInstance DataInstance CSWQueryM Physical Workflow Grid BPEL Engine CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 19
Design BPEL-compliant Grid Workflow Engine Service (GWES) � BPEL engine architecture – Execute Grid Services with Standard BPEL workflows. Browser-oriented clients As a server Service-oriented clients or middleware As a service BPEL Process Manager BPELPower Logic Deployment Process Instantiation Model WSDL Services BPEL Processes Instances Activities CSISS Center for Spatial Information Science and Systems 06/27/2006 Page 20
Recommend
More recommend
