The effective integration of scientific instruments in the Grid - PowerPoint PPT Presentation

Terena conference, June 2004, Rhodes, Greece The effective integration of scientific instruments in the Grid Norbert Meyer Norbert Meyer

Terena conference, June 2004, Rhodes, Greece High Performance Computing and Visualisation with the SGI Grid for Virtual Laboratory Applications co-funded by State Committee for Scientific Research and Silicon Graphics Project No. 6 T11 0052 2002 C/05836 No. 6 T11 0052 2002 C/05836 Project 2 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Project duration: R&D – December 2002 .. November 2004 Deployment – 1 year Partners: ACK CYFRONET AGH (Kraków) – LEAD PARTNER P Ł ( Ł ód ź ) PSNC (Pozna ń ) TASK (Gda ń sk) WCSS (Wroc ł aw) ATM S.A. (Warsaw) Silicon Graphics Institute of Bioorganic Chemistry PAS (Pozna ń ) Institute of Meteorology and Water Management (Warsaw) 3 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece PIONIER paradigms VLAB 4 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece R&D activities • Building a nation wide HPC/HPV infrastructure: • Connecting the existing infrastructure with the new testbed. • Dedicated Application Servers • Resource Management, User Account Management, Global Accounting • Data access optimisation • tape subsystems • Access to scientific libraries • Checkpoint restart • kernel level / IA64 architecture • Advanced security system • Advanced visualisation • Distributed & Remote visualization • Programming environment supporting the end user • How to simplify the process of making parallel applications 5 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Architecture A PPLICATIONS H IGH PERFORMANCE E MERGENCY C OMPUTING V IRTUAL L ABORATORY VISUALISATION APP S C ENTER G RID M IDDLEWARE A DVANCED NETWORK INFRASRUCTURE (PIONIER) HPC/HPV INFRASTRUCTURE 6 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Next Generation Grids (NGG) „The Grids that evolve along these lines will need to exhibit all the properties, most importantly, interoperability. In this way a collection of Grids, each providing specialized facilities, will interoperate to form a single Grid at the interface level. We believe that addressing these research priorities (with the representative balance between the pure technical and the social/business oriented issues) in the 2005 to 2010 timeframe will enable Europe to take the global lead in Grid technology and its application in the Information Society of the future” . European Grid Research 2005 2005 - - 2010 2010 Next Generation Grid(s), European Grid Research Expert Group Report, ftp://ftp.cordis.lu/pub/ist/docs/ngg_eg_final.pdf 7 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Virtual Laboratory (VLab) 8 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Why Vlabs ?? VERY limited access limited access VERY Main reason - - COSTS COSTS Main reason Main GOAL GOAL - - to to make make Main commonly accessible commonly accessible Added Value Added Value virtual, , remote remote, ... , ...Grid Grid- -enabled enabled virtual 9 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Guidelines • Access via Internet • Universal architecture • Allows to use the same approach for various types of instruments • To keep the information • Experiments, results • Publications 10 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece The Goal • Remote usage of expensive and unique facilities • Better utilisation • Joint venture and on-line co-operation of scientific teams • Shorter deadlines, faster work • eScience – closer • Equal chances • Tele –work, -science 11 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Differences between Virtual Laboratory and pure remote access • Access various facilities • Unique, expensive, universal architecture • Choose the best suitable site • Define measurement scenarios • Digital libraries • Collaborative work • Accounting issues • Enhanced security level • On-line progress monitoring • Platform independent 12 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Difference between Virtual Laboratory and pure remote access – CONT. • Advanced time reservation • Bearing in mind the ‘human factor’ 13 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Dynamic Measurement scenarios (DMS) • Allow to flexibly define the measurement scenarios, which include all experiment parts from pre-processing tasks, through the execution of experiment to post-processing • Possibility to add new scenario elements • Defining conditions between ‘black boxes’ • Clearly define the data flow • Make simpler the control process Example: Data Results Preprocessing Experiment Postprocessing Visualisation 14 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece 15 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Dynamic Measurement scenarios Out In 16 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Complexity of DNM - connections • Checking conditions and constrains (earlier defined inside the ‘black box’) • Conditions between connections (e.g. OR, AND) • Input and Output conditions 17 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Complexity of DMS - conversions • Made in case the OUTPUT of App1 is incompatible with INPUT of App2 • Developed several conversion schemas • The behaviour of Measurement parts is defined by DMSL (ang. Dynamic Measurement Scenario Language) 18 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Dynamic Measurement scenarios 19 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Resources in the Grid • Scientific instrument = Grid resource • Submitting the jobs to device (e.g. to Spectrometer) as well as to other computational systems • ‘Wider definition’ of Grid Resource 20 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Global Accounting • Defining limits for available resources • A reporting system, which takes into consideration the type of laboratory, projects and users • Integrated with Grid Accounting 21 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Testbed infrastructure Vi Virtual rtual Labora Laboratory o tory of f Nuclea Nuclear r • Magne Magnetic tic Resonance Spectroscopy – Resonance Spectroscopy – coopera cooperation tion wi with Ins th Institu titute o te of f Bioorganic Bioorgan ic Che hemist stry PAS ry PAS Vi Virtual rtual Labora Laboratory o tory of f Radio Radiotelesc elescopy opy • – Radioast adioastronomy ronomy Depa epart rtment ment of of Mikołaj Kopern kołaj Kopernik ik Universi iversity ... more than remote access 22 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Virtual Laboratory environment Grid environment Applications Collaborative work environmentj Labour administration Applications Access services Application A Data visualizations Measurement Scenarios Globus Global Vlab resource Authorization broker GRMS Middleware Layer Data Management System Grid gateway GridFTP Grid Information Service Vlab Layer Accounting Monitoring Local resource broker (specific services) Fabric Layer Scientific instruments HPC/HPV systems Networking Storage 23 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece User Interface - components Jobs Digital Communication Educational User management library tools area profile Submit Depends on NMR User new Chat laboratory database information scenario profile Radio- Customizing Monitoring astronomy Audio tools database Publications Video Accounting database 24 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Summary Grid-enabled Universal architecture User-friendly The remote facility becomes a critical resource !! 25 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

Terena conference, June 2004, Rhodes, Greece Subcomponents 26 Cezary Mazurek, PSNC, Access to Grid and Digital Library Services