1 eScience on Distributed Infrastructure in Poland Marian Bubak AGH University of Science and Technology ACC Cyfronet Krakow, Poland dice.cyfronet.pl PLAN-E, the Platform of National eScience/Data Research Centers in Europe, 29-30 September 2014, Amsterdam
2 Outline ACC Cyfronet AGH PL-Grid Consortium and Programme Focus on users: training and support Platforms and tools: towards PL-ecosystem International cooperation, conferences Summary
3 Credits ACC Cyfronet AGH ICM Michał Turała Marek Niezgódka Krzysztof Zieliński Piotr Bała Karol Krawentek Maciej Filocha Agnieszka Szymańska Maciej Twardy PCSS Angelika Zaleska-Walterbach Maciej Stroiński Andrzej Oziębło Norbert Meyer Zofia Mosurska Krzysztof Kurowski Marcin Radecki Bartek Palak Renata Słota Tomasz Piontek Tomasz Gubała Dawid Szejnfeld Darin Nikolow Paweł Wolniewicz Aleksandra Pałuk Patryk Lasoń WCSS Marek Magryś Łukasz Flis Paweł Tykierko Paweł Dziekoński Bartłomiej Balcerek … and many others domain experts …. TASK Rafał Tylman Mścislaw Nakonieczny Jarosław Rybicki
4 ACC Cyfronet AGH Participation and coordination of 40 years of Computational power, national and storage and libraries expertise international scientific for scientific research. projects. Coordinator of PL-Grid Infrastructure Development. High Performance Centre Computing of Competence High Performance Networking Main node of Cracow MAN. Rank R max R peak Site System Cores South Poland main node of TOP500 Tflops Tflops PIONIER network. Cluster Platform 176 Cyfronet Access to GEANT network. Infiniband 25,468 266.9 373.9 Poland VI.2014 Hewlett-Packard
5 Motivation and background World progress in Big Science: Theory, Experiment, Simulation Experiments in silico: 1st: Numerically Data intensive intensive computing Theory computing advanced, distributed computing big international collaboration e-Science and e-Infrastructure interaction 3rd: 2nd: Simulation Experiment Needs: increase of resources support for making science 4th Pradigm: Data Intensive Computational Science problems to be addressed: Scientific Discovery algoritms, environments and deployment 4 th paradigm, Big Data, Data Farming
6 PL-Grid Consortium Consortium creation – January 2007 a response to requirements from Polish scientists due to ongoing Grid activities in Europe (EGEE, EGI_DS) Aim: significant extension of amount of computing resources provided to the scientific community (start of the PL-Grid Programme) Development based on: projects funded by the European Regional Development Fund as part of the Innovative Economy Program close international collaboration (EGI, ….) PL-Grid Consortium members: previous projects (5FP, 6FP, 7FP, EDA…) 5 High Performance Computing Polish Centres, National Network Infrastructure available: representing Communities, coordinated by ACC Pionier National Project Cyfronet AGH computing resources: Top500 list Polish scientific communities: ~75% highly rated Polish publications in 5 Communities
7 PL-Grid and PLGrid Plus in short PL-Grid Project (2009 – 2012) PLGrid Plus Project (2011 – 2014) Budget: total 21 M € , from EU 17M € Budget: total ca.18 M € , from EU: ca.15 M € Outcome: Common base infrastructure Expected outcome: National Grid Infrastructure (NGI_PL) focus on users Resources: 230 Tflops, 3.6 PB specific computing environments QoS by SLM Extension of resources and services by: 500 Tflops, 4.4 PB Keeping diversity for users Clusters (thin and thick nodes, GPU) SMP, vSMP, Clouds
Polish Infrastructure for Supporting 8 PL-Grid project Computational Science in the European Research Space – PL-Grid Budget: total 21 m € , from EC 17m € Duration: 1.1.2009 – 31.3.2012 Managed by the PL-Grid Consortium made up of 5 Polish supercomputing and networking centres Project coordinator: Academic Computer Centre Cyfronet AGH, Krakow, Poland Project web site: projekt.plgrid.pl PL-Grid aimed at significantly extending the amount of computing resources provided to the Polish scientific community (by approximately 215 TFlops of computing power and 2500 TB of storage capacity) and constructing a Grid system that would facilitate effective and innovative use of the available resources. Main Project Objectives: Common (compatible) base infrastructure Capacity to construct specialized, domain Grid systems for specific applications Efficient use of available financial resources Focus on HPC and Scalability Computing for domain specific Grids
9 PL-Grid project – results First working NGI in Europe in the framework of Publication of the book presenting the scientific EGI.eu (since March 31, 2010) and technical achievements of the Polish NGI in the Springer Publisher, in March 2012: Number of users (March 2012): 900+ „ Building a National Distributed e- Number of jobs per month: 750,000 - 1,500,000 Infrastructure – PL-Grid ” Resources available: In Lecture Notes in Computer Science, Vol. 7136, Computing power: ca. 230 TFlops subseries: Information Systems and Applications Storage: ca. 3600 TBytes High level of availiability and realibility of the resources Content: 26 articles Facilitating effective use of these resources by describing the experience and providing: the scientific results obtained innovative grid services and end-user tools like Efficient by the PL-Grid project Resource Allocation, Experimental Workbench and Grid partners as well as the Middleware outcome of research and Scientific Software Packages development activities carried User support: helpdesk system, broad training offer out within the Project. Various, well-performed dissemination activities, carried out at national and international levels, which contributed to increasing of awareness and knowledge about the Project and the grid technology in Poland.
Domain-oriented services and resources of 10 PLGrid Plus project Polish Infrastructure for Supporting Computational Science in the European Research Space – PLGrid Plus Budget: total ca. 18 M € including funding from the EC: ca.15 M € Duration: 1.10.2011 – 31.12.2014 Five PL-Grid Consortium Partners Project Coordinator: ACC CYFRONET AGH The main aim of the PLGrid Plus project is to increase potential of the Polish Science by providing the necessary IT services for research teams in Poland, in line with European solutions. Preparation of specific computing environments so called domain grids i.e. solutions, services and extended infrastructure (including software), tailored to the needs of different groups of scientists. Domain-specific solutions created for 13 groups of users, representing the strategic areas and important topics for the Polish and international science:
11 PLGrid Plus project – activities Integration Services Data Intensive Computing National and International levels Access to distributed Scientific Databases Dedicated Portals and Environments Homogeneous access to distributed data Unification of distributed Databases Data discovery, process, visualization, validation…. Virtual Laboratiories 4th Paradigm of scientific research Remote Visualization Service value = utility + warranty Instruments in Grid SLA management Remote Transparent Access to instruments Computing Intensive Sensor networks Solutions Organizational Specific Computing Environments Adoption of suitable algorithms and Organizational backbone solutions Professional support for specific disciplines Workflows and topics Cloud computing Porting Scientific Packages
12 PLGrid Plus project – results Publication of the book presenting the scientific New domain-specific services for 13 identified scientific and technical achievements of PLGrid Plus in the domains Springer Publisher, in September 2014: Extension of the resources available in the PL-Grid „ eScience on Distributed Computing Infrastructure by ca. 500 TFlops of computing power and ca. Infrastructure ” 4.4 PBytes of storage capacity Design and start-up of support for new domain grids In Lecture Notes in Computer Science, Vol. 8500, Deployment of Quality of Service system for users by subseries: Information Systems and Applications introducing SLA agreement Deployment of new infrastructure services Content: 36 articles Deployment of Cloud infrastructure for users describing the experience Broad consultancy, training and dissemination offer and the scientific results obtained by the PLGrid Plus project partners as well as the outcome of research and development activities carried out within the Project. Huge effort of 147 authors, 76 reviewers and editors team in Cyfronet
New generation domain-specific 13 PLGrid NG project services in the PL-Grid infrastructure for Polish Science Budget: total ca. 14 889 773,23 PLN, including funding from the EC: 12 651 715,38 PLN Duration: 01.01.2014 – 31.10.2015 Five PL-Grid Consortium Partners Project Coordinator: ACC CYFRONET AGH The aim of the PLGrid NG project is to provide a set of dedicated, domain-specific computing services for 14 new groups of researchers and implementation of these services in the PL-Grid national computing infrastructure.
Recommend
More recommend
