Petascale Science Prototype Services Facility (PSPSF) Joe Mambretti, Director, (j-mambretti@northwestern.edu) International Center for Advanced Internet Research (www.icair.org) Northwestern University Director, Metropolitan Research and Education Network (www.mren.org) Co-Director, StarLight, (www.startap.net/starlight) Maxine Brown (maxine@uic.edu) Interim Director, Electronic Visualization Laboratory, University of Illinois at Chicago Co-Director, StarLight Tom DeFanti (tdefanti@soe.ucsd.edu) Research Scientist, California Institute for Telecommunications and Information Technology, University of California at San Diego Co-Director, StarLight Linda Winkler (winkler@mcs.anl.gov) Sr Network Engineer , Argonne National Lab Sr Network Engineer , StarLight Alan Verlo (darkman@evl.uic.edu) Associate Director , Electronic Visualization Laboratory, University of Illinois at Chicago Sr Network Engineer , StarLight 100 Gbps Transatlantic Science Trials Workshop At SC13 November 18, 2013 Denver, Colorado
NG Digital Sky Survey ATLAS BIRN: Biomedical Informatics Research LHCONE Network CAMERA CineGrid www.lhcone.net ANDRILL: www.nbirn.net Carbon Tracker metagenomics www.cinegrid.org Antarctic www.esrl.noaa.gov/ camera.calit2.net Geological gmd/ccgg/carbontrack ALMA: Atacama Drilling er Large Millimeter www.andrill.org Array www.alma.nrao.edu OOI-CI GEON: Geosciences ci.oceanobservatories.org ISS: International Network Space Station www.geongrid.org GLEON: Global Lake Comprehensive www.nasa.gov/statio Ecological Large-Array n Observatory Stewardship System DØ (DZero) Network Pacific Rim www.class.noaa.gov www-d0.fnal.gov www.gleon.org Applications and Grid Middleware Assembly WLCG www.pragma- LIGO lcg.web.cern.ch/LCG/publi grid.net www.ligo.org TeraGrid c/ IVOA: www.teragrid.org International Virtual Observatory Sloan Digital Sky www.ivoa.net Survey Globus Alliance XSEDE SKA OSG www.sdss.org www.globus.org www.xsede.org www.skatelescope.o www.opensciencegrid.org rg Compilation By Maxine Brown
IRNC:ProNet: TransLight/StarLight July 2010- August 2014 Tom DeFanti, Maxine Brown, Joe Mambretti, Tajana Rosing Calit2, University of California, San Diego Electronic Visualization Lab, University of Illinois at Chicago International Center for Advanced Internet Research, Northwestern University 20 years of NSF-Funded High-Performance International Networking for Advanced Applications 1995-2014!
TransLight/StarLight Petascale Science Prototype Services Facility • Goal: Prototyping Trans-Atlantic 100 Gbps Architectures, Services, and Emerging Technologies Among Institutions Connected to NetherLight, StarLight, and Other Participating GOLEs in North America and Europe • The TransLight/StarLight Consortium Has Been Awarded a National Science Foundation (NSF) Grant To Establish An Initiative To Design and Implement Network Architectures, Services, Technologies, and Core Capabilities In Support of Big Data Science Over 100 Gbps Trans-Atlantic Paths, Enabling Large-Scale Global Scientific Research Experiments, Instrumentation Access, Collaborations, Data Sharing and High-Resolution Visualization.
TransLight/StarLight Petascale Science Prototype Services Facility • This Project Is Designing, Implementing, and Experimenting With Prototype Services and Capabilities That Have the Potential to Optimize Advanced Networks for Production Science Research, Particularly for Large-Scale Data Transport, Including Persistent, Ultra-Large-Capacity, Real-Time, Long-Duration Streams. These Experiments Are Being Conducted With Multiple National and International Partners. • Four Major Themes of This Initiative Are To Provide: (a) Large- Scale Network Capacity, Including Support For Extremely High- Volume Individual Data Streams, (b) Network Services and Resource Programmability For This Capacity, (c) Edge Access To These Capabilities, and (d) Exchange Facilities That Can Support These Services and Capabilities.
Selected PSPSF Applications at 100 G • SDN, Science DMZ • WAN/LAN High-Performance Large capacity Flows and File Transfers • Computational Genomics and Analytics • Open Science Data Cloud (HPC Clouds) • LHC Research • 8K Digital Media Streaming • SAGE Streaming (Scientific Visualization) • Network Science Experimental Research (Including GENI/iGENI and International Network Research Testbeds) • Petascale Computational Science (e.g., Blue Waters, Titan) • 8k Digital Media/HPDMnet • CineGrid • HPC Storage Streaming
Initial Project Workshops • Workshop Themes: 100 Gbps Services for Global Data Intensive Science • Chicago, Aug, Sept, Oct: Project Planning • Amsterdam, Sept 16-17: SURFnet, SURFsara, University of Amsterdam • Singapore, Oct 2-4: Side Meetings at Global LambdaGrid Workshop • Multiple Meetings at SC13, Denver, Nov 17-22 • Also, Multiple Sets of 100 Gbps Demonstrations at SC13
StarLight – “By Researchers For Researchers” StarLight Is An Experimental And Production Optical Infrastructure Based Proving Ground for Advanced Network Services Optimized for High-Performance Data Intensive Applications Abbott Hall, Northwestern University’s View from StarLight Chicago Campus
Relatively Current StarLight Infrastructure Ciena OME, 5410 Calient PXC (L1) Juniper MX 960 (L2/L3) Many Lambdas & Collaborators Many 100 G Paths http://wiki.glif.is/index.php/StarLig ht Measurement Servers: bwctl, owamp, ndt/npad, perfSONAR StarLight International/National Communications Exchange Facility
The Global Lambda Integrated Facility Supports Multiple Advanced Networks Visualization courtesy of Bob Patterson, NCSA; data compilation by Maxine Brown, UIC. www.glif.is
StarLight 100 Gbps/Tbps Initiatives • StarLight Has Established Several Initiatives That Are Directed At Creating Networking Services, Architecture, Technology, and Networks Based on 100 Gbps and Higher Service, Including Tbps • Foundation Research Is Based On Earlier Experience Including With Dynamic Lightpath Technologies • 100 Gbps = More Than Capacity (e.g., Dynamic Control Over Channel Segments, Customization)
StarWave: A Multi-100 Gbps Exchange Facility • StarWave, An Advanced Multi-100 Gbps Exchange Facility and Services Implemented Within the StarLight International/National Communications Exchange Facility • StarWave Was Implemented In 2011 To Provide Services To Support Large Scale Data Intensive Science Research Initiatives • StarWave Was Developed With Support from an NSF Advanced Research Infrastructure Award • StarWave Is Support ing Multiple SC13 Demonstrations
CA*net/Ciena/StarLight/iCAIR 100 Gbps Testbed 1 st Implemented In Sept 2010, Implemented Periodically Since 100 Gbps Source: CANARIE
CVS Terrestrial Demo Content & Applications – 100G Ottawa MEN LAB 10 100G Connectivity from Ciena MEN LAB 10 Tile Display Ottawa to Starlight Gigapop in Chicago. Ability to show simultaneous data-flows sourced from major collaborators. Chicago Montreal Canadian Brain Imaging Network CBRAIN portal & Metadata Source: Rod Wilson, Ciena
MultiPath TCP Over 100 Gbps • MPTCP Demonstration Organized for TERENA 2013 Maastricht, Netherlands. • Lead: Ronald van der Pol, SURFnet • Participants: SURFnet, NetherLight, ESnet, International Center for Advanced Internet Research, ANA Consortium • Path: NetherLight ANA Esnet StarLight
SC13 100 Gbps NRE Demonstrations • 100 Gbps Networks for Next Generation Petascale Science Research and Discovery • Data-Scope at 100 Gbps Across National Data-Intensive Computational Science Testbeds • Next Generation Genome Sequencing Data at 100 Gbps • The Global Environment for Network Innovations (GENI) at 100 Gbps • HPC Open Science Data Cloud (OSDC) for Data Intensive Research at 100 Gbps • Using Remote I/O for Large-Scale Long Distance Data Storage and Processing • ExoGENI @ 40G: Dynamic Monitoring and Adaptation of Data Driven Scientific Workflows Using Federated Cloud Infrastructure
Multiple HPC Cloud Computing Testbeds Specifically Designed for Science Research At Scale Experimentation Integerated With High Performance Networks
Multiple Network Research Testbeds • Multiple Large Scale Network Research Testbeds – International – National – Regional – State-Wide – Metro – Local
Global Environment for Network Innovations (GENI) • GENI Is Funded By The National Science Foundation’s Directorate for Computer and Information Science and Engineering (CISE) • GENI Is a Virtual Laboratory For Exploring Future Internets At Scale. • GENI Is Similar To Instruments Used By Other Science Disciplines, e.g., Astronomers – Telescopes, HEP - Synchrotrons • GENI Creates Major Opportunities To Understand, Innovate and Transform Global Networks and Their Interactions with Society. • GENI Is Dynamic and Adaptive. • GENI Opens Up New Areas of Research at the Frontiers of Network Science and Engineering, and Increases the Opportunity for Significant Socio-Economic Impact.
Multiple Demonstrations at GENI Engineering Conferences
LHCONE
StarLight/StarWave/MREN Continually Progressing Forward!
Recommend
More recommend