The Energy Sciences Network BESAC August 2004 William E. Johnston, ESnet Dept. Head and Mary Anne Scott Senior Scientist Program Manager Advanced Scientific Computing R. P. Singh, Federal Project Manager Research Michael S. Collins, Stan Kluz, Office of Science Joseph Burrescia, and James V. Gagliardi, Department of Energy ESnet Leads Gizella Kapus, Resource Manager and the ESnet Team Lawrence Berkeley National Laboratory 1
What is ESnet? • Mission: Provide, interoperable, effective and reliable • communications infrastructure and leading-edge network services that support missions of the Department of Energy, especially the Office of Science • Vision: Provide seamless and ubiquitous access, via shared • collaborative information and computational environments, to the facilities, data, and colleagues needed to accomplish their goals. • Role: A component of the Office of Science infrastructure critical • to the success of its research programs (program funded through ASCR/MICS; managed and operated by ESnet staff at LBNL). 2
Why is ESnet important? • Enables thousands of DOE, university and industry scientists and collaborators worldwide to make effective use of unique DOE research facilities and computing resources independent of time and geographic location o Direct connections to all major DOE sites o Access to the global Internet (managing 150,000 routes at 10 commercial peering points) o User demand has grown by a factor of more than 10,000 since its inception in the mid 1990’s—a 100 percent increase every year since 1990 • Capabilities not available through commercial networks - Architected to move huge amounts of data between a small number of sites - High bandwidth peering to provide access to US, European, Asia- Pacific, and other research and education networks. Objective: Support scientific research Support scientific research by providing seamless and ubiquitous access to the facilities, data, and colleagues 3
How is ESnet Managed? • A community endeavor o Strategic guidance from the OSC programs - Energy Science Network Steering Committee (ESSC) – BES represented by Nestor Zaluzec, ANL and Jeff Nichols, ORNL o Network operation is a shared activity with the community - ESnet Site Coordinators Committee - Ensures the right operational “sociology” for success • Complex and specialized – both in the network engineering and the network management – in order to provide its services to the laboratories in an integrated support environment • Extremely reliable in several dimensions � Taken together these points make ESnet a unique facility supporting DOE science that is quite different from a commercial ISP or University network 4
…what now??? VISION - A scalable, secure, integrated network network environment for ultra-scale distributed science is being environment developed to make it possible to combine resources and expertise to address complex questions that no single institution could manage alone. • Network Strategy Production network - Base TCP/IP services; +99.9% reliable High-impact network - Increments of 10 Gbps; switched lambdas (other solutions); 99% reliable Research network - Interfaces with production, high-impact and other research networks; start electronic and advance towards optical switching; very flexible [UltraScience Net] • Revisit governance model o SC-wide coordination o Advisory Committee involvement 5
Where do you come in? • Early identification of requirements o Evolving programs o New facilities • Participation in management activities • Interaction with BES representatives on ESSC • Next ESSC meeting on Oct 13-15 in DC area 6
What Does ESnet Provide? • A network connecting DOE Labs and their collaborators that is critical to the future process of science • An architecture tailored to accommodate DOE’s large-scale science o move huge amounts of data between a small number of sites • High bandwidth access to DOE’s primary science collaborators: Research and Education institutions in the US, Europe, Asia Pacific, and elsewhere • Full access to the global Internet for DOE Labs • Comprehensive user support, including “owning” all trouble tickets involving ESnet users (including problems at the far end of an ESnet connection) until they are resolved – 24x7 coverage • Grid middleware and collaboration services supporting collaborative science o trust, persistence, and science oriented policy 7
What is ESnet Today? • ESnet builds a comprehensive IP network infrastructure (routing, IPv6, and IP multicast) on commercial circuits o ESnet purchases telecommunications services ranging from T1 (1 Mb/s) to OC192 SONET (10 Gb/s) and uses these to connect core routers and sites to form the ESnet IP network o ESnet purchases peering access to commercial networks to provide full Internet connectivity • Essentially all of the national data traffic supporting US science is carried by two networks – ESnet and Internet-2 / Abilene (which plays a similar role for the university community) 8
How Do Networks Work? • Accessing a service, Grid or otherwise, such as a Web server, FTP server, etc., from a client computer and client application (e.g. a Web browser_ involves o Target host names o Host addresses o Service identification o Routing 9
How Do Networks Work? core routers LBNL • focus on high- ESnet router core speed packet router router (Core network) forwarding border peering routers core gateway � Exchange reachability router router router information (“routes”) • implement/enforce peering routing policy for each router DNS border/gateway routers provider • implement separate site and network • provide cyberdefense provider policy (including site firewall policy) peering router router router Big ISP (e.g. SprintLink) router router router router Google, Inc. 10
ESnet Core is a High-Speed Optical Network ESnet site site LAN Site – ESnet network Site IP policy demarcation router (“DMZ”) RTR ESnet IP ESnet hub router RTR Lambda channels are Wave division converted to electrical multiplexing 10GE 10GE channels • today typically 64 x 10 Gb/s optical channels per fiber • usually SONET data framing • channels (referred to as or Ethernet data framing • can be clear digital channels “lambdas”) are usually used in bi-directional pairs (no framing – e.g. for digital HDTV) ESnet core optical A ring topology network is inherently reliable – all fiber ring single point failures are mitigated by routing traffic in the other direction around the ring. RTR RTR RTR RTR 11
ESnet Provides Full Internet Service to DOE Facilities and Collaborators with High-Speed Access to all Major Science Collaborators GEANT CA*net4 Australia - Germany KDDI (Japan) CA*net4 CA*net4 - France France Taiwan CERN MREN - Italy Switzerland (TANet2) Netherlands - UK Taiwan Singaren P Russia N - etc (TANet2) W StarTap G Sinet (Japan) Taiwan Japan – Russia(BINP) S E A H U B (ASCC) LIGO N PNNL A e ESnet IP L n N e S l NYC HUB A i t Japan b a M A r Abilene MIT l i g TWC h Chi NAP INEEL BNL t Abilene ANL-DC SNLL NY-NAP INEEL-DC JGI QWEST FNAL ORAU-DC ATM PPPL AMES LLNL LLNL/LANL-DC ANL LBNL MAE-E S N V H U B C H I H U B 4xLAB-DC NERSC GTN&NNSA MAE-W PAIX-E BECHTEL SLAC Fix-W NREL KCP PAIX-W JLAB D C H U B YUCCA MT ORNL Euqinix ORAU LANL OSTI SDSC ARM NOAA ALB SNLA SRS HUB Abilene PANTEX 42 end user sites Allied GA Signal ATL HUB Office Of Science Sponsored (22) DOE-ALB International (high speed) NNSA Sponsored (12) ELP HUB OC192 (10G/s optical) Joint Sponsored (3) OC48 (2.5 Gb/s optical) Gigabit Ethernet (1 Gb/s) Other Sponsored (NSF LIGO, NOAA) OC12 ATM (622 Mb/s) Laboratory Sponsored (6) OC12 peering points OC3 (155 Mb/s) ESnet core: Packet over hubs T3 (45 Mb/s) S N V H U B SONET Optical Ring and Hubs T1-T3 Abilene high-speed peering points T1 (1 Mb/s)
ESnet’s Peering Infrastructure Connects the DOE Community With its Collaborators CA*net4 Australia CERN CA*net4 GEANT MREN Taiwan - Germany Netherlands (TANet2) - France Russia Singaren - Italy StarTap KDDI (Japan) - UK Taiwan France - etc (ASCC) SInet (Japan) PNW-GPOP SEA HUB KEK Japan – Russia (BINP) 2 PEERS Distributed 6TAP 19 Peers STARLIGHT Abilene Japan C 1 PEER NYC HUBS CalREN2 H I N A P NY-NAP LBNL 1 PEER SNV HUB Abilene + MAE-E 5 PEERS Abilene 2 PEERS 7 Universities PAIX-W 26 PEERS PAIX-E MAX GPOP MAE-W EQX-ASH 22 PEERS 39 PEERS FIX-W 20 PEERS EQX-SJ 6 PEERS 3 PEERS LANL GA CENIC Abilene ATL HUB SDSC TECHnet ESnet provides access to all of the Internet by managing the full complement of Global Internet routes (about 150,000) at University ESnet Peering 10 general/commercial peering points + high-speed peerings (connections to International w/ Abilene and the international R&E networks. This is a lot other networks) of work, and is very visible, but provides full access for DOE. Commercial
Recommend
More recommend
