GANT network architecture Fibre and Photonic layers Guy Roberts, - PowerPoint PPT Presentation

GÉANT network architecture – Fibre and Photonic layers Guy Roberts, DANTE 21 November, 2012 connect • communicate • collaborate

Contents Update on the new GÉANT DF footprint Diversity analysis of new fibre footprint New 100G coherent photonic layer: Infinera Network design decisions AAPs and flexibility points in the network connect • communicate • collaborate

connect • communicate • collaborate eliminating shared risks New Dark Fibre:

DF procurement Current leases on GÉANT DF expire in 2015 To support the migration we decided to re-procure dark fibre early – having a second pair of fibres during migration makes process easier and reduces customer outages. ‘Hot swap’ of equipment on existing fibre will be necessary in some locations and will be a logistical challenge. Contracts have been awarded, 5 DF providers: Colt, Telia Sonera, Interoute, Level3, Pantel New fibre leases run to 2020. connect • communicate • collaborate 4

connect • communicate • collaborate 5 New DF footprint: up to 2020

Shared risk Geneva – and others Major fibre cut between Geneva and Basel - has happened at least once in the past and resulted in loss of both GEN-FRA and GEN- MIL IP traffic between Geneva and Milan (and S&E of there) will reroute around a very long loop: Geneva-Paris-London-Brussels-Amsterdam-Frankfurt-Prague- Bratislava-Vienna/Budapest... Shared risk between GEN-FRA and GEN-MIL has been eliminated Shared risk between AMS-FRA and AMS-COP has been eliminated Shared risk in Frankfurt has been almost completely eliminated connect • communicate • collaborate 6

To Frankfurt To Paris To Milan Shared risk To Madrid GÉANT DF footprint 2006-2012 connect • communicate • collaborate

connect • communicate • collaborate Shared risk Zurich-Geneva solved

connect • communicate • collaborate Dusseldorf-Frankfurt : today

connect • communicate • collaborate Dusseldorf-Frankfurt : solution

Frankfurt metro: today Shared risk? GÉANT: Frankfurt dark fibre metro routes connect • communicate • collaborate

connect • communicate • collaborate Frankfurt metro : Solved

connect • communicate • collaborate New 100G coherent photonic layer GÉANT3 procurement:

Transmission Equipment Procurement Alcatel DWDM transmission equipment no longer meets our needs (100G in particular) Procurement process was completed this year and Infinera is now our transmission equipment provider. Rollout of DTN-X equipment has begun on Geneva – Budapest route connect • communicate • collaborate 14

DANTE’s role DANTE builds and operates the GÉANT network on behalf of the NRENs (outsourcing model) Large network (180+ sites) small team Around 30 NRENs as owners makes for a challenging operating environment Heavy reliance on vendors for roll-out New emphasis on project management and transmission expertise 5 transmission engineers in operations and 6 project managers for GÉANT project mangement connect • communicate • collaborate 15

Lessons from procurement process Don’t be tempted to focus too much on detailed solutions in your Invitation-To-Tender. It is more important to be rigorous in your definition of the problem space. This will leave vendors to come up with innovative solutions. Don’t make assumptions about the cost of engineering solutions – equipment vendors can pull surprise discounts. Each vendor will have equipment architectures that scale in unique ways, so an accurate statement of beginning-of-life and end-of-life network capacity will help achieve cost. For example long-haul topology of GÉANT backbone suits Infinera than it would in a metro network. connect • communicate • collaborate 16

connect • communicate • collaborate All lambdas.... GÉANT: 10Gb/s wavelengths in 2010

GÉANT Fibre (2010) 44 Hut-hut distance (km) 6 fibre providers: Level3  31 24  Colt 17 14 18  Interoute  TeliaSonera 5 7 Invitel (previously  4 Memorex and Pantel) Global Crossing  5 5 4 G.655 (E-LEAF) PoP-PoP distance (km) 3 • All Western ring • Madrid, vienna... 1 1 1 G.652 (SMF) 1 0 0 0 • Routes to Copenhagen • Eastern ring (?) connect • communicate • collaborate Some long routes!

The Infinera Solution – DTN-X Next Generation Integrated WDM Transport, OTN, & Packet Switching platform Next-gen PIC-based Up to 8Tb/s capacity on ILS in initial release DWDM Up to 80 x 100G channels with ULH reach PIC ‐ based 500Gb/s DWDM line cards Bandwidth GMPLS & 5Tb/s Bandwidth Virtualization in single bay Virtualization MPLS-TP Fully non ‐ blocking OTN and P ‐ OTN switching Control Wave, sub ‐ wave, super ‐ wave switching Multi-Tb/s OTN & Plane In ‐ service expansion to multi ‐ bay, non ‐ blocking Packet Switch 50Tb/s switching Multi ‐ layer GMPLS, MPLS ‐ TP Software intelligence for OTN & packet services connect • communicate • collaborate

Digital ROADMs ODU0 & packet bandwidth management O-E-O O-E-O O-E-O O-E-O O O O O O-E-O O O O-E-O O-E-O O-E-O O O O-E-O O O O-E-O OXC O-E-O O O-E-O O O O O O OTN & packet services Infinera Digital Optical Network Conventional WDM Networks • Separate WDM/ROADM & OTN switching • Integrated WDM and OTN/packet layers bandwidth management • Sub-  grooming & muxing only with OXC • Sub-  grooming at every node • Manual grooming complexity or extra cost • End-end service management, PM and for OXC OAM connect • communicate • collaborate

Coherent Transmission and Super-Channels Super-channel: several DWDM carriers combined on one line card to create a channel >100G Traffic Growth Turn up more capacity in a single operational cycle All of these are Scale fiber capacity and problems of scale reach Support next generation data service rates >100GbE Data Rate 2.5G 10G 40/100G 500G 1Tb/s Enabling CD Management Coherent Super-Channels Technology 1998 2000 2002 2004 2006 2008 2010 2012 2014 connect • communicate • collaborate

Photonic integration 500G Tx PIC RF Fanout MZ Modulator Driver ASIC Control ASICS 500G Rx PIC 500G Tx PIC 500G Rx PIC Ceramic Package TIA ASIC 500G Rx PIC Output Fibers Thermoelectric Cooler Stacked connect • communicate • collaborate Ceramic LGA Package

Line side capacity & redundancy 500G capacity on all trunks from Day1, up to 2 Tbps end- of-life GMPLS enabled to support restoration At least 250G headroom on all trunks on Day 1 – will make planning simpler and will support restoration. Resilience of the system is assured with the use of protection for all cards – except for client interfaces – use pair of OTMs to remove single point of failure connect • communicate • collaborate

Move to all coherent transmission We are re-engineering the passive photonic layer to take advantage of coherent technology  Addition of some new ILA sites (where huts have previously been “skipped”)  Removal of dispersion compensation fibre (good for latency)  The addition of gain equalisers in some ILA sites connect • communicate • collaborate

Optical Design Future optical flexibility points Fibre has been chosen with the possibility of future optical ‘flexibility points’ in mind. Lyon, Zurich and Hamburg are all fibre cross-over points that could accommodate a DTN-X Milan, Hamburg and Zurich are candidates for AAPs. Milan will get an AAP on day 1. Hamburg planning is on- going. connect • communicate • collaborate

connect • communicate • collaborate All Photonic sites

Milan final setup (connections) GEANT-Geneva GEANT IP 100G XTC-4 GARR primary 100G access (IP + GEANT+) GARR -Lancetti GEANT-Lancetti GARR backup 100G access (IP + GEANT+) XTC-10 XTC-10 GARR -Caldera GEANT-Caldera GEANT-Marseille connect • communicate • collaborate 27 GEANT-Vienna

Summary A new fibre footprint improves the resilience of the network. GÉANT has procured new equipment for the transmission and switched layers of the network. The Ethernet switching layer rollout is now complete The Transmission layer rollout has started and is expected to be completed in Q2 2013 connect • communicate • collaborate 28