Scaling for Ultrafast, G.FAST, FTTP, 5G and the Cloud Neil J. McRae Chief Architect BT 1 British Telecommunications plc 2018
Agenda BT Core network • Traffic growth and trends • Scaling the core • new router introduction scaling the optical layer Readying the network for 5G • Network Cloud • Telemetry and AI • Whitebox • 2 British Telecommunications plc 2018
Investing in Research & Development 3rd 3rd largest investor in R&D in the UK over highest number of patents filed with the European past ten years* Patent Office of UK-based companies 2nd £2.5 billion largest investor in R&D in the fixed line spent on R&D over the last five years telecoms sector over past ten years 30+ 1025 Graduates and Apprentices recruited by BT in Direct university research relationships 2016 102 4900 Number of inventions filed in 2016/17 patents in our portfolio British Telecommunications plc 2018
Research Initiatives Principles • Working with partners to improve the solution. 2 x 3 x 1000 Cache 4 1G 100G 100G 100G 100G 100G 10G 400G 10G Peer Internet NGA MSE EEA P P MSC SAR Core ing DPI Peers 3 NG-WDM EBD NG-WDM 7 GEA 1 6 5 5 21C Core RSN IPP 8 1 Research with Cambridge University on autonomous Re 4 Research with Cambridge, Southampton Re Research on Network Chaining with Ki Re Kings 7 healing he ng. Huawei and Hua nd Ci Ciena on on future op optical 2 Re Research with Cambridge University on cache Re Research with Bell La Labs on future Ethernet and 8 KQ KQD research wi with various 5 op optimisation on, Research with MI MIT Me Media Lab on on ne network topo pology and nd edg dge comput pute co content optimisation (co codec c et etc) Research with Oxford on Quantum Compute Re Re Research with Cambridge, Bristol and 3 Re Research with Cambridge on access, passive 6 others on ot on alternatives to o op optical fibre gearing, ge g, (coherent, Wavegu guide Cu, Beamforming) g) Re Research with Surrey on 5G core and radio ra British Telecommunications plc 2018
BT Core network • Strategic core network supporting all IP/Ethernet based traffic Mu Multi-Servi vice • Foundation for Broadband, Mobile, Ethernet and IP Business services • Over 1800 Ethernet enabled nodes Deep UK De • Access via superfast fibre across the UK Broadband / Fibre IPVPN / Ethernet MEAS Broadband Cove verage • Core/Metro extends to 106 UK sites Business • MPLS extends to all 1800 sites Mobile Backhaul Broadband IP/Ethernet • High capacity optical and IP core Optical • Nx100G optical links Hi High h Capa pacity • Over 10 Tbit/s of peak demand just fixed broadband 21C Core • All nodes dual or triple connected to rest Resilience Re of the network & Ava vailability • Extensive multi-layer modelling to ensure resilience under component or fibre failure • One network which carries all consumer and business demands Scaled to meet peak demands across all services, with resilience to efficiently meet demands of most critical services • 5 British Telecommunications plc 2018
Core network topology Simplified topology of UK core Regional Hubs Content Global Global AS5400 Peers 2G/ G/3G/ G/4G x ~10 Content x 3-5 PE 5G 5G x ~1000 x ~100 PE Super Hubs Business Ethernet Bu VPN PE PE P PE ADSL AD UK MSE R Peering P PE Peers VDSL VD BNG 21C Core Network Internet & Peering G.FAS AST Metro (all MPLS) (native IP) – AS2856 FTTP FT Multicast distribution for TV services Openreach MPLS core platform extends to ~1000 • Super Hubs Regional Hubs sites to connect to Openreach NGA • Aggregates 5000 ADSL nodes and 10,000s of cell sites BNG function distributed to edge to • enable early decision on traffic routing 100G • Express routes to London based Super Hubs for Peering/Transit bound traffic • Regional Hubs for CDN content delivery 6 British Telecommunications plc 2018 Express routes to super hubs Regional hub connectivity
Content delivery by CDNs Proportion of peak time traffic offloaded vi via caching On-net (up to 14-Jan (u an-18) 18) Content Core Internet 60% 40% CDN CD RCN 21CN Customer Internet Caches Caches Distribute x10 Peering/Transit x3 Core sites further Regional Sites Multicast TV • Caching content deeper in the network offloads c 60% of core Pe Peering capacity – caches currently at ~13 locations, with potential to deploy more deeply to optimise further • We also serve BT TV content over multicast – which avoids an additional 1Tbps of traffic on the CDNs British Telecommunications plc 2018 7
Demand peaks are driven by sporting events… Peak demand is driven from major sporting events. Man City vs Liverpool game on 10 th April drove highest peak of traffic on our network - 10.37Tbps. Traffic served from CDN serving BT Sport Traffic generated from content CDNs hosted within our network. In addition multicast delivered live streams to our devices without loading CDN. 8 British Telecommunications plc 2018
Dollars less – bandwidth more. Content x ~10 Content PE x 3-5 PE x ~1000 x ~100 Super Hubs VPN PE PE P PE MSE UK R Peering P PE Peers BNG 21C Core Network Internet & Peering Metro (native IP) – AS2856 (all MPLS) Te Technology upgrades Traffic growth drives constant • NG IPP equipment refresh to deploy devices Peering with higher switching capacity and Upgrades Complete Multi- chassis NG Core drive down unit cost Core Routers existing Core <1 Tbit Routers chassis Refresh Dual vendor Core sites • Our 21C strategic network is about to introduce its 4 th generation of core 2005 2010 2014 2018 routers Core Datacentre Core WDM NG-WDM 200G Waves Optics Interconnect Dual vendor Single Domain £££ £££ • Since 2012 we have reduced unit Cost of Ar Architecture Simplification Unit Cost £/Mbps Un cost of capacity by over 70% adding + + Achieved by halving the number of • Lower cos Low ost technol olog ogy Mbps of electronics in the path carrying capacity -70% 70% broadband and driving technology cost reduction • Now targeting more reduction time 2012 2017 9 British Telecommunications plc 2018
Next gen routing platform Current generation devices support 16Tbps per routing node Current generation: Example shown is deployed as one a of a set of resilient devices in Nokia 7950 XRS one of our Super Hub nodes But demand for traffic growth requires us to grow capacity on of routers at our hub sites Growth driving investment in next generation core devices • Next gen router being deployed • Enables significant increased density of 100G aggregation at our core nodes • System will support 100s 100GE ports and 400GE. • 10GE supported via break out cables for legacy device interconnect • Able to replace multi-chassis device with single footprint core routers due to much higher density • Petabit scale. 10 British Telecommunications plc 2018
Low cost optical to 400GE We plan to deploy datacentre interconnect platforms to provide high capacity WDM links between key sites this year. The advantage is significant capacity in a small footprint and support for modern Netconf/YANG control • Terabit/s capacity optical boxes in a compact, modular form factor (e.g. 1RU or 2RU). • Programmable line side modulation formats,100/200Gbit/s evolving to 400Gbits per single carrier. • Simple stackable solution for ease of capacity scaling • Lower power consumption (as low as 0.5W/Gbit/s) • Carrier grade optical performance comparable to traditional optical transponders. • High-quality coherent optics • Ultra-efficient flexible grid compatible WDM e.g. ~120 channels in C-band • Supporting simple high-speed Ethernet client connectivity • e.g. 100GE evolving to 200/400GE. • Supporting new Netconf/YANG based management capabilities • Enabling near real-time streaming telemetry (not SNMP!) • Potential for more openness and disaggregated deployment models Also evaluating 400G line side optics and 400GE client ports for connection to NG core routers 11 British Telecommunications plc 2018
New devices drives investment in accommodation… Switching capacity Watt/Gbps kW/Rack, kW/Node 40kW /Rack 4kW /Rack time Meeting capacity growth is driving investment in cooling and power – as vendors keep pace with switching capacity but are not able to reduce Watt/Gbps as rapidly This is driving investment in new air conditioning being deployed at our key sites, back up generators at some nodes 12 British Telecommunications plc 2018
5G and demand? EE hits 2.8Gbps download speeds in UK-first 5G trial University, BT and Nokia to conduct joint research into 5G mobile networks in Bristol http://www.bristol.ac.uk/news/2017/ november/5g-mobile-networks.html http://newsroom.ee.co.uk/ee-showcases-end-to-end-5g-network-architecture-with-28gbps-speeds/ Massive MIMO testing @Adastral Park Huawei and EE Showcase 5G Uplink and Downlink Decoupling PoC in London 13 British Telecommunications plc 2018
Recommend
More recommend
