Hardware Acceleration Cloud BU, Huawei Huawei Cloud Architecture - PowerPoint PPT Presentation

High performance Cloud with Hardware Acceleration Cloud BU, Huawei

Huawei Cloud Architecture … MarketPlace and … API/SDK 网站 Marketplace Partner 工 金 企 石 智 业 科 生 医 重 远 现 智 在 中 商 全 车 融 物 业 B 汽 油 能 仿 学 命 疗 疾 程 代 电 油 抄 贸 电 园 物 慧 铁 机 公 保 线 媒 渲 小 游 渠 联 公 联 云 Industry Solutions E 车 勘 工 真 计 科 影 随 医 医 力 气 商 区 流 家 路 场 路 险 教 资 染 企 戏 表 连 道 网 共 网 通 S 探 厂 设 算 学 像 访 疗 疗 锁 庭 育 业 云 讯 计 制造 科研 能源 商业 交通 金融 运营商 医疗 其他 General SAP on Cloud Cloud Web & Dedicated Migration Purpose HPC FCS IoT Cloud DR Service Cloud Office Hosting Mobile Communication Solutions Enterprise Management Services DevOps IT Services ProjectMan CodeCheck WBS SBS WES CloudPipeline CloudIDE Workspace CES ICMS CodeHub TestMan LSB DMB RES IoT CloudRelease WeLink IAM TMS CloudBuild MBS RBS AMS CloudDeploy MobileTest IoTPlatform CTS RTS Application Services Data and AI Communication DMS MRS DPS CSS Logistics Meeting CloudIPCC CCS FunctionStage UQuery CAS Images SMN DDM DWS MLS OCR Forms Deblur IM VoiceCall Recognition CRS DIS CloudTable USearch CloudPBX MSGSMS ServiceStage XX CDM Services Computing Storage Services Network DB Security EVS VPC RDS Anti-DDoS SSA HWAF AAG CDN ECS DeC VBS ELB DDS SIS WTP WAF AAD CSBS CCE DeH OBS DSS DCS KMS HIDS SAS HSS DirectConnect BMS FGS DES DNS DRS ARS WebScan DBSS DESS IMS AS SFS VPN SCS HVD SCA FusionSphere Cloud OS Infrastructure Server Storage Network Security 2

The world is changing - more devices, more conns, more data Billion Tens of Billions 100 ~ 1000 of Billions Desktop Internet Mobile Internet Internet of Things Now! The PC brought the internet The Mobile Revolution put computing and instant access to billion, during the access to information in the hands of billions, 1990s in the early 2007s 3

Moore’s law is slowing Keeping Moore’s law alive in Data Center Single-threaded perf KunLun - Powerful X86 Smart Cloud Customi 1.1x per year Server (768 cores, 32T) NIC SSD zed CPU 1.5x per year 1990 2000 2010 2020 Heterogeneous computing SDI platform (Service Driven Infrastructure) Memory VS CPU Compute Memory Bandwidth 2000 2010 2020 4

Smart NIC 5

Under the hood: Network Virtualization Host-based SDN: separate a centralized control plane from a data plane on the host, and VM VM VM VM VM VM implement almost all virtual networking features, to connect VMs to physical network vSwitch vSwitch Physical Network vSwich is most important 6

History of Huawei eVS eVS – Elastic Virtual Switch eVS 2.0 eVS 1.0 • Start from 2015 • Start from 2013 • DPDK • Kernel-based OVS • General Packet Filtering Platform • Enhanced features (CT/BUM ） • Optimized SIMD and Multi-threaded • 8Gbps/900Kpps scheduling • 20Gbps/5Mpps Limited by Kernel Limited by CPU frequency, memory bandwidth 7

How to break the bottleneck of vSwitch? Our way: Combination of software and self-developed hardware And additional benefits: flexibility, high performance, low cost, high availability 8

eVS 3.0 - First Tens of Millions PPS virtual network switch 40Gbps 10Mpps High High Hardware Performance Availability Acceleration Smart NIC Offloads Virtio-Direct Hot upgrade 9

Huawei Smart NIC: u-NIC Self-developed smart chip: 𝐯 -NIC PCIe, SR-IOV ， Virt-IO RDMA TCP Intelligent Application network NIC protocol QoS processor OVS HD p-Switch Security VxLAN Memory … Ethernet Features • Programmable high performance packet forwarding platform Network-specific optimization engine （ PPE ） • • Large flow table and security rules • High precision hard QoS 10

Architecture: Integrated Flow Table and Offload VM ext eVS data plane action virtio-net GFP upcall ovs datapath Flow Table(IFE) virtio-direct Offload Engine First pocket u-NIC Rest of 11

Virtio-Direct: Virtual I/O • High performance virtio data path VM Offload virtio head virtio-net Zero Copy IRQ Aggregation • High Availability, Smooth migration virtio-direct Standard virtio-net Non-intrusive GuestOS Support Live migration u-NIC VF 12

Hot upgrade, both Hardware and Software QEMU virtio-net No user impact Active/Standby Mode eVS 3.0 Hot upgrade/downgrade Active Standby Independent hot upgrade Joint hot upgrade PCIe FW FW Active Standby u-NIC ETH ETH ETH ETH 13

Flexibility, Performance, Availability Other Smart NIC Virtio-Direct SR-IOV Virtual I/O Mode Software & Hardware Hardware Performance Non-intrusive GuestOS Live migration Hot upgrade 14

SDI 15

SDI ... ... VM VM VM VM VM VM PM APP Hypervisor A Hypervisor B Release more CPUs to user SDI Control Plane High perf on basic services: Computing Storage All IP pool pool network storage and network S D I Based on self-developed chip 16

SDI X86 X86 CPU CPU Storage Storage Network Network RAID Storage Storage SDI Network Network NIC • Resource Competition • Resource isolation • 20+% Cores wasted • 100% Cores for users • Weak reliability 17

SDI Architecture Cloud Scale Application ... ... Bare VM VM VM VM VM VM Metal Hypervisor A Hypervisor B APP SmartEP Driver @ PCIe Power External Management Storage Network Accelerator Extension interface accelerator Euler OS Storage Network PCIe Interface Interface Interface Software Accelerator Hardware Accelerator 18

Customized CPU Application Single Core Integer 25% ↑ * • Single Core Linpack 70% ↑ * Cloud • Memory Bandwidth 62% ↑ * CPU • Customized Server Data Center ↑ * :6151 vs 2680v4 19

C3ne - with u-NIC, Virtio-Direct, SDI C3ne 2.5x 2x Up 15% CPU PPS bps 20

Simultaneous online players from 30k to 13M Before ： Player Game Server 3Mpps 30k Player PPS  The first listed company 430% that offers game- 13Mpps 13M players now ： accelerating services in the world.  lower ping, no packet loss, Player Server C3ne C3ne no login failure 21

Thanks 22