Three years of automating large scale networks using Salt Mircea - PowerPoint PPT Presentation

Three years of automating large scale networks using Salt Mircea Ulinic FranceIX General Meeting Cloudflare, London Paris, September 2018 1

Mircea Ulinic Network software engineer at Cloudflare ● Member and maintainer at NAPALM Automation ● SaltStack contributor of the year 2017 ● O’Reilly author ● OpenConfig representative ● https://mirceaulinic.net/ ● mirceaulinic @mirceaulinic 2

Automation: definition The technique, method, or system of operating or controlling a process by highly ● automatic means, as by electronic devices, reducing human intervention to a minimum. The technique of making an apparatus, a process, or a system operate ● automatically . Automatically : Having a self-acting or self-regulating mechanism ○ 3

Common views on automation In general (mis)understood as the equivalent of just configuration management. In simpler terms, this boils down to: generate a configuration based on a template ⇒ load the text blob on the network device. … but what about the very long list of other manual tasks, e.g.: - run the command to deploy the config - same boring email to send to your providers - Same boring notifications written manually (sometimes with tpyos) - route leaks you learn about only minutes after it started - other events you react way too late 4

Common views on automation In general (mis)understood as the equivalent of just configuration management. In simpler terms, this boils down to: generate a configuration based on a template ⇒ load the text blob on the network device. … but what about the very long list of other manual tasks, e.g.: - run the command to deploy the config - same boring email to send to your providers - same boring notifications written manually (sometimes with tpyos) - route leaks you learn about only minutes after it started - other events you react way too late This is not 5 automation

Common views on automation In general (mis)understood as the equivalent of just configuration management. In simpler terms, this boils down to: generate a configuration based on a template ⇒ load the text blob on the network device. … but what about the very long list of other manual tasks, e.g.: But they all - run the command to deploy the config can be - same boring email to send to your providers automated - same boring notifications written manually (sometimes with tpyos) - route leaks you learn about only minutes after it started - other events you react way too late 6

Frameworks used in networking before 2016 … but they are not event-driven neither data-driven 7

Salt had the features to automate everything “ In SaltStack, speed isn’t a byproduct, it is a design goal. SaltStack was created as an extremely fast, lightweight communication bus to provide the foundation for a remote execution engine. SaltStack now provides orchestration, configuration management, event reactors, cloud provisioning, and more, all built around the SaltStack high-speed communication bus. ” … but no features for network automation before 2016 https://docs.saltstack.com/en/getstarted/speed.html 8

Salt Architecture Device to be Master managed The name of the Salt process ... Minion Minion Minion Minion Minion Minion https://docs.saltstack.com/en/latest/topics/topology/index.html 9

Salt Architecture Device to be Problem: you Master managed can’t install Minions on traditional network devices! The name of the Salt process ... Minion Minion Minion Minion Minion Minion https://docs.saltstack.com/en/latest/topics/topology/index.html 10

Salt Architecture: Proxy Minions Solution: Proxy Minions Master They behave like regular Minions, but can manage network devices, HTTP remotely . SSH Proxy Proxy Proxy ... Minion Minion Minion NETCONF network network network ... device device device https://docs.saltstack.com/en/latest/topics/topology/index.html 11

Vendor-agnostic API: NAPALM Network Automation and Programmability Abstraction Layer with Multivendor support NAPALM https://github.com/napalm-automation 12

NAPALM integrated in Salt: Carbon (2016.11) https://docs.saltstack.com/en/develop/topics/releases/2016.11.0.html 13

2016: Vendor-agnostic automation is here! $ sudo salt junos-router net.arp $ sudo salt iosxr-router net.arp junos-router: iosxr-router: ---------- ---------- out: out: |_ |_ ---------- ---------- age: age: 129.0 1620.0 interface: interface: ae2.100 Bundle-Ether4 ip: ip: 10.0.0.1 10.0.0.2 mac: mac: 84:B5:9C:CD:09:73 00:25:90:20:46:B5 |_ |_ ---------- ---------- age: age: 1101.0 8570.0 14

Vendor-agnostic configuration management $ sudo salt device1 state.sls ntp $ sudo salt device2 state.sls ntp device1: device2: ---------- ---------- ID: Manage the NTP config ID: Manage the NTP config Function: netconfig.managed Function: netconfig.managed Result: True Result: True Comment: Configuration changed! Comment: Configuration changed! Started: 10:53:25.624396 Started: 11:02:39.162423 Duration: 3494.153 ms Duration: 3478.683 ms Changes: Changes: ---------- ---------- diff: diff: [edit system ntp] --- - peer 172.17.17.2; +++ [edit system ntp] @@ -1,4 +1,10 @@ + server 10.10.10.1; +ntp + server 10.10.10.2; + server 10.10.10.1 - server 172.17.17.1; + server 10.10.10.2 ! 15

NAPALM integrated in Salt: Nitrogen (2017.7) https://docs.saltstack.com/en/develop/topics/releases/nitrogen.html 16

2017: event-driven network automation 17

2017: event-driven network automation 18

NAPALM integrated in Salt: Fluorine (2018.11) 19 https://docs.saltstack.com/en/develop/topics/releases/fluorine.html

Salt for network automation: not only NAPALM First framework with official OpenConfig integrations 24 https://docs.saltstack.com/en/develop/topics/releases/fluorine.html

Salt for network automation: not only NAPALM 25 https://docs.saltstack.com/en/develop/topics/releases/fluorine.html

Who’s Salty today 26

Network Automation at Scale: the book Free download: http://www.oreilly.com/webops-perf/free/network-aut omation-at-scale.csp 27

Everything is open sourced ● Salt https://github.com/saltstack/salt ● NAPALM Automation: https://github.com/napalm-automation 28

Need help/advice? Join https://networktocode.slack.com/ rooms: # saltstack # napalm New: https://saltstackcommunity.slack.com rooms: # networks Over 600 members 29

Questions ? mircea@cloudflare.com 30

Three years of automating large scale networks using Salt Mircea - PowerPoint PPT Presentation

Three years of automating large scale networks using Salt Mircea Ulinic FranceIX General Meeting Cloudflare, London Paris, September 2018 1 Mircea Ulinic Network software engineer at Cloudflare Member and maintainer at NAPALM

AUTOMATING KNOWLEDGE WORK WITH LARGE-SCALE KNOWLEDGE GRAPHS 2018 Strata Data Conference, New

Deploying Large Scale AVB/TSN Networks Jeff Koftinoff, Meyer Sound Laboratories, Inc. June 19,

Enabling large scale LAPW DFT calculations by a scalable iterative eigensolver CSE15, Salt Lake

Simulating Energy Aware Networks in Large Scale Distributed Systems Betsegaw Lemma Amersho

Python for Networking Devices Elisa Jasinska elisa@bigwaveit.org About Me Elisa Jasinska

Automating la large -scale simulation and data analysis with OMNeT++ ++ Antonio Virdis (Carlo

Fusion-Fission Hybrid Systems and Molten Salt Technologies in Large-Scale Nuclear Energy E.

Locality Aware Mechanisms for Large-scale Networks: The Tapestry Infrastructure John D.

Control of large-scale systems with applications to water distribution and road traffic networks

Networks and large scale optimization Open Data Science Conference Boston, May 2018 Sam Safavi

FINANCING LARGE SCALE SOLAR Large Scale Solar Conference - Sydney Gloria Chan Director, Large

Large Scale Simulation of Tor: Stream Mix Networks Low latency Networks Network Correlation

1 Objective Key Ideas Propose an analysis method for large-scale networks Extend existing

Large Scale Enzyme Func1on Discovery: Sequence Similarity Networks

Evaluation of Amplification attacks in large-scale networks to improve detection performance

Using Large-Scale Matrix Factorizations to identify users of Social Networks Dr. Michael W.

Towards reconstructing personalised causal regulatory networks using large-scale trans -eQTL and

Current Status of the Southern African Large Telescope Steve Crawford crawford@saao.ac.za SALT

Nonlinear dynamics emerging in large scale neural networks with ontogenetic and epigenetic

Spatial and modular organisation of brain networks prevents large-scale activation Marcus Kaiser

Multiresol olution M on Method hods f for Large-scale L Learni ning ng @ @ NIPS 2 S 2015

The effects of common communication patterns in large-scale networks with switch-based static

Optimized Routing for Large- Scale InfiniBand Networks Torsten Hoefler, Timo Schneider, and

Analysis Algorithms for Large-Scale Networks Dan Meehan meehan.49@osu.edu Table of Contents