kollaps
play

KOLLAPS Decentralized and Dynamic Topology Emulation Paulo - PowerPoint PPT Presentation

Oct 21, 2023 •812 likes •1.22k views

KOLLAPS Decentralized and Dynamic Topology Emulation Paulo Gouveia*, Joo Neves*, Carlos Segarra, Luca Liechti Shady Issa*, Valerio Schiavoni, and Miguel Matos* *: INESC-ID & IST, University of Lisbon, Portugal : University of

  1. KOLLAPS Decentralized and Dynamic Topology Emulation Paulo Gouveia*, João Neves*, Carlos Segarra†, Luca Liechti† Shady Issa*, Valerio Schiavoni†, and Miguel Matos* *: INESC-ID & IST, University of Lisbon, Portugal †: University of Neuchâtel, Switzerland 29.04.2020 Eurosys 2020 KOLLAPS

  2. 2 EuroSys 2020 KOLLAPS 29.04.2020

  3. MOTIVATION • Performance depends heavily on underlying network • Variability and Failures are the norm 3 EuroSys 2020 KOLLAPS 29.04.2020

  4. MOTIVATION • Performance depends heavily on underlying network • Variability and Failures are the norm • Need for tools for systematic evaluation of distributed applications • Ability to answer key questions: • What is the impact of halving the network latency in application throughput? • What is the effect of packet loss? • What if … 3 EuroSys 2020 KOLLAPS 29.04.2020

  5. RELATED WORK 4 EuroSys 2020 KOLLAPS 29.04.2020

  6. RELATED WORK Main limitations: - scalability/centralization - accuracy - dynamics 4 EuroSys 2020 KOLLAPS 29.04.2020

  7. KOLLAPS IN A NUTSHELL • Applications are concerned about end-to-end network properties • bandwidth, latency, jitter, packet loss • Rather than the network state leading to these properties 5 EuroSys 2020 KOLLAPS 29.04.2020

  8. KOLLAPS IN A NUTSHELL • Applications are concerned about end-to-end network properties • bandwidth, latency, jitter, packet loss • Rather than the network state leading to these properties • Emulate the emerging properties rather than the internal state of the network • Allows decentralized highly scalable emulation 5 EuroSys 2020 KOLLAPS 29.04.2020

  9. NETWORK COLLAPSING target topology 50Mb/s sv1 5ms 10Mb/s 100Mb/s c1 s1 s2 10ms 20ms 50Mb/s sv2 5ms 6 EuroSys 2020 KOLLAPS 29.04.2020

  10. NETWORK COLLAPSING collapsed topology target topology collapsed topology 50Mb/s 10Mb/s 10Mb/s 10Mb/s sv1 5ms c1 Node 35ms 35ms Router 10Mb/s 100Mb/s c1 s1 s2 10ms 20ms Throughput Latency 50Mb/s 50Mb/s sv2 sv2 sv1 10ms 5ms 6 EuroSys 2020 KOLLAPS 29.04.2020

  11. NETWORK COLLAPSING collapsed topology target topology collapsed topology 50Mb/s 10Mb/s 10Mb/s 10Mb/s sv1 5ms c1 Node 35ms 35ms Router 10Mb/s 100Mb/s c1 s1 s2 10ms 20ms Throughput Latency 50Mb/s 50Mb/s sv2 sv2 sv1 10ms 5ms 6 EuroSys 2020 KOLLAPS 29.04.2020

  12. NETWORK COLLAPSING collapsed topology target topology collapsed topology 50Mb/s 10Mb/s 10Mb/s 10Mb/s sv1 5ms c1 Node 35ms 35ms Router 10Mb/s 100Mb/s c1 s1 s2 10ms 20ms Throughput Latency 50Mb/s 50Mb/s sv2 sv2 sv1 10ms 5ms 7 EuroSys 2020 KOLLAPS 29.04.2020

  13. NETWORK COLLAPSING Minimum Minimum bandwidth on bandwidth on all links all links collapsed topology target topology collapsed topology 50Mb/s 10Mb/s 10Mb/s 10Mb/s sv1 5ms c1 Node 35ms 35ms Router 10Mb/s 100Mb/s c1 s1 s2 10ms 20ms Throughput Latency 50Mb/s 50Mb/s sv2 sv2 sv1 10ms 5ms 7 EuroSys 2020 KOLLAPS 29.04.2020

  14. NETWORK COLLAPSING Minimum Minimum bandwidth on bandwidth on all links all links collapsed topology target topology collapsed topology 50Mb/s 10Mb/s 10Mb/s 10Mb/s sv1 5ms c1 Node 35ms 35ms Router 10Mb/s 100Mb/s c1 s1 s2 10ms 20ms Throughput Latency 50Mb/s 50Mb/s sv2 sv2 sv1 10ms 5ms Sum of latencies Sum of latencies Sum of latencies on all links on all links on all links 7 EuroSys 2020 KOLLAPS 29.04.2020

  15. NETWORK COLLAPSING Minimum Minimum bandwidth on bandwidth on all links all links collapsed topology target topology collapsed topology 50Mb/s 10Mb/s 10Mb/s 10Mb/s sv1 5ms c1 Node 35ms 35ms Router 10Mb/s 100Mb/s c1 s1 s2 10ms 20ms Throughput Latency 50Mb/s 50Mb/s sv2 sv2 sv1 10ms 5ms Pre-computation of static properties Sum of latencies Sum of latencies Sum of latencies on all links on all links on all links 7 EuroSys 2020 KOLLAPS 29.04.2020

  16. ARCHITECTURE deployment monitor dashboard input design generator host-C host-B host-A tcal qdisc tcal qdisc tcal qdisc container container container tcal qdisc tcal qdisc tcal qdisc overlay,.. overlay,.. overlay,.. overlay,.. overlay,.. overlay,.. em. core em. core ! em. core ! ! em. core em. core ! em. core ! Aeron ! ! ! ! ! ! ! Aeron ! ! ! Log Media Driver ! ! ! shared memory Log Media Driver emulation manager shared memory host-B host-C physical network 8 EuroSys 2020 KOLLAPS 29.04.2020

  17. ARCHITECTURE deployment monitor dashboard input design generator host-C host-B host-A tcal qdisc tcal qdisc tcal qdisc container container container tcal qdisc tcal qdisc tcal qdisc overlay,.. overlay,.. overlay,.. overlay,.. overlay,.. overlay,.. em. core em. core ! em. core ! ! em. core em. core ! em. core ! Aeron ! ! ! ! ! ! ! Aeron ! ! ! Log Media Driver ! ! ! shared memory Log Media Driver emulation manager shared memory host-B host-C physical network 8 EuroSys 2020 KOLLAPS 29.04.2020

  18. ARCHITECTURE deployment monitor dashboard input design generator host-C host-B host-A tcal qdisc tcal qdisc tcal qdisc container container container tcal qdisc tcal qdisc tcal qdisc overlay,.. overlay,.. overlay,.. overlay,.. overlay,.. overlay,.. em. core em. core ! em. core ! ! em. core em. core ! em. core ! Aeron ! ! ! ! ! ! ! Aeron ! ! ! Log Media Driver ! ! ! shared memory Log Media Driver emulation manager shared memory host-B host-C physical network 8 EuroSys 2020 KOLLAPS 29.04.2020

  19. ARCHITECTURE deployment monitor dashboard input design generator host-C host-B host-A tcal qdisc tcal qdisc tcal qdisc container container container tcal qdisc tcal qdisc tcal qdisc overlay,.. overlay,.. overlay,.. overlay,.. overlay,.. overlay,.. em. core em. core ! em. core ! ! em. core em. core ! em. core ! Aeron ! ! ! ! ! ! ! Aeron ! ! ! Log Media Driver ! ! ! shared memory Log Media Driver emulation manager shared memory host-B host-C physical network 8 EuroSys 2020 KOLLAPS 29.04.2020

  20. ARCHITECTURE deployment monitor dashboard input design generator host-C host-B host-A tcal qdisc tcal qdisc tcal qdisc container container container tcal qdisc tcal qdisc tcal qdisc overlay,.. overlay,.. overlay,.. overlay,.. overlay,.. overlay,.. em. core em. core ! em. core ! ! em. core em. core ! em. core ! Aeron ! ! ! ! ! ! ! Aeron ! ! ! Log Media Driver ! ! ! shared memory Log Media Driver emulation manager shared memory host-B host-C physical network 8 EuroSys 2020 KOLLAPS 29.04.2020

  21. ARCHITECTURE deployment monitor dashboard input design generator host-C host-B host-A tcal qdisc tcal qdisc tcal qdisc container container container tcal qdisc tcal qdisc tcal qdisc overlay,.. overlay,.. overlay,.. overlay,.. overlay,.. overlay,.. em. core em. core ! em. core ! ! em. core em. core ! em. core ! Aeron ! ! ! ! ! ! ! Aeron ! ! ! Log Media Driver ! ! ! shared memory Log Media Driver emulation manager shared memory host-B host-C physical network 8 EuroSys 2020 KOLLAPS 29.04.2020

  22. ARCHITECTURE deployment monitor dashboard input design generator host-C host-B host-A tcal qdisc tcal qdisc tcal qdisc container container container tcal qdisc tcal qdisc tcal qdisc overlay,.. overlay,.. overlay,.. overlay,.. overlay,.. overlay,.. em. core em. core ! em. core ! ! em. core em. core ! em. core ! Aeron ! ! ! ! ! ! ! Aeron ! ! ! Log Media Driver ! ! ! shared memory Log Media Driver emulation manager shared memory host-B host-C physical network 8 EuroSys 2020 KOLLAPS 29.04.2020

  23. ARCHITECTURE deployment monitor dashboard input design generator host-C host-B host-A tcal qdisc tcal qdisc tcal qdisc container container container tcal qdisc tcal qdisc tcal qdisc overlay,.. overlay,.. overlay,.. overlay,.. overlay,.. overlay,.. em. core em. core ! em. core ! ! em. core em. core ! em. core ! Aeron ! ! ! ! ! ! ! Aeron ! ! ! Log Media Driver ! ! ! shared memory Log Media Driver emulation manager shared memory host-B host-C physical network 8 EuroSys 2020 KOLLAPS 29.04.2020

  24. EMULATION MANAGER (EM) •One instance per physical machine •Enforces topology properties •static properties •dynamic properties 9 EuroSys 2020 KOLLAPS 29.04.2020

  25. EM: DYNAMIC PROPERTIES target topology collapsed topology collapsed topology 50Mb/s 10Mb/s 10Mb/s 10Mb/s sv1 5ms c1 Node 35ms 35ms 10Mb/s 100Mb/s Router c1 s1 s2 10ms 20ms Throughput Latency 50Mb/s 50Mb/s sv2 sv1 sv2 5ms 10ms 10 EuroSys 2020 KOLLAPS 29.04.2020

  26. EM: DYNAMIC PROPERTIES target topology collapsed topology collapsed topology 50Mb/s 10Mb/s 10Mb/s 10Mb/s sv1 5ms c1 Node 35ms 35ms 10Mb/s 100Mb/s Router c1 s1 s2 10ms 20ms Throughput Latency 50Mb/s 50Mb/s sv2 sv1 sv2 5ms 10ms 10 EuroSys 2020 KOLLAPS 29.04.2020

  27. EM: DYNAMIC PROPERTIES target topology collapsed topology collapsed topology 50Mb/s 10Mb/s 10Mb/s 10Mb/s sv1 5ms c1 Node 35ms 35ms 10Mb/s 100Mb/s Router c1 s1 s2 10ms 20ms Throughput Latency 50Mb/s 50Mb/s sv2 sv1 sv2 5ms 10ms sv1 s / b M 0 1 C1 10 Mb/s sv2 10 EuroSys 2020 KOLLAPS 29.04.2020

Recommend

More recommend