Data Streaming over an International 10GE Multipath OpenFlow Network - PowerPoint PPT Presentation

Jan 28, 2024 •280 likes •331 views

Data Streaming over an International 10GE Multipath OpenFlow Network Sander Boele, Freek Dijkstra, Ronald van der Pol Artur Barczyk, Michael Bredel, Azher Mughal, Ramiro Voicu Gerben van Malenstein Jim Chen, Joe Mambretti Caltech

Data Streaming over an International 10GE Multipath OpenFlow Network Sander Boele, Freek Dijkstra, Ronald van der Pol Artur Barczyk, Michael Bredel, Azher Mughal, Ramiro Voicu Gerben van Malenstein Jim Chen, Joe Mambretti Caltech www.caltech.edu � Dr. Michael Bredel | USLHCNET@CERN | Oct. 11th, 2012 c
International Multipath OpenFlow Network NetherLight, Amsterdam StarLight, Chicago Open Flow Open Flow Open Flow Open Flow ◮ The Floodlight OpenFlow controller uses LLDP to discover the topology. ◮ OpenFlow is used to configure Open Flow multiple paths between the servers. Open Flow ◮ A Python script pushes flow forwarding entries for multiple paths between the CERN, Geneva servers to the Pronto 3290 OpenFlow switches. Caltech www.caltech.edu � Dr. Michael Bredel | USLHCNET@CERN | Oct. 11th, 2012 c
MultiPath TCP Application Layer ◮ Multipath TCP is a server side Transport Layer technology to send TCP data MPTCP simultaneously over multiple paths. Congestion control TCP TCP TCP Sub Sub Sub takes care of sending traffic Flow Flow Flow on the least congested path. ◮ For applications, MPTCP Network Layer looks like standard TCP . ◮ Multiple TCP flows traverse the network on different paths. ◮ In the demo, we present memory-to-memory data transfer from GVA to CHI using MPTCP . Caltech www.caltech.edu � Dr. Michael Bredel | USLHCNET@CERN | Oct. 11th, 2012 c
Monitoring the OpenFlow Network Caltech www.caltech.edu � Dr. Michael Bredel | USLHCNET@CERN | Oct. 11th, 2012 c

Recommend

Spark Streaming Summary by Lucy Yu Motivation Most of big data happens in a streaming

Spark Streaming Summary by Lucy Yu Motivation Most of big data happens in a streaming context Network monitoring, real-time fraud detection, algorithmic trading, risk management Current Model: Continuous Operator Model

306 views • 13 slides

Improving Data Centre Performance using Multipath TCP (work in progress) Mark Handley Costin

Improving Data Centre Performance using Multipath TCP (work in progress) Mark Handley Costin Raiciu Christopher Pluntke Adam Greenhalgh Sebastien Barre Data Centres are Interesting! As a real problem: Networks of tens of thousands of

811 views • 22 slides

Hacking the MPTCP socket API draft-hesmans-mptcp-socket-00 MultiPath TCP WiFi 4G LTE MultiPath

Hacking the MPTCP socket API draft-hesmans-mptcp-socket-00 MultiPath TCP WiFi 4G LTE MultiPath TCP MultiPath TCP Application connect read select getpid MPTCP TCP TCP TCP MultiPath TCP API Application add_subflow read select

1.04k views • 8 slides

Multipath TCP Signalling Costin Raiciu February 9, 2010 1 Introduction One design issue for

Multipath TCP Signalling Costin Raiciu February 9, 2010 1 Introduction One design issue for multipath TCP is whether to use TCP options or the payload to signal multipath control information. This document analyzes the protocol design

615 views • 5 slides

Massive-scale analysis of streaming social networks David A. Bader Exascale Streaming Data

Massive-scale analysis of streaming social networks David A. Bader Exascale Streaming Data Analytics: Real-world challenges All involve analyzing massive 450 Million Users streaming complex networks: 400 Exponential growth: 350

855 views • 32 slides

Multipath TCP Upstreaming Mat Martineau (Intel) and Matthieu Baerts (Tessares) Plan

Multipath TCP Upstreaming Mat Martineau (Intel) and Matthieu Baerts (Tessares) Plan Multipath TCP Overview First Patch Set Upstreaming Roadmap Advanced Features Roadmap Conclusion and links 2 What is MPTCP? 3 Multipath

1.36k views • 68 slides

Performance Evaluation of Multipath Performance Evaluation of Multipath TCP Linux Implementations

Performance Evaluation of Multipath Performance Evaluation of Multipath TCP Linux Implementations Euroview 2011 Euroview 2011 Amanpreet Singh C. Grg, A. Timm-Giel, M. Scharf, T.-R. Banniza 2 nd August 2011 Outline Motivation

185 views • 6 slides

Streaming Model of Computation A streaming algorithm processes a data stream : Input is

Streaming Model of Computation A streaming algorithm processes a data stream : Input is presented as a sequence of items and can be examined in only a few passes (typically just one). The algorithm has limited memory and cannot

1.35k views • 102 slides

Streaming Queries over Streaming Data Sirish Chandrasekaran UC Berkeley August 20, 2002 VLDB

Streaming Queries over Streaming Data Sirish Chandrasekaran UC Berkeley August 20, 2002 VLDB 2002 with Michael J. Franklin Motivation (1): Queries over Data Streams Queries over the past Select all the Hondas that passed I-80 at Ashby Ave.

735 views • 48 slides

Examples of Streaming Data Ocean behavior at a point Temperature (once

Streaming Data Mining Debapriyo Majumdar Data Mining Fall 2014 Indian Statistical Institute Kolkata November 20, 2014 Examples of Streaming Data Ocean behavior at a point Temperature (once every half an

485 views • 12 slides

Streaming Why should I care? Christian Trebing Blue Yonder GmbH @ctrebing 1 Agenda

Streaming Why should I care? Christian Trebing Blue Yonder GmbH @ctrebing 1 Agenda Motivation Streaming Intro Implementation Challenges 2 Data Processing - The Monolith Data Input Data Validation THE Database Machine Learning Data

1.16k views • 36 slides

Experimental Evaluation of Multipath TCP Schedulers Christoph Paasch 1 , Simone Ferlin 2 , zg

Experimental Evaluation of Multipath TCP Schedulers Christoph Paasch 1 , Simone Ferlin 2 , zg Alay 2 and Olivier Bonaventure 1 1 ICTEAM, UCLouvain, Belgium 2 Simula Research Laboratory, Fornebu, Norway Multipath TCP Resource pooling

909 views • 28 slides

A 10GE Monitoring System Arin Vijn arien@ams-ix.net Agenda - Introduction The role of an

A 10GE Monitoring System Arin Vijn arien@ams-ix.net Agenda - Introduction The role of an internet exchange (IX). - The problem to be solved. Real life examples - The chosen solution for that problem * The Force10's P10 IDS/IPS card *

887 views • 57 slides

Semi-Streaming Algorithms for Annotated Graph Streams Justin Thaler, Yahoo Labs Data Streaming

Semi-Streaming Algorithms for Annotated Graph Streams Justin Thaler, Yahoo Labs Data Streaming Model Stream: m elements from universe of size N e.g., <x 1 , x 2 , ... , x m > = 3,5,3,7,5,4,8,7,5,4,8,6,3,2, Goal:

1.19k views • 49 slides

Real-time Data Pipelines with Structured Streaming in Tathagata TD Das @tathadas

Real-time Data Pipelines with Structured Streaming in Tathagata TD Das @tathadas DataEngConf 2018 18 th April, San Francisco About Me Started Spark Streaming project in AMPLab, UC Berkeley Currently focused on building Structured

1.45k views • 51 slides

Multipath QUIC: Design and Evaluation Quentin De Coninck , Olivier Bonaventure

Multipath QUIC: Design and Evaluation Quentin De Coninck , Olivier Bonaventure quentin.deconinck@uclouvain.be multipath-quic.org QUIC = Quick UDP Internet Connection TCP/TLS1.3 atop UDP Stream multiplexing HTTP/2 use case 0-RTT

690 views • 56 slides

CS 6453: StreamScope Soumya Basu March 7, 2017 Motivation Streaming data is everywhere!

CS 6453: StreamScope Soumya Basu March 7, 2017 Motivation Streaming data is everywhere! Updates on Facebook Shopping on Alibaba Singles Day in China: 50 million events per sec, 3 second latency Streaming Problem Infinite

635 views • 15 slides

Greg Neiheisel CTO Astronomer Data Engineering Platform Streaming data Data pipelines Code

Greg Neiheisel CTO Astronomer Data Engineering Platform Streaming data Data pipelines Code first ETL Early Priorities Quick prototyping Get data in motion Ease of scale Astronomer V1 Lambda + API Gateway Cloudwatch for Monitoring

655 views • 26 slides

How to Establish Loop-Free Multipath Routes in Named Data Networking? NDNcomm 2017 Klaus

How to Establish Loop-Free Multipath Routes in Named Data Networking? NDNcomm 2017 Klaus Schneider , Beichuan Zhang March 24, 2017 The University of Arizona 1 Routing and Forwarding in IP Networks No Loop Detection on Forwarding Plane

485 views • 23 slides

Massive Streaming Data Analytics: A Case Study with Clustering Coefficients Davi vid Ediger,

Massive Streaming Data Analytics: A Case Study with Clustering Coefficients Davi vid Ediger, Karl Jiang, Jason Riedy and David A. Bader Overview Motivation A Framework for Massive Streaming hello Data Analytics STINGER

385 views • 22 slides

Agenda Motivation Multipath approaches Modeling Experiments and results

Institute of Computer Science Chair of Communication Systems Prof. Dr.-Ing. P. Tran-Gia Performance of Concurrent Multipath Transmissions - Measurements and Model Validation Thomas Zinner , Dominik Klein, Kurt Tutschku, Tanja Zseby, Phuoc

557 views • 11 slides

Designing a Multipath Transport Protocol Costin Raiciu Joint work with Mark Handley Part of the

Designing a Multipath Transport Protocol Costin Raiciu Joint work with Mark Handley Part of the Trilogy EU Project Problem Design a multipath version of TCP In order, reliable delivery Byte addressed Why TCP? Biggest chance

679 views • 36 slides

Insights Big Data Analytics Processing on streaming, hot and historical data Rajiv Shah

Simpler, Smarter and Faster Insights Big Data Analytics Processing on streaming, hot and historical data Rajiv Shah Director of Solution Architect and Professional Services 2019 About GigaSpaces 300+ Direct customers We deliver the

1.9k views • 42 slides

Training Presentation Web Streaming Introduction What is Web Streaming? Who is Streaming?

S A N D Y A U D I O V I S U A L Training Presentation Web Streaming Introduction What is Web Streaming? Who is Streaming? Web Stream Process Types of Streams How to Stream for Free 2 S A N D Y A U D I O V I S U A L Who

158 views • 13 slides