concurrent programming using the disruptor
play

Concurrent Programming Using The Disruptor Trisha Gee LMAX - PowerPoint PPT Presentation

Sep 29, 2022 •114 likes •1.14k views

Concurrent Programming Using The Disruptor Trisha Gee LMAX Wednesday, 23 May 12 Concurrent Programming Using The Disruptor Trisha Gee, Developer at LMAX @trisha_gee mechanitis.blogspot.com Wednesday, 23 May 12 The Disruptor? Wednesday,

  1. Concurrent Programming Using The Disruptor Trisha Gee LMAX Wednesday, 23 May 12

  2. Concurrent Programming Using The Disruptor Trisha Gee, Developer at LMAX @trisha_gee mechanitis.blogspot.com Wednesday, 23 May 12

  3. The Disruptor? Wednesday, 23 May 12

  4. What I’m covering • Overview of the Disruptor • Create your own! • Turn it up to Eleven • Q&A Wednesday, 23 May 12

  5. What is it? • Data structure and work flow with no contention. • Very fast message passing. • Allows you to go truly parallel. Wednesday, 23 May 12

  6. So...? Wednesday, 23 May 12

  7. The Magic RingBuffer Wednesday, 23 May 12

  8. The Magic RingBuffer Wednesday, 23 May 12

  9. The Magic RingBuffer Wednesday, 23 May 12

  10. The Magic RingBuffer Wednesday, 23 May 12

  11. The Magic RingBuffer Wednesday, 23 May 12

  12. The Magic RingBuffer Wednesday, 23 May 12

  13. The Magic RingBuffer Wednesday, 23 May 12

  14. Creating a RingBuffer final RingBuffer<SimpleEvent> ringBuffer = new RingBuffer<SimpleEvent>(SimpleEvent.EVENT_FACTORY, RING_BUFFER_SIZE); Wednesday, 23 May 12

  15. The Events are Buckets Wednesday, 23 May 12

  16. Great! I want one! public class SimpleEvent { public static final EventFactory<SimpleEvent> EVENT_FACTORY = new SimpleEventFactory(); private volatile String value; private static class SimpleEventFactory implements EventFactory<SimpleEvent> { @Override public SimpleEvent newInstance() { return new SimpleEvent(); } } } Wednesday, 23 May 12

  17. I’ve got a RingBuffer! • Erm.... how do I poke things into it? Wednesday, 23 May 12

  18. The Publisher Wednesday, 23 May 12

  19. Wednesday, 23 May 12

  20. Wednesday, 23 May 12

  21. Wednesday, 23 May 12

  22. Wednesday, 23 May 12

  23. Wednesday, 23 May 12

  24. Wednesday, 23 May 12

  25. What do I do? public class SimpleEventTranslator implements EventTranslator<SimpleEvent> SimpleEventTranslator translator = new SimpleEventTranslator(); EventPublisher<SimpleEvent> publisher = new EventPublisher<SimpleEvent>(ringBuffer); // poke your translator here // ...and when you’re done... publisher.publishEvent(translator); Wednesday, 23 May 12

  26. ...so now I want to read • The Disruptor provides nice batching behaviour for free Wednesday, 23 May 12

  27. Wednesday, 23 May 12

  28. Wednesday, 23 May 12

  29. Wednesday, 23 May 12

  30. Wednesday, 23 May 12

  31. Wednesday, 23 May 12

  32. Wednesday, 23 May 12

  33. Wednesday, 23 May 12

  34. Wednesday, 23 May 12

  35. Wednesday, 23 May 12

  36. Wednesday, 23 May 12

  37. Wednesday, 23 May 12

  38. Wednesday, 23 May 12

  39. Wednesday, 23 May 12

  40. Wednesday, 23 May 12

  41. Wednesday, 23 May 12

  42. ...and all you need is... public class SimpleEventHandler implements EventHandler<SimpleEvent> { @Override public void onEvent( final SimpleEvent event, final long sequence, final boolean endOfBatch) throws Exception { // do stuff } } Wednesday, 23 May 12

  43. Shiny. So what? Wednesday, 23 May 12

  44. Let’s go parallel Wednesday, 23 May 12

  45. And now for something different... Wednesday, 23 May 12

  46. Remember Henry Ford? Wednesday, 23 May 12

  47. Wednesday, 23 May 12

  48. Wednesday, 23 May 12

  49. Wednesday, 23 May 12

  50. Wednesday, 23 May 12

  51. Wednesday, 23 May 12

  52. Wednesday, 23 May 12

  53. Wednesday, 23 May 12

  54. Complex workflow... Wednesday, 23 May 12

  55. What on Earth has this got to do with RingBuffers?! Wednesday, 23 May 12

  56. Wednesday, 23 May 12

  57. Wednesday, 23 May 12

  58. Wednesday, 23 May 12

  59. Wednesday, 23 May 12

  60. Wednesday, 23 May 12

  61. Wednesday, 23 May 12

  62. Wednesday, 23 May 12

  63. Wednesday, 23 May 12

  64. Wednesday, 23 May 12

  65. Wednesday, 23 May 12

  66. Wednesday, 23 May 12

  67. Wednesday, 23 May 12

  68. Wednesday, 23 May 12

  69. Wednesday, 23 May 12

  70. Wednesday, 23 May 12

  71. Wednesday, 23 May 12

  72. Wednesday, 23 May 12

  73. Wednesday, 23 May 12

  74. Wednesday, 23 May 12

  75. Wednesday, 23 May 12

  76. Wednesday, 23 May 12

  77. Wednesday, 23 May 12

  78. Wednesday, 23 May 12

  79. Wednesday, 23 May 12

  80. Wednesday, 23 May 12

  81. Wednesday, 23 May 12

  82. Wednesday, 23 May 12

  83. Wednesday, 23 May 12

  84. Wednesday, 23 May 12

  85. Wednesday, 23 May 12

  86. Wednesday, 23 May 12

  87. Wednesday, 23 May 12

  88. Wednesday, 23 May 12

  89. Wednesday, 23 May 12

  90. Wednesday, 23 May 12

  91. Wednesday, 23 May 12

  92. Wednesday, 23 May 12

  93. Don’t wrap the buffer! ringBuffer.setGatingSequences(finalEventProcessor.getSequence()); Wednesday, 23 May 12

  94. Caveats Wednesday, 23 May 12

  95. Is that it? • Wait and claim strategies • Batch publishing • Multiple publishers • Different EventHandlers • The Wizard • You don’t even need a RingBuffer... Wednesday, 23 May 12

  96. You get... • A framework the encourages you to model your domain • The ability to run in parallel but single- threaded • Reliable ordering • ...and it can be very fast Wednesday, 23 May 12

  97. More Information • Google Code Site, including Wiki http://code.google.com/p/disruptor/ • Blogs, e.g. mine: mechanitis.blogspot.com • Presentations • Google Group Wednesday, 23 May 12

  98. Q&A Wednesday, 23 May 12

  99. WorkerPool Wednesday, 23 May 12

  100. AggregateEventHandler Wednesday, 23 May 12

Recommend

Concurrent Programming in Scala 1 / 7 Concurrent Programming 1 Concurrent programming:

Concurrent Programming in Scala 1 / 7 Concurrent Programming 1 Concurrent programming:

Concurrent Programming in Scala 1 / 7 Concurrent Programming 1 Concurrent programming: separate overlapping threads of execution, not necessarily run on separate processors/cores Parallel programming: separate threads of execution running

257 views • 7 slides
What is Concurrent Programming? M. Ben-Ari Principles of Concurrent and Distributed Programming

What is Concurrent Programming? M. Ben-Ari Principles of Concurrent and Distributed Programming

CoSc 450: Programming Paradigms 01 What is Concurrent Programming? M. Ben-Ari Principles of Concurrent and Distributed Programming Second Edition Addison-Wesley, 2006 c Mordechai Ben-Ari 2006 Computer Time - 0 100 200 300 400

711 views • 15 slides
Concurrent programming made simple The (r)evolution of transactional memory Torvald Riegel Nuno

Concurrent programming made simple The (r)evolution of transactional memory Torvald Riegel Nuno

Concurrent programming made simple The (r)evolution of transactional memory Torvald Riegel Nuno Diegues Red Hat INESC-ID, Lisbon, Portugal FOSDEM 2014 Concurrent programming Concurrent = at the same time and not independent Concurrent

849 views • 47 slides
Chapter 3 Concurrent Execution DM519 Concurrent Programming 1 Repetition (Concepts, Models,

Chapter 3 Concurrent Execution DM519 Concurrent Programming 1 Repetition (Concepts, Models,

Chapter 3 Concurrent Execution DM519 Concurrent Programming 1 Repetition (Concepts, Models, and Practice) u Concepts: l We adopt a model-based approach for the design and construction of concurrent programs u Safe model =&gt; safe

919 views • 43 slides
Concurrent programming Multiple threads working together to achieve a common goal These threads

Concurrent programming Multiple threads working together to achieve a common goal These threads

Concurrent programming slides T.S. Norvell (c) 2001 Concurrent programming Multiple threads working together to achieve a common goal These threads may share memory Communication is via shared variables. Care is required to ensure

392 views • 11 slides
Concurrent programming in C++11 Computer Architecture J. Daniel Garca Snchez (coordinator)

Concurrent programming in C++11 Computer Architecture J. Daniel Garca Snchez (coordinator)

Concurrent programming in C++11 Concurrent programming in C++11 Computer Architecture J. Daniel Garca Snchez (coordinator) David Expsito Singh Francisco Javier Garca Blas ARCOS Group Computer Science and Engineering Department

843 views • 60 slides
Advanced Programming Concurrency Concurrent Programming Until now, a program was a sequence

Advanced Programming Concurrency Concurrent Programming Until now, a program was a sequence

Advanced Programming Concurrency Concurrent Programming Until now, a program was a sequence of operations, executing one after another. In a concurrent program, several sequences of operations may execute in the same time ,

456 views • 34 slides
Concurrent and parallel programming Seminars in Advanced Topics in Computer Science Engineering

Concurrent and parallel programming Seminars in Advanced Topics in Computer Science Engineering

Concurrent and parallel programming Seminars in Advanced Topics in Computer Science Engineering 2019/2020 Romolo Marotta Trend in processor technology Concurrent and parallel programming 2 Blocking synchronization SHARED RESOURCE

1.31k views • 74 slides
Concurrent Programming Actors, SALSA, Coordination Abstractions Carlos Varela Rensselaer

Concurrent Programming Actors, SALSA, Coordination Abstractions Carlos Varela Rensselaer

Concurrent Programming Actors, SALSA, Coordination Abstractions Carlos Varela Rensselaer Polytechnic Institute March 14, 2019 C. Varela 1 Advantages of concurrent programs Reactive programming User can interact with applications

697 views • 31 slides
Rela%vis%c Red Black Trees Rela%vis%c Programming Concurrent

Rela%vis%c Red Black Trees Rela%vis%c Programming Concurrent

Rela%vis%c Red Black Trees Rela%vis%c Programming Concurrent reading and wri%ng improves performance and scalability concurrent readers may disagree on the

771 views • 51 slides
Computational Logic Concurrent (Constraint) Logic Programming 1 Concurrent Logic Programs

Computational Logic Concurrent (Constraint) Logic Programming 1 Concurrent Logic Programs

Computational Logic Concurrent (Constraint) Logic Programming 1 Concurrent Logic Programs Predicate: Set of clauses Clause: Head :- Guard | Body. Head is an atom Guard and Body are conjunctions of atoms Resolvent: Set of goals

623 views • 28 slides
Concurrent Message Service M. Clemencic CERN - LHCb Forum on Concurrent Programming Models and

Concurrent Message Service M. Clemencic CERN - LHCb Forum on Concurrent Programming Models and

Concurrent Message Service M. Clemencic CERN - LHCb Forum on Concurrent Programming Models and Frameworks 24-10-2012 M. Clemencic (CERN - LHCb) Concurrent Message Service 24-10-2012 1 / 11 Outline Introduction 1 Gaudi Concurrent

777 views • 32 slides
Concurrent Programming Multitasking (Interactive) Perform more than one task at a time for

Concurrent Programming Multitasking (Interactive) Perform more than one task at a time for

Multiprocessing granularity Using Multiple Processors. Multiprogramming (Batch) Switch and execute different jobs simultaneously, to improve CPU utilization. Concurrent Programming Multitasking (Interactive) Perform

273 views • 15 slides
Concurrent Programming 15-213: Introduc0on to Computer Systems 22

Concurrent Programming 15-213: Introduc0on to Computer Systems 22

Carnegie Mellon Concurrent Programming 15-213: Introduc0on to Computer Systems 22 nd Lecture, Nov. 11, 2010 Instructors: Randy Bryant and Dave OHallaron 1

657 views • 41 slides
Basic Synchronization Principles Encourage Concurrency No widely-accepted concurrent

Basic Synchronization Principles Encourage Concurrency No widely-accepted concurrent

Basic Synchronization Principles Encourage Concurrency No widely-accepted concurrent programming languages No concurrent programming paradigm Each problem requires careful consideration There is no common model See SOR

630 views • 49 slides
Concurrent Programming Languages and Semantic Analyses Manfred Schmidt-Schauss

Concurrent Programming Languages and Semantic Analyses Manfred Schmidt-Schauss

Concurrent Programming Languages and Semantic Analyses Manfred Schmidt-Schauss Goethe-Universit at Frankfurt, Institut f ur Informatik, Germany RTA/TLCA 14 16. July 2014 Based on joint work with David Sabel 1 Concurrency of Programming

1.05k views • 87 slides
11Concurrent Programming CS 4215: Programming Language Implementation Martin Henz March 30,

11Concurrent Programming CS 4215: Programming Language Implementation Martin Henz March 30,

Spawning Concurrent Computation Shared Variables and Granularity of Concurrency Mutual Exclusion Monitors Implementation of Concurrent Constructs 11Concurrent Programming CS 4215: Programming Language Implementation Martin Henz March 30,

1.09k views • 40 slides
Resizable, Scalable, Concurrent Hash Tables via Relativistic Programming Josh Triplett 1 Paul E.

Resizable, Scalable, Concurrent Hash Tables via Relativistic Programming Josh Triplett 1 Paul E.

Resizable, Scalable, Concurrent Hash Tables via Relativistic Programming Josh Triplett 1 Paul E. McKenney 2 Jonathan Walpole 1 1 Portland State University 2 IBM Linux Technology Center June 16, 2011 Synchronization = Waiting Concurrent

989 views • 76 slides
Concurrent Programming in Harmony: Critical Sections and Locks CS 4410 Operating Systems

Concurrent Programming in Harmony: Critical Sections and Locks CS 4410 Operating Systems

Concurrent Programming in Harmony: Critical Sections and Locks CS 4410 Operating Systems [Robbert van Renesse] An Operating System is a Concurrent Program The kernel contexts of each of the processes share many data structures

1.68k views • 148 slides
CSE P 506 PARALLEL AND CONCURRENT PROGRAMMING Spring 2011

CSE P 506 PARALLEL AND CONCURRENT PROGRAMMING Spring 2011

1 3/30/11 CSE P 506 PARALLEL AND CONCURRENT PROGRAMMING Spring 2011 Course Staff Instructor: Madan Musuvathi madanm@u.washington.edu Senior

331 views • 10 slides
Protein Folding Simulation in Concurrent Constraint Programming Luca Bortolussi, Alessandro Dal

Protein Folding Simulation in Concurrent Constraint Programming Luca Bortolussi, Alessandro Dal

Protein Folding Simulation in Concurrent Constraint Programming Luca Bortolussi, Alessandro Dal Pal` u, Agostino Dovier DIMI, Univ. of Udine (IT) Federico Fogolari DST, Univ. of Verona (IT) Outline of the talk Introduction Concurrent

399 views • 20 slides
CPSC 213 Concurrent Programming with Threads 2ed: 12.3 1ed: 13.3 Introduction to

CPSC 213 Concurrent Programming with Threads 2ed: 12.3 1ed: 13.3 Introduction to

Reading Text CPSC 213 Concurrent Programming with Threads 2ed: 12.3 1ed: 13.3 Introduction to Computer Systems Unit 2b Threads 1 2 The Virtual Processor Illusion of Synchrony Originated with Edsger Dijkstra in the THE

378 views • 9 slides
Concurrent Logic Programming This lecture will cover: synchronization through shared

Concurrent Logic Programming This lecture will cover: synchronization through shared

06 25433 Logic Programming Concurrent Logic Programming This lecture will cover: synchronization through shared variables; dont care non -determinism; reactive v. transformational systems. 06 25433 Logic Programming A new

711 views • 28 slides
CPSC 213 Concurrent Programming With Threads 2nd: 12.3 1st: 13.3 Introduction to

CPSC 213 Concurrent Programming With Threads 2nd: 12.3 1st: 13.3 Introduction to

Readings for These Next Four Lectures Text CPSC 213 Concurrent Programming With Threads 2nd: 12.3 1st: 13.3 Introduction to Computer Systems Unit 2b Virtual Processors 1 2 The Virtual Processor Thread Originated with

232 views • 8 slides

More recommend