introduction
play

Introduction Inter Process Communication (IPC) is the heart of - PDF document

Jun 24, 2023 •301 likes •543 views

Lecturer: Hadi Salimi Lecturer: Hadi Salimi Distributed Systems Lab, School of Computer Engineering I Iran University of Science and Technology, U i i f S i d T h l hsalimi@iust.ac.ir Introduction Inter Process Communication (IPC) is

  1. Lecturer: Hadi Salimi Lecturer: Hadi Salimi Distributed Systems Lab, School of Computer Engineering I Iran University of Science and Technology, U i i f S i d T h l hsalimi@iust.ac.ir Introduction � Inter ‐ Process Communication (IPC) is the heart of distributed systems. � The underlying technology to support communication is the network technology. the network technology. � Unlike simple passing of data packets on a network, p p g p distributed systems need more advanced communication styles, such as: � Remote Procedure Calls (RPCs) � Remote Procedure Calls (RPCs) � Message Passing (MOMs) � Streaming � …

  2. Layered Protocols � Due to the lack of shared memory, communication in distributed systems is performed using message passing. � It means: � A process prepares its data in a buffer � Then it executes a system call. � And the same for the receiver. � Many agreements need to communicate: � From the way data is expresses � From the way data is expresses. � … � To the voltage for representing 0 or 1. g p g ISO OSI Layers, interfaces, and protocols in the OSI model

  3. Layered Protocols A typical message as it appears on the network A typical message as it appears on the network Types of Communication � Consider a e ‐ mail system � Take the whole system as a middleware � Communication is persistent C i ti i i t t � Communication is asynchronous

  4. Remote Procedure Calls � In 1984, Barrel and Nelson, proposed the idea of Remote Procedure Calls (RPCs). � Allowing processes to call functions available on other machines. h � The RPC, has many challenges: Th RPC h h ll � Processes run on different address spaces. � Platforms may differ � Platforms may differ. � … Example � Consider a case which is a call to a function: Count = read(fd , buf , nbytes) f f y � The simply reads a file fd into a buffer. � nbytes show that how many buffers has been read. � See the status of stack after this call.

  5. Stack State � The stack after calling the read procedure. � Any comments about the order of parameters? y p Parameter Passing � Some parameters the previous example are passed by value and some by reference. � In addition, some languages use call by copy/restore. Do you know what is it? you know what is it? � They are important for C programmers. y p p g � They are important for RPC designers as well. � In addition, different languages use different calling styles styles.

  6. Steps � The client procedure calls the client stub in the normal way. � The client stub builds a message and calls the local operating system. � The client’s OS sends the message to the remote OS. � Th � The remote OS gives the message to the server stub. t OS i th t th t b � The server stub unpacks the parameters and calls the server. � The server does the work and returns the result to the stub The server does the work and returns the result to the stub. � The server stub packs it in a message and calls its local OS. � The server’s OS sends the message to the client’s OS. g � The client’s OS gives the message to the client stub. � The stub unpacks the result and returns to the client. Stubs � A RPC should seem like an ordinary call to users. � Client and server stubs bring this transparency for users � Client and server stubs bring this transparency for users. � This example is a synchronous communication.

  7. Parameter Passing � The client stub should pack the parameters and send them to the sever. Passing Parameters � A big challenge in parameter passing is the different representation of words on different machines. � See what happens in passing � See what happens in passing two words from a Pentium architecture to SPARC.

  8. Passing by Reference � What is the problem with passing pointers to a remote machine? � To emulate this call by reference, we should copy the whole array to a buffer and send it over the network. h l b ff d d h k � Is it a good idea? I i d id ? � What about a pointer to a big data structure, like a graph? � Wh t b t i t t bi d t t t lik h? Parameter Specification � The client and server should agree with the specification of messages. � This should be reached using h h ld b h d client and server stubs. � As you will see, client and server stub could be generated using a stub could be generated using a compiler.

  9. Example: DCE RPC A Question � Why in a IDL, the input, output and input ‐ output parameters should be specified explicitly?

  10. Asynchronous RPC � There is no need to block the client, when no result is going to be returned. Traditional RPC Asynchronous RPC Deferred Synchronous RPC � In many cases, the server returns a result, but the client cannot wait it. � This could happen using two asynchronous calls.

  11. Client Server Binding in DCE Client ‐ Server Binding in DCE RMI � Like RPC, Remote Method Invocation (RMI) is a special calling between distributed objects. � Some languages such as Java, support this feature. � The same techniques described for RPC, such as IDLs and stubs are valid for RMI too. t b lid f RMI t

  12. Message Passing � RPC and RMI could provide transparency for communication challenge of distributed systems. � But unfortunately, the both sides should be executing at the same time. h � To solve this issue, the messaging technology could be T l hi i h i h l ld b helpful. Sockets � Primitives of a TCP/IP socket � Primitives of a TCP/IP socket.

  13. Communication by Sockets � Communication using sockets Sockets � Pros: � Too simple � Are efficient � Cons: � Not too abstract � Lack most needs of today’s HPC environments � Are protocol specific A t l ifi

  14. MPI � The need for a hardware and platform independent programming interface, led to standardization of Message Passing Interface or MPI Passing Interface or MPI. � In this standard, each process could be represented by a In this standard, each process could be represented by a tuple, namely, (GroupId , ProcessId) � This standard includes more than 100 primitives for: � Scattering data � Gathering dada � Gathering dada � Getting the group id � … MPI Primitives � Some basic primitives of MPI

  15. Message Queuing � They provide support for persistent communication. � The underlying middleware is usually called a Message Oriented Middleware or MOM. � The simple idea is to put the message for another process in a queue. The receiver will pick up the message as soon i Th i ill i k th as it become online. Message ‐ Queuing Model (1) � Loosely coupled communication by � Loosely coupled communication by means of message queues

  16. Interface of MOMs � The basic primitives for a message queuing system Queue Level addressing � The scenario in which a process send a message to Th i i hi h d t another queue.

  17. General Architecture � General architecture of a message queuing system with g q g y routers Message Brokers � An important application area of message ‐ queuing systems is integrating new and legacy applications. � It needs they have the same message format. � Two approaches could be applied: � Agree on a standard format d d f � Use a message broker

  18. Message Brokers � General organization of a message broker used in message g g g queuing systems. Some Notes � The idea of message queuing systems has long been used in email systems. � But there are differences: � In email systems routing is generally left out � In addition, they are aimed at providing direct support for end users end users. � There are special features in message queue systems that There are special features in message queue systems that there is no need for them in email systems, such as message priorities or guaranteed message delivery.

  19. Data Streams � There are forms of communication in which timing plays a crucial role. � As an example, suppose that an audio stream should be transferred through a communication channel. � Playing out in a different rate, will produce and incorrect version of the original sound. g � The same is true for a video clip in which at least 20 ‐ 25 frames should be displayed in a second should be displayed in a second. � For discrete media, i.e. images and text this is not true, but for continuous media this is valid. ti di thi i lid Stream Transmission � Asynchronous: � Data items are transmitted one after another and there are no further time constraints. f th ti t i t � File transmission � Synchronous: Synchronous: � There is always a maximum end ‐ to ‐ end delay. � Sensor Data or DSMSs � Isochronous: � Data transfer is subject to a ma imum and minimum dela � Data transfer is subject to a maximum and minimum delay, also referred t as bounded delay (jitter). � Audio and video streams

  20. Streams � Simple: � Consists only one sequence of data. � A non ‐ stereo audio stream � Complex: � Consists of several simple streams, called sub ‐ streams � Streams of video, sound, subtitle, etc. S f id d b i l General Architecture � General architecture of a data streaming system � General architecture of a data streaming system

Recommend

INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION

INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION

TRAINING COURSE ON SOCIAL PROTECTION & FORMALIZATION TRINIDAD AND TOBAGO MARCH 15, 2017 INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION Design of the NIS Assistance from the

547 views • 23 slides
INTRODUCTION Introduction 2/42 INTRODUCTION Alternations I am giving bread to the

INTRODUCTION Introduction 2/42 INTRODUCTION Alternations I am giving bread to the

Patterns of variation in the expression of case and agreement Andrs Brny Leiden University Centre for Linguistics 9 November 2019, BaSIS Workshop a.barany@hum.leidenuniv.nl INTRODUCTION Introduction 2/42 INTRODUCTION

1.37k views • 42 slides
Introduction Introduction Introduction Introduction Outline Motivation Failures

Introduction Introduction Introduction Introduction Outline Motivation Failures

Introduction Introduction Introduction Introduction Outline Motivation Failures Definition and concepts Process and product properties Principles SE Approaches Motivation Software and the economy The economies of

1.03k views • 49 slides
Introduction Introduction Introduction Nationwide Cause for Concern 1

Introduction Introduction Introduction Nationwide Cause for Concern 1

Introduction Introduction Introduction Nationwide Cause for Concern 1 https://www.cdc.gov/std/stats17/infographic.htm Introduction Epidemiology in Western Colorado CPHE Surveillance Data Report, May 2018 Chlamydia Epidemiology in Western

977 views • 39 slides
DAQ introduction Purpose of this talk : (1) Introduction for those who have not been in every

DAQ introduction Purpose of this talk : (1) Introduction for those who have not been in every

DAQ introduction Purpose of this talk : (1) Introduction for those who have not been in every meeting (2) Some ideas of diagrams for section 7.1 (Introduction) of TP. Giles Barr 25 Jan 2018, Pembroke College On DUNE, the reality is there is a

474 views • 10 slides
INTRODUCTION cf. Schneider, Chapter 1 INTRODUCTION THEY ARE OUT TO GET YOU INTRODUCTION WHAT

INTRODUCTION cf. Schneider, Chapter 1 INTRODUCTION THEY ARE OUT TO GET YOU INTRODUCTION WHAT

ADVANCED COMPUTER SECURITY INTRODUCTION cf. Schneider, Chapter 1 INTRODUCTION THEY ARE OUT TO GET YOU INTRODUCTION WHAT IS SECURITY? A systems security policies describe What the system is supposed to do Store and provide access

479 views • 16 slides
Overview Introduction to SMIL Introduction to W3C and XML Introduction to SMIL

Overview Introduction to SMIL Introduction to W3C and XML Introduction to SMIL

Overview Introduction to SMIL Introduction to W3C and XML Introduction to SMIL Writing a SMIL file Adding Media Objects Martin Halvey Clipping media files January 2008 Timing and Synchronising Layout World Wide

387 views • 14 slides
14 Introduction Introduction Bad guys can put malware into Example: hosts

14 Introduction Introduction Bad guys can put malware into Example: hosts

Introduction Introduction source Encapsulation ISO/OSI reference model message M application segment H t H t M transport network datagram H n H n H t M presentation: allow applications to frame link H l H n H t M interpret

583 views • 4 slides
Previous Lecture Introduction to SMIL 2 Introduction to W3C and XML Introduction to SMIL

Previous Lecture Introduction to SMIL 2 Introduction to W3C and XML Introduction to SMIL

Previous Lecture Introduction to SMIL 2 Introduction to W3C and XML Introduction to SMIL Writing a SMIL file Adding Media Objects Martin Halvey Clipping media files January 2008 Timing and Synchronising Layout

322 views • 8 slides
Lecture 1 Andreas Habegger Introduction Zynq Introduction Zynq Introduction Zynq PS vs. PL

Lecture 1 Andreas Habegger Introduction Zynq Introduction Zynq Introduction Zynq PS vs. PL

Introduction Zynq Lecture 1 Andreas Habegger Introduction Zynq Introduction Zynq Introduction Zynq PS vs. PL Processing System Processor Peripherals Data Buses AXI Bus Conclusion BTE5380 - Embedded Systems Octobre 2014 Andreas Habegger

1.81k views • 30 slides
2018.06 01 SMILE5 Introduction S E 5 02 Alpha Cloud M I L 03 Company Introduction 04

2018.06 01 SMILE5 Introduction S E 5 02 Alpha Cloud M I L 03 Company Introduction 04

2018.06 01 SMILE5 Introduction S E 5 02 Alpha Cloud M I L 03 Company Introduction 04 Project References S E 5 PART.1 SMILE5 Introduction M I L Introduction STORION-SMILE5 Residential Energy Storage System Inverter 5kW Output Input

1.06k views • 25 slides
Introduction to CICS Course introduction Course introduction What is CICS? What is an

Introduction to CICS Course introduction Course introduction What is CICS? What is an

Introduction to CICS Course introduction Course introduction What is CICS? What is an application server? Why use an application server? Course introduction Services provided by CICS How CICS applications are defined Scaling CICS to meet

1.84k views • 146 slides
Network Visualization Introduction Presented by Shahed Introduction Introduction Basic

Network Visualization Introduction Presented by Shahed Introduction Introduction Basic

Network Visualization Introduction Presented by Shahed Introduction Introduction Basic building blocks Node Links (relationship between nodes) Spatial information Network data

584 views • 9 slides
Introduction Introduction (1) Main argument of the paper: universities are not only

Introduction Introduction (1) Main argument of the paper: universities are not only

Le jugement des pairs comme outil de management des universits Peer-review as a management tool Christine Musselin (CSO, Sciences Po et CNRS) Avril 2013, Lirrsistible ascension du capitalisme acadmique Introduction Introduction (1)

590 views • 28 slides
Introduction Introduction to storage and to storage and filesystems filesystems Introduction

Introduction Introduction to storage and to storage and filesystems filesystems Introduction

Moreno Baricevic Gilberto Daz Axel Kohlmeyer Stefano Cozzini ULA ICTP CNR-IOM DEMOCRITOS Merida, VENEZUELA Trieste, ITALY Trieste, ITALY Introduction Introduction to storage and to storage and filesystems filesystems Introduction

1.19k views • 51 slides
JABLOTRON JA-100 introduction November 2011 Introduction Todays goals First introduction of

JABLOTRON JA-100 introduction November 2011 Introduction Todays goals First introduction of

JABLOTRON JA-100 introduction November 2011 Introduction Todays goals First introduction of the brand new JA-100 alarm system Visions Basic architecture System components Setting Help us with final validations You are the FIRST ones

1.69k views • 111 slides
1 Introduction Introduction Communication System Baseband an adjective that describes

1 Introduction Introduction Communication System Baseband an adjective that describes

Introduction Introduction Physical Layer Mobile network Global ISP Provides the means to transmit bits Basic Concepts of from sender to receiver, Data Transmission Defines the mechanical, electrical, and Home network timing

463 views • 7 slides
Welcome! Todays Agenda: Topic Introduction Course Introduction Team Practical

Welcome! Todays Agenda: Topic Introduction Course Introduction Team Practical

INFOGR Computer Graphics Jacco Bikker - April-July 2015 - Lecture 1: Introduction Welcome! Todays Agenda: Topic Introduction Course Introduction Team Practical Details Assignments Field Study State of

869 views • 62 slides
Introduction (00) RNDr. Martin Madaras, PhD. madaras@skeletex.xyz Introduction Introduction

Introduction (00) RNDr. Martin Madaras, PhD. madaras@skeletex.xyz Introduction Introduction

Virtual and Augmented Reality Introduction (00) RNDr. Martin Madaras, PhD. madaras@skeletex.xyz Introduction Introduction Who am I? What do I do here? 2 About me Short research bio: - 2014 - finished PhD at FMFI UK - 2014 2016 -

1.3k views • 39 slides
PRESENTATION The Introduction What is the Introduction ? The introduction prepares the audience

PRESENTATION The Introduction What is the Introduction ? The introduction prepares the audience

PRESENTATION The Introduction What is the Introduction ? The introduction prepares the audience for your presentation. It tells them what your presentation is about, why it is important, and finally, what to listen for in your speech. Get the

505 views • 3 slides
How to make a presentation with L A T EX? Introduction to L A T EX Introduction to Beamer

How to make a presentation with L A T EX? Introduction to L A T EX Introduction to Beamer

Introduction to Beamer Hafida Benhidour How to make a presentation with L A T EX? Introduction to L A T EX Introduction to Beamer Introduction to Beamer Hafida Benhidour Department of computer science King Saud University November

732 views • 49 slides
Shenzhen Cuilu jewelry Co., Ltd was founded in 1996 and its a large private enterprise

Shenzhen Cuilu jewelry Co., Ltd was founded in 1996 and its a large private enterprise

Introduction Introduction - - Brief Brief Introduction Introduction of of Cuilu Cuilu Group Group Introduction Introduction - - Brief Brief Introduction Introduction of of Cuilu Cuilu Group Group Shenzhen Cuilu jewelry Co., Ltd

147 views • 14 slides
Introduction to ICS- -214 214 Introduction to ICS Official Unit / Incident Log - A V-C-N.org

Introduction to ICS- -214 214 Introduction to ICS Official Unit / Incident Log - A V-C-N.org

V olunteer C ommunications N etwork (V-C-N.org) Introduction to ICS- -214 214 Introduction to ICS Official Unit / Incident Log - A V-C-N.org Academy Course - 2012-02.24-2208 262: Introduction to ICS-214 : V-C-N.org : Slide: 1 V olunteer C

735 views • 34 slides
Introduction to ICS- -214 214 Introduction to ICS Official Unit / Incident Log - A V-C-N.org

Introduction to ICS- -214 214 Introduction to ICS Official Unit / Incident Log - A V-C-N.org

V olunteer C ommunications N etwork (V-C-N.org) Introduction to ICS- -214 214 Introduction to ICS Official Unit / Incident Log - A V-C-N.org Academy Course - 2012-02.24-2208 262: Introduction to ICS-214 : V-C-N.org : Slide: 1 V olunteer C

558 views • 18 slides

More recommend