Reliable Multicast in the STOW RTI Prototype 97S-SIW-119 Harry - - PowerPoint PPT Presentation

reliable multicast in the stow rti prototype
SMART_READER_LITE
LIVE PREVIEW

Reliable Multicast in the STOW RTI Prototype 97S-SIW-119 Harry - - PowerPoint PPT Presentation

Reliable Multicast in the STOW RTI Prototype 97S-SIW-119 Harry Wolfson <HarryWolfson@LL.MIT.EDU> Steve Boswell <Boswell@LL.MIT.EDU> Daniel J. Van Hook <dvanhook@LL.MIT.EDU> Steve McGarry <smcgarry@LL.MIT.EDU> MIT Lincoln


slide-1
SLIDE 1

Wolfson 1 97S-SIW-119

Reliable Multicast in the STOW RTI Prototype

97S-SIW-119

Harry Wolfson <HarryWolfson@LL.MIT.EDU> Steve Boswell <Boswell@LL.MIT.EDU> Daniel J. Van Hook <dvanhook@LL.MIT.EDU> Steve McGarry <smcgarry@LL.MIT.EDU> MIT Lincoln Laboratory March 6, 1997

slide-2
SLIDE 2

Wolfson 2 97S-SIW-119

Outline

  • Introduction
  • Message Transport Services
  • Reliable Multicast
  • Discovery Service
  • Emulation of Reliable Multicast in RTI-s
  • Performance Measurements
  • Summary
slide-3
SLIDE 3

Wolfson 3 97S-SIW-119

Federation using the HLA / RTI

Fe de ra te RTI C o mm Fe d e ra te RTI Co mm Fe de ra te RTI Co m m Fe de ra te RTI C o mm Fe d e ra te RTI Co mm Fe de ra te RTI C o mm

slide-4
SLIDE 4

Wolfson 4 97S-SIW-119

RTI-s Sponsors

  • Defense Modeling and Simulation Office (DMSO)

– Part of larger DoD 1.0 RTI development effort – Initial implementation of Data Distribution Management Services – Support initial use of the HLA in a large scale, real-time system

  • DARPA

– Synthetic Theater of War (STOW) program

» STOW is an Advanced Concept Technology Demonstration (ACTD) » Customer is Atlantic Command (ACOM) » An HLA based simulation system

slide-5
SLIDE 5

Wolfson 5 97S-SIW-119

RTI-s Development

  • STOW Requirements (RTI perspective)

– ~ 25 Federate classes on 350-450 host computers – 10 – 20 sites (LANs connected via a WAN) – 10,000 objects (scaleable to 100,000)

  • MIT Lincoln Laboratory is developing the

prototype RTI-s for use by STOW

– Full RTI functionality except for Time and Ownership Management – Focus on real-time performance and very large exercise scalability » Low latency, High throughput, Low bandwidth

  • verhead

– Early availability of RTI (15 Oct 96)

slide-6
SLIDE 6

Wolfson 6 97S-SIW-119

RTI-s Block Diagram

Distribution Databas e Be st Effort Minimum Ra te S tate Consistent Reliable Consistency Mana ger Consistency P rotocol Discovery P rotocol create delete update Stream Manager Transport Ma nager Update Attr, S end Interaction Refle ct Attr, Re c Interaction {

  • id, attribute_values
  • r, class , param_values }

Subs cription P rincipa l Local S ubscription Agent S ubscribe, P ublish, Assoc Regions Remove Obj, P rovide Attr Remove Obj, Provide Attr Control Updates S ubscriptions , Publications , Resources Res ource s Reques t Streams

  • f Interest

RTI Ambassador Object Ma nager { stream, data, count} UDP TCP Rel Distrib Fe d Create, Join, etc. Create, Delete Obj RTI Initializa tion Data (FED + RID) Set Trans p Mode S trea m Mappings Communication Managers {

  • id, attribute_value s
  • r, class , param_values }

Federa tion Manager Buffe r Manager

slide-7
SLIDE 7

Wolfson 7 97S-SIW-119

Message Transport Services

  • Best Effort

– Based on UDP Multicast » Permits scaling to large exercises – No mechanism for reliability or message ordering

  • Minimum Rate

– Comparable to DIS Transport mechanism

  • State Consistent

– Ensures delivery of the latest attribute value – No guarantee of intermediate message delivery

  • Reliable

– Guaranteed delivery of messages – Messages delivered in order

slide-8
SLIDE 8

Wolfson 8 97S-SIW-119

Reliable Multicast

  • Reliable Multicast Protocols

– RAMP, RMP, SOM (MTP-2) – Based on UDP to support multicast – Some provide reliability based on NACKs – May be optimized for single sender (one-to-many) – Some are optimized for a fixed set of senders and receivers

  • Emulation of Reliable Multicast in RTI-s

– Dynamic message routing based on streams – Reliability provided by use of TCP protocol – Does not consume UDP multicast groups – Multicast emulated via use of hierarchical topology of Reliable Distributors (exploders)

slide-9
SLIDE 9

Wolfson 9 97S-SIW-119

Discovery Services

  • General purpose mechanism to facilitate contact between

distributed service providers and clients

– Predates similar capability in CORBA – Supports multiple providers of same service type

  • Provider advertises its service

– Service type – Qualifier: discoverer can screen for desired value – Invariant data: constant provider info (eg. socket addr) – Variant data: time-varying provider status info

  • Client discovers available providers

– Only receives advertisements from appropriate providers – Initiates connection with provider based on information in advertisement (eg. Invariant data)

  • Clients may monitor status of providers

– Fault detection – Load balancing

slide-10
SLIDE 10

Wolfson 10 97S-SIW-119

advert ms gs Fe d e rat e DS M RTI

Se rvice s

Fe d e rat e Advert Dis cov er Monitor Reques tor

  • C A

RD S erv ices

  • RTI

DS M

Periodic Timer s end lis ten and callb ack adv ert ms gs advert ms gs advert ms gs Fe d e rat e DS M RTI

Se rvice s

advert ms gs Fe d e rat e DS M RTI

S e rvice s

Discovery Service Manager (DSM)

slide-11
SLIDE 11

Wolfson 11 97S-SIW-119

Implementation of Reliable Multicast in RTI-s

  • Based on TCP point-to-point connections
  • Reliable Distributor services a number of

clients that wish to send and / or receive reliable message traffic

  • Clients connect to appropriate Reliable

Distributor using information provided by the Discovery Service

slide-12
SLIDE 12

Wolfson 12 97S-SIW-119

Sample Network Topology for Reliable Servers / Clients

  • STOW is using fully connected mesh

– Could configure Server connections as a-cyclic tree

Fe de ra te RTI RD tcp Fe de ra te RTI tcp Fe de ra te RTI tcp LAN # 2 Fe de ra te RTI tcp RD Fe de ra te RTI tcp LAN # 1 Fe de ra te RTI RD tcp Fe d e ra te RTI tcp Fe de ra te RTI tc p LAN # 3

slide-13
SLIDE 13

Wolfson 13 97S-SIW-119

Features of RTI-s Reliable Multicast

  • Robust

– Outgoing message queue (accommodates bursty traffic) – Re-establishing connectivity (fault tolerance)

  • Provides atomic message delivery within a

stream based protocol (TCP)

– Framing of received messages – Reassembly of fragmented messages – Fragmentation of large outgoing messages

  • Configurable Server hierarchy

– Auto-configuration for small Federation Execution, or in a small scale testing environment – Configurable server / client topology for larger Federations that span LANs and WANs – Stand-alone or integrated servers

slide-14
SLIDE 14

Wolfson 14 97S-SIW-119

Performance Measurements

  • Latency

– Limits the ultimate responsiveness of a system – Defined as elapsed time between invocation of the updateAttributeValues in one Federate, and the corresponding invocation of the reflectAttributeValues method in the second Federate

  • Throughput

– Defined as the number of transactions per second that can be processed by a system on a sustained basis

slide-15
SLIDE 15

Wolfson 15 97S-SIW-119

Latency Performance

Reliable Transport Service in RTI-s

  • Dominated by Ethernet bit rate

5 0 1 0 0 1 5 0 2 0 0 1 0

1

10

2

1 0

3

1 0

4

1 0

5

3 hop la te ncy (mS e c) 2 hop la te ncy (mS e c) Latency (mSec) Me s s a g e s iz e (b yte s )

Snd Rcv RD RD

3 Sun Ultra 1/140’s and 1 SGI Onyx, using 10Mbps Ethernet Time: Snd updates, Rcv reflects, Rcv updates, Snd reflects; divide result by 2

slide-16
SLIDE 16

Wolfson 16 97S-SIW-119

1 0 0 2 0 0 3 0 0 4 0 0 5 0 0 10

1

10

2

1 0

3

1 0

4

1 0

5

pre dicte d: 10 rcvr pre dicte d: 5 rcvr pre dicte d: 3 rcvr pre dicte d: 2 rcvr me a s ure d: 1 rcvr Latency (mSec) Me s s a g e s iz e ( b yte s )

Latency Performance

with Receiver “Fan Out”

Reliable Transport Service in RTI-s

Predicted Latency for N th Receiver: L R N = L R 1 / 2 + ( N * L R 1 / 2 )

Snd RcvN RD Rcv2 Rcv1

slide-17
SLIDE 17

Wolfson 17 97S-SIW-119

Throughput Performance

Reliable Transport Service in RTI-s

1000 2000 3000 4000 1 10 100 1000 10000 10 5

messages per second m e s s a g e s iz e (byte s )

Snd Rcv RD

Ethernet-limited

  • perating region

3 Sun Ultra 1/140’s, using 10Mbps Ethernet Snd updates, Rcv reflects Rates are sustained, with no packet loss

slide-18
SLIDE 18

Wolfson 18 97S-SIW-119

Future Work

  • Continue evaluation of Reliable multicast

performance in the context of STOW

  • Deliver rti-s/C to STOW, 24 March 97
  • Merge rti-s with RTI 1.0 to create RTI 1.1
  • Re-visit evaluation of available reliable

multicast protocols

slide-19
SLIDE 19

Wolfson 19 97S-SIW-119

Summary

  • Reliable Message Transport Service in

RTI-s emulates reliable multicast protocol

– Based on TCP point-to-point connections – Reliable Distributors service clients and interconnect with other RDs – Provides adequate performance for STOW

  • Discovery Service provides mechanism

for Service providers to find each other, and for clients to find servers

– Provides connection information – Allows monitoring of providers status