automatically comparing memory consistency models
play

Automatically Comparing Memory Consistency Models John Wickerson - PowerPoint PPT Presentation

Feb 13, 2023 •940 likes •1.72k views

C++ x86 Automatically Comparing Memory Consistency Models John Wickerson Mark Batty Tyler Sorensen George A. Constantinides Imperial U Kent Imperial Imperial S-REPLS @ Imperial Tuesday 27 September 2016 1 Contents Context: memory

  1. C++ x86 Automatically Comparing Memory Consistency Models John Wickerson Mark Batty Tyler Sorensen George A. Constantinides Imperial U Kent Imperial Imperial S-REPLS @ Imperial Tuesday 27 September 2016 1

  2. Contents • Context: memory consistency models (MCMs) • Where our work fits in • Key Ideas • Applications 2

  3. Contents • Context: memory consistency models (MCMs) • Where our work fits in • Key Ideas • Applications 3

  4. Relaxed-memory behaviours x = y = 0; x = 1; y = 1; r0 = y; r1 = x; 4

  5. Relaxed-memory behaviours x = y = 0; x = 1; r0 = y; y = 1; r1 = x; r0 = 0, r1 = 1 5

  6. Relaxed-memory behaviours x = y = 0; x = 1; y = 1; r0 = y; r1 = x; r0 = 0, r1 = 1 r0 = 1, r1 = 1 6

  7. Relaxed-memory behaviours x = y = 0; y = 1; r1 = x; x = 1; r0 = y; r0 = 0, r1 = 1 r0 = 1, r1 = 1 r0 = 1, r1 = 0 7

  8. Relaxed-memory behaviours x = y = 0; x = 1; y = 1; r0 = y; r1 = x; r0 = 0, r1 = 0 r0 = 0, r1 = 1 r0 = 1, r1 = 1 r0 = 1, r1 = 0 8

  9. Much confusion! Subtleties related to relaxed memory have led to bugs in... • programming language specifications 
 [Batty+ POPL'11, Batty+ ESOP'13] , • deployed processors [Alglave+ CAV'10] ; • compilers [Morisset+ PLDI'13, Sevcik+ ECOOP'08] , and • vendor-endorsed programming guides 
 [Alglave+ ASPLOS'15] . 9

  10. Axiomatic models x = 1; y = 1; r0 = y; r1 = x; 10

  11. Axiomatic models W x=1 W y=1 sb rf sb R y=1 R x=0 x = 1; y = 1; r0 = y; r1 = x; 11

  12. Axiomatic models W x=1 W y=1 W x=1 W y=1 sb rf sb sb rf sb R y=1 R x=0 R y=0 R x=1 x = 1; y = 1; r0 = y; r1 = x; 12

  13. Axiomatic models W x=1 W y=1 W x=1 W y=1 sb rf sb sb rf sb R y=1 R x=0 R y=0 R x=1 x = 1; y = 1; r0 = y; r1 = x; W x=1 W y=1 sb rf rf sb R y=1 R x=1 13

  14. Axiomatic models W x=1 W y=1 W x=1 W y=1 sb rf sb sb rf sb R y=1 R x=0 R y=0 R x=1 x = 1; y = 1; r0 = y; r1 = x; W x=1 W y=1 W x=1 W y=1 sb rf rf sb sb sb R y=1 R x=1 R y=0 R x=0 14

  15. Axiomatic models W x=1 W y=1 W x=1 W y=1 sb rf sb sb rf sb R y=1 R x=0 R y=0 R x=1 SC ✓ x = 1; y = 1; r0 = y; r1 = x; W x=1 W y=1 W x=1 W y=1 sb rf rf sb sb sb R y=1 R x=1 R y=0 R x=0 15

  16. Axiomatic models W x=1 W y=1 W x=1 W y=1 sb rf sb sb rf sb R y=1 R x=0 R y=0 R x=1 SC ✓ SC ✓ x = 1; y = 1; r0 = y; r1 = x; W x=1 W y=1 W x=1 W y=1 sb rf rf sb sb sb R y=1 R x=1 R y=0 R x=0 16

  17. Axiomatic models W x=1 W y=1 W x=1 W y=1 sb rf sb sb rf sb R y=1 R x=0 R y=0 R x=1 SC ✓ SC ✓ x = 1; y = 1; r0 = y; r1 = x; W x=1 W y=1 W x=1 W y=1 sb rf rf sb sb sb R y=1 R x=1 R y=0 R x=0 SC ✓ 17

  18. Axiomatic models W x=1 W y=1 W x=1 W y=1 sb rf sb sb rf sb R y=1 R x=0 R y=0 R x=1 SC ✓ SC ✓ x = 1; y = 1; r0 = y; r1 = x; W x=1 W y=1 W x=1 W y=1 sb rf rf sb sb sb R y=1 R x=1 R y=0 R x=0 SC ✓ SC × 18

  19. Axiomatic models W x=1 W y=1 W x=1 W y=1 sb rf sb sb rf sb R y=1 R x=0 R y=0 R x=1 x86 ✓ SC ✓ SC ✓ x = 1; y = 1; r0 = y; r1 = x; W x=1 W y=1 W x=1 W y=1 sb rf rf sb sb sb R y=1 R x=1 R y=0 R x=0 SC ✓ SC × 19

  20. Axiomatic models W x=1 W y=1 W x=1 W y=1 sb rf sb sb rf sb R y=1 R x=0 R y=0 R x=1 x86 ✓ SC ✓ x86 ✓ SC ✓ x = 1; y = 1; r0 = y; r1 = x; W x=1 W y=1 W x=1 W y=1 sb rf rf sb sb sb R y=1 R x=1 R y=0 R x=0 SC ✓ SC × 20

  21. Axiomatic models W x=1 W y=1 W x=1 W y=1 sb rf sb sb rf sb R y=1 R x=0 R y=0 R x=1 x86 ✓ SC ✓ x86 ✓ SC ✓ x = 1; y = 1; r0 = y; r1 = x; W x=1 W y=1 W x=1 W y=1 sb rf rf sb sb sb R y=1 R x=1 R y=0 R x=0 x86 ✓ SC ✓ SC × 21

  22. Axiomatic models W x=1 W y=1 W x=1 W y=1 sb rf sb sb rf sb R y=1 R x=0 R y=0 R x=1 x86 ✓ SC ✓ x86 ✓ SC ✓ x = 1; y = 1; r0 = y; r1 = x; W x=1 W y=1 W x=1 W y=1 sb rf rf sb sb sb R y=1 R x=1 R y=0 R x=0 x86 ✓ SC ✓ x86 ✓ SC × 22

  23. Contents • Context: memory consistency models (MCMs) • Where our work fits in • Key Ideas • Applications 23

  24. Some challenges and current approaches to tackling them Question Existing work 24

  25. Some challenges and current approaches to tackling them Question Existing work Can a given litmus test pass under a given MCM? 25

  26. Some challenges and current approaches to tackling them Question Existing work Can a given litmus test pass CppMem, Herd, MemSAT, Nemos, ... under a given MCM? 26

  27. Some challenges and current approaches to tackling them Question Existing work Can a given litmus test pass CppMem, Herd, MemSAT, Nemos, ... under a given MCM? Which litmus tests can be run to check whether a machine conforms to a given MCM? 27

  28. Some challenges and current approaches to tackling them Question Existing work Can a given litmus test pass CppMem, Herd, MemSAT, Nemos, ... under a given MCM? Which litmus tests can be run semi-automatic generation 
 to check whether a machine with DIY [Alglave+ CAV'10]; 
 conforms to a given MCM? 28

  29. Some challenges and current approaches to tackling them Question Existing work Can a given litmus test pass CppMem, Herd, MemSAT, Nemos, ... under a given MCM? Which litmus tests can be run semi-automatic generation 
 to check whether a machine with DIY [Alglave+ CAV'10]; 
 conforms to a given MCM? Is one MCM more permissive than another? 29

  30. Some challenges and current approaches to tackling them Question Existing work Can a given litmus test pass CppMem, Herd, MemSAT, Nemos, ... under a given MCM? Which litmus tests can be run semi-automatic generation 
 to check whether a machine with DIY [Alglave+ CAV'10]; 
 conforms to a given MCM? manual proof; manual examples [Batty+ POPL'16] ; 
 Is one MCM more permissive semi-automatic checking with DIY+Herd; than another? 30

  31. Some challenges and current approaches to tackling them Question Existing work Can a given litmus test pass CppMem, Herd, MemSAT, Nemos, ... under a given MCM? Which litmus tests can be run semi-automatic generation 
 to check whether a machine with DIY [Alglave+ CAV'10]; 
 conforms to a given MCM? manual proof; manual examples [Batty+ POPL'16] ; 
 Is one MCM more permissive semi-automatic checking with DIY+Herd; than another? Does my MCM allow a given compiler optimisation? 31

  32. Some challenges and current approaches to tackling them Question Existing work Can a given litmus test pass CppMem, Herd, MemSAT, Nemos, ... under a given MCM? Which litmus tests can be run semi-automatic generation 
 to check whether a machine with DIY [Alglave+ CAV'10]; 
 conforms to a given MCM? manual proof; manual examples [Batty+ POPL'16] ; 
 Is one MCM more permissive semi-automatic checking with DIY+Herd; than another? manual c'examples [Vafeiaidis+ POPL'15] ; 
 Does my MCM allow a given manual proof [Sevcik PLDI'11]; 
 compiler optimisation? 32

  33. Some challenges and current approaches to tackling them Question Existing work Can a given litmus test pass CppMem, Herd, MemSAT, Nemos, ... under a given MCM? Which litmus tests can be run semi-automatic generation 
 to check whether a machine with DIY [Alglave+ CAV'10]; 
 conforms to a given MCM? manual proof; manual examples [Batty+ POPL'16] ; 
 Is one MCM more permissive semi-automatic checking with DIY+Herd; than another? manual c'examples [Vafeiaidis+ POPL'15] ; 
 Does my MCM allow a given manual proof [Sevcik PLDI'11]; 
 compiler optimisation? Does my MCM allow a given compiler mapping? 33

  34. Some challenges and current approaches to tackling them Question Existing work Can a given litmus test pass CppMem, Herd, MemSAT, Nemos, ... under a given MCM? Which litmus tests can be run semi-automatic generation 
 to check whether a machine with DIY [Alglave+ CAV'10]; 
 conforms to a given MCM? manual proof; manual examples [Batty+ POPL'16] ; 
 Is one MCM more permissive semi-automatic checking with DIY+Herd; than another? manual c'examples [Vafeiaidis+ POPL'15] ; 
 Does my MCM allow a given manual proof [Sevcik PLDI'11]; 
 compiler optimisation? manual c'examples [Wickerson+ OOPSLA'15] ; 
 Does my MCM allow a given manual proof [Batty+ POPL'11, Batty+ POPL'12]; 
 compiler mapping? 34

  35. Our contributions Question Existing work Can a given litmus test pass CppMem, Herd, MemSAT, Nemos, ... under a given MCM? Which litmus tests can be run semi-automatic generation 
 to check whether a machine with DIY [Alglave+ CAV'10]; 
 conforms to a given MCM? manual proof; manual examples [Batty+ POPL'16] ; 
 Is one MCM more permissive semi-automatic checking with DIY+Herd; than another? manual c'examples [Vafeiaidis+ POPL'15] ; 
 Does my MCM allow a given manual proof [Sevcik PLDI'11]; compiler optimisation? manual c'examples [Wickerson+ OOPSLA'15] ; 
 Does my MCM allow a given manual proof [Batty+ POPL'11, Batty+ POPL'12]; compiler mapping? 35

Recommend

Memory Consistency Models CSE 451 James Bornholt Memory consistency models The short version:

Memory Consistency Models CSE 451 James Bornholt Memory consistency models The short version:

Memory Consistency Models CSE 451 James Bornholt Memory consistency models The short version: Multiprocessors reorder memory operations in unintuitive, scary ways This behavior is necessary for performance Application programmers

803 views • 36 slides
Shared Memory Consistency Models: A Tutorial By Sarita Adve, Kourosh Gharachorloo WRL

Shared Memory Consistency Models: A Tutorial By Sarita Adve, Kourosh Gharachorloo WRL

Shared Memory Consistency Models: A Tutorial By Sarita Adve, Kourosh Gharachorloo WRL Research Report, 1995 Presentation: Vince Schuster Contents Overview Uniprocessor Review Sequential Consistency Relaxed Memory Models

598 views • 25 slides
Memory Consistency Models Adam Wierman Daniel Neill Adve, Pai, and Ranganathan. Recent advances

Memory Consistency Models Adam Wierman Daniel Neill Adve, Pai, and Ranganathan. Recent advances

Memory Consistency Models Adam Wierman Daniel Neill Adve, Pai, and Ranganathan. Recent advances in memory consistency models for hardware shared-memory systems, 1999. Gniady, Falsafi, and Vijaykumar . Is SC+ILP=RC? , 1999. Hill. Multiprocessors

405 views • 25 slides
Memory consistency models Computer Architecture J. Daniel Garca Snchez (coordinator) David

Memory consistency models Computer Architecture J. Daniel Garca Snchez (coordinator) David

Memory consistency models Memory consistency models Computer Architecture J. Daniel Garca Snchez (coordinator) David Expsito Singh Francisco Javier Garca Blas ARCOS Group Computer Science and Engineering Department University Carlos

520 views • 50 slides
CSC2/458 Parallel and Distributed Systems Parallel Memory Systems Consistency Sreepathi Pai

CSC2/458 Parallel and Distributed Systems Parallel Memory Systems Consistency Sreepathi Pai

CSC2/458 Parallel and Distributed Systems Parallel Memory Systems Consistency Sreepathi Pai February 8, 2018 URCS Outline Memory Consistency Programming on Relaxed Consistency Machines Memory Models for Languages Special Relativity

375 views • 36 slides
Lecture 27: Pot-Pourri Todays topics: Consistency Models Shared memory vs

Lecture 27: Pot-Pourri Todays topics: Consistency Models Shared memory vs

Lecture 27: Pot-Pourri Todays topics: Consistency Models Shared memory vs message-passing Simultaneous multi-threading (SMT) GPUs Accelerators Disks and reliability 1 Coherence Vs. Consistency Recall that

630 views • 31 slides
Synthesizing Memory Models from Framework Sketches and Litmus Tests James Bornholt Emina

Synthesizing Memory Models from Framework Sketches and Litmus Tests James Bornholt Emina

Synthesizing Memory Models from Framework Sketches and Litmus Tests James Bornholt Emina Torlak University of Washington Memory consistency models define memory reordering behaviors on mul>processors Memory consistency models define

1.06k views • 86 slides
Weak memory models INF4140 - Models of concurrency Weak memory models Fall 2016 30. 10. 2016

Weak memory models INF4140 - Models of concurrency Weak memory models Fall 2016 30. 10. 2016

Weak memory models INF4140 - Models of concurrency Weak memory models Fall 2016 30. 10. 2016 Overview Weak memory models 1 Introduction 2 Hardware architectures Compiler optimizations Sequential consistency Weak memory models 3 TSO

1.3k views • 87 slides
Todays Topics - Distributed Shared Memory The Shared Memory Abstraction, why? Approaches

Todays Topics - Distributed Shared Memory The Shared Memory Abstraction, why? Approaches

Distributed Systems Lecture 6 1 Todays Topics - Distributed Shared Memory The Shared Memory Abstraction, why? Approaches to implementation; Consistency Models: Slide 1 Strict Consistency; Sequential Consistency Release

271 views • 12 slides
Memory Consistency Models Nima Honarmand Fall 2015 :: CSE 610 Parallel Computer Architectures

Memory Consistency Models Nima Honarmand Fall 2015 :: CSE 610 Parallel Computer Architectures

Fall 2015 :: CSE 610 Parallel Computer Architectures Memory Consistency Models Nima Honarmand Fall 2015 :: CSE 610 Parallel Computer Architectures Why Consistency Models Matter Each thread accesses two types of memory locations

859 views • 46 slides
Distributed Shared Memory Distributed Shared Memory Systems Page based

Distributed Shared Memory Distributed Shared Memory Systems Page based

Operating Systems DSM Distributed Shared Memory Distributed Shared Memory Systems Page based Shared-variable based Consistency Models Strict consistency Sequential consistency Release consistency

320 views • 11 slides
Memory Consistency Models Virendra Singh Computer Architecture & Dependable Systems Lab.

Memory Consistency Models Virendra Singh Computer Architecture & Dependable Systems Lab.

Memory Consistency Models Virendra Singh Computer Architecture & Dependable Systems Lab. Dept. of Electrical Engineering Indian Institute of Technology Bombay Courtesy: Sarita Adve University of Illinois at Urbana-Champaign CS-683:

2.14k views • 71 slides
Replication and Consistency Setting: Concurrent threads accessing shared data Roland Meyer (TU

Replication and Consistency Setting: Concurrent threads accessing shared data Roland Meyer (TU

Replication and Consistency in and hardware general memory consistency models in particular Roland Meyer Technische Universit at Kaiserslautern Roland Meyer (TU KL) Replication and Consistency IFIP WG 2.2 09/2016 1 / 32

1.76k views • 150 slides
COMP 633 - Parallel Computing Lecture 12 September 17, 2020 CC-NUMA (2) Memory Consistency

COMP 633 - Parallel Computing Lecture 12 September 17, 2020 CC-NUMA (2) Memory Consistency

COMP 633 - Parallel Computing Lecture 12 September 17, 2020 CC-NUMA (2) Memory Consistency Reading Patterson & Hennesey, Computer Architecture (2 nd Ed.) secn 8.6 a condensed treatment of consistency models COMP 633 - Prins

304 views • 17 slides
Distributed Shared Memory Shared memory : difficult to realize vs . easy to program with.

Distributed Shared Memory Shared memory : difficult to realize vs . easy to program with.

CSCE 613 : Operating Systems Memory Models CSCE 613: Interlude: Distributed Shared Memory Shared Memory Systems Consistency Models Distributed Shared Memory Systems page based shared-variable based Reading (old!):

679 views • 21 slides
CS6354: Memory models 1 To read more This days papers: Adve and Gharachorloo, Shared

CS6354: Memory models 1 To read more This days papers: Adve and Gharachorloo, Shared

CS6354: Memory models 1 To read more This days papers: Adve and Gharachorloo, Shared Memory Consistency Models: A Tutorial Boehm and Adve, Foundations of the C++ Concurrency Memory Model, section 1 only Supplementary

859 views • 44 slides
Verification with the Check suite Yatin Manerkar Princeton University ARM Cambridge, July 20 th ,

Verification with the Check suite Yatin Manerkar Princeton University ARM Cambridge, July 20 th ,

Automated Full-Stack Memory Model Verification with the Check suite Yatin Manerkar Princeton University ARM Cambridge, July 20 th , 2018 http:/ ://check.cs.p .princeton.edu/ What are Memory (Consistency) Models? Memory Consistency Models

2.2k views • 192 slides
Consistency of RTL Designs Yatin A. Manerkar , Daniel Lustig*, Margaret Martonosi, and Michael

Consistency of RTL Designs Yatin A. Manerkar , Daniel Lustig*, Margaret Martonosi, and Michael

RTLCheck: Verifying the Memory Consistency of RTL Designs Yatin A. Manerkar , Daniel Lustig*, Margaret Martonosi, and Michael Pellauer* Princeton University *NVIDIA MICRO-50 http:/ ://check.cs.p .princeton.edu/ Memory Consistency Models

1.11k views • 73 slides
C++ 11 Memory Consistency Model Sebastian Gerstenberg NUMA Seminar 07.01.2015 Agenda 1.

C++ 11 Memory Consistency Model Sebastian Gerstenberg NUMA Seminar 07.01.2015 Agenda 1.

C++ 11 Memory Consistency Model Sebastian Gerstenberg NUMA Seminar 07.01.2015 Agenda 1. Sequential Consistency 2. Violation of Sequential Consistency Non-Atomic Operations Instruction Reordering 3. C++ 11 Memory Consistency

554 views • 27 slides
Compiler Techniques For Memory Consistency Models Students: Xing Fang (Purdue), Jaejin Lee (Seoul

Compiler Techniques For Memory Consistency Models Students: Xing Fang (Purdue), Jaejin Lee (Seoul

Compiler Techniques For Memory Consistency Models Students: Xing Fang (Purdue), Jaejin Lee (Seoul National University), Kyungwoo Lee (Purdue), Zehra Sura (IBM T.J. Watson Research Center), David Wong (Intel KAI Research Lab) Faculty: Sam Midkiff

823 views • 38 slides
Distributed Memory and Cache Consistency Distributed Memory and Cache Consistency (some slides

Distributed Memory and Cache Consistency Distributed Memory and Cache Consistency (some slides

Distributed Memory and Cache Consistency Distributed Memory and Cache Consistency (some slides courtesy of Alvin Lebeck) Software DSM 101 Software DSM 101 Software-based distributed shared memory (DSM) provides an illusion of shared memory on

236 views • 23 slides
Distributed Memory and Cache Consistency Distributed Memory and Cache Consistency (some slides

Distributed Memory and Cache Consistency Distributed Memory and Cache Consistency (some slides

Distributed Memory and Cache Consistency Distributed Memory and Cache Consistency (some slides courtesy of Alvin Lebeck) Software DSM 101 Software DSM 101 Software-based distributed shared memory (DSM) provides an illusion of shared memory on

414 views • 12 slides
This talk is about Data consistency in 3D Understanding consistency (Its the invariants,

This talk is about Data consistency in 3D Understanding consistency (Its the invariants,

This talk is about Data consistency in 3D Understanding consistency (Its the invariants, stupid) Primitive consistency mechanisms How primitives compose models How models relate / differ What they cost Understanding

365 views • 13 slides
Consistency of Models) 1. Big Models 2. Examples of Graphs in Models 3. Types of Graphs Prof.

Consistency of Models) 1. Big Models 2. Examples of Graphs in Models 3. Types of Graphs Prof.

Fakultt Informatik, Institut fr Software- und Multimediatechnik, Lehrstuhl fr Softwaretechnologie 12) Validation of Graph-Based Models and Programs (Analysis and Consistency of Models) 1. Big Models 2. Examples of Graphs in Models 3. Types

764 views • 74 slides

More recommend