two phase commit
play

Two-phase commit Doug Woos Logistics notes Problem Set 2 out - - PowerPoint PPT Presentation

Nov 17, 2023 •116 likes •642 views

Two-phase commit Doug Woos Logistics notes Problem Set 2 out - Due next Friday Next week: Paxos - Notoriously difficult topic - Please do the reading! Caching Discussion Complexity as a downside Do the scalability/performance issues

  1. Two-phase commit Doug Woos

  2. Logistics notes Problem Set 2 out - Due next Friday Next week: Paxos - Notoriously difficult topic - Please do the reading!

  3. Caching Discussion “Complexity” as a downside Do the scalability/performance issues mentioned in the paper exist today? Why do we use NFS? When is the recovery protocol executed?

  4. Review: Sharding Sharding - Different data on different servers - Partitioned via some function on keys - Implement in Lab 4! Another axis of scaling, cf. replication - Usually, shard then replicate - Each piece of data lives on one replicated shard

  5. Sharding and Transactions Adve rule we discussed lets us avoid synchronizing between shards for simple reads and writes But what if we do need to synchronize across shards? Transactions: atomic updates to multiple items - Bank account transfer - Calendar event - Unix user creation - etc.

  6. Calendar event creation I have three advisors (Tom, Zach, Mike) Want to schedule a meeting with all of them - Let’s try Tues at 11, people are usually free then Calendars all live on different nodes! Other students also trying to schedule meetings Nodes can fail, messages can be dropped (of course)

  7. Calendar event creation (wrong) Tom Mike Zach Doug

  8. Calendar event creation (wrong) Tom Mike Zach Meet at 11 on Tues Doug

  9. Calendar event creation (wrong) Tom Mike Zach OK Doug

  10. Calendar event creation (wrong) Tom Mike Zach Meeting Doug @ 11 on Tues Doug

  11. Calendar event creation (wrong) Tom Mike Zach Meeting Doug @ 11 on Tues Meet at 11 on Tues Doug

  12. Calendar event creation (wrong) Tom Mike Zach Meeting Doug @ 11 on Tues OK Doug

  13. Calendar event creation (wrong) Tom Mike Zach Meeting Doug Meeting Doug @ 11 on Tues @ 11 on Tues Doug

  14. Calendar event creation (wrong) Tom Mike Zach Meeting Doug Meeting Doug @ 11 on Tues @ 11 on Tues Meet at 11 on Tues Doug

  15. Calendar event creation (wrong) Tom Mike Zach Meeting Doug Meeting Doug @ 11 on Tues @ 11 on Tues Busy! Doug

  16. Calendar event creation (wrong) Tom Mike Zach Meeting Doug Meeting Doug @ 11 on Tues @ 11 on Tues Doug

  17. Calendar event creation (wrong) Tom Mike Zach Meeting Doug Meeting Doug @ 11 on Tues @ 11 on Tues Doug

  18. Calendar event creation (better) Tom Mike Zach Doug

  19. Calendar event creation (better) Tom Mike Zach Meet at 11 on Tues Doug

  20. Calendar event creation (better) Tom Mike Zach OK Doug

  21. Calendar event creation (better) Tom Mike Zach Maybe Meeting Doug @ 11 on Tues Doug

  22. Calendar event creation (better) Tom Mike Zach Maybe Meeting Doug @ 11 on Tues Meet at 11 on Tues Doug

  23. Calendar event creation (better) Tom Mike Zach Maybe Meeting Doug @ 11 on Tues OK Doug

  24. Calendar event creation (better) Tom Mike Zach Maybe Meeting Maybe Meeting Doug @ 11 on Tues Doug @ 11 on Tues Doug

  25. Calendar event creation (better) Tom Mike Zach Maybe Meeting Maybe Meeting Doug @ 11 on Tues Doug @ 11 on Tues Meet at 11 on Tues Doug

  26. Calendar event creation (better) Tom Mike Zach Maybe Meeting Maybe Meeting Doug @ 11 on Tues Doug @ 11 on Tues Busy! Doug

  27. Calendar event creation (better) Tom Mike Zach Maybe Meeting Maybe Meeting Doug @ 11 on Tues Doug @ 11 on Tues Doug

  28. Calendar event creation (better) Tom Mike Zach Maybe Meeting Maybe Meeting Doug @ 11 on Tues Doug @ 11 on Tues Never mind! Doug

  29. Calendar event creation (better) Tom Mike Zach Maybe Meeting Doug @ 11 on Tues Doug

  30. Calendar event creation (better) Tom Mike Zach Maybe Meeting Doug @ 11 on Tues Never mind! Doug

  31. Calendar event creation (better) Tom Mike Zach Doug

  32. Two-phase commit Atomic commit protocol (ACP) - Every node arrives at the same decision - Once a node decides, it never changes - Transaction committed only if all nodes vote Yes - In normal operation, if all processes vote Yes the transaction is committed - If all failures are eventually repaired, the transaction is eventually either committed or aborted

  33. Two-phase commit Roles: - Participants (Mike, Tom, Zach): nodes that must update data relevant to the transaction - Coordinator (Doug): node responsible for executing the protocol (might also be a participant) RPCs: - V OTE - REQ : Can you commit this transaction? - C OMMIT : Commit this transaction - A BORT : Abort this transaction

  34. Failures In the absence of failures, 2PC is pretty simple! When can interesting failures happen? - Participant failures? - Coordinator failures? - Message drops?

  35. Participant failures

  36. Participant failures: Before sending response? Coordinator Participant Participant Prepare Prepare Yes No Abort Decision? Abort

  37. Participant failures: After sending vote? Coordinator Participant Participant Prepare Prepare Yes Yes Yes Commit Commit

  38. Participant failures: Lost vote? Coordinator Participant Participant Prepare Prepare Yes Yes No Abort Decision? Abort

  39. Coordinator failures

  40. Coodinator failures: Before sending prepare Coordinator Participant Participant Prepare Prepare Yes Yes Yes Commit Commit

  41. Coordinator failures: After sending prepare Coordinator Participant Participant Prepare Prepare Prepare Prepare Yes Yes Yes Commit Commit

  42. Coordinator failures: After receiving votes Coordinator Participant Participant Prepare Prepare Yes Yes Prepare Prepare Yes Yes Yes Commit Commit

  43. Coordinator failures: After sending decision Coordinator Participant Participant Prepare Prepare Yes Yes Yes Commit Decision? Commit

  44. Do we need the coordinator? Coordinator Participant Participant Prepare Prepare Yes Yes Yes Commit Decision? Commit

  45. What if we do not have the coordinator’s decision? Coordinator Participant Participant Prepare Prepare Yes Yes or Decision? No? Yes Commit?

  46. 2PC vs. SMR Is 2PC a state machine replication protocol?

  47. 2PC vs. SMR Is 2PC a state machine replication protocol? - Could be—but isn’t a very good one! 2PC is for coordinating an operation between multiple nodes, where every node has to agree in order for the system to make progress!

  48. Typical architecture State State 2PC machine machine 2PC 2PC State machine

  49. Typical architecture State State 2PC machine machine 2PC 2PC State machine

  50. Two generals Does 2PC solve Two Generals? Why not?

Recommend

Easy Commit: A Non-blocking Two-phase Commit Protocol Suyash Gupta, Mohammad Sadoghi Dept. of

Easy Commit: A Non-blocking Two-phase Commit Protocol Suyash Gupta, Mohammad Sadoghi Dept. of

Warmup Motivation 2PC 3PC EC Implementation Evaluation Conclusions Easy Commit: A Non-blocking Two-phase Commit Protocol Suyash Gupta, Mohammad Sadoghi Dept. of Computer Science University of California Davis March 28, 2018 Suyash

915 views • 62 slides
Network FS / Access Control 1 last time two-phase commit consensus: workers + coordinator agree

Network FS / Access Control 1 last time two-phase commit consensus: workers + coordinator agree

Network FS / Access Control 1 last time two-phase commit consensus: workers + coordinator agree to commit no take-backs via redo-logging at each node blocking on failure idea of majority-vote consensus 2 logistics note last weeks

1.65k views • 132 slides
Two-Phase Commit (2PC) Y Site at which Xact originates is coordinator; other sites at which it

Two-Phase Commit (2PC) Y Site at which Xact originates is coordinator; other sites at which it

Two-Phase Commit (2PC) Y Site at which Xact originates is coordinator; other sites at which it executes are subordinates. Y When an Xact wants to commit: { Coordinator sends prepare msg to each subordinate. | Subordinate force-writes an abort or

493 views • 3 slides
Two-phase commit Implications of Two Generals Cannot get agreement in a distributed system to

Two-phase commit Implications of Two Generals Cannot get agreement in a distributed system to

Two-phase commit Implications of Two Generals Cannot get agreement in a distributed system to perform some action at the same time. What if we want to update data stored in multiple locations? In a linearizable fashion? Perform group of ops at

1.28k views • 54 slides
DATABSE SYSTEMS CONSENSUS ON TRANSACTION COMMIT. TODS06 MADE BY- ARCHIT GARG 1 Agenda

DATABSE SYSTEMS CONSENSUS ON TRANSACTION COMMIT. TODS06 MADE BY- ARCHIT GARG 1 Agenda

ECS 265 DISTRIBUTED DATABSE SYSTEMS CONSENSUS ON TRANSACTION COMMIT. TODS06 MADE BY- ARCHIT GARG 1 Agenda What is the paper about? Two Phase Commit Paxos Commit Conclusion 2 Introduction The distributed transaction commit

620 views • 31 slides
two-phase commit / security (start) 1 Changelog Changes made in this version not seen in fjrst

two-phase commit / security (start) 1 Changelog Changes made in this version not seen in fjrst

two-phase commit / security (start) 1 Changelog Changes made in this version not seen in fjrst lecture: quorum: add note that part of voting is updating other nodes to latest version 1 last time (1) RPC: remote function calls like local

1.05k views • 78 slides
Non-Blocking Two Phase Commit (2PC) Using Blockchain Paul Ezhilchelvan , Amjad Aldweesh and Aad

Non-Blocking Two Phase Commit (2PC) Using Blockchain Paul Ezhilchelvan , Amjad Aldweesh and Aad

Non-Blocking Two Phase Commit (2PC) Using Blockchain Paul Ezhilchelvan , Amjad Aldweesh and Aad van Moorsel School of Computing, Newcastle University, UK Contributions Non-blocking 2PC in a synchronous database system Impossible when the

631 views • 12 slides
Security / VM (start) 1 last time two-phase commit: doing operation together data is split

Security / VM (start) 1 last time two-phase commit: doing operation together data is split

Security / VM (start) 1 last time two-phase commit: doing operation together data is split across several machines redo logging machines know what message to send when rebooting state machine to describe protocol for proving/testing

1.38k views • 78 slides
CS 764: Topics in Database Management Systems Lecture 11: Two-Phase Commit (2PC) Xiangyao Yu

CS 764: Topics in Database Management Systems Lecture 11: Two-Phase Commit (2PC) Xiangyao Yu

CS 764: Topics in Database Management Systems Lecture 11: Two-Phase Commit (2PC) Xiangyao Yu 10/12/2020 1 Announcement Submit a 1-page course project proposal by Oct. 21 A list of project ideas are uploaded to the course website

961 views • 37 slides
access control 1 last time two phase commit and delayed messages simplifjcations in assignment

access control 1 last time two phase commit and delayed messages simplifjcations in assignment

access control 1 last time two phase commit and delayed messages simplifjcations in assignment quorum consensus: not requiring unanimity goal: use nodes for redundancy, but keep them consistent keep operating when suffjciently many nodes are

1k views • 62 slides
CS5412: TWO AND THREE PHASE COMMIT Lecture XI Ken Birman Continuing our consistency saga 2

CS5412: TWO AND THREE PHASE COMMIT Lecture XI Ken Birman Continuing our consistency saga 2

CS5412 Spring 2012 (Cloud Computing: Birman) 1 CS5412: TWO AND THREE PHASE COMMIT Lecture XI Ken Birman Continuing our consistency saga 2 Recall from last lecture: Cloud-scale performance centers on replication Consistency of

663 views • 47 slides
RPC (fjnish) / two-phase commit 1 Changelog Changes made in this version not seen in fjrst

RPC (fjnish) / two-phase commit 1 Changelog Changes made in this version not seen in fjrst

RPC (fjnish) / two-phase commit 1 Changelog Changes made in this version not seen in fjrst lecture: 19 November 2019: gRPC IDL example: update to be consistent with version of gRPC syntax used in assignment 19 November 2019: gRPC IDL example:

1.79k views • 142 slides
How To Make Your Commit Seen? Marta Rybczyska Akademy 2012, Tallin Commit message? What for?

How To Make Your Commit Seen? Marta Rybczyska Akademy 2012, Tallin Commit message? What for?

How To Make Your Commit Seen? Marta Rybczyska Akademy 2012, Tallin Commit message? What for? KDE Commit Digest Collaborative Effort http://commit-digest.org Open Source base: Enzyme http://enzyme-project.org/ Review Classification

308 views • 29 slides
COMMIT: Jon Meredith March 15, 2017 COMMIT is Live! We have had some WINS : Very minimal

COMMIT: Jon Meredith March 15, 2017 COMMIT is Live! We have had some WINS : Very minimal

COMMIT: Jon Meredith March 15, 2017 COMMIT is Live! We have had some WINS : Very minimal member impact Each case has been identified and addressed quickly Department ran an additional payment cycle on 3/ 6 In the first week, we

509 views • 8 slides
two-phase commit / network FSes 1 last time remote procedure calls imitate function/method call

two-phase commit / network FSes 1 last time remote procedure calls imitate function/method call

two-phase commit / network FSes 1 last time remote procedure calls imitate function/method call interface extra setup: where is server interface description language to specify interface extra concerns: portability (language + machine),

1.54k views • 127 slides
1 Figure 14.5 The two-phase commit protocol Phase 1 (voting phase): 1. The coordinator sends a

1 Figure 14.5 The two-phase commit protocol Phase 1 (voting phase): 1. The coordinator sends a

Figure 14.3 A distributed banking transaction coordinator join openTransaction participant closeTransaction A a.withdraw(4); . join BranchX T participant b.withdraw(T, 3); Client B b.withdraw(3); T = openTransaction BranchY join

640 views • 6 slides
2PC, Linearizability, Spanner 2020-04-17 Nikita Borisov - UIUC 12 Topics for Today

2PC, Linearizability, Spanner 2020-04-17 Nikita Borisov - UIUC 12 Topics for Today

2PC, Linearizability, Spanner 2020-04-17 Nikita Borisov - UIUC 12 Topics for Today Two-phase commit Atomic commit protocol Crash-recovery, durability External consistency / linearizability Spanner Multi-version database

440 views • 16 slides
Phase IB Supplement Phase II Submission Progressing Towards a Phase II Submission Phase IB

Phase IB Supplement Phase II Submission Progressing Towards a Phase II Submission Phase IB

Phase IB Supplement Phase II Submission Progressing Towards a Phase II Submission Phase IB Supplement Foster relationships with strategic partners and investors Advance Phase I research Help bridge the Phase I/Phase II gap

370 views • 9 slides
GIT RECAP Check status since last commit: $ git status Stage changes/add new files: $ git add

GIT RECAP Check status since last commit: $ git status Stage changes/add new files: $ git add

GIT RECAP Check status since last commit: $ git status Stage changes/add new files: $ git add file_name Record changes (advisable for new units of code): $ git commit -m "Relevant message here" Push to remote repository (so we can

577 views • 45 slides
COMMUNITY GAME RETURN TO PLAY ROADMAP Phase 1 Phase 2A Phase 2B Phase 3 Phase 4 Phase 5 WRU &

COMMUNITY GAME RETURN TO PLAY ROADMAP Phase 1 Phase 2A Phase 2B Phase 3 Phase 4 Phase 5 WRU &

COMMUNITY GAME RETURN TO PLAY ROADMAP Phase 1 Phase 2A Phase 2B Phase 3 Phase 4 Phase 5 WRU & club Return to Household/ Non-Sanctioned sanctioned Season start - Competition Contact household Group Training Small Group

432 views • 6 slides
Lecture 3 More on Git Commits Sign in on the attendance sheet! Review: The Git Commit Workflow

Lecture 3 More on Git Commits Sign in on the attendance sheet! Review: The Git Commit Workflow

Lecture 3 More on Git Commits Sign in on the attendance sheet! Review: The Git Commit Workflow (Edit, Add, Commit) Working Directory Staging Area List of commits file1.txt (v2) bb2df1a file2.txt (v1) (HEAD) file3.txt (v1) file1.txt

719 views • 14 slides
Our Ga lve sto n 2019 E xpe r ie nc e Why Pe ople Commit F r aud We a k I nte rna l Co

Our Ga lve sto n 2019 E xpe r ie nc e Why Pe ople Commit F r aud We a k I nte rna l Co

T ra vis Co unty T a x Offic e T a x Asse sso r-Co lle c to rs Asso c ia tio n Annua l Co nfe re nc e Our Ga lve sto n 2019 E xpe r ie nc e Why Pe ople Commit F r aud We a k I nte rna l Co ntro ls L a c k o f Po lic y E nfo

444 views • 13 slides
Alviso Dock Feasibility Study Phase II: Follow-Up HOUSIN G, LAND USE, ENVIR ON MENT &

Alviso Dock Feasibility Study Phase II: Follow-Up HOUSIN G, LAND USE, ENVIR ON MENT &

Alviso Dock Feasibility Study Phase II: Follow-Up HOUSIN G, LAND USE, ENVIR ON MENT & TRANSPOR TATI ON (HLUET) COMMIT TE E COU NTY OF SA NTA CLARA NOVEMBER 15, 2018 1 Background Apr. 2015 Public asks County to Apr. 2017: Alviso Dock

209 views • 9 slides
Dynamically checking types and bounds with libcrunch Stephen Kell stephen.kell@cl.cam.ac.uk

Dynamically checking types and bounds with libcrunch Stephen Kell stephen.kell@cl.cam.ac.uk

Dynamically checking types and bounds with libcrunch Stephen Kell stephen.kell@cl.cam.ac.uk Computer Laboratory University of Cambridge 1 Tool wanted if (obj > type == OBJ COMMIT) { if (process commit(walker, ( struct commit )obj))

641 views • 62 slides

More recommend