fluxo
play

Fluxo Improving the Responsiveness of Internet Services with - PowerPoint PPT Presentation

May 21, 2023 •352 likes •990 views

Fluxo Improving the Responsiveness of Internet Services with Automa7c Cache Placement Alexander Rasmussen UCSD (Presen7ng) Emre Kiciman MSR Redmond Benjamin Livshits MSR Redmond Madanlal Musuvathi MSR Redmond 1 Caching in

  1. Fluxo Improving the Responsiveness of Internet Services with Automa7c Cache Placement Alexander Rasmussen – UCSD (Presen7ng) Emre Kiciman – MSR Redmond Benjamin Livshits – MSR Redmond Madanlal Musuvathi – MSR Redmond 1

  2. Caching in Internet Services • Sa7sfying user request involves calling many external components, aggrega7ng data • Want to cache computa7on performed by some components to improve performance – Disk‐intensive opera7ons, DB queries, etc. • What you cache and when depends on a number of factors – Workload, architecture, SLAs, ... 2 2

  3. Caching in Internet Services • Choice of what, where, how much to cache is usually very ad‐hoc – Programmer intui7on – Localized profiling • “Best” choice can change rapidly over 7me; too quickly for humans to respond manually • Need an automa7c solu7on! 3 3

  4. Fluxo ‐ Automa7c Cache Op7miza7on A ... Fluxo <1234567890, B, C, x> B + <{A, B}, 50 MB> <1234567941, C, D, x’> <1234567890, A, B, x’’> <{B, E, C}, 256 KB> <1234567892, B, E, y> E C <1234567921, E, C, y’> ... D • Describe Internet service as dataflow graph • Gather run7me request traces • Simulate and op7mize to converge on reasonably good cache placement policy 4 4

  5. Fluxo Dataflow Graphs • Source node produces request as tuple • Sink node consumes response as tuple • All other nodes are components which may call external services 5 5

  6. Sample Service ‐ Weather Report Zip Code to Weather Split Join Source Build Sink HTML IP to City City to Weather 6 6

  7. Weather Service ‐ Sample Input Zip Code to Weather Split Join Source Build Sink HTML IP to City City to Weather 7 7

  8. Weather Service ‐ Sample Input Zip Code to Weather 137.110.222.250 Split Join 92093 Source Build Sink HTML IP to City City to Weather 7 7

  9. Weather Service ‐ Sample Input Zip Code to Weather 137.110.222.250 Split Join 92093 Source Build Sink HTML IP to City City to Weather 7 7

  10. Weather Service ‐ Sample Input Zip Code to Weather 137.110.222.250 Split Join 92093 Source Build Sink HTML IP to City City to Weather 7 7

  11. Weather Service ‐ Sample Input Zip Code to Weather 92093 Split Join Source Build Sink HTML 137.110.222.250 IP to City City to Weather 7 7

  12. Weather Service ‐ Sample Input Zip Code to Weather 92093 Split Join Source Build Sink HTML La Jolla, CA IP to City City to Weather 7 7

  13. Weather Service ‐ Sample Input Zip Code to Weather 92093 Split Join Source Build Sink HTML La Jolla, CA IP to City City to Weather 7 7

  14. Weather Service ‐ Sample Input Zip Code to Weather 92093 Split Join Source Build Sink HTML 72 F, Sunny IP to City City to Weather 7 7

  15. Weather Service ‐ Sample Input Zip Code to Weather 92093 Split Join 72 F, Sunny Source Build Sink HTML IP to City City to Weather 7 7

  16. Weather Service ‐ Sample Input Zip Code to Weather 92093 Split Join 72 F, Sunny Source Build Sink HTML IP to City City to Weather 7 7

  17. Weather Service ‐ Sample Input Zip Code to Weather 92093 <p>72 F, Split Join Sunny</p> Source Build Sink HTML IP to City City to Weather 7 7

  18. Weather Service ‐ Sample Input Zip Code to Weather 92093 <p>72 F, Split Join Sunny</p> Source Build Sink HTML IP to City City to Weather 7 7

  19. Weather Service ‐ Sample Input Zip Code to Weather 92093 Split Join Source Build Sink HTML IP to City City to Weather 7 7

  20. Weather Service ‐ Sample Input Zip Code to Weather 72 F, Sunny Split Join Source Build Sink HTML IP to City City to Weather 7 7

  21. Weather Service ‐ Sample Input Zip Code to Weather Split Join 72 F, Sunny Source Build Sink HTML IP to City City to Weather 7 7

  22. Weather Service ‐ Sample Input Zip Code to Weather Split Join Source Build Sink HTML IP to City City to Weather 7 7

  23. Caching {IP to City, City to Weather} Zip Code to Weather Split Join Source Build Sink HTML $ Cache Contents: IP to City City to Weather 8 8

  24. Caching {IP to City, City to Weather} Zip Code to Weather 137.110.222.250 Split Join 92093 Source Build Sink HTML $ Cache Contents: IP to City City to Weather 8 8

  25. Caching {IP to City, City to Weather} Zip Code to Weather 137.110.222.250 Split Join 92093 Source Build Sink HTML $ Cache Contents: IP to City City to Weather 8 8

  26. Caching {IP to City, City to Weather} Zip Code to Weather 137.110.222.250 Split Join 92093 Source Build Sink HTML $ Cache Contents: IP to City City to Weather 8 8

  27. Caching {IP to City, City to Weather} Zip Code to Weather 92093 Split Join Source Build Sink HTML $ 137.110.222.250 Cache Contents: IP to City City to Weather 8 8

  28. Caching {IP to City, City to Weather} Zip Code to Weather 92093 Split Join Source Build Sink HTML $ Cache Contents: 137.110.222.250 IP to City City to Weather 8 8

  29. Caching {IP to City, City to Weather} Zip Code to Weather 92093 Split Join Source Build Sink HTML $ Cache Contents: La Jolla, CA IP to City City to Weather 8 8

  30. Caching {IP to City, City to Weather} Zip Code to Weather 92093 Split Join Source Build Sink HTML $ Cache Contents: La Jolla, CA IP to City City to Weather 8 8

  31. Caching {IP to City, City to Weather} Zip Code to Weather 92093 Split Join Source Build Sink HTML $ Cache Contents: 72 F, Sunny IP to City City to Weather 8 8

  32. Caching {IP to City, City to Weather} Zip Code to Weather 92093 Split Join Source Build Sink HTML $ 72 F, Sunny Cache Contents: IP to City City to Weather 8 8

  33. Caching {IP to City, City to Weather} Zip Code to Weather 92093 Split Join 72 F, Sunny Source Build Sink HTML $ Cache Contents: 137.110.222.250 : “72 F, Sunny” IP to City City to Weather 8 8

  34. Caching {IP to City, City to Weather} Zip Code to Weather 92093 Split Join 72 F, Sunny Source Build Sink HTML $ Cache Contents: 137.110.222.250 : “72 F, Sunny” IP to City City to Weather 8 8

  35. Caching {IP to City, City to Weather} Zip Code to Weather 92093 <p>72 F, Split Join Sunny</p> Source Build Sink HTML $ Cache Contents: 137.110.222.250 : “72 F, Sunny” IP to City City to Weather 8 8

  36. Caching {IP to City, City to Weather} Zip Code to Weather 92093 <p>72 F, Split Join Sunny</p> Source Build Sink HTML $ Cache Contents: 137.110.222.250 : “72 F, Sunny” IP to City City to Weather 8 8

  37. Caching {IP to City, City to Weather} Zip Code to Weather 92093 Split Join Source Build Sink HTML $ Cache Contents: 137.110.222.250 : “72 F, Sunny” IP to City City to Weather 8 8

  38. Caching {IP to City, City to Weather} Zip Code to Weather 72 F, Sunny Split Join Source Build Sink HTML $ Cache Contents: 137.110.222.250 : “72 F, Sunny” IP to City City to Weather 8 8

  39. Caching {IP to City, City to Weather} Zip Code to Weather Split Join 72 F, Sunny Source Build Sink HTML $ Cache Contents: 137.110.222.250 : “72 F, Sunny” IP to City City to Weather 8 8

  40. Caching {IP to City, City to Weather} Zip Code to Weather Split Join Source Build Sink HTML $ Cache Contents: 137.110.222.250 : “72 F, Sunny” IP to City City to Weather 8 8

  41. Caching {IP to City, City to Weather} Zip Code to Weather Split Join Source Build Sink HTML $ Cache Contents: 137.110.222.250 : “72 F, Sunny” IP to City City to Weather 9 9

  42. Caching {IP to City, City to Weather} Zip Code to Weather 137.110.222.250 Split Join 92093 Source Build Sink HTML $ Cache Contents: 137.110.222.250 : “72 F, Sunny” IP to City City to Weather 9 9

  43. Caching {IP to City, City to Weather} Zip Code to Weather 137.110.222.250 Split Join 92093 Source Build Sink HTML $ Cache Contents: 137.110.222.250 : “72 F, Sunny” IP to City City to Weather 9 9

  44. Caching {IP to City, City to Weather} Zip Code to Weather 137.110.222.250 Split Join 92093 Source Build Sink HTML $ Cache Contents: 137.110.222.250 : “72 F, Sunny” IP to City City to Weather 9 9

  45. Caching {IP to City, City to Weather} Zip Code to Weather 92093 Split Join Source Build Sink HTML $ 137.110.222.250 Cache Contents: 137.110.222.250 : “72 F, Sunny” IP to City City to Weather 9 9

  46. Caching {IP to City, City to Weather} Zip Code to Weather 92093 Split Join Source Build Sink HTML $ 72 F, Sunny Cache Contents: 137.110.222.250 : “72 F, Sunny” IP to City City to Weather 9 9

  47. Caching {IP to City, City to Weather} Zip Code to Weather 92093 Split Join 72 F, Sunny Source Build Sink HTML $ Cache Contents: 137.110.222.250 : “72 F, Sunny” IP to City City to Weather 9 9

  48. Caching {IP to City, City to Weather} Zip Code to Weather 92093 Split Join 72 F, Sunny Source Build Sink HTML $ Cache Contents: 137.110.222.250 : “72 F, Sunny” IP to City City to Weather 9 9

More recommend