o ur s olution bstore o ur s olution bstore
play

O UR S OLUTION BSTORE O UR S OLUTION BSTORE Key ideas: Data - PowerPoint PPT Presentation

Feb 21, 2024 •429 likes •1.6k views

S EPARATING W EB A PPLICATIONS FROM U SER D ATA S TORAGE WITH BSTORE Ramesh Chandra Priya Gupta Nickolai Zeldovich MIT CSAIL M OTIVATING E XAMPLE Alice manages her photos online. M OTIVATING E XAMPLE Alice manages her photos online. Snaps

  1. T ALK O UTLINE  Motivation  Current solutions  BSTORE overview  Design details:  Filesystem API  FS organization with tags  Tag-based access control  Filesystem setup  Implementation  Evaluation  Related work

  2. F ILESYSTEM API  Each FS has a flat file structure  BSTORE FS API:  create(fs, init_tags) -> handle  set (handle, data) ->  get (handle) -> data  delete(handle) ->  Fits data model for most web apps

  3. V ERSIONING  All files are versioned  Most API calls return current version

  4. V ERSIONING  All files are versioned  Most API calls return current version  create(fs, init_tags) -> ver, handle  set (handle, data) -> ver  get (handle) -> ver, data  delete(handle) ->

  5. V ERSIONING  All files are versioned  Most API calls return current version  create(fs, init_tags) -> ver, handle  set (handle, data) -> ver  get (handle) -> ver, data  delete(handle) ->  set increments version number

  6. V ERSIONING  All files are versioned  Most API calls return current version  create(fs, init_tags) -> ver, handle  set (handle, data, [match_ver]) -> ver  get (handle) -> ver, data  delete(handle, [match_ver]) ->  set increments version number  Compare and swap-like functionality to detect concurrent modifications  set and delete fail if current ver != match_ver

  7. P RINCIPALS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly BACKEND SERVERS

  8. P RINCIPALS BROWSER redeye.com viewer.com sfly.com editor.com flickr.com fsmgr.com flickr.com Shutterfly BACKEND SERVERS

  9. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly

  10. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly

  11. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly paris newyork

  12. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly paris newyork print

  13. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly paris newyork print

  14. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly paris newyork print

  15. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly paris newyork print print

  16. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS flickr.com flickr.com Shutterfly #paris #newyork flickr.com viewer.com #print #print

  17. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager flickr FS flickr.com flickr.com Shutterfly #paris #newyork flickr.com viewer.com #print #print

  18. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager flickr FS flickr.com flickr.com Shutterfly #paris #newyork flickr.com viewer.com #print #print

  19. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager flickr FS flickr.com flickr.com Shutterfly #paris #newyork flickr.com viewer.com #print #print fsmgr.com fsmgr.com #christmas #christmas

  20. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor Tags API File Manager FS Manager settag(handle, tag) -> ver rmtag (handle, tag) -> ver gettag(handle) -> ver, tag_list search(fs, tag_expr) -> handle_list flickr FS flickr.com flickr.com Shutterfly #paris #newyork flickr.com viewer.com #print #print fsmgr.com fsmgr.com #christmas #christmas

  21. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  22. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager from to tags rights flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  23. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager from to tags rights flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  24. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager from to tags rights fsmgr.com viewer.com fsmgr.com read #christmas flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  25. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Photo Shutterfly Remover Viewer Viewer Editor File Manager FS Manager from to tags rights fsmgr.com viewer.com fsmgr.com read #christmas flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  26. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager from to tags rights fsmgr.com viewer.com fsmgr.com read #christmas flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  27. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager from to tags rights fsmgr.com viewer.com fsmgr.com read #christmas viewer.com sfly.com viewer.com read #print flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  28. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Shutterfly Remover Viewer Editor File Manager FS Manager from to tags rights fsmgr.com viewer.com fsmgr.com read #christmas viewer.com sfly.com viewer.com read #print flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  29. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Shutterfly Remover Viewer Editor File Manager FS Manager from to tags rights fsmgr.com viewer.com fsmgr.com read #christmas viewer.com sfly.com viewer.com read #print flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  30. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Shutterfly Remover Viewer Editor File Manager FS Manager from to tags rights fsmgr.com viewer.com fsmgr.com read #christmas viewer.com sfly.com viewer.com read #print flickr FS viewer.com sfly.com fsmgr.com read #private Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  31. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor Access Control API File Manager FS Manager add_dlg(to, tags, rights) -> from to tags rights rm_dlg (to, tags, rights) -> fsmgr.com viewer.com fsmgr.com read get_dlg(to) -> <tags,rights> #christmas viewer.com sfly.com viewer.com read #print flickr FS viewer.com sfly.com fsmgr.com read #private Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  32. F ILESYSTEM S ETUP  FS manager needs FS info to mount the FS  FS info stored in a mountpoint file  Example: <mountpoint> <url src="http://flickr.com/fs.html"/> <params username="ramesh" password="pass"/> </mountpoint>  Any principal can add a mountpoint as long as it can create the mountpoint file  Mountpoint file contents encrypted by FS manager  encrypt(mntpoint_plaintext) -> mntpoint_ciphertext

  33. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly BACKEND SERVERS

  34. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS Shutterfly BACKEND SERVERS

  35. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS Storage FS Shutterfly BACKEND SERVERS

  36. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS encrypt FS Storage FS Shutterfly BACKEND SERVERS

  37. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS encrypt FS Layered FS Storage FS Shutterfly BACKEND SERVERS

  38. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS encrypt FS Layered FS Storage FS Shutterfly BACKEND SERVERS

  39. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS encrypt FS Layered FS Storage FS Shutterfly BACKEND SERVERS

  40. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS encrypt FS Layered FS Storage FS Shutterfly BACKEND SERVERS

  41. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS encrypt FS Layered FS Storage FS Shutterfly BACKEND SERVERS

  42. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS encrypt FS Layered FS Storage FS Shutterfly BACKEND SERVERS

Recommend

CSA CSA Ev Evolut olution: ion:

CSA CSA Ev Evolut olution: ion:

CSA CSA Ev Evolut olution: ion: The e Farm rms: s: Juni niper per Hi Hill Far arm Fledgin dging g Crow w

338 views • 17 slides
REV REVOL OLUTION UTIONAR ARY Y P&amp;A P&amp;A Melti Melting ng r roc ock us k using T

REV REVOL OLUTION UTIONAR ARY Y P&amp;A P&amp;A Melti Melting ng r roc ock us k using T

REV REVOL OLUTION UTIONAR ARY Y P&amp;A P&amp;A Melti Melting ng r roc ock us k using T ing The hermit mite MIKE RICHARDSON Spirit Energy With input from Interwell CO CONTENTS NTENTS Traditional P&amp;A is a Pain

555 views • 32 slides
10 B EST P RACTICES F OR S OLUTION A RCHITECTURES THAT WOULD TAME BIG DATA !!! B IG D ATA B EST P

10 B EST P RACTICES F OR S OLUTION A RCHITECTURES THAT WOULD TAME BIG DATA !!! B IG D ATA B EST P

10 B EST P RACTICES F OR S OLUTION A RCHITECTURES THAT WOULD TAME BIG DATA !!! B IG D ATA B EST P RACTICE -1 U SE CASE ! U SE C ASE ! U SE C ASE ( F RAME IT TIGHT ) T HE IDEA IN B RIEF What are the questions at the heart of the problem ?

590 views • 46 slides
C OMPUTING ? [Mark Weiser 1991] PART 1 : R EQUIREMENTS , TRENDS , Silicon based

C OMPUTING ? [Mark Weiser 1991] PART 1 : R EQUIREMENTS , TRENDS , Silicon based

R AINBOW RESEARCH GROUP T RENDS IN M IDDLEWARE FOR T RENDS IN M IDDLEWARE FOR U BIQUITUOUS C OMPUTING : WC OMP S OLUTION S OLUTION HMI Ubiquitous User Interaction Computing DAAD Summer CTDS 09, 24th 26th September Tunis Reactive and HMI

486 views • 16 slides
L ECTURE 24: T ASK A LLOCATION 3 I NSTRUCTOR : G IANNI A. D I C ARO S OLUTION APPROACHES Use

L ECTURE 24: T ASK A LLOCATION 3 I NSTRUCTOR : G IANNI A. D I C ARO S OLUTION APPROACHES Use

15-382 C OLLECTIVE I NTELLIGENCE S18 L ECTURE 24: T ASK A LLOCATION 3 I NSTRUCTOR : G IANNI A. D I C ARO S OLUTION APPROACHES Use the reference optimization models in a centralized scheme, solving the problems to optimality (e.g.,

323 views • 28 slides
From Th Theory to Practice: Exploring Sustainable Sol olution ons t to A o Africas D

From Th Theory to Practice: Exploring Sustainable Sol olution ons t to A o Africas D

From Th Theory to Practice: Exploring Sustainable Sol olution ons t to A o Africas D Develop opmental C Challenges !!!!!!!!!!!! F. Kwame Yeboah, Assistant Professor Thomas S. Jayne, University Foundation Professor Michigan State

410 views • 24 slides
MOS OSAIC: : Mas ask k Opt ptimiz imizing ing Solut olution ion Wit With h Proces

MOS OSAIC: : Mas ask k Opt ptimiz imizing ing Solut olution ion Wit With h Proces

MOS OSAIC: : Mas ask k Opt ptimiz imizing ing Solut olution ion Wit With h Proces ocess Window Window Awar are e Inv nver erse e Cor orrect ection ion Jhih-Rong Gao, Xiaoqing Xu, Bei Yu, and David Z. Pan Dept. of Electrical

383 views • 23 slides
Dynamics i in the Short-Term rm E Evol olution on of of HIV D Drug g Res esistance e

Dynamics i in the Short-Term rm E Evol olution on of of HIV D Drug g Res esistance e

Dynamics i in the Short-Term rm E Evol olution on of of HIV D Drug g Res esistance e Prelim limin inary Data ta Arevir 2019 Jennifer Brown Molecular Virology, Department of Biomedicine, University of Basel Rationale Higher

244 views • 8 slides
C RITIQUE OF C OST -R ISK A NALYSIS AND F RANKENSTEIN S PACECRAFT D ESIGNS : A P ROPOSED S OLUTION

C RITIQUE OF C OST -R ISK A NALYSIS AND F RANKENSTEIN S PACECRAFT D ESIGNS : A P ROPOSED S OLUTION

C RITIQUE OF C OST -R ISK A NALYSIS AND F RANKENSTEIN S PACECRAFT D ESIGNS : A P ROPOSED S OLUTION 2014 ICEAA Workshop Denver, CO June 10-13 , 2014 Eric Plumer, NASA CAD HQ Mohamed Elghefari, Pasadena Applied Physics Cost- Risk Analysis Best

458 views • 31 slides
Us Using a g agen ent-bas ased ed model els t to exam amine e e eco-evol olution onar

Us Using a g agen ent-bas ased ed model els t to exam amine e e eco-evol olution onar

Us Using a g agen ent-bas ased ed model els t to exam amine e e eco-evol olution onar ary f y feedbac acks Monique de Jager m.dejager@uu.nl PhD at NIOZ Yerseke Im an evolutionary ecologist With Johan van de Koppel Postdoc

661 views • 38 slides
Tw Two-St Stream C Con onvol olution onal Networ orks fo for Action Recognition in Vi

Tw Two-St Stream C Con onvol olution onal Networ orks fo for Action Recognition in Vi

Tw Two-St Stream C Con onvol olution onal Networ orks fo for Action Recognition in Vi Videos Karen Simonyan Andrew Zisserman Cemil Zalluholu Introduction Aim Extend deep ConvolutionNetworks to action recognitionin video.

809 views • 23 slides
SOL OLUTION TION! ! Observation Theory OUR LEARNING EXPERIENCE Solution Results Evolution

SOL OLUTION TION! ! Observation Theory OUR LEARNING EXPERIENCE Solution Results Evolution

INT NTERP ERPRETERS'S RETERS'S PROFES OFESSIONAL IONAL LE LEAR ARNING NING IN N SCIC IC THE HE BLE LENDED NDED SOL OLUTION TION! ! Observation Theory OUR LEARNING EXPERIENCE Solution Results Evolution Synthesis OBSE SERVA

248 views • 9 slides
S afety &amp; ecurity olution Utmost Safety with Exceptional Technology Integrat egrated ed

S afety &amp; ecurity olution Utmost Safety with Exceptional Technology Integrat egrated ed

Unique S afety &amp; ecurity olution Utmost Safety with Exceptional Technology Integrat egrated ed Solut ution ion by y Skool olSm Smar art-No No Swiping ng of Cards s (Aut Automat omatic ic De Detect ection) ion) Bus Solution

347 views • 12 slides
E W OLUTION - Efficacy and safety of LAAO in patients with prior ischemic and hemorrhagic stroke

E W OLUTION - Efficacy and safety of LAAO in patients with prior ischemic and hemorrhagic stroke

E W OLUTION - Efficacy and safety of LAAO in patients with prior ischemic and hemorrhagic stroke Prof. Dr. Lucas Boersma, MD/PhD/FESC St. Antonius Hospital, Nieuwegein, The Netherlands AMC/University of Amsterdam, The Netherlands H. Ince

436 views • 17 slides
DATA VISUALS P OWER BI AS A S OLUTION 44 ZETTABYTES BY 2020 IDC E XECUTIVE S UMMARY D ATA G ROWTH ,

DATA VISUALS P OWER BI AS A S OLUTION 44 ZETTABYTES BY 2020 IDC E XECUTIVE S UMMARY D ATA G ROWTH ,

DATA VISUALS P OWER BI AS A S OLUTION 44 ZETTABYTES BY 2020 IDC E XECUTIVE S UMMARY D ATA G ROWTH , B USINESS O PPORTUNITIES , AND THE IT I MPERATIVES DATA IS HARD TO UNDERSTAND WE NEED TO SEE IT, MOVE IT D ATA MUST INFORM DECISIONS D ATA

427 views • 9 slides
Or Oregon egon Records Manage gemen ent Sol olution Public / Private Partnership: Oregon

Or Oregon egon Records Manage gemen ent Sol olution Public / Private Partnership: Oregon

Or Oregon egon Records Manage gemen ent Sol olution Public / Private Partnership: Oregon Secretary of State, Archives Division Chaves Consulting, Inc. / Arikkan, Inc. The Problem Too much stuff to manage manually Too many silos

676 views • 12 slides
Ba y esian Decon v olution of Seismic Arra y Data for RippleFired Explosions Eric

Ba y esian Decon v olution of Seismic Arra y Data for RippleFired Explosions Eric

Ba y esian Decon v olution of Seismic Arra y Data for RippleFired Explosions Eric A Suess Advisor Professor Rob ert Sh um w a y Outline The Problem Mo del Ba y esian Statistics

421 views • 26 slides
Multiresol olution M on Method hods f for Large-scale L Learni ning ng @ @ NIPS 2 S 2015

Multiresol olution M on Method hods f for Large-scale L Learni ning ng @ @ NIPS 2 S 2015

Multiresol olution M on Method hods f for Large-scale L Learni ning ng @ @ NIPS 2 S 2015 Ily lya Safro ro Clemso son U Universi sity Multigrid-inspired Methods for Large-scale Networks Fast Response to Infection Spread (with S.

796 views • 56 slides
Comb Combined Genera ral M Meeti ting Votin oting results lts on on resolu olution tions

Comb Combined Genera ral M Meeti ting Votin oting results lts on on resolu olution tions

Comb Combined Genera ral M Meeti ting Votin oting results lts on on resolu olution tions 30 APRIL 2020 1 Getlink SE COMBINED GENERAL MEETING Quorum of the 2020 AGM: 72.206% of shares with voting rights Number of shares present

550 views • 33 slides
Finite Mathematics MAT 141: Chapter 2 Notes Solutions to Linear Systems by the Echelon Method

Finite Mathematics MAT 141: Chapter 2 Notes Solutions to Linear Systems by the Echelon Method

MAT141, Chapter 2 Finite Mathematics MAT 141: Chapter 2 Notes Solutions to Linear Systems by the Echelon Method (i.e. elimination) David J. Gisch S ystems of Linear Equations One S olution 1 MAT141, Chapter 2 No S olution Infinite S

292 views • 16 slides
CO 2 Emissions Reduction Potential of a Novel High Capacity Car Carrier S olution S outh Africa

CO 2 Emissions Reduction Potential of a Novel High Capacity Car Carrier S olution S outh Africa

5 t h International Workshop on S ustainable Road Freight CO 2 Emissions Reduction Potential of a Novel High Capacity Car Carrier S olution S outh Africa CO 2 Emissions Reduction Potential of a Novel High Capacity Car Carrier Solution Abdool

676 views • 55 slides
CRE CREAT ATION ION VS VS EV EVOLUTION OLUTION Introduction &amp; Evidence Introduction

CRE CREAT ATION ION VS VS EV EVOLUTION OLUTION Introduction &amp; Evidence Introduction

CRE CREAT ATION ION VS VS EV EVOLUTION OLUTION Introduction &amp; Evidence Introduction Paleontology Geology (135) (180) (125) (270) (400) (600) Introduction Paleontology Geology Mathematics MAT MATHEMAT

790 views • 57 slides
West t Midlands ands Rail l De Devolution olution November 2015 Who o is s West st Midl

West t Midlands ands Rail l De Devolution olution November 2015 Who o is s West st Midl

West t Midlands ands Rail l De Devolution olution November 2015 Who o is s West st Midl dlands ands Rai ail? l? West t Midlands lands local al author thoriti ities es have e formed ed West t Midlands lands Rail l (WMR),

301 views • 15 slides
FHWA Emergency Relief Program Innovation Mobile S olution for Assessment and Reporting (MS AR)

FHWA Emergency Relief Program Innovation Mobile S olution for Assessment and Reporting (MS AR)

FHWA Emergency Relief Program Innovation Mobile S olution for Assessment and Reporting (MS AR) Emergency Relief Program FHWA provides stakeholders with Emergency Relief funding after a disaster. To receive funds stakeholders must

432 views • 14 slides

More recommend