Cloud- and Peer-to-Peer Storage End-user considerations and product - PowerPoint PPT Presentation

Jan 23, 2024 •142 likes •300 views

Cloud- and Peer-to-Peer Storage End-user considerations and product overview 4/3/2010 Arjan Peddemors Objectives Get overview of existing cloud storage and P2P storage concepts and products* outline of basic principles underlying cloud-

Cloud- and Peer-to-Peer Storage End-user considerations and product overview 4/3/2010 Arjan Peddemors
Objectives • Get overview of existing cloud storage and P2P storage concepts and products* • outline of basic principles underlying cloud- and P2P storage technologies • product scan • scenario description • Focus on end-users (researchers, staff, students) * Report available soon on SURFnet website 2
Overview Cloud Storage cloud storage service cloud storage process local data storage 3
Overview Peer-to-Peer (P2P) Storage p2p storage process local data peer data storage storage 4
Overview Application Domain • Cloud storage / P2P storage domain is currently highly dynamic • many new products • quickly increasing number of (end-)users • new technologies being applied • Future developments driven by • fast internet connections for (end-)users • cheap storage hardware • uptake of cloud computing in general 5
Basic principles • Redundancy • Erasure coding • Security • Asymmetric read / write • Peer selection • Fairness and quota • Versioning • Efficient transmission 6
Erasure Coding Original file Split Fragments ( k = 3) Encode Redundant fragments ( n = 6) Upload to peers Fragments stored at peers Loss of fragments due to peer churn or temporal unavailability Remaining fragments stored at peers Download from peers Retrieved fragments ( ≥ k ) Decode and join Original file 7
Erasure Coding • Compared to replication, erasure codes deliver a higher probability of successful data restore • Example calculation • peer network consisting of 10000 peers • 10% of peers is offline on average • replication factor of 2 (file consumes twice the original size at peers) • 2 replicas: probability of availability of at least one replica is 0.99 (2 nines) • 16 fragments at peers: probability of availability of at least 8 fragments is 0.99994 (four nines) 8
Product scan • Research projects / products • Simple Tools • Cloud Storage products • P2P Storage products • Amazon S3 • Wuala • Dropbox • Tahoe • Microsoft Live Mesh / • CrashPlan Live Skydrive • Cucku • Adrive • PowerFolder • Mozy 9
Amazon S3 / Dropbox (cloud) 10
Amazon S3 / Dropbox (cloud) 11
Wuala (P2P) 12
Scenario • Doctoral student working on research data / thesis at multiple locations cloud storage / P2P storage home university laptop fixed PC fixed PC 13
Scenario • Comparing • Simple tool (Unison) • Cloud storage service (Dropbox) • P2P storage service (Wuala) • Aspects • Preparation / installation • Regular activities and maintenance • Recovery 14
Conclusions • Cloud / P2P storage products interesting for SURFnet end users • Domain is new and developing quickly • Many product variants (targeting different usage) • Subscription versus bringing in own resources • Two types of P2P storage products • ‘full’ P2P system scaling to many peers • ‘social’ P2P systems • Cloud storage services more mature than P2P • Many products have both Cloud and P2P features 15

Recommend

Peer-to-Peer Computing Peer-to-Peer (P2P) employ distributed resources to perform function in a

Introduction Peer-to-Peer Computing Peer-to-Peer (P2P) employ distributed resources to perform function in a decentralized manner Resource can be: computing, storage, bandwidth Function can be: computing, data sharing, D.

625 views • 6 slides

Peer-to-Peer Networks 09 Random Graphs for Peer-to-Peer-Networks Christian Ortolf Technical

Peer-to-Peer Networks 09 Random Graphs for Peer-to-Peer-Networks Christian Ortolf Technical Faculty Computer-Networks and Telematics University of Freiburg Peer-to-Peer Networking Facts Hostile environment - Legal situation - Egoistic

882 views • 57 slides

Storage Management and Caching in PAST, a Large-scale, Persistent Peer-to-peer Storage Utility

Storage Management and Caching in PAST, a Large-scale, Persistent Peer-to-peer Storage Utility Presented by Haiming Jin 2013-03-07 Background P2P applications emerges as mainstream applications 53.3% of upstream internet traffic (2010)

848 views • 41 slides

Comparing Hybrid Peer-to-Peer Hybrid peer-to-peer systems Systems Beverly Yang and Hector

Comparing Hybrid Peer-to-Peer Hybrid peer-to-peer systems Systems Beverly Yang and Hector Garcia-Molina Pure peer-to-peer systems are hard to scale Gnutella Look at hybrids between p2p and server-client Presented by Marco Barreno Servers

283 views • 6 slides

THE PEER-TO-PEER NETWORK JOHN NEWBERY @jfnewbery github.com/jnewbery THE PEER-TO-PEER NETWORK

THE PEER-TO-PEER NETWORK JOHN NEWBERY @jfnewbery github.com/jnewbery THE PEER-TO-PEER NETWORK Introduction Types of nodes Message format Control messages Transaction propagation Block propagation THE PEER TO PEER

768 views • 38 slides

Serverless networking (peer-to-peer computing) Peer-to-peer models Client-server computing

5/7/08 Serverless networking (peer-to-peer computing) Peer-to-peer models Client-server computing servers provide special services to clients clients request service from a server Pure peer-peer computing all systems have equivalent

586 views • 20 slides

Hierarchical Codes: How to Make Erasure Codes Attractive for Peer-to-Peer Storage Systems

Hierarchical Codes: How to Make Erasure Codes Attractive for Peer-to-Peer Storage Systems Alessandro Duminuco and Ernst Biersack EURECOM Sophia Antipolis, France (Best paper award in P2P'08) Presented by: Amir H. Payberah amir@sics.se

456 views • 45 slides

Peer-to-Peer Networks 11 Past Christian Ortolf Technical Faculty Computer-Networks and

Peer-to-Peer Networks 11 Past Christian Ortolf Technical Faculty Computer-Networks and Telematics University of Freiburg PAST PAST: A large-scale, persistent peer-to-peer storage utility - by Peter Druschel (Rice University, Houston

372 views • 26 slides

Peer-to-Peer Networking and Discovery Technologies Week 6 Whats Peer-to-Peer? A different

Peer-to-Peer Networking and Discovery Technologies Week 6 Whats Peer-to-Peer? A different network architecture than client/server Each peer is both a client and a server Appropriate for applications that dont require a

353 views • 11 slides

NSYNC Network Synchronization for Low-latency Peer-to-Peer Streaming Overlay Construction

NSYNC Network Synchronization for Low-latency Peer-to-Peer Streaming Overlay Construction Shudong Jin Case Western Reserve University NEONet Workshop, March 1, 2006 Peer-to-Peer Streaming Peer-to-peer systems versus client/server systems

292 views • 15 slides

THE POLITICS OF BLOCKCHAIN From Primus Inter Pares to Peer-to-Peer HOW BLOCKCHAIN WORKS In

THE POLITICS OF BLOCKCHAIN From Primus Inter Pares to Peer-to-Peer HOW BLOCKCHAIN WORKS In peer-to-peer networks, all the operations Peer-to-peer networks Proof-of-work equally rely on each node in the system. Digital signature Registry

328 views • 18 slides

Economics of Peer-to-Peer Markets Jonathan Levin Stanford

Economics of Peer-to-Peer Markets Jonathan Levin Stanford University Lear Conference July 25, 2015 1 Internet Marketplaces 2 On-Demand Services 3 Introduction Peer-to-peer

1.02k views • 25 slides

5th Grade Peer Ambassadors Parkway Elementary What is a Peer Ambassador? A Peer Ambassador is a

5th Grade Peer Ambassadors Parkway Elementary What is a Peer Ambassador? A Peer Ambassador is a good role model! She or he proudly represents the 6 pillars of character: Trustworthiness, Respect, Responsibility, Fairness, Caring, Citizenship A

258 views • 7 slides

P2P: Distributed Hash Tables Chord + Routing Geometries Nirvan Tyagi CS 6410 Fall16

P2P: Distributed Hash Tables Chord + Routing Geometries Nirvan Tyagi CS 6410 Fall16 Peer-to-peer (P2P) Peer-to-peer (P2P) Decentralized! Hard to coordinate with peers joining and leaving Peer-to-peer (P2P) Napster (1999) Peer-to-peer

869 views • 68 slides

Lets Put a Peer Worker on Campus! Keely Phillips, Self Help & Peer Support OPDI

Lets Put a Peer Worker on Campus! Keely Phillips, Self Help & Peer Support OPDI Conference, October 2018 About Self Help & Peer Support Peer Navigator Services at Conestoga College A full-time Peer Navigator will provide:

579 views • 16 slides

Peer-to-Peer Networks 14 Game Theory Christian Schindelhauer Technical Faculty

Peer-to-Peer Networks 14 Game Theory Christian Schindelhauer Technical Faculty Computer-Networks and Telematics University of Freiburg Literature Feldman, Chuang Overcoming Free-Riding Behavior in Peer-to-Peer Systems, 2005

449 views • 24 slides

Chor d: A Scalable Peer-t o-peer Lookup Chor d: A Scalable Peer-t o-peer Lookup Ser vice f or I

Chor d: A Scalable Peer-t o-peer Lookup Chor d: A Scalable Peer-t o-peer Lookup Ser vice f or I nt er net Applicat ions Ser vice f or I nt er net Applicat ions Ion Stoica, Robert Morris, David Karger, M. Frans Kaashoek, Hari Balakrishnan

533 views • 30 slides

Peer-to-Peer Networks 14 Security Christian Schindelhauer Technical Faculty Computer-Networks

Peer-to-Peer Networks 14 Security Christian Schindelhauer Technical Faculty Computer-Networks and Telematics University of Freiburg Free-Net Ian Clarke, Oskar Sandberg, Brandon Wiley, Theodore Hong, 2000 Goal - peer-to-peer network -

746 views • 36 slides

Peer to Peer Learning & Support Aims and Objectives of this Workshop Workshop 3: Peer to

Peer to Peer Learning & Support Aims and Objectives of this Workshop Workshop 3: Peer to Peer Learning & Support is designed to encourage peer to peer support, learning and development and sharing best practice amongst the

495 views • 11 slides

Outline What is the proposed e-Science Desktop Peer and why. P2P-DVM, a prototype of

Realizing the e-Science Desktop Peer Using a Peer-to-Peer Distributed Virtual Machine Middleware. Lei Ni, Aaron Harwood and Peter J. Stuckey NICTA Victoria Labs, Australia, Department of Computer Science and Software Engineering, The

459 views • 12 slides

Understanding Peer-to-Peer Networking and File- Sharing Introduction Although the recent

Content copied from: http://www.limewire.com/about/p2p.php Understanding Peer-to-Peer Networking and File- Sharing Introduction Although the recent growth of user-friendly file-sharing networks has only now brought Peer-to-Peer (P2P)

144 views • 3 slides

INTERCONNECTING CDNS AKA PEERING PEER-TO- PEER Bruce Davie & Francois le Faucheur

INTERCONNECTING CDNS AKA PEERING PEER-TO- PEER Bruce Davie & Francois le Faucheur Outline Background: peering peer-to-peer providers CDN Interconnect Motivation CDNI Technical Issues Discussion Why is this a

876 views • 19 slides

Decentralized Trust Management for Decentralized Trust Management for Ad-Hoc Peer-to-Peer

Decentralized Trust Management for Decentralized Trust Management for Ad-Hoc Peer-to-Peer Networks Ad-Hoc Peer-to-Peer Networks Thomas Repantis Vana Kalogeraki Department of Computer Science & Engineering University of California,

1.41k views • 29 slides

Peer-to-Peer Information Sharing in a Mobile Ad Hoc Environment Anna Hayes University College

Peer-to-Peer Information Sharing in a Mobile Ad Hoc Environment Anna Hayes University College Dublin David Wilson University of North Carolina at Charlotte %give summary of the whole work: %contents Weve developed a peer-to-peer system

332 views • 17 slides