Amalgamating Manila and Swift for Unified Data Sharing Across Instances Bill Owen Sandeep Patil Gaurang Tapase Simon Lorenz Brian Nelson Sr Software Engineer STSM Software Engineer Software Engineer Software Engineer @wwowen @Sandeep_r_patil @gaurangtapase @SimLorenz
Problem
Problem Scenario Media Production House or Professional Sports Team 1. Employees collects videos and upload to a central object storage system 2. Employees edit videos using sophisticated image editing software. This software requires file access to these images 3. Each employee has access to data in dedicated container from object interface. 4. Same access credentials are used to access data from file interface 5. Requirement for multi-tenant support to segregate clients 6. Must be able to easily scale up compute based on priority and schedule of projects Ingest data from Object interface, analyze data from file interface
Solution
Agenda 1. Solution architecture to address these and similar use cases 2. Demo of sample deployment 3. Challenges to overcome to realize this architecture
Components of the solution OpenStack Cloud • OpenStack Swift is the highly available, distributed object storage system used for uploading unstructured data Nova • SwiftonFile diskfile backend implementation for Swift enables VM Cinder object data to be accessed as files Instances Glance • OpenStack Manila is the file share service used to share file data across VM instances. Multi-tenancy in Manila can help AD/LDAP share data securely across tenants Manila Object Data • Shared Filesystem backend for both Swift and Manila enables shares over object data common data access • OpenStack Keystone , an authentication service coupled with AD/LDAP as common authentication backend enforce Shared Data authentication and data access authorization • OpenStack Nova, Cinder, Glance etc. for creation of virtual Swift (with SwiftonFile) Manila (File Share) machines used for creating VM farm which will be used to analyze data Shared Filesystem
OpenStack Swift • Highly scalable, enterprise class OpenStack Object storage • Rich and growing feature set • Extensible: • custom middleware • pluggable backend: diskfile • Swift and Amazon S3 protocol support
But how do file applications access object data?
Swift On File • Origin: Red Hat contribution in April 2014 Openstack • Allows you to: Swift • Write an object, read as a file • Write a file, read as an object default diskfile • Swift Diskfile Module: different modules for XFS different types of storage Swiftonfile Swiftonfile diskfile diskfile • Swift Storage polices: coexists nicely with traditional storage policies Spectrum GlusterFS Scale • Clients can access data directly from file interface
Swift on File Storage Policy Standard Policy File and Object Access Policy
Swift on File Storage Object Layout This object: http://swift.example.com/v1/acct/cont/obj Is located here with traditional Swift: /mnt/swift/z1device7/objects/63773/ba2/f91d1e7550cd32822a17b00fa86d9ba2/ 1414045361.93852.data But is located here with Swift On File: /mnt/scaleout_fs/ acct/cont/obj
What about easy remote access to this data? And access from VMs?
Manila Overview • Shared file system service for OpenStack • Provides uniform interface for management of file system shares from different storage backends • Many different vendor drivers today • Share Operations include: • Create, delete, extend, shrink shares • Create snapshot, create share from snapshot • Manage share access rules • Manage / unmanage existing data sets • Consistency groups, replication, … • Multi-tenancy support
This is sounding better… But how do I share data between Swift on File and Manila?
Shared File Systems and OpenStack Storage • Common data plane for OpenStack storage • Provides enterprise features like: • Snapshots & backups • Automatic tiering/migration of data across storage pools • Local & multi-site Replication Shared File System • Enables Unique Features for OpenStack services • Nova live migration • Efficient data sharing between Glance, Cinder, Nova using COW • Features vary between vendors, but the idea is the same
That seems simple enough…
Demo
But… What are the challenges to make this work in a production environment? Unified Authentication: Use same credentials for object interface and file interface Today: • Middleware to enable creation of objects with ownership (UID/GID) of requesting user Future Extensions: • Mapping of Object ACLs to File ACLs • Mapping of Object quotas to File quotas • Define on either interface, enforce on both Learn more at: “Write a File, Read as an Object” Thursday @ 1:30pm
More… Challenges to make this work in a production environment Semantic Mismatch Object uses eventual consistency, file uses strong consistency Today: • Access managed by user & application workflow • Ingest through file, read through object • Ingest through object, analyze and publish through file, read results through object • Single writer to container or subdirectory at any point in time • Can be enforced by ACLs or export permissions • New files are automatically “ objectized ” by background daemon Future Extensions: • Enforced coordination between object and file interfaces • Eventual goal: full simultaneous access from either interface
Conclusions OpenStack Cloud • OpenStack provides the building blocks for sharing data between wide variety Nova of clients and interfaces VM Cinder Instances Glance • An enterprise shared file system can be the glue that brings the pieces together AD/LDAP in the most efficient manner Manila Object Data shares over • Simple, hypothetical use cases object data presented today Shared Data • The infrastructure can be used to solve the complex real life use cases that Swift (with SwiftonFile) Manila (File Share) customers are facing today Shared Filesystem
Announcements
OpenStack & Spectrum Scale Red Paper Released this week:
IBM Sponsored Track 11:15 Kick-off Event Jesse Proudman 11:20 OpenStack for Beginners Brad Topol • Shamail Tahir • Tyler Britten The open cloud: A platform of possibilities – Local, Dedicated and Public use cases 12:05 Jason McGee • Azmir Mohamed 2:00 Modelling, Deploying and Managing Applications in IBM Blue Box with Cloudsoft AMP Duncan Johnston-Watt (Cloudsoft ) • Hernan Alvarez 2:50 Open without Limits -- LinuxONE, Ubuntu 16.04 and OpenStack Mark Shuttleworth (Canonical) • Angel Diaz • Jessica Murillo • Kershaw Mehta 3:40 One network to rule them all: Open, scalable, & integrated networking for Containers & VMs Kyle Mestery • Phil Estes 4:20 Networking Time-out with Kyle Mestery and Team Skip the coffee: iPad Air 2 raffle, Texan specialty beers, sodas, cool posters 4:40 Accelerating Mobile App delivery with IBM UrbanCode Deploy, Heat, and OpenStack Tim Pouyer • Tyson Lawrie • Glen Hickman April 26 th , Austin Convention Center, Level 4, MR 18 C/D
THANK YOU
Recommend
More recommend
