OpenSDS An Indus try W ide Colla bora tion For SDS Ma na gement Cameron Bahar and Steven Tan
Part I: A Path To Open SDS 2
SDS Software Defined Storage (SDS) brings “cloud” benefits to storage, including auto - provisioning, self service, and management through a single pane of glass A key enabler of the new SDS architecture is an SDS controller to simplify and unify management APPLICATIONS ORCHESTRATOR SDS CONTROLLER Northbound API • Visibility and control of ALL storage resources SDS CONTROLLER • Communication between apps, Southbound API orchestrator, and storage systems Open Source + Traditional ISV + Standard • Allocation of storage resources Standard (e.g., SAN, Server Server NAS, AFA) to meet SLAs Storage Systems 3
State Of Plug-in Plug-in Plug-in Plug-in Plug-in Plug-in Storage Management OceanStor Flocker Cinder Manila RexRay libStorage Ceph Swift CoprHD OceanStor Flocker Cinder Manila RexRay libStorage CoprHD 10+ drivers Ceph 60+ drivers 10+ drivers Swift DJ MIX AND MATCH Flocker Cinder Manila OceanStor DJ 10+ drivers 60+ drivers 10+ drivers RexRay libStorage CoprHD Ceph Swift DJ 10+ drivers 60+ drivers 10+ drivers MULTIPLE Is there a better option? CONTROLLERS FOR EACH FRAMEWORK ONE DRIVER FOR Direct Attached SAN NAS AFA Scale-Out Cloud EACH STORAGE PRODUCT Direct SAN AFA MULTIPLE DRIVERS FOR EACH STORAGE *All brands and names are the property of their respective owners 4
An Open Plug-in Plug-in Plug-in Plug-in Plug-in Plug-in SDS API Future END-TO-END SDS MANAGEMENT Open SDS Orchestration Provisioning, Data Placement, Data Protection, Data Migration, Replication, Data Security, Lifecycle Management, DR ONE PLUG-IN FOR O P E N S D S C O N T R O L L E R Open SDS Adapter Vendor A Adapter Vendor B Adapter Vendor C Adapter EACH FRAMEWORK OPEN SDS API Direct Attached SAN NAS AFA Scale-Out Cloud OPEN AND VENDOR ADAPTERS THAT INTEROPERATE COMMON MANAGEMENT API Discovery Configuration Monitoring *All brands and names are the property of their respective owners 5
Value Propositions Solve real-world storage Reuse open-source storage management problems for our building blocks, and driver collective customers investments (eg. Cinder and Manila) Integrate seamlessly with Collaborate in an open source Kubernetes, Docker, Mesos, community with momentum and OpenStack and others broad developer support
Mission Develop an open SDS controller that enables storage management across cloud, containerized, virtualized and other environments Facilitate collaboration among storage vendors, end users, and standards organizations to solve real-world storage management problems
Part II: Solutions and Project Proposal 8
Storage Kubernetes Master Replication API Scheduler Management Controllers etcd For Proxy Kubelet Proxy Kubelet Node Node Pod Pod Pod Pod Kubernetes Container Container Container Container Storage Agents Storage Agents CONTAINER ORCHESTRATION THAT IS HIGHLY AUTOMATED … QuoByte Flocker Ceph Gluster FlexVol vSphereVol GROWING COMMUNITY AND ECOSYSTEM MULTIPLE CONTROLLERS Proprietary Management SOLVING THE SAME PROBLEMS OF FAILOVER, MIGRATION, etc. Direct Attached SAN NAS AFA Scale-Out EACH CONTROLLER SUPPORTS ONLY A LIMITED SET OF STORAGE
Open SDS Kubernetes Master Replication API Scheduler Management Controllers etcd For Proxy Kubelet Proxy Kubelet Node Node Pod Pod Pod Pod Kubernetes Container Container Container Container O P E N S D S C O N T R O L L E R Open SDS Agent Open SDS Agent CONTAINER ORCHESTRATION THAT IS HIGHLY AUTOMATED GROWING COMMUNITY AND Open SDS Orchestration ECOSYSTEM Open SDS Adapter ONE STORAGE AGENT SUPPORTS ANY TYPE OF STORAGE Proprietary Management Common Management API Proprietary Management SINGLE SOLUTION FOR END-TO- Direct Attached SAN NAS AFA Scale-Out END STORAGE MANAGEMENT
Storage Virtual Machine Management QEMU/KVM iSCSI, iSER, NFS, RBD etc. Launch VM 5 For Boot or Attach Get image info 3 volume Glance 4 Nova Horizon VM template VM management Dashboard OpenStack management Snap Storage Create 4 Get volume info images 1 volume/file template share MOST POPULAR CLOUD OS WITH LARGE COMMUNITY AND Manila Cinder Swift Backup ECOSYSTEM File Share Volumes Object Store snapshots Drivers Drivers BROAD STORAGE SUPPORT Create volume/file 2 backend WITH CINDER AND MANILA Proprietary Management LACKS DISCOVERY, Direct Attached SAN NAS AFA Scale-Out CONFIGURATION AND MONITORING OF STORAGE 11
Open SDS Virtual Machine Management QEMU/KVM iSCSI, iSER, NFS, RBD etc. Launch VM 5 For Boot or Attach Get image info 3 volume Glance 4 Nova Horizon VM template VM management Dashboard OpenStack management Create Snap Storage 1 volume/file 4 Get volume info images template share LARGE COMMUNITY AND Open SDS Orchestration ECOSYSTEM Open SDS Adapter (+ Cinder + Manila + Swift) BROAD STORAGE SUPPORT Create volume/file 2 backend LEVERAGE CINDER AND MANILA Common Management API Proprietary Management Proprietary Management DRIVER INVESTMENTS Direct Attached SAN NAS AFA Scale-Out STANDARDIZED DISCOVERY, CONFIGURATION AND MONITORING 12
The Plug-in Plug-in Plug-in Plug-in Plug-in Plug-in OpenSDS API Project END-TO-END SDS MANAGEMENT Open SDS Orchestration Provisioning, Data Placement, Data Protection, Data Migration, Replication, Data Security, Lifecycle Management, DR O P E N S D S C O N T R O L L E R Open SDS Adapter Vendor X Adapter Vendor Y Adapter SEAMLESS PLUG-IN FOR ANY (+Cinder/+Manila) FRAMEWORK SIMPLIFY END-TO-END STORAGE Direct Attached SAN NAS AFA Scale-Out Cloud MANAGEMENT WITH A SINGLE SOLUTION SUPPORT FOR BROAD SET OF STORAGE SYSTEMS AND CLOUD STORAGE WITH STANDARD API *All brands and names are the property of their respective owners
Model Technical project with light governance model TSC for technical oversight of the project GitHub source code, Gerrit code reviews, Launchpad blueprints Regular IRC meetings, and meetups 14
Pillars Open Users Communities Vendors License Service Providers OpenSDS Storage Software Enterprise CNCF Networking API Developers OpenStack OS Design And Specs Docker Cloud Standards Mesos Database Source CloudStack Big Data OCI Tools SNIA … … 15
Join The Project Discussions in progress with UX vendors, end customers and open Release Architecture source communities Testing Code Review Tune in for an announcement this Specifications Documentation year! T he OpenSDS Pro ject Steven Tan Reddy steven.tan@huawei.com anjaneya.chagam@intel.com Skype: stevenphtan 16
More recommend
