OpenStack Architecture for the Enterprise Keith Tobin Greg Jacobs Cloud Architect Network Architect
Speaker Profiles Keith Tobin Greg Jacobs • Dell Cloud Architect • Dell Network Architect • 20 years working as a network • Located in the Dell Cloud Center of architecture and solutions specialist Excellence in Dublin, Ireland • Network evangelist and packet head • Over two decades of software, platform and cloud development • Organizer for OpenStack Ireland • Loves all things OpenStack and Cloud OpenStack Architecture for the Enterprise Services 2
Design Goals • Design an OpenStack architecture to run both enterprise and cloud applications • Meet enterprise performance expectations for VM’s, networking and storage • Zero downtime on the control layer • No data loss in the event of a single node failure • Must be durable, reliable and highly available • Must automatically recover after a fault situation has been fixed • Minimize management tasks OpenStack Architecture for the Enterprise Services 3
Solution Stack Dell Private Managed Cloud Tested Qualified Solution Solution Dell Multi-Cloud Manager Enstratius OpenStack OpenStack Titanium Storage CEPH on R720 Deployment Crowbar SUSE Linux SUSE Linux Networking Physical Layer SonicWall Force10 R720 R620 C6100 Servers Security SecureWorks Cloud Services Managed OpenStack Architecture for the Enterprise Services 4
Deployment With Crowbar OpenStack Architecture for the Enterprise Services 5
Deploying OpenStack with Crowbar Is Easy • Crowbar boots and installs from ISO on a management node (server) • Provides user with web UI for configuration and operations management • Discovers all potential targets (servers) automatically • Performs hardware configuration – BIOS configuration – Performs updates to BIOS and firmware • Installs OS on targets • Deploys OpenStack from a set of configuration modules called barclamps OpenStack Architecture for the Enterprise Services 6
Crowbar Deployment OpenStack Database Controller Barclamp Node 01 Identity Controller DHCP Barclamp Node 02 Image Controller Barclamp Node 03 Block storage Crowbar PXE Compute Barclamp Node 01 Networking Compute Barclamp Chef Server Node 02 Nova Compute Barclamp Node 03 Horizon Barclamp OpenStack Architecture for the Enterprise Services 7
Crowbar 2 Status OpenStack Architecture for the Enterprise Services 8
Load Balancer OpenStack Architecture for the Enterprise Services 9
Active/Passive (Normal) Incoming API Requests Controller Controller VIP 01 02 KeepaliveD KeepaliveD Load Load Load Load Balancer 01 Balancer 01 Balancer 02 Balancer 02 (Inactive) (Active) (Passive) (Active) Keystone Keystone Keystone etc… etc… etc… OpenStack Architecture for the Enterprise Services 10
Active/Passive (Fault) Incoming API Requests Controller Controller VIP 01 02 KeepaliveD KeepaliveD Load Load Load Load Balancer 01 Balancer 01 Balancer 02 Balancer 02 (Inactive) (Active) (Passive) (Active) Keystone Keystone Keystone etc… etc… etc… OpenStack Architecture for the Enterprise Services 11
Single HAProxy Bottleneck iVIP eVIP Controller Controller 01 02 (Active LB) HAProxy HAProxy Inactive LB MySQL MySQL RabbitMQ RabbitMQ Horizon Horizon Glance-API Glance-API Glance- Glance- registry registry Nova- Nova- scheduler scheduler Nova-API Nova-API Keystone-API Keystone-API Cinder-API Cinder-API Neutron-API Neutron-API Neutron L2 Neutron L2 Neutron L3 Neutron L3 Neutron Neutron DHCP DHCP OpenStack Architecture for the Enterprise Services 12
Dynamic Load Balancing Incoming API Traffic Network Network Switch Switch OSPF ECMP Controller Controller Controller 01 02 Quagga 03 Quagga Quagga HAProxy HAProxy HAProxy Keystone Keystone Keystone e tc… e tc… etc… OpenStack Architecture for the Enterprise Services 13
Neutron OpenStack Architecture for the Enterprise Services 14
Neutron (Single Networking Node) Controller 01 Controller 02 Compute 01 Compute 03 Keystone Keystone Nova Nova Glance Glance Compute 02 Compute 04 MySQL MySQL Nova Nova etc… e tc… Network 01 Neutron API L3 Agent Internet OVS Agent DHCP Agent OpenStack Architecture for the Enterprise Services 15
Neutron (Separate Networking Nodes) Compute 01 Controller 02 Controller 03 Controller 01 Compute 02 HAProxy HAProxy HAProxy L3 Agent L3 Agent DHCP Agent Quagga DHCP Agent Quagga Quagga OVS Agent OVS Agent Neutron API Neutron API Neutron API Neutron Neutron Neutron Scheduler Scheduler Scheduler Ect …. Other Other Other Compute 04 Compute 03 OpenStack OpenStack OpenStack Services Services Services L3 Agent L3 Agent DHCP Agent DHCP Agent OVS Agent OVS Agent Internet OpenStack Architecture for the Enterprise Services 16
RabbitMQ OpenStack Architecture for the Enterprise Services 17
RabbitMQ Cluster (With Mirrored Queues) Physical View Logical View End Point Controller 01 Controller 02 Controller 03 HAProxy HAProxy HAProxy Quagga Quagga Quagga Dynamic Load RabbitMQ RabbitMQ RabbitMQ Balancer Other Other Other Ect …. OpenStack OpenStack OpenStack Services Services Services RabbitMQ 01 RabbitMQ 02 RabbitMQ 03 OpenStack Architecture for the Enterprise Services 18
MySQL Database OpenStack Architecture for the Enterprise Services 19
MySQL Single Server (Normal Operation) Application DB Server Data Openstack Architecture for the Enterprise Services 20
MySQL Single Server (Failed) Application DB Server 1 (Active) Data Openstack Architecture for the Enterprise Services 21
MySQL Single Server (Failed) Disadvantage • Application Single point of failure • DB Server 1 (Active) Data Openstack Architecture for the Enterprise Services 22
MySQL Active/Passive Failover Openstack Architecture for the Enterprise Services 23
MySQL Active/Passive Failover (Normal Operation) MySQL Active/Passive Failover (Failed Node) Disadvantages Application Inactive Server • • Limits scale Reduces the potential • workload processing ability of the solution by half DB Server 2 DB Server 2 DB Server 1 DB Server 1 • Async replication has (Passive) (Active) (Active) (Failed) potential for data inconsistencies across Async Replication server nodes in fault Data Data Data Data situations Openstack Architecture for the Enterprise Services 24
MySQL With DRDB Openstack Architecture for the Enterprise Services 25
MySQL With DRDB (Normal Operation) Disadvantages Application Inactive server • • Limits scale Reduces the potential • workload processing ability of the solution DB Server 1 DB Server 2 by half (Failed) Server Not Available ! Event Data Data Event Confirmed Openstack Architecture for the Enterprise Services 26
MySQL Multi- Master Openstack Architecture for the Enterprise Services 27
MySQL Multi-Master Cluster Application Application 01 02 Load balancer DB DB Server 1 Server 2 Data Data DB Server 3 Data Openstack Architecture for the Enterprise Services 28
MySQL Multi-Master Cluster (Failed Node) Application Application 01 02 Load balancer DB DB Server 1 Server 2 Data Data DB Server 3 Data Openstack Architecture for the Enterprise Services 29
MySQL Async Replication • No guarantee that data will be consistent across all nodes at any point in time Server 1 Server N Data Data Openstack Architecture for the Enterprise Services 30
MySQL Single Thread replication Processor C1 C2 C3 C4 C5 C6 C7 C8 Openstack Architecture for the Enterprise Services 31
MySQL Multi-Master Cluster Application Application 01 02 Disadvantages At any point in time there • Load balancer is no guarantee that data is in a consistent state within the cluster One thread allocated for • DB DB Server 1 Server 2 replication tasks Data Data DB Server 3 Data Openstack Architecture for the Enterprise Services 32
Percona MySQL Cluster Openstack Architecture for the Enterprise Services 33
Percona MySQL Cluster Capability Synchronous Replication Data Consistency Parallel Applying on All Nodes Automatic Node Provisioning Multi-Master Openstack Architecture for the Enterprise Services 34
Synchronous Replication Application 01 Capability Controller Controller Synchronous Replication DB 1 DB 2 Data Consistency Event Parallel Applying on All Nodes Data Data Automatic Node Provisioning Event Multi-Master Confirmed Openstack Architecture for the Enterprise Services 35
Data Consistency Controller Controller Server DB 1 DB 2 DB 3 Capability Synchronous Replication Data Data Data Data Consistency Parallel Applying on All Nodes Automatic Node At any point in time data is always Provisioning consistent across all nodes in the cluster Multi-Master Openstack Architecture for the Enterprise Services 36
Parallel Applying on All Nodes Processor C1 C2 C3 C4 C5 C6 C7 C8 Capability Synchronous Replication Data Consistency Parallel Applying on All Nodes Automatic Node Provisioning Multi-Master Openstack Architecture for the Enterprise Services 37
Recommend
More recommend
