GETting Science & IT Together at OMRF with Swift Brad Pazoureck - SysAdmin, IT Stuart Glenn - SysAdmin, ACI Oklahoma Medical Research Foundation OpenStack Summit Boston 2017
OpenStack Summit Boston 2017
US vs Them • Enterprise IT • Availability • Typical ” Business” • Science “IT” • Shadow • Just Get “IT” Done OpenStack Summit Boston 2017
Usual Enterprise • Dell Equallogic SAN • iSCSI/SMB • Commvault Disk-Disk-Tape • Offsite tape storage for DR OpenStack Summit Boston 2017
Faking IT • Scale out NAS, 2x • ~200-400TiB • Backups? • “Separated” OpenStack Summit Boston 2017
OpenStack Summit Boston 2017
OpenStack Summit Boston 2017
Data • Up & to the right • Eternal retention • Mixed types/sizes/uses • Funding? • Protection? OpenStack Summit Boston 2017
Age Old Problems • Good for one, not the other • Tape & all its baggage • Mess • Dwindling capacity OpenStack Summit Boston 2017
A Swift Solution • Shadow IT meets Enterprise IT • Joint project • Useful to both • Useable by both • C_O approval OpenStack Summit Boston 2017
Initial Wins • Commvault • Science data archive • Commodity/consumer drives • Cost OpenStack Summit Boston 2017
Growing Together • 2015-08 6 (&1) PACO (250 TiB) • 2016-02 2 PACO (+100 TiB) • 2017-02 3 PACO & drives (+50TiB) • 2016-2017 Adding drives/license (+50TiB) OpenStack Summit Boston 2017
Speeds & Feeds • 3 Zones, 2 “ Regions” • Mixed O drives, SSD AC drives • LUKS • Read/Write affinity • RR DNS & load balancer OpenStack Summit Boston 2017
10Gb REP/ 10Gb REP/ Cluster Cluster dark magic Region OKC Region OUN Zone-00 Zone-01 Zone-03 PACO-00 PACO-01 PACO-02 PACO-03 PACO-04 PACO-05 Controller PACO-06 PACO-07 PACO-08 PACO-09 PACO-0A PACO-0B 10Gb Client OMRF LAN HPC DESKTOP Clients Commvault OpenStack Summit Boston 2017
OpenStack Summit Boston 2017
Easy Swift(Stack) • Ansible • SwiftStack • AD integration OpenStack Summit Boston 2017
Easy Swift(Stack) OpenStack Summit Boston 2017
Easy Swift(Stack) OpenStack Summit Boston 2017
Use the API • Docker registry • Hashi Vault • Customer delivery • Automated TempUrl Maker OpenStack Summit Boston 2017
Auth Tokens OpenStack Summit Boston 2017
Swift Do OpenStack Summit Boston 2017
Troubles • Workflow • User Error • Offsite • Growth OpenStack Summit Boston 2017
Still To Do • NAS tiering or just ProxyFS? • Metadata search • WORM middleware? • Always adding more drives OpenStack Summit Boston 2017
Us & Them • Availability • Business Continuity • Out of shadows, into the light • PUT & GET data at leisure • Affordability OpenStack Summit Boston 2017
Take Aways • ~420TB object data • We can work together • OpenStack Swift 👎 • SwiftStack 👎 👎 OpenStack Summit Boston 2017
Thank you! Questions, Concerns, Comments? Brad Pazoureck Network & Computer Systems Senior Administrator Information Technology Oklahoma Medical Research Foundation Brad-Pazoureck@omrf.org Stuart Glenn Assistant Director of Infrastructure & Research Computing Arthritis and Clinical Immunology Oklahoma Medical Research Foundation Stuart-Glenn@omrf.org https://github.com/glennsb/swat https://github.com/glennsb/atm OpenStack Summit Boston 2017
OpenStack Summit Boston 2017
Recommend
More recommend