Build Your Cluster with Rocks Build Your Cluster with Rocks Yu Fu Yu Fu University of Florida University of Florida 2011 OSG Summer Workshop 2011 OSG Summer Workshop Lubbock, TX Lubbock, TX
… You need a cluster … You need a cluster Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
… and an efficient tool to build it … and an efficient tool to build it Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
• Clusters are cost/performance oriented • Clusters are cost/performance oriented computational engines, but are hard to computational engines, but are hard to manage. manage. • Cluster management gets linearly harder • Cluster management gets linearly harder as it scales out and as more and more as it scales out and as more and more frequent updates come for modern OS. frequent updates come for modern OS. • Heterogeneous nodes are a bummer. • Heterogeneous nodes are a bummer. Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
What is Rocks? What is Rocks? • Rocks Cluster Distribution is a • Rocks Cluster Distribution is a Linux Linux distribution intended for intended for high high- -performance performance distribution computing clusters. computing clusters. • Started by National Partnership for Advanced • Started by National Partnership for Advanced Computational Infrastructure and the SCSD Computational Infrastructure and the SCSD in 2000. in 2000. • Used by 1800+ registered clusters so far and • Used by 1800+ registered clusters so far and many more unregistered clusters. many more unregistered clusters. • The biggest registered academic Rocks • The biggest registered academic Rocks cluster as of now: 8632 CPUs. cluster as of now: 8632 CPUs. Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Rocks Overview Rocks Overview • Based on • Based on CentOS CentOS Linux. Linux. • Uses standard RPM as package tool. • Uses standard RPM as package tool. • Uses automatically generated custom • Uses automatically generated custom RedHat RedHat kickstart to control the whole installation. to control the whole installation. kickstart • Is • NOT “ “ system imager ” based. Is NOT system imager ” based. • All nodes are • “ installed, not “ imaged ” . All nodes are “ installed, not “ imaged ” . • Managed with • Managed with MySQL MySQL and XML. and XML. • Highly customizable. • Highly customizable. • Supports heterogeneous nodes, even cross • Supports heterogeneous nodes, even cross- - install a hybrid of i386 and x86_64. install a hybrid of i386 and x86_64. • Excellent scalability with • “ Avalanche ” install Excellent scalability with “ Avalanche ” install mode based on BitTorrent BitTorrent p2p transfer tool. p2p transfer tool. mode based on Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Topology of Rocks Topology of Rocks Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
What You Need To Get Started What You Need To Get Started • A bunch of x86/x86_64 machines • – you can A bunch of x86/x86_64 machines – you can even build a Rocks cluster on virtual machines. even build a Rocks cluster on virtual machines. • 1GB memory on each machine for Rocks 5.4. • 1GB memory on each machine for Rocks 5.4. • 30GB hard drive for Rocks 5.4 default install. • 30GB hard drive for Rocks 5.4 default install. • Two Ethernet ports on one of them • – the Two Ethernet ports on one of them – the frontend / headnode headnode. . frontend / • PXE booting feature on worker nodes • – can use PXE booting feature on worker nodes – can use CD or floppy emulators. CD or floppy emulators. • A network switch to connect them up. • A network switch to connect them up. • Download Rocks ISO images and burn to • Download Rocks ISO images and burn to – a single “ Jumbo ” DVD would meet CDs/DVDs – a single “ Jumbo ” DVD would meet CDs/DVDs needs in most startup cases, you can add more needs in most startup cases, you can add more rolls later. rolls later. Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Build a Rocks Cluster Build a Rocks Cluster • Rocks provides for installation of a cluster • Rocks provides for installation of a cluster with minimum user interaction. with minimum user interaction. • Steps involved • Steps involved – Boot from CD or DVD on the frontend. Boot from CD or DVD on the frontend. – – Answer a few questions. Answer a few questions. – … Get favorite beverage … – Get favorite beverage – ’ re on your way to a full fledged cluster in – You You ’ re on your way to a full fledged cluster in – 2 hours or less: ~ 1 hour for the frontend 2 hours or less: ~ 1 hour for the frontend server install, ~ 30 min for worker node, ~ 20 server install, ~ 30 min for worker node, ~ 20 extra sec for each additional worker node. extra sec for each additional worker node. Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
’ s Start! Let ’ s Start! Let Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Minimum Rolls for a frontend: base, kernel, os os, web , web- -server server Minimum Rolls for a frontend: base, kernel, Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Default Rocks 5.4 frontend server disk partitions: Default Rocks 5.4 frontend server disk partitions: / / 16 GB 16 GB / var var 4 GB / 4 GB swap swap 1 GB 1 GB /export (symbolic link to /state/partition1) remainder of the primary disk /export (symbolic link to /state/partition1) remainder of the primary disk Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Manual partitioning: Manual partitioning: Minimum of 16GB for / partition. Minimum of 16GB for / partition. Must have a /export partition. Must have a /export partition. Software RAIDs RAIDs are supported, but LVM is not supported as in 5.4. are supported, but LVM is not supported as in 5.4. Software Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Build Your Cluster with Rocks Yu Fu Build Your Cluster with Rocks Yu Fu 2011 OSG Summer Workshop, Lubbock, TX 2011 OSG Summer Workshop, Lubbock, TX
Recommend
More recommend
