an introduction to cgroups and cgroupspy
play

An introduction to cgroups and cgroupspy tags = [python, docker, - PowerPoint PPT Presentation

Oct 20, 2022 •33 likes •513 views

An introduction to cgroups and cgroupspy tags = [python, docker, coreos', systemd'] @vpetersson About me Entrepreneur Geek VP Biz Dev @ CloudSigma Contact info Email: viktor@cloudsigma.com WWW:

  1. An introduction to cgroups and cgroupspy tags = [‘python’, ’docker’, ‘coreos', ‘systemd'] @vpetersson

  2. About me • Entrepreneur • Geek • VP Biz Dev @ CloudSigma Contact info • Email: viktor@cloudsigma.com • WWW: http://vpetersson.com • Twitter: @vpetersson • LinkedIn: http://www.linkedin.com/in/vpetersson @vpetersson

  3. About CloudSigma • Public Infrastructure-as-a-Service (IaaS) • PoPs in Europe and North America • Support (almost) all operating systems • Virtual data center • Trusted by CERN, ESA and many more @vpetersson

  4. Talk outline • Introduction to cgroups • Using cgroups • Examples • Cgroup tools • Filesystem • libcgroup • cgroupspy • systemd • Docker @vpetersson

  5. 1. Introduction @vpetersson

  6. 1. Introduction What are cgroups? • Control groups • Resource accounting (with hierarchy) • Much more sophisticated than `ulimit` • A file system @vpetersson

  7. What can you do with cgroups? • Limit and prioritize • CPU consumption 1. Introduction • Memory consumption • Disk I/O consumption • Network consumption • Device limitations • Classify network packets • Freeze processes • Set up resource accounting @vpetersson

  8. Example (from the Kernel docs) Students 
 Professors 
 Other 
 CPU (20%) (20%) (60%) Students 
 Professors 
 System 
 Memory 1. Introduction (20%) (50%) (30%) Students 
 Professors 
 System 
 Disk (20%) (50%) (30%) WWW NFS Other Network (20%) (60%) (20%) S P (5%) (15%) @vpetersson

  9. Terminology 1. Introduction • Resource class or Controller • Group or Slice (in systemd) • CPU Schedulers • Completely Fair Scheduler (CFS) • Real-Time scheduler (RT) @vpetersson

  10. Resource classes • Block IO (blkio) • CPU Set (cpuset) 1. Introduction • CPU Accounting (cpuacct) • CPU (cpu) • Devices (devices) • Freezer (freezer) • Memory (memory) • Network Classifier (net_cls) • Network Priority (net_prio) @vpetersson

  11. 1. Introduction Universal elements • tasks • notify_on_release • release_agent @vpetersson

  12. Distro Cgroups Systemd 1. Introduction CentOS/RHEL Yes Yes CoreOS Yes Yes Yes Debian Yes Fedora Yes Yes Ubuntu Yes Optional @vpetersson

  13. 1. Introduction Zero to cgroups on Ubuntu 14.04 $ apt-get install -y cgroup-lite $ mkdir /sys/fs/cgroup/cpuset/test $ echo 0 > /sys/fs/cgroup/cpuset/test/cpuset.cpus $ echo $$ > /sys/fs/cgroup/cpuset/test/tasks @vpetersson

  14. 2. Using cgroups @vpetersson

  15. 2.1 CPU Resources @vpetersson

  16. 2.1 CPU Resources CPU resources • cpu • cpuset @vpetersson

  17. cpu cpuset cpu.stat cpuset.memory_pressure_enabled cpu.cfs_period_us cpuset.memory_spread_slab cpu.cfs_quota_us cpuset.memory_spread_page cpu.shares cpuset.memory_pressure 2.1 CPU Resources cgroup.sane_behavior cpuset.memory_migrate cgroup.clone_children cpuset.sched_relax_domain_level cgroup.event_control cpuset.sched_load_balance cgroup.procs cpuset.mem_hardwall cpuset.mem_exclusive cpuset.cpu_exclusive cpuset.mems cpuset.cpus cgroup.sane_behavior cgroup.clone_children cgroup.event_control cgroup.procs @vpetersson

  18. 2.1 CPU Resources Limit a process to a specific CPU core # Create a group $ cd /sys/fs/cgroup $ mkdir -p cpuset/group1 # Limit ‘group1’ to core 0 and enroll the current shell $ echo 0 > cpuset/group1/cpuset.cpus $ echo $$ > cpuset/group1/tasks @vpetersson

  19. Limit a process to a specific CPU core # Before 2.1 CPU Resources $ cat /proc/$$/status | grep '_allowed' Cpus_allowed: 3 Cpus_allowed_list: 0-1 Mems_allowed: 00000000,00000001 Mems_allowed_list: 0 # After $ cat /proc/$$/status | grep '_allowed' Cpus_allowed: 1 Cpus_allowed_list: 0 Mems_allowed: 00000000,00000001 Mems_allowed_list: 0 @vpetersson

  20. Allocate “CPU Shares” across two groups 2.1 CPU Resources # Create two groups $ cd /sys/fs/cgroup $ mkdir -p cpu/group1 cpu/group2 # Allocate CPU shares $ echo 250 > cpu/group1/cpu.shares $ echo 750 > cpu/group2/cpu.shares # Fire off the workload $ burnP6 --group1 & echo $! > cpu/group1/tasks $ burnP6 --group2 & echo $! > cpu/group2/tasks @vpetersson

  21. 2.1 CPU Resources ‘cpu.shares’ in action @vpetersson

  22. 2.2 Memory Resources @vpetersson

  23. Memory memory.kmem.tcp.max_usage_in_bytes memory.force_empty memory.kmem.tcp.failcnt memory.stat memory.kmem.tcp.usage_in_bytes memory.failcnt 2.1 Memory Resources memory.kmem.tcp.limit_in_bytes memory.soft_limit_in_bytes memory.kmem.slabinfo memory.limit_in_bytes memory.kmem.max_usage_in_bytes memory.max_usage_in_bytes memory.kmem.failcnt memory.usage_in_bytes memory.kmem.usage_in_bytes cgroup.sane_behavior memory.kmem.limit_in_bytes cgroup.clone_children memory.numa_stat cgroup.event_control memory.pressure_level cgroup.procs memory.oom_control memory.move_charge_at_immigrate memory.swappiness memory.use_hierarchy @vpetersson

  24. Setting up memory policies 2.1 Memory Resources # Create a group $ cd /sys/fs/cgroup $ mkdir -p memory/group1 # Set a memory limit of 150M $ echo 150M > memory/group1/memory.limit_in_bytes # Add shell to group $ echo $$ > memory/group1/tasks # Fire off a memory eating task $ ./memhog @vpetersson

  25. 2.1 Memory Resources ‘memory.limit_in_bytes’ in action @vpetersson

  26. 2.3 Block I/O Resources @vpetersson

  27. Block IO blkio.io_queued_recursive blkio.time blkio.io_merged_recursive blkio.leaf_weight blkio.io_wait_time_recursive blkio.leaf_weight_device 2.3 Block I/O Resources blkio.io_service_time_recursive blkio.weight blkio.io_serviced_recursive blkio.weight_device blkio.io_service_bytes_recursive blkio.throttle.io_serviced blkio.sectors_recursive blkio.throttle.io_service_bytes blkio.throttle.write_iops_device blkio.time_recursive blkio.io_queued blkio.throttle.read_iops_device blkio.io_merged blkio.throttle.write_bps_device blkio.io_wait_time blkio.throttle.read_bps_device blkio.io_service_time blkio.reset_stats blkio.io_serviced cgroup.sane_behavior blkio.io_service_bytes cgroup.clone_children blkio.sectors cgroup.event_control @vpetersson

  28. 2.3 Block I/O Resources Setting up I/O policies # Find the device $ lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 40G 0 disk └─ sda1 8:1 0 40G 0 part / # Create the groups $ cd /sys/fs/cgroup $ mkdir blkio/group1 blkio/group2 @vpetersson

  29. Setting up I/O policies 2.3 Block I/O Resources # Group 1 and shell 1 $ echo "8:0 10485760" > blkio/group1/blkio.throttle.write_bps_device $ echo $$ > blkio/group1/tasks $ dd if=/dev/zero of=/tmp/writetest bs=64k count=3200 conv=fdatasync && \ rm /tmp/writetest # Group 2 and shell 2 $ echo "8:0 20971520" > blkio/group1/blkio.throttle.write_bps_device $ echo $$ > blkio/group2/tasks $ dd if=/dev/zero of=/tmp/writetest bs=64k count=3200 conv=fdatasync && \ rm /tmp/writetest @vpetersson

  30. 2.3 Block I/O Resources ‘blkio.throttle.write_bps_device’ in action @vpetersson

  31. 3. Cgroup tools @vpetersson

  32. Overview • Filesystem • libcgroup • cgroupspy • systemd • Docker @vpetersson

  33. Using the filesystem 2.1 Filesystem $ cd /sys/fs/cgroup # Create a CPU group $ mkdir -p cpu/group1 # Set a CPU Share $ echo 250 > cpu/group1/cpu.shares # Enroll [PID] in ‘group1’ $ echo [PID] > cpu/group1/tasks @vpetersson

  34. Using libcgroup # On Debian and Ubuntu $ apt-get install -y cgroup-bin 3.2 Libcgroup # Create a group $ cgcreate -g cpu:foobar # Set values $ cgset -r cpu.shares=6 foobar # Run a command $ cgexec -g cpu:foobar bash ^D # Delete group $ cgdelete cpu:foobar @vpetersson

  35. Cgroupspy • Python wrapper for cgroups • Integration with libvirt for interacting with VMs • Developed by and used at CloudSigma @vpetersson

  36. Getting started with cgroupspy $ pip install cgroupspy $ python 3.3 cgroupspy >>> from cgroupspy import trees >>> t = trees.Tree() >>> cset = t.get_node_by_path(‘/cpuset/') >>> cset.controller.cpus set([0, 1]) >>> test = cset.create_cgroup(‘test') >>> test.controller.cpus set([0, 1]) >>> test.controller.cpus = [1] >>> test.controller.cpus set([1]) >>> cset.delete_cgroup('test') @vpetersson

  37. Controlling VMs with cgroupspy >>> from cgroupspy.trees import VMTree >>> vmt = VMTree() >>> print vmt.vms 3.3 cgroupspy {u'1ce10f47-fb4e-4b6a-8ee6-ba34940cdda7.libvirt-qemu': <NodeVM 1ce10f47- fb4e-4b6a-8ee6-ba34940cdda7.libvirt-qemu>, u'3d5013b9-93ed-4ef1-b518-a2cea43f69ad.libvirt-qemu': <NodeVM 3d5013b9-93ed-4ef1-b518-a2cea43f69ad.libvirt-qemu>, } >>> vm = vmt.get_vm_node("1ce10f47-fb4e-4b6a-8ee6-ba34940cdda7") >>> print vm.cpuset.cpus {0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15} >>> print vm.memory.limit_in_bytes 25603080192 @vpetersson

Recommend

Evaluation of Memory and CPU usage via Cgroups of ATLAS workloads via Cgroups of ATLAS workloads

Evaluation of Memory and CPU usage via Cgroups of ATLAS workloads via Cgroups of ATLAS workloads

Evaluation of Memory and CPU usage Evaluation of Memory and CPU usage via Cgroups of ATLAS workloads via Cgroups of ATLAS workloads running at a Tier-2 running at a Tier-2 Gang Qin, Gareth Roy Ma March rch. 25 th , 2015 Condor Cgroups

363 views • 19 slides
An introduction to Control Groups (cgroups) (plus some systemd evangelizing) Who am I? Jonathan

An introduction to Control Groups (cgroups) (plus some systemd evangelizing) Who am I? Jonathan

An introduction to Control Groups (cgroups) (plus some systemd evangelizing) Who am I? Jonathan maw (not James Thomas) jonathan.maw@codethink.co.uk Responsibilities: GENIVI Node Startup Controller AGL Distro OS/Common Libs

426 views • 8 slides
Resource Management with CGroups Resource Management with CGroups Steven Ellis Steven Ellis

Resource Management with CGroups Resource Management with CGroups Steven Ellis Steven Ellis

Resource Management with CGroups Resource Management with CGroups Steven Ellis Steven Ellis Solution Architect Solution Architect Red Hat New Zealand Red Hat New Zealand sellis@redhat.com sellis@redhat.com

458 views • 25 slides
Who I Think You Are Software engineer, Sysadmin, etc who is... wanting to learn about

Who I Think You Are Software engineer, Sysadmin, etc who is... wanting to learn about

Who I Think You Are Software engineer, Sysadmin, etc who is... wanting to learn about namespaces and cgroups intereseted in containers and how they work loves turtles (optional) Saturday, September 21, 13 Modern Linux Server with

1.29k views • 116 slides
INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION

INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION

TRAINING COURSE ON SOCIAL PROTECTION &amp; FORMALIZATION TRINIDAD AND TOBAGO MARCH 15, 2017 INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION INTRODUCTION Design of the NIS Assistance from the

547 views • 23 slides
The userspace solution for control groups Linux Kongress 2010 Dhaval Giani

The userspace solution for control groups Linux Kongress 2010 Dhaval Giani

The userspace solution for control groups Linux Kongress 2010 Dhaval Giani dhaval.giani@gmail.com RETIS Lab, Scuola Superiore SantAnna September 2010 Dhaval Giani The userspace solution for control groups Control Groups What are cgroups?

896 views • 70 slides
INTRODUCTION Introduction 2/42 INTRODUCTION Alternations I am giving bread to the

INTRODUCTION Introduction 2/42 INTRODUCTION Alternations I am giving bread to the

Patterns of variation in the expression of case and agreement Andrs Brny Leiden University Centre for Linguistics 9 November 2019, BaSIS Workshop a.barany@hum.leidenuniv.nl INTRODUCTION Introduction 2/42 INTRODUCTION

1.37k views • 42 slides
Introduction Introduction Introduction Introduction Outline Motivation Failures

Introduction Introduction Introduction Introduction Outline Motivation Failures

Introduction Introduction Introduction Introduction Outline Motivation Failures Definition and concepts Process and product properties Principles SE Approaches Motivation Software and the economy The economies of

1.03k views • 49 slides
Introduction Introduction Introduction Nationwide Cause for Concern 1

Introduction Introduction Introduction Nationwide Cause for Concern 1

Introduction Introduction Introduction Nationwide Cause for Concern 1 https://www.cdc.gov/std/stats17/infographic.htm Introduction Epidemiology in Western Colorado CPHE Surveillance Data Report, May 2018 Chlamydia Epidemiology in Western

977 views • 39 slides
DAQ introduction Purpose of this talk : (1) Introduction for those who have not been in every

DAQ introduction Purpose of this talk : (1) Introduction for those who have not been in every

DAQ introduction Purpose of this talk : (1) Introduction for those who have not been in every meeting (2) Some ideas of diagrams for section 7.1 (Introduction) of TP. Giles Barr 25 Jan 2018, Pembroke College On DUNE, the reality is there is a

474 views • 10 slides
INTRODUCTION cf. Schneider, Chapter 1 INTRODUCTION THEY ARE OUT TO GET YOU INTRODUCTION WHAT

INTRODUCTION cf. Schneider, Chapter 1 INTRODUCTION THEY ARE OUT TO GET YOU INTRODUCTION WHAT

ADVANCED COMPUTER SECURITY INTRODUCTION cf. Schneider, Chapter 1 INTRODUCTION THEY ARE OUT TO GET YOU INTRODUCTION WHAT IS SECURITY? A systems security policies describe What the system is supposed to do Store and provide access

479 views • 16 slides
Overview Introduction to SMIL Introduction to W3C and XML Introduction to SMIL

Overview Introduction to SMIL Introduction to W3C and XML Introduction to SMIL

Overview Introduction to SMIL Introduction to W3C and XML Introduction to SMIL Writing a SMIL file Adding Media Objects Martin Halvey Clipping media files January 2008 Timing and Synchronising Layout World Wide

387 views • 14 slides
14 Introduction Introduction Bad guys can put malware into Example: hosts

14 Introduction Introduction Bad guys can put malware into Example: hosts

Introduction Introduction source Encapsulation ISO/OSI reference model message M application segment H t H t M transport network datagram H n H n H t M presentation: allow applications to frame link H l H n H t M interpret

583 views • 4 slides
Previous Lecture Introduction to SMIL 2 Introduction to W3C and XML Introduction to SMIL

Previous Lecture Introduction to SMIL 2 Introduction to W3C and XML Introduction to SMIL

Previous Lecture Introduction to SMIL 2 Introduction to W3C and XML Introduction to SMIL Writing a SMIL file Adding Media Objects Martin Halvey Clipping media files January 2008 Timing and Synchronising Layout

322 views • 8 slides
Lecture 1 Andreas Habegger Introduction Zynq Introduction Zynq Introduction Zynq PS vs. PL

Lecture 1 Andreas Habegger Introduction Zynq Introduction Zynq Introduction Zynq PS vs. PL

Introduction Zynq Lecture 1 Andreas Habegger Introduction Zynq Introduction Zynq Introduction Zynq PS vs. PL Processing System Processor Peripherals Data Buses AXI Bus Conclusion BTE5380 - Embedded Systems Octobre 2014 Andreas Habegger

1.81k views • 30 slides
2018.06 01 SMILE5 Introduction S E 5 02 Alpha Cloud M I L 03 Company Introduction 04

2018.06 01 SMILE5 Introduction S E 5 02 Alpha Cloud M I L 03 Company Introduction 04

2018.06 01 SMILE5 Introduction S E 5 02 Alpha Cloud M I L 03 Company Introduction 04 Project References S E 5 PART.1 SMILE5 Introduction M I L Introduction STORION-SMILE5 Residential Energy Storage System Inverter 5kW Output Input

1.06k views • 25 slides
Introduction to CICS Course introduction Course introduction What is CICS? What is an

Introduction to CICS Course introduction Course introduction What is CICS? What is an

Introduction to CICS Course introduction Course introduction What is CICS? What is an application server? Why use an application server? Course introduction Services provided by CICS How CICS applications are defined Scaling CICS to meet

1.84k views • 146 slides
Network Visualization Introduction Presented by Shahed Introduction Introduction Basic

Network Visualization Introduction Presented by Shahed Introduction Introduction Basic

Network Visualization Introduction Presented by Shahed Introduction Introduction Basic building blocks Node Links (relationship between nodes) Spatial information Network data

584 views • 9 slides
Introduction Introduction (1) Main argument of the paper: universities are not only

Introduction Introduction (1) Main argument of the paper: universities are not only

Le jugement des pairs comme outil de management des universits Peer-review as a management tool Christine Musselin (CSO, Sciences Po et CNRS) Avril 2013, Lirrsistible ascension du capitalisme acadmique Introduction Introduction (1)

590 views • 28 slides
Introduction Introduction to storage and to storage and filesystems filesystems Introduction

Introduction Introduction to storage and to storage and filesystems filesystems Introduction

Moreno Baricevic Gilberto Daz Axel Kohlmeyer Stefano Cozzini ULA ICTP CNR-IOM DEMOCRITOS Merida, VENEZUELA Trieste, ITALY Trieste, ITALY Introduction Introduction to storage and to storage and filesystems filesystems Introduction

1.19k views • 51 slides
JABLOTRON JA-100 introduction November 2011 Introduction Todays goals First introduction of

JABLOTRON JA-100 introduction November 2011 Introduction Todays goals First introduction of

JABLOTRON JA-100 introduction November 2011 Introduction Todays goals First introduction of the brand new JA-100 alarm system Visions Basic architecture System components Setting Help us with final validations You are the FIRST ones

1.69k views • 111 slides
1 Introduction Introduction Communication System Baseband an adjective that describes

1 Introduction Introduction Communication System Baseband an adjective that describes

Introduction Introduction Physical Layer Mobile network Global ISP Provides the means to transmit bits Basic Concepts of from sender to receiver, Data Transmission Defines the mechanical, electrical, and Home network timing

463 views • 7 slides
Welcome! Todays Agenda: Topic Introduction Course Introduction Team Practical

Welcome! Todays Agenda: Topic Introduction Course Introduction Team Practical

INFOGR Computer Graphics Jacco Bikker - April-July 2015 - Lecture 1: Introduction Welcome! Todays Agenda: Topic Introduction Course Introduction Team Practical Details Assignments Field Study State of

869 views • 62 slides
Introduction (00) RNDr. Martin Madaras, PhD. madaras@skeletex.xyz Introduction Introduction

Introduction (00) RNDr. Martin Madaras, PhD. madaras@skeletex.xyz Introduction Introduction

Virtual and Augmented Reality Introduction (00) RNDr. Martin Madaras, PhD. madaras@skeletex.xyz Introduction Introduction Who am I? What do I do here? 2 About me Short research bio: - 2014 - finished PhD at FMFI UK - 2014 2016 -

1.3k views • 39 slides

More recommend