management of
play

Management of Kubernetes/OpenShift Clusters Ulrike Klusik, - PowerPoint PPT Presentation

Feb 04, 2024 •409 likes •483 views

Metric Storage for Capacity Management of Kubernetes/OpenShift Clusters Ulrike Klusik, https://www.consol.de PromCon Europe 2019-11-08 Motivation Capacity Management needs aggregated node capacity, quota and resource usage metrics for

  1. Metric Storage for Capacity Management of Kubernetes/OpenShift Clusters Ulrike Klusik, https://www.consol.de PromCon Europe 2019-11-08

  2. Motivation • Capacity Management needs aggregated node capacity, quota and resource usage metrics for several month and years. • Prometheus has only one retention for all metrics • Conflict: • Detailed metrics for post mortem analysis (days or upto a month) • Highly aggregated data for capacity management. E.g. one value of CPU Quota per per cluster and application_type (infrastructure vs. application) Metrics wanted for years. • Prometheus Remote write feature: selected metrics can be stored in an external time series database with longer retention policies. • Thanos (https://thanos.io/) provides a remote write target and PromQL interface ConSol 2

  3. Metric Collection and Storage Architecture central storage and visualization Kubernetes/OpenShift Cluster Project prometheus-infra-mon PromQL Thanos Query Grafana PROMETHEUS Thanos TSDB Receiver Thanos Store • KSM (Kube state metrics)/ OSM (OpenShift state metrics): KSM/OSM Minio S3 for running Pods per Namespace, Thanos Compactor bucket ResourceQuotas and ClusterResourceQuotas • Node-Exporter for operating system metrics of resource usage Nodes Thanos Kubernetes Kubelet + container api-servers metric target cAdvisor Container NODE- EXPORTER namespace host ConSol 3

  4. Dashboard: Capacity Management Overview ConSol 4

  5. Computing Effective Quotas per Namespace - record: namespace:kube_resourcequota:effective expr: min by(namespace,namespace_type,resource_base,type) (label_replace({__name__=~"^(kube_resourcequota)$",namespace=~".+", resource=~"(requests.)?(memory|cpu)",resource!~"limit.*",type="hard"},"resource_base","requests.$2", "resource","(requests.)?(.+)")) - record: namespace:kube_resourcequota:effective expr: max by(namespace,namespace_type,resource_base,type) (label_replace({__name__=~"^(kube_resourcequota)$",namespace=~".+", resource=~"(requests.)?(memory|cpu)",resource!~"limit.*",type="used"},"resource_base","requests.$2", "resource","(requests.)?(.+)")) … - record: namespace:kube_resourcequota:effective expr: min by(namespace,namespace_type,resource_base,type) (label_replace({__name__=~"^(kube_resourcequota)$",namespace=~".+",resource=~"limits.+",type="hard"} ,"resource_base","$1","resource","(.+)")) - record: namespace:kube_resourcequota:effective expr: max by(namespace,namespace_type,resource_base,type) (label_replace({__name__=~"^(kube_resourcequota)$",namespace=~".+",resource=~"limits.+",type="used"} ,"resource_base","$1","resource","(.+)")) ConSol 5

  6. Thank you!

  7. ConSol Consulting & Solutions Software GmbH St.-Cajetan-Straße 43 D-81669 München Tel.: +49-89-45841-100 info@consol.de www.consol.de Twitter: @consol_ de

Recommend

MANUFACTURING MANAGEMENT CAPACITY MANAGEMENT What is Capacity management The management of

MANUFACTURING MANAGEMENT CAPACITY MANAGEMENT What is Capacity management The management of

MANUFACTURING MANAGEMENT CAPACITY MANAGEMENT What is Capacity management The management of the limits of an organization's resources, such as its labor force, manufacturing and office space, technology and equipment, raw materials, and

617 views • 26 slides
Resource Resource Management Management RESOURCE MANAGEMENT RESOURCE MANAGEMENT We have a

Resource Resource Management Management RESOURCE MANAGEMENT RESOURCE MANAGEMENT We have a

Moreno Baricevic Stefano Cozzini CNR-IOM DEMOCRITOS Trieste, ITALY Resource Resource Management Management RESOURCE MANAGEMENT RESOURCE MANAGEMENT We have a pool of users and a pool of resources, then what? some software that controls

538 views • 22 slides
Market Risk Management Gen Ins. Risk Management Life Ins. Risk Management Op.

Market Risk Management Gen Ins. Risk Management Life Ins. Risk Management Op.

Market Risk Management Gen Ins. Risk Management Life Ins. Risk Management Op. Risk Management Board of Enterprise Risk Senior Management Committees Directors Management Credit Risk Cross-Border Exposure Country Rating

453 views • 6 slides
Configuration management Configuration management Configuration management Configuration

Configuration management Configuration management Configuration management Configuration

Configuration management Configuration management Configuration management Configuration management Configuration management Field of management that focuses on establishing and maintaining consistency of a systems attributes

647 views • 6 slides
Medical Organization Needs SOA Patients Service Oriented Architecture Finance Doctors Data

Medical Organization Needs SOA Patients Service Oriented Architecture Finance Doctors Data

Management of Patient Records Management of Medical Records Management of Services Price management Relations with Insurance Company Financial Management and Accounting Medical Supplies Management Auxiliary

952 views • 9 slides
What is Risk Management? What is Risk Management? A (great) management tool Focus

What is Risk Management? What is Risk Management? A (great) management tool Focus

Proudly Presents How To Establish Functional Risk Management in Your Public Entity R. J oy J ackson, City of London Tina Gardiner, Region of York RIMS, Ottawa, 2011 What is Risk Management? What is Risk Management? A (great)

463 views • 24 slides
Self Management VS. Professional Management ADVANTAGES OF SELF MANAGEMENT $$$ The main

Self Management VS. Professional Management ADVANTAGES OF SELF MANAGEMENT $$$ The main

Self Management VS. Professional Management ADVANTAGES OF SELF MANAGEMENT $$$ The main reason to manage your own home is cost savings. This may be a valid enough reason to undertake self management. However, there are some items to

393 views • 17 slides
Change Management Change Management Change Management Appreciate the balance within Change

Change Management Change Management Change Management Appreciate the balance within Change

Slide 2 Purpose of this Session Objectives Understanding of Change Management principles within RBS Understand why CM is important / necessary Change Management Change Management Change Management Appreciate the balance within

250 views • 4 slides
Financial Management Review of Financial Management Financial Management System Internal

Financial Management Review of Financial Management Financial Management System Internal

Financial Management Review of Financial Management Financial Management System Internal Controls Accuracy of Report Information Program Income Salaries And Wages OMB Circular A-133 Single Audits Financial Management

461 views • 12 slides
Value Management Overview Doug Cantrell, PE, PMP AGC Conference March 14, 2018 Value

Value Management Overview Doug Cantrell, PE, PMP AGC Conference March 14, 2018 Value

Value Management Overview Doug Cantrell, PE, PMP AGC Conference March 14, 2018 Value Management Team State Value Management Engineer Jessica Kuse, PE, CPM Value Management Value Management Value Management Value Management Program

922 views • 44 slides
IT Management, Simplified Real-&me IT management solu&ons for the

IT Management, Simplified Real-&me IT management solu&ons for the

IT Management, Simplified Real-&me IT management solu&ons for the new speed of business Product Overview Who we are A Real-Time IT Management Company Enterprise IT management software

370 views • 19 slides
MANAGEMENT CONCEPTS and FUNDAMENTALS Dr. M.Thenmozhi Professor Department of Management

MANAGEMENT CONCEPTS and FUNDAMENTALS Dr. M.Thenmozhi Professor Department of Management

MANAGEMENT CONCEPTS and FUNDAMENTALS Dr. M.Thenmozhi Professor Department of Management Studies Indian Institute of Technology Madras Chennai 600 036 E-mail: mtm@iitm.ac.in WHAT IS MANAGEMENT ? 1.Field of Study - Management principles,

286 views • 16 slides
Key Management Lifecycle Key Management Lifecycle Cryptographic key management encompasses the

Key Management Lifecycle Key Management Lifecycle Cryptographic key management encompasses the

Key Management Lifecycle Key Management Lifecycle Cryptographic key management encompasses the entire lifecycle of cryptographic keys and other keying material. Basic key management guidance is provided in [SP800-21]. A single item of keying

522 views • 18 slides
Portfolio Management 101 Portfolio Management 101 Portfolio Management Institute 2006 PMI Forum

Portfolio Management 101 Portfolio Management 101 Portfolio Management Institute 2006 PMI Forum

Portfolio Management 101 Portfolio Management 101 Portfolio Management Institute 2006 PMI Forum Chicago, IL Jeff Gerson Al Derosa, CFA Business Practice Mgmt Fixed Income Kurt Meyer Paul Davis Equities Marketing Running a Successful PM

772 views • 65 slides
Lecture 7: Bu ff er Management 1 / 46 Bu ff er Management Administrivia To accommodate

Lecture 7: Bu ff er Management 1 / 46 Bu ff er Management Administrivia To accommodate

Bu ff er Management Lecture 7: Bu ff er Management 1 / 46 Bu ff er Management Administrivia To accommodate students who faced challenges with setting up the virtual machine and / or getting familiar with C ++ , we are bumping up the number of

973 views • 46 slides
Management & Leadership Professor Kerry Goulston Management & Leadership MANAGEMENT

Management & Leadership Professor Kerry Goulston Management & Leadership MANAGEMENT

2/28/2014 Management & Leadership Professor Kerry Goulston Management & Leadership MANAGEMENT - Make sure the organisation runs well - Steady continuous improved performance as a whole LEADERSHIP - Involves vision and

148 views • 4 slides
ASSET MANAGEMENT December 7, 2018 WHAT IS ASSET MANAGEMENT? ASSET MANAGEMENT IS A PROCESS TO

ASSET MANAGEMENT December 7, 2018 WHAT IS ASSET MANAGEMENT? ASSET MANAGEMENT IS A PROCESS TO

BREAKING THROUGH: OVERCOMING THE WATER FUNDING CHALLENGE ASSET MANAGEMENT December 7, 2018 WHAT IS ASSET MANAGEMENT? ASSET MANAGEMENT IS A PROCESS TO ENSURE THAT THERE IS SUFFICIENT INVESTMENT IN AND PLANNED MAINTENANCE, REPAIR AND

627 views • 7 slides
Overview of this weeks material 2 Procurement management is one of the nine major project

Overview of this weeks material 2 Procurement management is one of the nine major project

Overview of this weeks material 2 Procurement management is one of the nine major project management knowledge areas according to PMI Project Integration management, scope management, time management, cost management, quality

375 views • 6 slides
Lecture 5: Memory Management 1 / 54 Memory Management Administrivia Assignment 1 is due on

Lecture 5: Memory Management 1 / 54 Memory Management Administrivia Assignment 1 is due on

Memory Management Lecture 5: Memory Management 1 / 54 Memory Management Administrivia Assignment 1 is due on September 7th @ 11:59pm 2 / 54 Memory Management Poll https: // www.strawpoll.me / 20863490 3 / 54 Memory Management Recap

952 views • 54 slides
Portfolio management 1 Portfolio management and investment banking Asset management and

Portfolio management 1 Portfolio management and investment banking Asset management and

Portfolio management 1 Portfolio management and investment banking Asset management and trading constitute the other major activity of IB, alongside investment banking (i.e. corporate finance) For large banks, asset management and

493 views • 45 slides
Lecture Notes: Message Management 1 Slide 1: Message Management Message Management A critical

Lecture Notes: Message Management 1 Slide 1: Message Management Message Management A critical

Lecture Notes: Message Management 1 Slide 1: Message Management Message Management A critical aspect of successful advocacy is the ability to create and deliver a message. While your passion matters greatly, your coalitions make the work

487 views • 15 slides
Memory Management Memory Management 5A. Memory Management and Address Spaces 1. allocate/assign

Memory Management Memory Management 5A. Memory Management and Address Spaces 1. allocate/assign

4/14/2018 Memory Management Memory Management 5A. Memory Management and Address Spaces 1. allocate/assign physical memory to processes 5B. Memory Allocation explicit requests: malloc (sbrk) implicit: program loading, stack extension

555 views • 9 slides
Memory Management Memory Management 5A. Memory Management and Address Spaces 1. allocate/assign

Memory Management Memory Management 5A. Memory Management and Address Spaces 1. allocate/assign

4/12/2017 Memory Management Memory Management 5A. Memory Management and Address Spaces 1. allocate/assign physical memory to processes 5B. Simple Memory Allocation explicit requests: malloc (sbrk) implicit: program loading, stack

205 views • 8 slides
About 650Km Research Theme Sustainable Supply Chain Circular Economy Resources (Resource

About 650Km Research Theme Sustainable Supply Chain Circular Economy Resources (Resource

Professor Simone Sehnem Academic Background Post Doc in Management at FGV (2016...on going) PhD in Management at Univali (2011) MSc in Management at UFSC (2007) BSC in Management at UNOESC (2010) BSc in Agribusiness at UNOESC (2005) Position

636 views • 34 slides

More recommend