Gnocchi and Collectd for Title faster fault detection and - PowerPoint PPT Presentation

Apr 15, 2023 •379 likes •549 views

Gnocchi and Collectd for Title faster fault detection and maintenance Julien Danjou, Red Hat Emma Foley, Intel Whats this all about? What is Gnocchi? What is collectd? How do they work together? What can I do with this?

Gnocchi and Collectd for Title faster fault detection and maintenance Julien Danjou, Red Hat Emma Foley, Intel
What’s this all about? • What is Gnocchi? • What is collectd? • How do they work together? • What can I do with this? • How can these possibly improve?
What is Gnocchi? • Time series database as a service • Part of OpenStack Telemetry 2014-2017 • Database backend for OpenStack Ceilometer metering • Pre-computed aggregation • Largely scalable
Gnocchi architecture
Gnocchi / Ceilometer • Gnocchi is more scalable • Can handle more data • Faster responses on reading and writing • Ceilometer old storage API is deprecated • But why do I want these advantages? § Because you may want to use collectd!
What is Collectd? • A system statistics collection daemon • Uses plugins to collect system statistics/events and can mangle/publish those statistics/events in a number of ways. • Extensible via plugins • Supports thresholding and notifications • Platform independent Source: https://collectd.org/images/architecture-schematic.png
What kind of information is available? • • • cpu disk processes • • • load IPMI libvirt • • • ping RDT dpdkstats • • • interface ovs etc • • memory hugepages
How do collectd and gnocchi go together?
How is collectd used in OpenStack? • OPNFV Doctor • OpenStack Watcher • OpenStack Vitrage • Aodh (OpenStack alarming)
How can I use events and alarms? • Collectd generates events! • collectd ->aodh (thresholds) • collectd->gnocchi->aodh (all other alarms)
What new features can I expect to see? • Barometer OPNFV E Release Plan • RDT, IPMI, PMU, RAS, Libvirt, vSwitch, PCIe, SNMP, Aodh and Gnocchi plugins for collectd. • Collectd protocol extensions for dynamic configuration. • Gnocchi • Stability and performance improvements
What do I do next? • Try collectd out for yourself • collectd, collectd-ceilometer-plugin, gnocchi • The examples here are not a monitoring solution, but tools to facilitate your solutions • Billing, rating, prediction, auto-scaling, fault management, capacity planning, etc
Can you repeat that? • Gnocchi can handle LOTs of metrics • Collectd generates lots of metrics • Some projects already use collectd metrics/events • Collectd-gnocchi and collectd-aodh let you get in on the action!
What are your Questions? Julien Danjou Emma Foley jdanjou@redhat.com emma.l.foley@intel.com @juldanjou @EmmaLFoley
Where can I find more information? • collectd and Vitrage Integration: An Eventful Presentation • Intel - Collectd and Vitrage Integration: An Eventful Demo • Automating Noisey Neighbour Detection with OpenStack Watcher • OPNFV Doctor • Barometer stats • OpenStack Vitrage
Thank You! Julien Danjou Emma Foley jdanjou@redhat.com emma.l.foley@intel.com @juldanjou @EmmaLFoley

Recommend

Automated fault detection for Automated fault detection for Autosub6000: Autosub6000: What we've

Automated fault detection for Automated fault detection for Autosub6000: Autosub6000: What we've achieved in a year? TSEM talk @ Institute of Cybernetics, Tallinn, Estonia Juhan Ernits, March 9, 2010 Overview of todays talk Overview of today s

490 views • 26 slides

Fault Detection and Mitigation in WLAN RSS Nearest Neighbor Fingerprint-based Positioning

Introduction - Motivation - Fault Model - Measurement Setup Fault Detection and Mitigation in WLAN RSS Nearest Neighbor Fingerprint-based Positioning Algorithm - Fault Detection - Fault Tolerance Hybrid Positioning Algorithm Christos

708 views • 41 slides

BSc Project What kinds of fault we may confront in a control loop? Fault Detection &

13/12/2016 2 of 23 Content What is fault? Why we detect fault in a control loop? BSc Project What kinds of fault we may confront in a control loop? Fault Detection & Diagnosis What is stiction? in Control Valves

406 views • 6 slides

Lecture 10: Fault Tolerance Fault Tolerant Concurrent Computing The main principles of fault

Lecture 10: Fault Tolerance Fault Tolerant Concurrent Computing The main principles of fault tolerant programming are: Fault Detection - Knowing that a fault exists Fault Recovery - having atomic instructions that can be rolled back in

361 views • 18 slides

Voting-based fault detection and diagnosis in systems with multiple operating conditions Carlos F

Voting-based fault detection and diagnosis in systems with multiple operating conditions Carlos F . Alcala Controls Research Group May 18, 2016 1 / 39 Outline Introduction 1 Fault detection and diagnosis with PCA 2 Voting-based Fault

1.34k views • 108 slides

Transient Fault Detection and Reducing Transient Error Rate Jose Lugo-Martinez CSE 240C:

Transient Fault Detection and Reducing Transient Error Rate Jose Lugo-Martinez CSE 240C: Advanced Microarchitecture Prof. Steven Swanson Outline Motivation What are transient faults? Hardware Fault Detection Lockstepping NonStop Himalaya

561 views • 37 slides

Fault Detection & Diagnosis in Control Valve Shahriar iar Shahra ram Super ervi visor:

BSc Project Fault Detection & Diagnosis in Control Valve Shahriar iar Shahra ram Super ervi visor: sor: Dr. No Noba bakhti hti 2 of 29 Content What is fault? Why we detect fault in a control loop? What is Stiction

720 views • 30 slides

faster c&c detection - strategies for finding algorithmically generated domain names

. Malgorzata Debska September 22, 2015 CERT Polska faster c&c detection - strategies for finding algorithmically generated domain names Introduction - what is DGA? Malicious usage in botnets Benign DGA - false alarms in detection

1.38k views • 99 slides

Can Data Transformation Help in the Detection of Fault-Prone Modules? Y. Jiang, B. Cukic, T.

Can Data Transformation Help in the Detection of Fault-Prone Modules? Y. Jiang, B. Cukic, T. Menzies Lane Department of CSEE West Virginia University DEFECTS 2008 High Assurance Systems Lab Background Prediction of fault-prone modules is

406 views • 17 slides

Locating arrays and disjoint partitions Daniel Horsley (Monash University, Australia) Joint work

Locating arrays and disjoint partitions Daniel Horsley (Monash University, Australia) Joint work with Charles Colbourn and Bingli Fan. Covering arrays A fault detection problem A fault detection problem A fault detection problem A fault

1.23k views • 111 slides

MPLS TP Ring Fault Detection and Localization draft-jiang-mpls-tp-ring-fd Authors Albert

MPLS TP Ring Fault Detection and Localization draft-jiang-mpls-tp-ring-fd Authors Albert Jiang Guoman Liu Xuehui Dai (ZTE) Purpose & Overview MPLS TP Ring Optimized Node/Link Fault Detection & Localization Mechanism 1)

405 views • 21 slides

IEEE P1149.8.1 Selective Toggle Fault Detection and Isolation Steve Butkovich Cisco Systems,

IEEE P1149.8.1 Selective Toggle Fault Detection and Isolation Steve Butkovich Cisco Systems, Inc . y , Goal of the Fault Evaluation Goal of the Fault Evaluation Using the faults Using the faults portrayed in figure 6 expand on the

369 views • 8 slides

Parameter estimation methods for fault detection and isolation LAAS-CNRS UPC Teresa Escobet

Parameter estimation methods for fault detection and isolation LAAS-CNRS UPC Teresa Escobet (UPC & LEA-SICA, Spain) Louise Trav-Massuys (LAAS-CNRS & LEA-SICA, France) Parameter estimation methods for fault detection and isolation

265 views • 14 slides

Concurrent Fault Detection for Secure QDI Asynchronous Circuits Konrad J. Kulikowski, Mark G.

Concurrent Fault Detection for Secure QDI Asynchronous Circuits Konrad J. Kulikowski, Mark G. Karpovsky, Alexander Taubin, Zhen Wang, Adrian Kulikowski Boston University Reliable Computing Laboratory 6/27/2008 Outline Side Channel

293 views • 18 slides

Faster Region-based Hotspot Detection Ran Chen 1 , Wei Zhong 2 , Haoyu Yang 1 , Hao Geng 1 , Xuan

Faster Region-based Hotspot Detection Ran Chen 1 , Wei Zhong 2 , Haoyu Yang 1 , Hao Geng 1 , Xuan Zeng 3 , Bei Yu 1 1 The Chinese University of Hong Kong 2 Dalian University of Technology 3 Fudan University 1 / 16 Lithography Hotspot Detection

641 views • 16 slides

Unsupervised scene adaptation for faster multi-scale pedestrian detection Speaker Federico

Unsupervised scene adaptation for faster multi-scale pedestrian detection Speaker Federico Bartoli 1 Giuseppe Lisanti 1 , Svebor Karaman 1 , Andrew D. Bagdanov 2 and Alberto Del Bimbo 1 1 MICC (Media Integration and Communication Center) -

311 views • 19 slides

Friet: An Authenticated Encryption Scheme with Built-in Fault Detection Thierry Simon 1,2 Lejla

Friet: An Authenticated Encryption Scheme with Built-in Fault Detection Thierry Simon 1,2 Lejla Batina 1 Joan Daemen 1 Vincent Grosso 1,3 Pedro Maat Costa Massolino 1 Kostas Papagiannopoulos 1,4 Francesco Regazzoni 5 Niels Samwel 1 1 Radboud

543 views • 28 slides

Statistical fault detection and isolation for linear time-varying systems Qinghua Zhang &

Introduction Proposed algorithm Example Statistical fault detection and isolation for linear time-varying systems Qinghua Zhang & Michle Basseville INRIA & CNRS-IRISA, Rennes, France 16th IFAC SYSID, Brussels, Belgium, July 11-13,

488 views • 19 slides

Fault detection and mitigation from uninterpreted data of robotic sensorimotor cascades Andrea

1 Fault detection and mitigation from uninterpreted data of robotic sensorimotor cascades Andrea Censi * Magnus Hkansson # Richard M. Murray Caltech LTH Caltech * 5th year graduate student, # spent a California summer defending in a few

295 views • 26 slides

AI-based Low Computational Power Actuator/ Sensor Fault Detection Applied on a MAGLEV Suspension

AI-based Low Computational Power Actuator/ Sensor Fault Detection Applied on a MAGLEV Suspension K. Michail, K. Deliparaschos, A. Zolotas, S. G. Tzafestas 21 st Mediterranean Conference on Control and Automation Crete, Greece, 25-28 June 2013

945 views • 23 slides

Data Analysis, Estimation, and Fault detection of Large-Scale Autonomous System of Vehicles Using

Data Analysis, Estimation, and Fault detection of Large-Scale Autonomous System of Vehicles Using Neural Networks Presented by: Parsa Yousefi Supervisors: Dr. M. Jamshidi, Dr. P. Benavidez June 23 rd , 2017 The University of Texas at San

571 views • 33 slides

CS7015 (Deep Learning) : Lecture 12 Object Detection: R-CNN, Fast R-CNN, Faster R-CNN, You Only

CS7015 (Deep Learning) : Lecture 12 Object Detection: R-CNN, Fast R-CNN, Faster R-CNN, You Only Look Once (YOLO) Mitesh M. Khapra Department of Computer Science and Engineering Indian Institute of Technology Madras 1/47 Mitesh M. Khapra

1.17k views • 47 slides

An Intelligent Approach using SVM to Enhance Turn-to-Turn Fault Detection in Power Transformers

An Intelligent Approach using SVM to Enhance Turn-to-Turn Fault Detection in Power Transformers Dr. Mohamed Elsamahy, P.Eng. Department of Electrical Power & Energy Military Technical College, Cairo, Egypt Mariya Babiy, E.I.T Department of

352 views • 16 slides

NoCAlert: An On-Line and Real- Time Fault Detection Mechanism for Network-on-Chip Architectures

NoCAlert: An On-Line and Real- Time Fault Detection Mechanism for Network-on-Chip Architectures Andreas Prodromou, Andreas Panteli, Chrysostomos Nicopoulos, and YiannakisSazeides University of Cyprus MICRO 2012 Presenters: Leul Belayneh, Shibo

215 views • 18 slides