Monasca Project Update Shanghai Open Infrastructure Summit Witek - PowerPoint PPT Presentation

N o v e mb e r 2 0 1 9 Monasca Project Update Shanghai Open Infrastructure Summit Witek Bedyk (irc: witek)

What does Monasca do? • Monitoring-as-a-Service • multi-tenant • high-performant • HA / fault tolerant • scalable • PUSH model • Amazon CloudWatch equivalent

C o mp a r i s o n Monasca Prometheus Telemetry model push pull push multi-tenant + - + HA + ○ + scalability + ○ + historical data + ○ + alerting API YAML API delivery guarantee + - - high-performant + + - query language + ++ + community small large maintanace https://www.openstack.org/summit/denver-2019/summit-schedule/events/23646/monasca-openstack-monitoring

M a i n C o n t r i b u t o r s

N o v e mb e r 2 0 1 9 T r a i n Wo r k

Middleware Upgrade • InfmuxDB 1.7.6 – Time Series Index introduced to support millions of unique time series – security fjxes • Apache Kafka 2.0.1 • Apache Storm 1.2.2 https://storyboard.openstack.org/#!/story/2005624

M e t r i c s + L o g s + N o t i fj c a t i o n s • L o g s / N o t i fj c a t i o n s a n d M e t r i c s a r e c o m p l e m e n t a r y • P r o v i d e S i n g l e P a n e o f G l a s s M e t r i c s • C o r r e l a t e d i fg e r e n t s o u r c e s o f i n f o r m a t i o n • D e r i v e e v e n t - b a s e d m e t r i c s • S y s t e m p e r f o r m a n c e N o t i fj c a t i o n s L o g s • U t i l i z a t i o n • S t a t u s / E r r o r s

M e r g e A P I s • R e d u c e t e c h n i c a l d e b t • S a m e u s e r e x p e r i e n c e • E a s i e r d e p l o y m e n t a n d o p e r a t i o n h t t p s : / / s t o r y b o a r d . o p e n s t a c k . o r g / # ! / s t o r y / 2 0 0 3 8 8 1

Apache Kafka client upgrade • All components can now use confmuent-kafka-python library • Uses asynchronous interface for better performance – producer x10 higher throughput – consumer x6 higher throughput • legacy_kafka_client_enabled has to be set to false https://storyboard.openstack.org/#!/story/2005624

Other work • Create Docker images in OpenDev CI – https://storyboard.openstack.org/#!/story/2001694 ● Add time-range scoping for dimension queries – https://storyboard.openstack.org/#!/story/2006204 ● Add templating support for Slack notifjcations – https://storyboard.openstack.org/#!/story/2001308 ● Use separate databases for tenants (InfmuxDB) – https://storyboard.openstack.org/#!/story/2006331 (work in progress)

Community-wide goals ● Update Python 3 test runtimes ● Enabling PDF generation support – https://storyboard.openstack.org/#!/story/2006097

N o v e mb e r 2 0 1 9 U s s u r i p l a n s

New Thresholding Engine • Faust – Python Stream Processing library – highly-available – distributed – fast and fmexible • Works with Apache Kafka – no Apache Storm dependency • Library evaluated and prototype implemented – https://storyboard.openstack.org/#!/story/2001308 • Will support threshold and event based alerts

Planned features & enhancements for Ussuri • Monasca Events Agent • InfmuxDB HA setup • Extended query capabilities • Use Keystone’s application credentials in Grafana • IPv6 support http://specs.openstack.org/openstack/monasca-specs/priorities/ussuri-priorities.html

We w a n t y o u r f e e d b a c k • M a i l i n g l i s t ( p l e a s e a d d [ m o n a s c a ] t a g ) o p e n s t a c k - d i s c u s s @l i s t s . o p e n s t a c k . o r g • I R C a t f r e e n o d e # o p e n s t a c k - m o n a s c a • We e k l y t e a m m e e t i n g We d n e s d a y s 1 5 0 0 U T C # o p e n s t a c k - m o n a s c a h t t p : / / e a v e s d r o p . o p e n s t a c k . o r g / # M o n a s c a _ T e a m _ M e e t i n g

H o w t o c o n t r i b u t e • K a n b a n b o a r d ( b a c k l o g , r e v i e w s ) h t t p s : / / s t o r y b o a r d . o p e n s t a c k . o r g / # ! / b o a r d / 1 9 0 • B u g fj x e s • C r o s s - P r o j e c t I n t e g r a t i o n s • I n s t a l l e r s • D o c u m e n t a t i o n

M o n a s c a i n D e n v e r • E ffjc i e n t M o n i t o r i n g a n d R o o t C a u s e A n a l y s i s i n C o mp l e x S y s t e ms t h T u e 3 : 2 0 p m – 6 F l o o r , 6 1 9 • P T G M o n a s c a P r o j e c t O n b o a r d i n g – We d 1 : 3 0 p m – M i t a k a

THANKS. Questions? openstack @OpenStack openstack OpenStackFoundation