GRNET NOC network monitoring & visualization tools TF-NOC - PowerPoint PPT Presentation

http://www.grnet.gr GRNET NOC network monitoring & visualization tools TF-NOC Zurich Alex Kosiaris (alex@noc.grnet.gr) Leonidas Poulopoulos (leopoul@noc.grnet.gr)

Network monitoring • Constant monitoring of network for components • Failing • Malfunctioning • Notification of users via mail, sms, web interface • Monitoring aids in • Preventing or limiting downtime • Effectively tracing errors and coping with them • Translating from machine errors to user friendly ones • Keeping performance, errors and faults archive GRNET NOC network monitoring & TF-NOC, Zurich 2 visualization tools

Visualization • Network Topology • Clearer view of network topology • Easier reading of links and relations • Services • Better anticipation of service deployment • Effective and appealing “marketing” • Any network related set of data • Traffic, Errors, Service requests • Charts, Maps, Graphs, Tables GRNET NOC network monitoring & TF-NOC, Zurich 3 visualization tools

Tools • Tool Requirements • What we do  Developed (if possible) in-house  70% of the tools is developed  … using the same (if - in-house  Python/Django: 70%, PHP: 30% possible)development framework  Use SNMP (99%) to harvest  …with a widely deployed and network data accepted network mgmt  Release updates every 2-3 middleware months  Maintained in-house  Use a MySQL database to bind  Bound together – using a data common data source  Avoid live SNMP queries to  With the least possible devices overhead to the network devices, services GRNET NOC network monitoring & TF-NOC, Zurich 4 visualization tools

Tools (2) • • NMS & Monitoring In-house  Alcatel & Adva NMS  grnetdb (~150 tables) MySQL  HP OV  Topology, devices features discovery: SNMP, PHP, custom RDBMS layer (4 times/day)  Nagios, Munin, mrtg/rrd  Visualization: Google Maps API, Django framework, DOJO JS framework, JSON data serialization  Graphs: Django framework, jquery, rrd  Monitoring: Nagios with data feed from grnetdb GRNET NOC network monitoring & TF-NOC, Zurich 5 visualization tools

Architecture PHP SNMP getters GRNET Network discovery Device Graphs core functionality GRNET RDBMS DJANGO framework Network Topology Rancid Hostmaster grnetdb MySQL Nagios H/W Inventory Ticketing L1 topology (Jira) builder CLI check scripts Widgets GRNET NOC network monitoring & TF-NOC, Zurich 6 visualization tools

Device Graphs • http://mon.grnet.gr/rg • Django (Python) templates - backend • jQuery & jQuery UI • Mobile flavour (jQuery mobile) • Network device configuration retrieved from grnetdb • Poll devices using a smart algorithm (minimize overhead) • RRD graphs (rrdtool Python) • Minor administrative interference • Devices and ifces discovered by PHP SNMP script automatically • Device graph types determined automatically • Personalization • Custom search engine • Version releases every 2-3 months • Not open sourced yet • Abstraction layer has to be implemented • Rewrite parts of code – get rid of GRNET-specific parts GRNET NOC network monitoring & TF-NOC, Zurich 7 visualization tools

Device Graphs (2) Mobile flavor will be soon released GRNET NOC network monitoring & TF-NOC, Zurich 8 visualization tools

Network Topology • http://mon.grnet.gr/network/maps/  Google Maps API v2 (soon to be ported to v3)  Django Framework  DOJO Javascript Framework  Data serialized to JSON and fed to API  Topology (L1, L2, L3)  Network weathermap (live data from rrd files)  Points of presence – GRNET clients  Lightweight edition eases integration with other apps TF-NOC, Zurich GRNET NOC network monitoring & 9 visualization tools

Network Topology (2) GRNET NOC network monitoring & TF-NOC, Zurich 10 visualization tools

Alarming • Nagios based  Common Infrastructure • Network – Django Python tool to query grnetdb and generate configuration • Servers/Services – Populated through automation tool Puppet  An effort to maximize SNR • Notifications go to interested parties only • Web interface supports authorization so only relevant information is available  Plans for Load Balancing/HA setup GRNET NOC network monitoring & TF-NOC, Zurich 11 visualization tools

Alarming (2) • Visualization  Standard interface not topology aware • Hates circular (aka rendundant) links • Nagios map cgi ugly • Information decimation difficult  Nagvis to the rescue • Supports multiple maps • Maps web editable • Visual and audible alarming • Still a work in progress GRNET NOC network monitoring & TF-NOC, Zurich 12 visualization tools

Alarming (3) GRNET NOC network monitoring & TF-NOC, Zurich 13 visualization tools

Thank you Questions ? TF-NOC, Zurich GRNET NOC network monitoring & 14 visualization tools