Network Monitoring System with Scheduler Takatoshi Ikeda APAN-JP - PowerPoint PPT Presentation

Network Monitoring System with Scheduler Takatoshi Ikeda APAN-JP NOC, KDDI R&D Labs The 20 th APAN meeting in Taipei 2005.8.25

Outline � Background and Motivation � Goal � Outline of the System � Specification of the Developed Environment � Demonstration � Issue List � Roadmap The 20 th APAN meeting in Taipei 2005.8.25

Background and Motivation � Lessons Learned from SC2004 � Traffic pattern in Bandwidth Challenge I l l i n o i s U N I V . & J A X A A lot of demonstration that A I S T filled in almost all bandwidth of a link were conducted in very short term. (tens of minutes) Illinois UNIV. Tokyo UNIV. JGN2 circuit, Japan-US, OC-192c(10Gbps) The 20 th APAN meeting in Taipei 2005.8.25

Background and Motivation (cont.) � Lessons Learned � Schedule The schedule of actual demos were under control, but preliminary experiments had to been arranged by applicant. In addition, these schedules ware not opened to an online, such as web. � Unexpected traffic An unexpected traffic might be generated during the allocated time slot . However, we couldn’t identify the source of this traffic and couldn’t detect it either. � No expected traffic Although the demo slot was allocated, the traffic was not generated at all. The allocated slot should be well used by applicants. → We need tool that can manage the schedule of the demonstration and monitor the traffic along the schedule The 20 th APAN meeting in Taipei 2005.8.25

Goal � Efficiency of managing the schedule The user and a operator can manage the schedule of demo through web, that makes the schedule management more efficient � Management of a resource By managing the bandwidth of an international link, overbooking by multiple demos can be avoided. � Monitoring along the schedule By monitoring the traffic on the international link along the schedule, unexpected or abused traffic will be alerted and the unused slot will be detected, too. The 20 th APAN meeting in Taipei 2005.8.25

Outline of the System The 20 th APAN meeting in Taipei 2005.8.25

Outline of the Operation (example: detection a unexpected traffic) Network Network Unexpected user Unexpected user Unexpected user Unexpected user congestion Observatory 2, generate the huge traffic for experiment data user user user user Get the network data Network Monitoring System Alert with Scheduler 1, register the schedule detect - start time, end time Scheduler Monitoring tool - required bandwidth Notification - Src IP , Dst IP • Manage the schedule • Monitor the traffic - …etc Check the schedule • Alert to unexpected user manage the schedule Check the schedule schedule operator operator The 20 th APAN meeting in Taipei 2005.8.25

Outline of the Function � Scheduling The system has web page for registering a demo. The user or operator can register information of demo into the system, such as start time, end time, bandwidth and the contact point. The system decide whether the demo can be accepted or not, based on the availability of the link. � Monitoring The system monitors the traffic along the schedule on the link in full-time, and detects both unscheduled traffic and unused slot; the system alerts the contact point, if detected. The 20 th APAN meeting in Taipei 2005.8.25

System Architecture U s e r O p e r a t o r User Access Layer � � Web Interface (for Management) W e b i n t e r f a c e � Request Handler U s e r P a g e O p e r a t o r p a g e � Schedule Management Layer R e q u e s t H a n d l e r U s e r d a t a � Demo scheduling manager U s e rA c c e s sL a y e r S e r v i c e � Resource manager r e g i s t o r y P l a n D e m o s c h e d u l i n g R e s o u r c e m a n a g e r m a n a g e r Monitoring Layer � L i n k r e s o u r c e S c h e d u l e d a t a d a t a � monitoring S c h e d u l e M a n a g e m e n tL a y e r � Alert sender M o n i t o r i n g Service register � A l e r t s e n d e r M a n a g e r � For multi domain (Plan) I n t e r f a c e N e t f l o w M o n i t o r i n gL a y e r U s a g e E - m a i l O b s e r v a t o r y w h o i s U s a g e N e t f l o w D a t a d a t a s e r v e r The 20 th APAN meeting in Taipei 2005.8.25

User Access Layer This Layer provides a web interface for management to a user and operator, and handle the request that through the web interface UAL SML � Component � Web interface MML � Request Handler Network Monitoring system � Management information With Scheduler � User information � Demo information (start and end time, requested link and bandwidth, ,,,etc) The 20 th APAN meeting in Taipei 2005.8.25

Schedule Management Layer This Layer manages the schedule of demo and a resource of link, and process the request about the schedule from UAL and MML. UAL � Component SML � Demo Scheduling Manager � Resource Manager MML � Management information � Demo information (start and end time, Network Monitoring system requested link and bandwidth, ,,,etc) With Scheduler � Link information (bandwidth, terminated router and interface, ,,,etc) � Link reservation (start and end time, bandwidth) The 20 th APAN meeting in Taipei 2005.8.25

Monitoring Layer This Layer collects the traffic data from observatory which is the system that disclose the valuable network data. By using that data and schedule data, it monitor whether the traffic are generated along the UAL schedule. If the traffic is not along the schedule, it give notice to appropriate SML contact and operator. Component � MML � Monitoring � Alert sender Network Monitoring system With Scheduler � Management information � Usage data of link � Flow data The 20 th APAN meeting in Taipei 2005.8.25

Specification of the Developed Environment The 20 th APAN meeting in Taipei 2005.8.25

Specification � Hardware for development � Supermicro 8013P+8 � CPU : Dual Intel Xeon 3.2GHz � Memory : DDR-226 2GB � HDD : SCSI Ultra320 140GB � Software for development � OS � Redhat Fedora core 3 （ Kernel 2.6.11-1.27_smp ） � Language � Perl (Version 5.8.5) � Free software � Apache （ web server) � rrdtool （ store the interface usage data) � Flow-tools (netflow collector & analyst tool) � NFS (sync the measurement data) The 20 th APAN meeting in Taipei 2005.8.25

Specification (cont.) � Traffic Data Router � Usage Data (Juniper,Cisco,,,) Usage data of router interface for international link. This data is gotten by SNMP every 10 seconds and stored into rrd file. The system fetch the data through SNMP NFS. Netflow � Flow Data Netflow data which is exported by nms2 a router. The router which terminated target link exports it. nms4 The data is stored into file which is replication NFS flow-tool format every one minute. nmdb1 Network Monitoring The system fetch the data by System replication function of flow-tools on NFS With Scheduler Observatory Observatory server. The 20 th APAN meeting in Taipei 2005.8.25

Demonstration The 20 th APAN meeting in Taipei 2005.8.25

Outline of the Demonstration register the demonstration 1. Register the demo information on the system (done beforehand) Generate the demo traffic 2. Generate the traffic from Tokyo to Los Angeles Show the graph 3. Show the graph of demo traffic The 20 th APAN meeting in Taipei 2005.8.25

Network configuration for the demo iperf TCP Stream （ １ Gbps) nms1 Tokyo to LA nms2 nms4 Monitoring Data TransPAC2 nmdb1 Transfer US-JAPAN Link nms1 OC-192(10Gbps) Observatory Network Observatory Monitoring System with Scheduler Registration of operator operator schedule Los Angeles, US Tokyo, Japan The 20 th APAN meeting in Taipei 2005.8.25

Issue List � Algorithm design for detection In the current phase , the system can grasp the traffic on the link. For the next phase, the algorithm that detects unscheduled traffic or unused slot will be implemented. � Assessment of the performance The CPU load of the router will be checked, and the performance of server will be estimated in the real environments. The 20 th APAN meeting in Taipei 2005.8.25

Issue List (cont.) � User profile Manage the user login and prepare for the user and the operator’s web pages. � Security The security of communication between layers will be implemented. � Other flow format Switch or router has adapted the other flow technology such as sFlow. Its format will be supported. The 20 th APAN meeting in Taipei 2005.8.25

Road map � 2005/8-9 Algorithm for the detection will be implemented. Also, some parameters for detection are adjusted by using real-world data. � 2005/9 use the system experimentally for iGrid2005. � 2005/11 use the system for SC2005. The 20 th APAN meeting in Taipei 2005.8.25