sampling and filtering techniques sampling and filtering
play

Sampling and Filtering Techniques Sampling and Filtering Techniques - PowerPoint PPT Presentation

Sampling and Filtering Techniques Sampling and Filtering Techniques for IP Packet Selection for IP Packet Selection draft-ietf ietf- -psamp psamp-sample-tech-00.txt -sample-tech-00.txt draft- Tanja Zseby, FhG FOKUS Maurizio Molina, NEC


  1. Sampling and Filtering Techniques Sampling and Filtering Techniques for IP Packet Selection for IP Packet Selection draft-ietf ietf- -psamp psamp-sample-tech-00.txt -sample-tech-00.txt draft- Tanja Zseby, FhG FOKUS Maurizio Molina, NEC Europe Ltd. Fredric Raspall, NEC Europe Ltd.

  2. Scope of of Document Document Scope � Terminology (later moved to framework) � Information Models for Packet selection methods – What information needs to be provided to describe the method – Basis for • Configuration of methods • Reporting of technique in use to collector draft-ietf-psamp-sample-tech-00.txt 2

  3. Terminology Terminology Use IPFIX terms: � – Metering, Exporting and Collection Process – Observation Point – Flow � Packet Selection – Filtering – Sampling – Combinations � Filtering – Deterministic function on parts of the packet content (header, payload) – can emulate a pseudo random selection – � needs to process the packet for selection decision � Sampling – Deterministic or random function on temporal or spatial packet position or – By performing random calculations per packet – � may need packet position � Packet Stream – Input stream for selector – Differs from IPFIX flow definition draft-ietf-psamp-sample-tech-00.txt 3

  4. Relation to IPFIX Relation to IPFIX Exporting Process IPFIX Metering Process PSAMP MIB Record Creation Packet Selection Timestamping Packet Selection Capturing Packet Selection Observation Point draft-ietf-psamp-sample-tech-00.txt 4

  5. Information Models Information Models SELECTOR_ID � – Unique ID for Selector � SELECTOR_TYPE – Sampling algorithm • n-out-of-N • Systematic Time Based (STB) • Systematic Position Based (SPB) • Probabalistic – Filtering method • Matching • Hashing • Router State � SELECTOR_PARAMETERS – Input parameters for process (depend on SELECTOR_TYPE) � OPERATING_TIME – Start/stop time of process � ASSOCIATIONS – Stream ID (Observation Point ID or List of SELECTOR_IDs) – Associations to IPFIX processes (metering, exporting) draft-ietf-psamp-sample-tech-00.txt 5

  6. STREAM_ID STREAM_ID Observation Point STREAM_ID: Stream Selector A - Observation Point ID Observation Point Stream STREAM_ID: Selector A Selector B - SELECTOR_ID A Observation Selector A Point STREAM_ID: Stream Selector C - SELECTOR_ID A - SELECTOR_ID B Selector B draft-ietf-psamp-sample-tech-00.txt 6

  7. Parameters Parameters � Sampling � Random Sampling � n-out-of-N � Sample fraction n/N � Probabilistic � Sampling probability p � Systematic Sampling (equally spaced) � Time Based (temporal packet position) � Interval length (in time) � Spacing � Position based (spatial packet position) � Interval length (in packets) � Spacing draft-ietf-psamp-sample-tech-00.txt 7

  8. Parameters Parameters � Filtering – Matching • Bitmask or interval • For header, payload or both – Hashing • Considered bits • Hash function and parameters – Router State • Router state/treatment that triggers selection � Composite Schemes – Combination of basis schemes – Concatenated via STREAM_ID definition draft-ietf-psamp-sample-tech-00.txt 8

  9. Open Issues Issues Open � Terminology – Agree on common terminology (sampling draft, framework draft, IPFIX) – Move section to framework document � Categorization – Specify what input is required for the selection process • Filtering needs packet content • Sampling may need packet position • 3rd category for router state based filtering ? – Hashing • would be a form of filtering • But: pseudo random sampling can be achieved with hashing – Useful categorization ? Other proposals ? Needed at all ? draft-ietf-psamp-sample-tech-00.txt 9

  10. Open Issues Issues Open � IPFIX Relations – Packet selection as part of the IPFIX metering process – Associated IPFIX process – Alternative reporting protocols ? – will there be IDs for observation points and IPFIX processes ? – Specify location of packet selection component in metering process draft-ietf-psamp-sample-tech-00.txt 10

  11. Open Issues Issues Open � Focus on few standard selection methods ? – Which ? – How many ? � Combined schemes – Linked – Or define as separate scheme � Which aspects should be standardized ? – Schemes and Parameters – Configuration format – Reporting format – Configuration Protocol? SNMP ? – Reporting protocol ? IPFIX ? � Further issues need to be covered ? draft-ietf-psamp-sample-tech-00.txt 11

  12. Thank you for your attention ! Thank you for your attention ! Questions ? Opinions ?

Recommend


More recommend