machine learning based anomaly detection for post silicon
play

Machine Learning-based Anomaly Detection for Post-silicon Bug - PowerPoint PPT Presentation

Aug 30, 2022 •41 likes •201 views

Machine Learning-based Anomaly Detection for Post-silicon Bug Diagnosis Andrew DeOrio , Qingkun Li, Matthew Burgess and Valeria Bertacco University of Michigan University of Illinois Verification trends Wilson Research Group and Mentor

  1. Machine Learning-based Anomaly Detection for Post-silicon Bug Diagnosis Andrew DeOrio , Qingkun Li, Matthew Burgess and Valeria Bertacco University of Michigan University of Illinois

  2. Verification trends Wilson Research Group and Mentor Graphics 2010 Functional Verification Study 20-Mar-2013 Andrew DeOrio / University of Michigan 2

  3. Increasing post-silicon validation Design and pre-silicon Post-silicon validation effort verification effort Bob Barton, Intel. Invited talk at GSRC. 20-Mar-2013 Andrew DeOrio / University of Michigan 3

  4. Post-silicon validation Pre-silicon Post-silicon Product Goal: locate bug + Fast prototypes - Poor observability + High coverage - Slow off-chip transfer + Test full system - Noisy + Find deep bugs - Intermittent bugs 20-Mar-2013 Andrew DeOrio / University of Michigan 4

  5. Post-silicon and credit cards pushl %epb movl difficult to %epb locate bug! same test many different results difficult to locate fraud! same card many different transactions 20-Mar-2013 Andrew DeOrio / University of Michigan 5

  6. Post-silicon and credit cards pushl %epb anomalous movl compare %epb time and failing same location test test anomaly? compare same new card transaction 20-Mar-2013 Andrew DeOrio / University of Michigan 6

  7. Post-silicon and credit cards pushl clustering %epb anomalous movl %epb algorithm time and same location test training data: unknown positive example examples feature feature time@1=1 time@1=2 … signal A signal B … time@1=2 time@1=1 feature feature 20-Mar-2013 Andrew DeOrio / University of Michigan 7

  8. Learning clusters clustering algorithm feature values of One test, 1 st time window passing examples signal B feature value time@1 clusters signal A feature value signal A signal B 1 st time window 20-Mar-2013 Andrew DeOrio / University of Michigan 8

  9. Searching for anomalies clustering algorithm One test, 1 st time window feature values of signal B feature value unknown examples Added after inside clusters: no bug clustering signal A feature value signal A signal B 1 st time window 20-Mar-2013 Andrew DeOrio / University of Michigan 9

  10. Searching for anomalies clustering algorithm One test, 2 nd time window Outside clusters: signal B feature value bug found # anomalies > threshold signal A feature value signal A signal B 2 nd time window 20-Mar-2013 Andrew DeOrio / University of Michigan 10

  11. Clustering in X,000 dimensions clustering algorithm • Each signal is a dimension – Circular clusters become signal B feature value hyper-spheres – High dimensionality is a challenge • In practice: – Cap #signals in one clustering set (500) signal A feature value – Group signals by module(s) (100-500 signals) – Apply clustering to each group 20-Mar-2013 Andrew DeOrio / University of Michigan 11

  12. Experimental Setup 100 random seeds: variable memory delay, 10 seeds crossbar random traffic monitored 41,743 top level control signals 1000 passing runs training data HW unknown data 1000 10 testcases buggy runs 10 bugs: e.g. , functional bug in PCX, electrical error in Xbar 20-Mar-2013 Andrew DeOrio / University of Michigan 12

  13. Bug injection Bug Description PCX_gnt SA Stuck-at in PCX grant Xbar elect Electrical error in crossbar BR fxn Functional bug in branch logic MMU fxn Functional bug in memory controller PCX_atm SA Stuck-at in PCX atomic grant PCX fxn Functional bug in PCX XBar combo Combined electrical errors in Xbar/PCX MCU combo Combined electrical errors in mem/PCX MMU combo Combined functional bugs in MMU/PCX EXU elect Electrical error in execute unit 20-Mar-2013 Andrew DeOrio / University of Michigan 13

  14. Bug detection on OpenSPARC T2 100% exact 90% signal Percentage of Testcases detected Bug not detected 80% Bug signal not Bug detected other 70% observable signals 60% detected no bug 50% effect 40% 30% false negative 20% 10% false 0% positive 9/10 bugs caught 20-Mar-2013 Andrew DeOrio / University of Michigan 14

  15. Bug signal vs. noise More training data -> more accuracy 20-Mar-2013 Andrew DeOrio / University of Michigan 15

  16. Conclusions • Machine learning automatically localizes bug time and location • Leverages a statistical approach to tolerate noise • Effective for a variety of bugs: functional, electrical and manufacturing – 336 cycles, 347 signals on average 20-Mar-2013 Andrew DeOrio / University of Michigan 16

Recommend

Challenges in Vessel Behavior and Anomaly Detection: From Classical Machine Learning to Deep

Challenges in Vessel Behavior and Anomaly Detection: From Classical Machine Learning to Deep

Challenges in Vessel Behavior and Anomaly Detection: From Classical Machine Learning to Deep Learning Lucas May Petry 1 , Amilcar Soares 2 , Vania Bogorny 1 , Bruno Brandoli 2 , Stan Matwin 2 1 Programa de Ps-Graduao em Cincias da

1.26k views • 16 slides
Opprentice: Towards Practical and Automatic Anomaly Detection Through Machine Learning Dapeng Liu

Opprentice: Towards Practical and Automatic Anomaly Detection Through Machine Learning Dapeng Liu

Opprentice: Towards Practical and Automatic Anomaly Detection Through Machine Learning Dapeng Liu , Youjian Zhao, Haowen Xu, Yongqian Sun, Dan Pei, Jiao Luo, Xiaowei Jing, Mei Feng 2015/12/3 Dapeng Liu (liudp10@mails.tsinghua.edu.cn) KPIs and

545 views • 42 slides
Using Machine Learning for Intelligent Storage Performance Anomaly Detection Ramakrishna Vadla,

Using Machine Learning for Intelligent Storage Performance Anomaly Detection Ramakrishna Vadla,

Using Machine Learning for Intelligent Storage Performance Anomaly Detection Ramakrishna Vadla, IBM Archana Chinnaiah, IBM Acknowledgement : Sumant Padbidri, Anbazhagan Mani Agenda Market Estimates & Forecasts Applications in

606 views • 12 slides
Anomaly Detection of Trajectories Junier B. Oliva Anomaly Detection An anomaly (or outlier)

Anomaly Detection of Trajectories Junier B. Oliva Anomaly Detection An anomaly (or outlier)

Anomaly Detection of Trajectories Junier B. Oliva Anomaly Detection An anomaly (or outlier) in a dataset is an instance that is abnormal or unlikely based on the rest of the dataset If the instances in the dataset are labeled as

760 views • 19 slides
Learning Rules for Anomaly Detection (LERAD) of Hostile Network Traffic Matt Mahoney Overview

Learning Rules for Anomaly Detection (LERAD) of Hostile Network Traffic Matt Mahoney Overview

Learning Rules for Anomaly Detection (LERAD) of Hostile Network Traffic Matt Mahoney Overview Prior Work in Network Anomaly Detection The 1999 DARPA Intrusion Detection Evaluation Packet Header Anomaly Detection (PHAD) Application

575 views • 18 slides
Detecting Attacks Anomaly-based Detection Signature-based Signature-based (Misuse)

Detecting Attacks Anomaly-based Detection Signature-based Signature-based (Misuse)

Detecting Attacks Anomaly-based Detection Signature-based Signature-based (Misuse) Detection Intrusion Detection Host-based Network-based Boriana Ditcheva and Lisa Fowler Active/Passive University of North Carolina at

401 views • 12 slides
Anomaly Detection Jia-Bin Huang Virginia Tech Spring 2019 ECE-5424G / CS-5824 Administrative

Anomaly Detection Jia-Bin Huang Virginia Tech Spring 2019 ECE-5424G / CS-5824 Administrative

Anomaly Detection Jia-Bin Huang Virginia Tech Spring 2019 ECE-5424G / CS-5824 Administrative Anomaly Detection Motivation Developing an anomaly detection system Anomaly detection vs. supervised learning Choosing what features

514 views • 34 slides
In Incorporating Feedback in into Tree-based Anomaly Detection Shubhomoy Das, Weng-Keen Wong,

In Incorporating Feedback in into Tree-based Anomaly Detection Shubhomoy Das, Weng-Keen Wong,

In Incorporating Feedback in into Tree-based Anomaly Detection Shubhomoy Das, Weng-Keen Wong, Alan Fern, Thomas G. Dietterich and Md Amran Siddiqui School of EECS Anomaly Detection Goal: Identify rare or strange objects 2 Anomaly

756 views • 51 slides
Anomaly Based Network Intrusion Detection with Unsupervised Outlier Detection Jiong Zhang and

Anomaly Based Network Intrusion Detection with Unsupervised Outlier Detection Jiong Zhang and

Anomaly Based Network Intrusion Detection with Unsupervised Outlier Detection Jiong Zhang and Mohammad Zulkernine School of Computing Queens University, Kingston Ontario, Canada K7L 3N6 {zhang, mzulker} @cs.queensu.ca Abstract- Anomaly

284 views • 6 slides
An Empirical Evaluation of Entropy- based Traffic Anomaly Detection George Nychis, Vyas Sekar,

An Empirical Evaluation of Entropy- based Traffic Anomaly Detection George Nychis, Vyas Sekar,

An Empirical Evaluation of Entropy- based Traffic Anomaly Detection George Nychis, Vyas Sekar, David Andersen, Hyong Kim, Hui Zhang Carnegie Mellon University Entropy-based Anomaly Detection Goal: detect abnormal behavior scan activity,

447 views • 34 slides
What is an anomaly? Alastair Rushworth Data Scientist DataCamp Anomaly Detection in R Defining

What is an anomaly? Alastair Rushworth Data Scientist DataCamp Anomaly Detection in R Defining

DataCamp Anomaly Detection in R ANOMALY DETECTION IN R What is an anomaly? Alastair Rushworth Data Scientist DataCamp Anomaly Detection in R Defining the term anomaly Anomaly: a data point or collection of data points that do not follow the

870 views • 21 slides
Data Mining II Anomaly Detection Heiko Paulheim Anomaly Detection Also known as Outlier

Data Mining II Anomaly Detection Heiko Paulheim Anomaly Detection Also known as Outlier

Data Mining II Anomaly Detection Heiko Paulheim Anomaly Detection Also known as Outlier Detection Automatically identify data points that are somehow different from the rest Working assumption: There are considerably

905 views • 74 slides
Data Mining II Anomaly Detection Heiko Paulheim Anomaly Detection Also known as Outlier

Data Mining II Anomaly Detection Heiko Paulheim Anomaly Detection Also known as Outlier

Data Mining II Anomaly Detection Heiko Paulheim Anomaly Detection Also known as Outlier Detection Automatically identify data points that are somehow different from the rest Working assumption: There are considerably

984 views • 72 slides
360 Unsupervised Anomaly-based Intrusion Detection Stefano Zanero , Ph.D. Stefano Zanero ,

360 Unsupervised Anomaly-based Intrusion Detection Stefano Zanero , Ph.D. Stefano Zanero ,

Politecnico di Milano Dip. Elettronica e Informazione Milano, Italy 360 Unsupervised Anomaly-based Intrusion Detection Stefano Zanero , Ph.D. Stefano Zanero , Ph.D. Post-doc Researcher, Politecnico di Milano CTO & Founder, Secure

522 views • 39 slides
Anomaly-based Bot Server (and more!) Detection Jim Binkley jrb@cs.pdx.edu Portland State

Anomaly-based Bot Server (and more!) Detection Jim Binkley jrb@cs.pdx.edu Portland State

Anomaly-based Bot Server (and more!) Detection Jim Binkley jrb@cs.pdx.edu Portland State University Computer Science outline background experimental flow tuples botnet server mesh detection botnet client mesh detection

364 views • 23 slides
PANACEA: AUTOMATING ATTACK CLASSIFICATION FOR ANOMALY-BASED NETWORK INTRUSION DETECTION SYSTEMS

PANACEA: AUTOMATING ATTACK CLASSIFICATION FOR ANOMALY-BASED NETWORK INTRUSION DETECTION SYSTEMS

PANACEA: AUTOMATING ATTACK CLASSIFICATION FOR ANOMALY-BASED NETWORK INTRUSION DETECTION SYSTEMS DAMIANO BOLZONI, SANDRO ETALLE AND PIETER HARTEL DISTRIBUTED AND EMBEDDED SECURITY GROUP TWENTE SECURITY LAB 10+ YEARS OF RESEARCH OVER ANOMALY

160 views • 14 slides
ACCT 420: Topic modeling and anomaly detection Session 8 Dr. Richard M. Crowley 1 Front matter

ACCT 420: Topic modeling and anomaly detection Session 8 Dr. Richard M. Crowley 1 Front matter

ACCT 420: Topic modeling and anomaly detection Session 8 Dr. Richard M. Crowley 1 Front matter 2 . 1 Learning objectives Theory: NLP Anomaly detection Application: Understand annual report readability Examine the

1.12k views • 85 slides
ACCT 420: Topic modeling and anomaly detection Session 9 Dr. Richard M. Crowley 1 Front matter

ACCT 420: Topic modeling and anomaly detection Session 9 Dr. Richard M. Crowley 1 Front matter

ACCT 420: Topic modeling and anomaly detection Session 9 Dr. Richard M. Crowley 1 Front matter 2 . 1 Learning objectives Theory: NLP Anomaly detection Application: Understand the distribution of readability Examine

1.31k views • 82 slides
Deep Representation and Reinforcement Learning Soumalya Sarkar, PhD for Anomaly Detection and

Deep Representation and Reinforcement Learning Soumalya Sarkar, PhD for Anomaly Detection and

Deep Representation and Reinforcement Learning Soumalya Sarkar, PhD for Anomaly Detection and Control Senior Research scientist, UTRC in Multi-modal Aerospace Applications May 9 @ GTC 2017 This document contains no technical data subject to the

1.09k views • 43 slides
<Title> Yiqun Hu, SP Group Agenda Condition monitoring & anomaly detection

<Title> Yiqun Hu, SP Group Agenda Condition monitoring & anomaly detection

Data Council Singapre 2019 Autoencoder Forest for Anomaly Detection from IoT Time Series <Title> Yiqun Hu, SP Group Agenda Condition monitoring & anomaly detection Autoencoder for anomaly detection Autoencoder

540 views • 27 slides
Anomaly Detection and Categorization Using Unsupervised Deep Learning S6340 Thursday 7 th April

Anomaly Detection and Categorization Using Unsupervised Deep Learning S6340 Thursday 7 th April

Anomaly Detection and Categorization Using Unsupervised Deep Learning S6340 Thursday 7 th April 2016 GPU Technology Conference A. Stephen McGough , Noura Al Moubayed, Jonathan Cumming, Eduardo Cabrera, Peter Matthews, Toby P . Breckon, Ed

599 views • 29 slides
Dataflow Anomaly Detection Presented By Archana Viswanath Computer Science and Engineering The

Dataflow Anomaly Detection Presented By Archana Viswanath Computer Science and Engineering The

Dataflow Anomaly Detection Presented By Archana Viswanath Computer Science and Engineering The Pennsylvania State University Anomaly Intrusion Detection Systems Anomaly Intrusion Detection Systems Model normal behavior. Attack - Any

417 views • 20 slides
Evading Network Anomaly Detection Sytems - Fogla,Lee Divya Muthukumaran Intrusion detection

Evading Network Anomaly Detection Sytems - Fogla,Lee Divya Muthukumaran Intrusion detection

Evading Network Anomaly Detection Sytems - Fogla,Lee Divya Muthukumaran Intrusion detection Systems Signature Based IDS Monitor packets on the network Compare them against database of signatures/attributes from known threats

476 views • 26 slides
Robust and Unsupervised KPI Anomaly Detection Based on Conditional Variational Autoencoder Zeyan

Robust and Unsupervised KPI Anomaly Detection Based on Conditional Variational Autoencoder Zeyan

Robust and Unsupervised KPI Anomaly Detection Based on Conditional Variational Autoencoder Zeyan Li , Wenxiao Chen, Dan Pei Department of Computer Science and Technology Tsinghua University November 18, 2018 1/37 Table of Contents 1 Background

573 views • 41 slides

More recommend