Improving BER with Machine Learning by Alex The Setup Binary - PowerPoint PPT Presentation

Dec 29, 2023 •247 likes •372 views

Improving BER with Machine Learning by Alex The Setup Binary value X = {-1, 1} sent over the channel to get Y = X + N Generator HMM creates and muddles the data Predictor HMM take the data in and guesses what was sent

Improving BER with Machine Learning by Alex
The Setup Binary value X = {-1, 1} sent over the ● channel to get Y = X + N Generator HMM creates and muddles ● the data Predictor HMM take the data in and ● “guesses” what was sent If we aren’t sending anything (Idle) we ● send “-1,1,1,1,1,1,-1”
The Goal Using a neural network, decrease the amount of uncertainty in the P-HMM ● Strengthen the confidence in HDLC bits while leaving the random message bits ● untouched By decreasing bit error in HDLC, error correction codes should have an easier time ● decoding the important messages
Structure Layer Type Output Shape # of Params Reshape (None, 1, 12) 0 LSTM (None, 32) 8320 Dense (None, 3) 99 Total 8,419 Params:
Input Structure LSTM Layer uses time to make decisions ● Feed the neural net a vector of 32 time- ● steps Decision is based on the most recent bit ● that came in
Performance Training Time: 41 seconds ● Max Accuracy: ~98% ●
Varying Input SNR Next, trained 3 Neural ● Nets on different AWGN with covariances 0.1 (Top Right), 0.5 (Bottom Left), and 0.9 (Bottom Right)
Varying Input SNR
Varying Input Covariance
Error Compared to HMM
Metric HMM Total NN-HMM Total NN Only HMM % NN-HMM % NN % Total Error 546.2 1112.2 0.5817 0.5462 1.1122 581.7 HDLC Low 2.2 1.4 132 0.0022 0.0014 0.132 HDLC High 5.8 3.4 705.5 0.0058 0.0034 0.7055 Random Data 573.7 541.4 274.7 0.5737 0.5414 0.2747 Total Hardens 88750.1 88721 87645 88.7501 88.721 87.645 Missed Hardens 7.6 4.4 813.7 0.0076 0.0044 0.8137 False Hardens 573.7 541.4 274.7 0.5737 0.5414 0.2747 Low -> High 0.2 0.2 4.9 0.0002 0.0002 0.0049 High -> Low 0.2 0.2 18.9 0.0002 0.0002 0.0189

Recommend

PROJECT SPARROW Improving traffic flow with machine learning TYPES OF MACHINE LEARNING Google

PROJECT SPARROW Improving traffic flow with machine learning TYPES OF MACHINE LEARNING Google Deep Mind MORE VARIABLES Improving the simulation, so it more accurately simulates the real world. USE 3D MAPPING SOFTWARE TO SIMULATE Allows

396 views • 11 slides

Improving EnKF with machine learning algorithms John Harlim Department of Mathematics and

Improving EnKF with machine learning algorithms John Harlim Department of Mathematics and Department of Meteorology The Pennsylvania State University June 12, 2017 Overview A supervised learning algorithm An unsupervised learning algorithm

697 views • 36 slides

Improving Optimization Bounds using Machine Learning: Decision Diagrams meet Deep Reinforcement

Improving Optimization Bounds using Machine Learning: Decision Diagrams meet Deep Reinforcement Learning Quentin Cappart , Emmanuel Goutierre, David Bergman, Louis-Martin Rousseau 1 Research question Bounding mechanisms are critical in the

449 views • 24 slides

An Exercise in An Exercise in Machine Learning Machine Learning

An Exercise in An Exercise in Machine Learning Machine Learning http://www.cs.iastate.edu/~cs573x/bbsilab.html Machine Learning Software Preparing Data Building Classifiers Interpreting Results Machine Learning Software

496 views • 26 slides

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by which computers can be trained through observation, rather than being explicitly programmed. Basically, a program is given input and adjusts its

556 views • 17 slides

Improving Forecasts of Extreme Values By Machine Learning Models Using Occam's Razor William W.

Improving Forecasts of Extreme Values By Machine Learning Models Using Occam's Razor William W. Hsieh University of British Columbia (Visiting Scientist at Univ. of Victoria) American Meteorological Society Annual Meeting January 2018, Austin

258 views • 11 slides

Machine Learning: Study of algorithms that improve their performance P at some task T

Machine Learning 10-601 Tom M. Mitchell Machine Learning Department Carnegie Mellon University January 12, 2015 Today: Readings: What is machine learning? The Discipline of ML Decision tree learning Mitchell, Chapter 3

872 views • 29 slides

Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning Pipeline in Classification Tasks A set of hand-designed audio features are selected

398 views • 26 slides

Adaptive Knowledge Sharing in Multi-Task Learning: Improving Low-Resource Neural Machine

Adaptive Knowledge Sharing in Multi-Task Learning: Improving Low-Resource Neural Machine Translation Poorya ZareMoodi , Wray Buntine, Gholamreza (Reza) Haffari Monash University Slides : Roadmap ! 2 Introduction & background Adaptive

360 views • 17 slides

CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine

1/22/19 CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine Learning? A Simple Task: Recognize Obama How do you program a computer to Recognize faces? Recommend movies? Decide which web

581 views • 5 slides

Machine Learning Machine Learning: algorithms that use experience to improve their

Machine Learning Machine Learning: algorithms that use experience to improve their performance We use machine learning in situations where it is very challenging (or impossible) to define the rules by hand: e.g. face detection

1.04k views • 28 slides

Improving Disease Prediction Using Machine Learning Shelda Sajeev, Stephanie Champion, Anthony

Improving Disease Prediction Using Machine Learning Shelda Sajeev, Stephanie Champion, Anthony Maeder Flinders Digital Health Research Centre, College of Nursing and Health Sciences, Flinders University, Adelaide, Australia Cardiovascular

474 views • 16 slides

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine Learning Introduction to Machine Learning 1 / 12 Outline 1 Nearest Neighbor Prediction 2 Complexity Considerations 3 The Voronoi Diagram 4 Overfitting

564 views • 12 slides

1 Why Study Machine Learning? Why Study Machine Learning? Cognitive Science The Time is Ripe

What is Learning? Herbert Simon: Learning is any process by which a system improves performance from CS 391L: Machine Learning experience. Introduction What is the task? Classification Problem solving / planning /

603 views • 6 slides

MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING

JACOPO DI IORIO, MATTEO FONTANA, DANIELE OCCHIUTO, CLAUDIA VOLPETTI MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING STATISTICAL LEARNING Separate evolutions, but with shared methodologies MERGE

565 views • 55 slides

Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine

Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine Learning? What is Machine Learning? Examples of machine learning applications: Facial recognition software E-mail spam detectors Automated

302 views • 17 slides

Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning

Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning 11.1 Learning agents 11.2 Inductive learning 11.3 Deep learning 11.4 Statistical learning 11.5 Reinforcement learning 11.6 Transfer learning

1.7k views • 159 slides

Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine learning pipeline Temporal Frame-level Unsupervised Classifier Summary

613 views • 27 slides

Machine Learning for Auto Optimization What is Machine Learning? Definition: Machine

Machine Learning for Auto Optimization What is Machine Learning? Definition: Machine learning refers to any system where the performance of a machine in performing a task improves by gaining more experience in performing that task .

394 views • 27 slides

MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How

MACHINE LEARNING 2012 MACHINE LEARNING MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How to separate the red class from the grey class? x 2 360 r x 1 Polar coordinates Data

1.04k views • 44 slides

BBM406 Fundamentals of Machine Learning Lecture 2: Machine Learning by Examples, Nearest

photo:@rewardyfahmi // Unsplash BBM406 Fundamentals of Machine Learning Lecture 2: Machine Learning by Examples, Nearest Neighbor Classifier Aykut Erdem // Hacettepe University // Fall 2019 When Do We Use Machine Learning? ML is

1.33k views • 110 slides

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a dataset, identify features which may help predict information about the data Identify common types of machine learning algorithms 2 Machine

553 views • 27 slides

Machine Learning @ Amazon Ralf Herbrich Amazon 6/29/17 1 Overview Machine Learning in

Machine Learning @ Amazon Ralf Herbrich Amazon 6/29/17 1 Overview Machine Learning in Practise Probabilities Finite Resource Machine Learning @ Amazon Forecasting Machine Translation Visual Systems Conclusions

348 views • 34 slides

Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning?

CS6501: Deep Learning for Visual Recognition Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning? Supervised Learning: Classification with K-nearest neighbors Unsupervised Learning: Clustering with

1.36k views • 91 slides