machine learning for the inverse control of fm synthesis
play

Machine Learning for the Inverse Control of FM Synthesis ROSA GARZA - PowerPoint PPT Presentation

Jul 03, 2023 •449 likes •609 views

Machine Learning for the Inverse Control of FM Synthesis ROSA GARZA MENTORS: DR. EDGAR BERDAHL & ANDREW PFALZ CCT REU 2017 LSU CENTER FOR COMPUTATION & TECHNOLOGY (CCT) Frequency Modulation (FM) Synthesis Invented by John Chowning

  1. Machine Learning for the Inverse Control of FM Synthesis ROSA GARZA MENTORS: DR. EDGAR BERDAHL & ANDREW PFALZ CCT REU 2017 LSU CENTER FOR COMPUTATION & TECHNOLOGY (CCT)

  2. Frequency Modulation (FM) Synthesis • Invented by John Chowning in 1967 Control Signals: • Carrier Frequency (CF) • Depth (D) • ModulaEon Frequency (MF) * t is an array of +me

  3. Current Sound Design Procedure Control AddiEve Synthesized / FM Sound Synthesizer Signals

  4. Research Goal Target Inverse Synthesized Control of Sound FM Synthesis Sound

  6. Long Short Term Memory (LSTM) Recurrent Neural Network (RNN) Hyperparameters: • Learning Rate (1e-4 – 1e-7) • Number of Unrollings (1,5,10,15,50,100) • Epochs (1,5,20,100) • Number of LSTM Layers CalculaEng Loss: Mean Squared Error • Goal: Low loss (close to 0)

  7. First Test 1 Control Audio LSTM Signal Label Loss

  8. Second Test Fully Connected 3 Control LSTM Audio Layer Signals Loss Label

  9. Third Test FM Fully Connected LSTM LSTM Audio Synthesizer Layer Audio Loss

  10. Small Edit to Third Test Fourier FM Fully Connected Transform LSTM Audio Synthesizer Layer of LSTM Audio Fourier Loss Transform of Audio

  11. Fourth Test FM Fully Connected LSTM LSTM Audio Synthesizer Layer Audio Loss

  12. Most Recent Data Seeing a loss of 0.002

  13. Piano Input Data

  14. Acknowledgements Thank you to for this opportunity to be a part of the Center for ComputaEon & Technology (CCT) at Louisiana State University (LSU) REU 2017. Thank you to my graduate student, Andrew Pfalz, Dr. Berdahl, and Dr. Jesse Allison. Also to my family and friends for their support throughout my summer research experience. This material is based upon work supported by the NaEonal Science FoundaEon under award OCI-1560410 with addiEonal support from the CCT at LSU.

  15. Ques%ons?

Recommend

Autonomous Navigation CSE 571 Inverse Optimal Control (Inverse Reinforcement Learning) Many

Autonomous Navigation CSE 571 Inverse Optimal Control (Inverse Reinforcement Learning) Many

5/25/20 Autonomous Navigation CSE 571 Inverse Optimal Control (Inverse Reinforcement Learning) Many slides by Drew Bagnell Carnegie Mellon University 1 2 Optimal Control Solution X X Learning Y Y Cost Map (Sensor Data) (Input)

489 views • 10 slides
An inverse problem perspective on machine learning Lorenzo Rosasco University of Genova

An inverse problem perspective on machine learning Lorenzo Rosasco University of Genova

An inverse problem perspective on machine learning Lorenzo Rosasco University of Genova Massachusetts Institute of Technology Istituto Italiano di Tecnologia lcsl.mit.edu Feb 9th, 2018 Inverse Problems and Machine Learning Workshop, CM+X

765 views • 48 slides
Optimal Control Solution Mode 1: Training example Cost Map 2-D Learning Planner Y (Path to

Optimal Control Solution Mode 1: Training example Cost Map 2-D Learning Planner Y (Path to

11/22/16 X X Learning Y Y (Sensor Data) (Input) (Output) (Path to goal) CSE 571 Inverse Optimal Control (Inverse Reinforcement Learning) Many slides by Drew Bagnell Carnegie Mellon University Optimal Control Solution Mode 1: Training

191 views • 7 slides
Genetics-based Machine Learning and Behaviour Based Robotics: A New Synthesis

Genetics-based Machine Learning and Behaviour Based Robotics: A New Synthesis

Genetics-based Machine Learning and Behaviour Based Robotics: A New Synthesis Genetics-based Machine Learning and Behavior Based Robotics: A New Synthesis, Marco Dorigo, Uwe Schnepf, IEEE Transactions on System, MAn, and Cybernetics,

348 views • 34 slides
Probabilistic and Logistic Circuits: A New Synthesis of Logic and Machine Learning Guy Van den

Probabilistic and Logistic Circuits: A New Synthesis of Logic and Machine Learning Guy Van den

Probabilistic and Logistic Circuits: A New Synthesis of Logic and Machine Learning Guy Van den Broeck KULeuven Symposium Dec 12, 2018 Outline Learning Adding knowledge to deep learning Logistic circuits for image classification

782 views • 49 slides
Learning convex bounds for linear quadratic control policy synthesis Jack Umenberger Thomas

Learning convex bounds for linear quadratic control policy synthesis Jack Umenberger Thomas

Learning convex bounds for linear quadratic control policy synthesis Jack Umenberger Thomas B. Schn Learning to control data control (observations of the (stabilize the upright dynamical system) equilibrium position) learning

743 views • 34 slides
Probabilistic and Logistic Circuits: A New Synthesis of Logic and Machine Learning Guy Van den

Probabilistic and Logistic Circuits: A New Synthesis of Logic and Machine Learning Guy Van den

Probabilistic and Logistic Circuits: A New Synthesis of Logic and Machine Learning Guy Van den Broeck RelationalAI ArrowCon Feb 5, 2019 Which method to choose? Classical AI Methods: Neural Networks: Hungry $25? ? Restaura Sleep? nt?

819 views • 56 slides
CSC 2547: Machine Learning for Vision as Inverse Graphics Anthony Bonner

CSC 2547: Machine Learning for Vision as Inverse Graphics Anthony Bonner

CSC 2547: Machine Learning for Vision as Inverse Graphics Anthony Bonner www.cs.toronto.edu/~bonner Paper Presentations Each week will focus on one topic, as listed on the course web page (soon). You can vote for your choice of

591 views • 23 slides
AlphaD3M Machine Learning Pipeline Synthesis Iddo Drori, Yamuna Krishnamurthy, Remi Rampin, Raoni

AlphaD3M Machine Learning Pipeline Synthesis Iddo Drori, Yamuna Krishnamurthy, Remi Rampin, Raoni

AlphaD3M Machine Learning Pipeline Synthesis Iddo Drori, Yamuna Krishnamurthy, Remi Rampin, Raoni de Paula Lourenco, Jorge Piazentin Ono, Kyunghyun Cho, Claudio Silva, Juliana Freire International Workshop on Automatic Machine Learning, ICML,

741 views • 28 slides
AlphaD3M Machine Learning Pipeline Synthesis Iddo Drori, Yamuna Krishnamurthy, Remi Rampin, Raoni

AlphaD3M Machine Learning Pipeline Synthesis Iddo Drori, Yamuna Krishnamurthy, Remi Rampin, Raoni

AlphaD3M Machine Learning Pipeline Synthesis Iddo Drori, Yamuna Krishnamurthy, Remi Rampin, Raoni de Paula Lourenco, Jorge Piazentin Ono, Kyunghyun Cho, Claudio Silva, Juliana Freire International Workshop on Automatic Machine Learning, ICML,

421 views • 26 slides
Direct Inverse Control & Internal Model Control Modelling and Control of Dynamic Systems 17

Direct Inverse Control & Internal Model Control Modelling and Control of Dynamic Systems 17

Direct Inverse Control & Internal Model Control Modelling and Control of Dynamic Systems 17 Nov 2008 Jrgen Jnes and Andres Tiko Talk Outline Introduction to Control Direct Inverse Control General Training Specialized Training Demo

460 views • 41 slides
Probabilistic and Logistic Circuits: A New Synthesis of Logic and Machine Learning Guy Van den

Probabilistic and Logistic Circuits: A New Synthesis of Logic and Machine Learning Guy Van den

Probabilistic and Logistic Circuits: A New Synthesis of Logic and Machine Learning Guy Van den Broeck Stanford Nov 14, 2018 Foundation: Logical Circuit Languages Negation Normal Form Circuits = (sun rain rainbow) [Darwiche 2002]

890 views • 75 slides
Probabilistic and Logistic Circuits: A New Synthesis of Logic and Machine Learning Guy Van den

Probabilistic and Logistic Circuits: A New Synthesis of Logic and Machine Learning Guy Van den

Probabilistic and Logistic Circuits: A New Synthesis of Logic and Machine Learning Guy Van den Broeck HRL/ACTIONS @ KR Oct 28, 2018 Foundation: Logical Circuit Languages Negation Normal Form Circuits = (sun rain rainbow)

1.01k views • 74 slides
On the Invertibility of ReLU Networks Inverse Problems and Machine Learning, Caltech Jens

On the Invertibility of ReLU Networks Inverse Problems and Machine Learning, Caltech Jens

Faculty 03 Center for Mathematics/ Computer Sciences Industrial Mathematics On the Invertibility of ReLU Networks Inverse Problems and Machine Learning, Caltech Jens Behrmann joint work with: S oren Dittmer, Pascal Fernsel, Peter Maass

528 views • 24 slides
1. Algorithms for Inverse Reinforcement Learning 2. Apprenticeship learning via Inverse

1. Algorithms for Inverse Reinforcement Learning 2. Apprenticeship learning via Inverse

1. Algorithms for Inverse Reinforcement Learning 2. Apprenticeship learning via Inverse Reinforcement Learning Algorithms for Inverse Reinforcement Learning Andrew Ng and Stuart Russell Motivation Given: (1) measurements of an agent's

379 views • 34 slides
Convex Optimization in Machine Learning and Inverse Problems Part 2: First-Order Methods ario A.

Convex Optimization in Machine Learning and Inverse Problems Part 2: First-Order Methods ario A.

Convex Optimization in Machine Learning and Inverse Problems Part 2: First-Order Methods ario A. T. Figueiredo 1 and Stephen J. Wright 2 M 1 Instituto de Telecomunica c oes, Instituto Superior T ecnico, Lisboa, Portugal 2 Computer

1.53k views • 114 slides
Convex Optimization in Machine Learning and Inverse Problems Part 3: Augmented Lagrangian Methods

Convex Optimization in Machine Learning and Inverse Problems Part 3: Augmented Lagrangian Methods

Convex Optimization in Machine Learning and Inverse Problems Part 3: Augmented Lagrangian Methods ario A. T. Figueiredo 1 and Stephen J. Wright 2 M 1 Instituto de Telecomunica c oes, Instituto Superior T ecnico, Lisboa, Portugal 2

806 views • 46 slides
Program Synthesis and Description with Structured Machine Learning Models Graham Neubig

Program Synthesis and Description with Structured Machine Learning Models Graham Neubig

Program Synthesis and Description with Structured Machine Learning Models Graham Neubig @Stanford CS379C 5/1/2018 Coding = Concept Implementation sort list x in descending order x.sort(reverse=True) The (Famous) Stack

965 views • 52 slides
Synthesis, Verification, and Synthesis, Verification, and Inductive Learning Inductive Learning

Synthesis, Verification, and Synthesis, Verification, and Inductive Learning Inductive Learning

Synthesis, Verification, and Synthesis, Verification, and Inductive Learning Inductive Learning Sanjit A. Seshia EECS Department UC Berkeley Joint work with Susmit Jha (UTC) Dagstuhl Seminar Verified SW Working Group August 2014 July

661 views • 28 slides
Cartesian Control Analytical inverse kinematics can be difficult to derive Inverse

Cartesian Control Analytical inverse kinematics can be difficult to derive Inverse

Cartesian Control Analytical inverse kinematics can be difficult to derive Inverse kinematics are not as well suited for small differential motions Lets take a look at how you use the Jacobian to control Cartesian position

639 views • 33 slides
Machine Learning 10-701 Tom M. Mitchell Machine Learning Department Carnegie Mellon University

Machine Learning 10-701 Tom M. Mitchell Machine Learning Department Carnegie Mellon University

Machine Learning 10-701 Tom M. Mitchell Machine Learning Department Carnegie Mellon University April 26, 2011 Today: Readings: Mitchell, chapter 13 Learning of control policies Markov Decision Processes Kaelbling, et al.,

532 views • 15 slides
Oracle Guided Synthesis of Machine Learning Models Sanjit A. Seshia Professor EECS, UC

Oracle Guided Synthesis of Machine Learning Models Sanjit A. Seshia Professor EECS, UC

Oracle Guided Synthesis of Machine Learning Models Sanjit A. Seshia Professor EECS, UC Berkeley Publication: Towards Verified Artificial Intelligence, S. A. Seshia, D. Sadigh, and S. S. Sastry, June 2016. Dagstuhl Seminar March 20, 2018

345 views • 12 slides
Maximum Entropy Inverse RL, Adversarial imitation learning Katerina Fragkiadaki Reinforcement

Maximum Entropy Inverse RL, Adversarial imitation learning Katerina Fragkiadaki Reinforcement

Carnegie Mellon School of Computer Science Deep Reinforcement Learning and Control Maximum Entropy Inverse RL, Adversarial imitation learning Katerina Fragkiadaki Reinforcement Learning Probability Dynamics distribution over next Model T

911 views • 66 slides
Maximum Entropy Inverse RL, Adversarial imitation learning Katerina Fragkiadaki Reinforcement

Maximum Entropy Inverse RL, Adversarial imitation learning Katerina Fragkiadaki Reinforcement

Carnegie Mellon School of Computer Science Deep Reinforcement Learning and Control Maximum Entropy Inverse RL, Adversarial imitation learning Katerina Fragkiadaki Reinforcement Learning Probability Dynamics distribution over next Model T

608 views • 56 slides

More recommend