neural program synthesis
play

Neural Program Synthesis Rishabh Singh, Google Brain Great - PowerPoint PPT Presentation

Sep 13, 2022 •19 likes •1.44k views

Neural Program Synthesis Rishabh Singh, Google Brain Great Collaborators! Deep Learning and Evolutionary Progression Vision Speech Language Deep Learning and Evolutionary Progression Vision Speech Language Programming Deep Learning

  1. Reverse-Recursive Input: root representation from recursive pass

  2. Reverse-Recursive Input: root representation from recursive pass

  3. Reverse-Recursive Input: root representation from recursive pass Output: Global leaf representations.

  4. Reverse-Recursive Input: root representation from recursive pass Output: Global leaf representations.

  5. Reverse-Recursive Input: root representation from recursive pass Output: Global leaf representations.

  6. Cross-Correlation I/O Encoder

  7. Cross-Correlation I/O Encoder

  8. Cross-Correlation I/O Encoder

  9. Synthetic Data Results (< 13 AST)

  10. FlashFill Benchmarks

  11. FlashFill Benchmarks Batching Trees for larger programs

  12. FlashFill Benchmarks Batching Trees for larger programs R3NN for contextual program embeddings

  13. RobustFill [ICML 2017] J. Devlin, J. Uesato, S. Bhuptiraju, R. Singh, A. Mohamed, P . Kohli

  14. RobustFill [ICML 2017] J. Devlin, J. Uesato, S. Bhuptiraju, R. Singh, A. Mohamed, P . Kohli

  15. RobustFill [ICML 2017] J. Devlin, J. Uesato, S. Bhuptiraju, R. Singh, A. Mohamed, P . Kohli

  16. RobustFill [ICML 2017] J. Devlin, J. Uesato, S. Bhuptiraju, R. Singh, A. Mohamed, P . Kohli

  17. Multiple I/O Examples

  18. Multiple I/O Examples

  19. Multiple I/O Examples

  20. Extended DSL

  21. 92% Generalization Accuracy

  22. Robustness with Noise

  23. Incorrect Generalization

Recommend

Neural Program Synthesis with Priority Queue Training Daniel A. Abolafia, Mohammad Norouzi,

Neural Program Synthesis with Priority Queue Training Daniel A. Abolafia, Mohammad Norouzi,

Neural Program Synthesis with Priority Queue Training Daniel A. Abolafia, Mohammad Norouzi, Jonathan Shen, Rui Zhao, Quoc V. Le https://arxiv.org/abs/1801.03526 Why Program Synthesis? One of the hard AI reasoning domains A tool for

819 views • 27 slides
Improving Neural Program Synthesis with Inferred Execution Traces Richard Shin 1 Illia Polosukhin

Improving Neural Program Synthesis with Inferred Execution Traces Richard Shin 1 Illia Polosukhin

Improving Neural Program Synthesis with Inferred Execution Traces Richard Shin 1 Illia Polosukhin 2 Dawn Song 1 1 UC Berkeley 2 NEAR Protocol Poster: Room 210 &amp; 230 AB #31 Background For program synthesis from input-output examples ,

393 views • 16 slides
Neural Program Synthesis Rishabh Singh, Google Brain Great Collaborators! Deep Learning and

Neural Program Synthesis Rishabh Singh, Google Brain Great Collaborators! Deep Learning and

Neural Program Synthesis Rishabh Singh, Google Brain Great Collaborators! Deep Learning and Evolutionary Progression Vision Perceptual Tasks Speech Language Algorithmic Tasks Programming Neural Program Learning M ore Complex Tasks G

3.34k views • 52 slides
Neural Program Synthesis from Diverse Demonstration Videos Sriram Shao-Hua Sun* 1 Hyeonwoo Noh* 2

Neural Program Synthesis from Diverse Demonstration Videos Sriram Shao-Hua Sun* 1 Hyeonwoo Noh* 2

Neural Program Synthesis from Diverse Demonstration Videos Sriram Shao-Hua Sun* 1 Hyeonwoo Noh* 2 Joseph J. Lim 1 Somasundaram 1 1 University of Southern California 2 Pohang University of Science and Technology *Equal contribution A program is an

977 views • 63 slides
From Program Synthesis to Optimal Program . . . Optimal Program Synthesis Logical Interpretation

From Program Synthesis to Optimal Program . . . Optimal Program Synthesis Logical Interpretation

Need for Data . . . Program Synthesis Wave Algorithm for . . . Boolean Logic . . . From Program Synthesis to Optimal Program . . . Optimal Program Synthesis Logical Interpretation . . . A Seemingly Natural . . . Counter-Example to . . .

725 views • 24 slides
Synthesis of Ranking Functions and Synthesis of Inductive Invariants and Synthesis of

Synthesis of Ranking Functions and Synthesis of Inductive Invariants and Synthesis of

Synthesis of Ranking Functions and Synthesis of Inductive Invariants and Synthesis of Recurrence Sets via Constraint Solving Andreas Podelski January 17, 2012 1 Program Verification and Constraints Reasoning about program

422 views • 28 slides
Guarantees in in Program Synthesis Qinheping Hu , Jason Breck , John Cyphert , Loris D'Antoni ,

Guarantees in in Program Synthesis Qinheping Hu , Jason Breck , John Cyphert , Loris D'Antoni ,

Guarantees in in Program Synthesis Qinheping Hu , Jason Breck , John Cyphert , Loris D'Antoni , Thomas Reps Program Synthesis Specification Solution Program Synthesizer Search space Program Synthesis is Un Unpredicta edictable ble

1.05k views • 41 slides
Parallel and cascaded deep neural networks for text-to-speech synthesis M. Sam Ribeiro, Oliver

Parallel and cascaded deep neural networks for text-to-speech synthesis M. Sam Ribeiro, Oliver

Parallel and cascaded deep neural networks for text-to-speech synthesis M. Sam Ribeiro, Oliver Watts, Junichi Yamagishi School Of Informatics The University of Edinburgh m.f.s.ribeiro@sms.ed.ac.uk 14 September 2016 Speech Synthesis Workshop 9

854 views • 36 slides
From Program Verification to Program Synthesis Overview Jaak Ristioja March 30, 2010 1 / 91

From Program Verification to Program Synthesis Overview Jaak Ristioja March 30, 2010 1 / 91

From Program Verification to Program Synthesis Overview Jaak Ristioja March 30, 2010 1 / 91 Reference From Program Verification to Program Synthesis. @ POPL10; January 17-23, 2010 Saurabh Srivastava , University of Maryland, College Park

1.21k views • 91 slides
LPCNet: Improving Neural Speech Synthesis Through Linear Prediction Jean-Marc Valin* (Amazon Web

LPCNet: Improving Neural Speech Synthesis Through Linear Prediction Jean-Marc Valin* (Amazon Web

LPCNet: Improving Neural Speech Synthesis Through Linear Prediction Jean-Marc Valin* (Amazon Web Services) Jan Skoglund (Google LLC) May 2019 *work performed while with Mozilla Approaches to Speech Synthesis Old DSP approach

172 views • 13 slides
Conditional Program Generation for Bimodal Program Synthesis Swarat Chaudhuri Rice University

Conditional Program Generation for Bimodal Program Synthesis Swarat Chaudhuri Rice University

Conditional Program Generation for Bimodal Program Synthesis Swarat Chaudhuri Rice University www.cs.rice.edu/~swarat (Joint work with Chris Jermaine, Vijay Murali, and Letao Qi) Program synthesis [Simon 1963, Summers 1977, Manna-Waldinger

411 views • 22 slides
Recursive Program Synthesis Aws Albarghouthi (UToronto), Sumit Gulwani (MSR), and Zachary

Recursive Program Synthesis Aws Albarghouthi (UToronto), Sumit Gulwani (MSR), and Zachary

Recursive Program Synthesis Aws Albarghouthi (UToronto), Sumit Gulwani (MSR), and Zachary Kincaid (UToronto) CAV 2013 Saint Petersburg, Russia Program Synthesis Magic Specification Program 2 Program Synthesis Magic Specification

753 views • 74 slides
Syntax-Guided Synthesis Rajeev Alur University of Pennsylvania 1 Program Verification Program

Syntax-Guided Synthesis Rajeev Alur University of Pennsylvania 1 Program Verification Program

Syntax-Guided Synthesis Rajeev Alur University of Pennsylvania 1 Program Verification Program P Specification S Verifier Proof of correctness or Witness of a bug 2 Classical Program Synthesis Specification S High Level WHAT

1.28k views • 59 slides
Deep Learning over Big Code for Program Analysis and Synthesis Swarat Chaudhuri, Vijay

Deep Learning over Big Code for Program Analysis and Synthesis Swarat Chaudhuri, Vijay

Deep Learning over Big Code for Program Analysis and Synthesis Swarat Chaudhuri, Vijay Murali, Chris Jermaine Programming is hard Program synthesis, debugging, verification, repair Can we automate these processes? Decades of prior

1.59k views • 143 slides
Unsupervised acoustic unit discovery for speech synthesis using discrete latent-variable neural

Unsupervised acoustic unit discovery for speech synthesis using discrete latent-variable neural

Unsupervised acoustic unit discovery for speech synthesis using discrete latent-variable neural networks Interspeech 2019, Graz, Austria Ryan Eloff, Andr e Nortje, Benjamin van Niekerk, Avashna Govender, Leanne Nortje, Arnu Pretorius, Elan

744 views • 38 slides
Adaptive)Concretization)for) Parallel)Program)Synthesis) Jinseong(Jeon 1 ,)Xiaokang)Qiu 2 ,)

Adaptive)Concretization)for) Parallel)Program)Synthesis) Jinseong(Jeon 1 ,)Xiaokang)Qiu 2 ,)

Adaptive)Concretization)for) Parallel)Program)Synthesis) Jinseong(Jeon 1 ,)Xiaokang)Qiu 2 ,) Armando)Solar@Lezama 2 ,)and)Jeffrey)S.)Foster 1) ) 1.)University)of)Maryland,)College)Park) 2.)MIT)CSAIL ) Syntax@guided)Synthesis) bit[32]

579 views • 57 slides
Adaptive)Concretization)for) Parallel)Program)Synthesis) Jinseong(Jeon 1 ,)Xiaokang)Qiu 2 ,)

Adaptive)Concretization)for) Parallel)Program)Synthesis) Jinseong(Jeon 1 ,)Xiaokang)Qiu 2 ,)

Adaptive)Concretization)for) Parallel)Program)Synthesis) Jinseong(Jeon 1 ,)Xiaokang)Qiu 2 ,) Armando)Solar@Lezama 2 ,)and)Jeffrey)S.)Foster 1) ) 1.)University)of)Maryland,)College)Park) 2.)MIT)CSAIL ) Syntax@guided)Synthesis) bit[32]

310 views • 27 slides
Program Synthesis Tikhon Jelvis (tikhon@jelv.is) February 24, 2014 Synthesis Find a program

Program Synthesis Tikhon Jelvis (tikhon@jelv.is) February 24, 2014 Synthesis Find a program

Program Synthesis Tikhon Jelvis (tikhon@jelv.is) February 24, 2014 Synthesis Find a program to some specification ( ( input , output ) ) input/output pairs executable specification P x . ( x , P ( x )) Why? easy

594 views • 23 slides
Shape and texture prior for 2D/3D analysis/ synthesis of neural stem cells for fate prediction 2D

Shape and texture prior for 2D/3D analysis/ synthesis of neural stem cells for fate prediction 2D

A French-Singaporean joint laboratory Shape and texture prior for 2D/3D analysis/ synthesis of neural stem cells for fate prediction 2D differentiation and 3D

151 views • 13 slides
M emory A ugmented P olicy O ptimization ( MAPO ) for Program Synthesis and Semantic Parsing Chen

M emory A ugmented P olicy O ptimization ( MAPO ) for Program Synthesis and Semantic Parsing Chen

M emory A ugmented P olicy O ptimization ( MAPO ) for Program Synthesis and Semantic Parsing Chen Liang, Mohammad Norouzi, Jonathan Berant, Quoc Le, Ni Lao Program Synthesis / Semantic Parsing how many more passengers flew to los angeles than to

686 views • 29 slides
for Speech Synthesis and Sensor Data Augmentation Deep Generative Neural Network Speech Text

for Speech Synthesis and Sensor Data Augmentation Deep Generative Neural Network Speech Text

Deep Generative Modeling for Speech Synthesis and Sensor Data Augmentation Deep Generative Neural Network Speech Text Praveen Narayanan Ford Motor Company PROJECT DESCRIPTION Use of DNNs increasingly prevalent as a solution for many data

893 views • 53 slides
Program Boosting: Program Synthesis via Crowd-Sourcing Robert A. Cochran, Loris DAntoni,

Program Boosting: Program Synthesis via Crowd-Sourcing Robert A. Cochran, Loris DAntoni,

Program Boosting: Program Synthesis via Crowd-Sourcing Robert A. Cochran, Loris DAntoni, Benjamin Livshits, David Molnar and Margus Veanes Presented by: Sam Witty, Shehzaad Dhuliawala and Samer Nashed Outline Introduction (Research

734 views • 62 slides
CSE507 Computer-Aided Reasoning for Software Program Synthesis

CSE507 Computer-Aided Reasoning for Software Program Synthesis

CSE507 Computer-Aided Reasoning for Software Program Synthesis courses.cs.washington.edu/courses/cse507/14au/ Emina Torlak emina@cs.washington.edu Today Last lecture Angelic nondeterminism and execution Today Program synthesis:

645 views • 15 slides
Reconstruction II Neural Networks in Monte Carlo Rendering Philipp Slusallek Karol Myszkowski

Reconstruction II Neural Networks in Monte Carlo Rendering Philipp Slusallek Karol Myszkowski

Reconstruction II Neural Networks in Monte Carlo Rendering Philipp Slusallek Karol Myszkowski Gurprit Singh 1 Realistic Image Synthesis SS2018 Previous Lecture 2 Realistic Image Synthesis SS2018 Slide from Kartic Subr 3

1.02k views • 80 slides

More recommend