program verification as a toolbox
play

Program Verification as a Toolbox 2005Now Todays Verification A - PowerPoint PPT Presentation

Aug 29, 2023 •96 likes •432 views

Program Verification as a Toolbox David Cock Is Your System Correct? Verified Systems Program Verification as a Toolbox 2005Now Todays Verification A Brief, Subjective History Toolbox Whats Next? David Cock January 23, 2015 1

  1. Program Verification as a Toolbox David Cock Is Your System Correct? Verified Systems Program Verification as a Toolbox 2005–Now Today’s Verification A Brief, Subjective History Toolbox What’s Next? David Cock January 23, 2015 1 / 32

  2. Program Is Your System Correct? Verification as a Toolbox Short answer — no. David Cock Is Your System Correct? Verified Systems 2005–Now Today’s Verification Toolbox What’s Next? 2 / 32

  3. Program Is Your System Correct? Verification as a Toolbox Short answer — no. David Cock Is Your System Correct? Verified Systems 2005–Now Today’s Verification Toolbox What’s Next? 3 / 32

  4. The Bug Rate in Linux 1 Program Verification as a Toolbox David Cock Is Your System Correct? Verified Systems 2.6.5 2.6.10 2.6.15 2.6.20 2.6.25 2.6.30 2005–Now Average 0.8 % of faulty notes Staging Today’s Verification Toolbox Drivers 0.6 Sound What’s Next? Arch 0.4 FS Net 0.2 Other 0.0 2004 2005 2006 2007 2008 2009 2010 It’s dropping, but there’s a long way to go. 1 Source: Palix et. al., Faults in Linux: Ten Years Later, ASPLOS’11 4 / 32

  5. Bug Lifetime in Linux 2 Program Verification as a Toolbox David Cock Is Your System Correct? All faults Cumulative number 80 % of all faults Verified Systems 1500 50 % of all faults of faults fixed 2005–Now Staging Today’s Verification Drivers 1000 Toolbox 50 % of drivers Sound What’s Next? 500 Arch FS Net 0 Other 0 2 4 6 Years • Only 60% fixed within a year. • Asymptotic — some bugs live 5+ years! 2 Source: Palix et. al., Faults in Linux: Ten Years Later, ASPLOS’11 5 / 32

  6. Program Why Now? Verification as a Toolbox David Cock Is Your System Correct? Verified Systems 2005–Now Today’s Verification • Less expertise is required than 10 years ago. Toolbox • We’ve seen some real milestones: What’s Next? • seL4 • CompCert • Tool support has matured dramatically. 6 / 32

  7. Program A Timeline Verification as a Toolbox David Cock 2003 2004 2005 2006 2007 Is Your System Correct? Verified Systems 2005–Now 2008 Today’s Verification Toolbox What’s Next? 2009 2014 2013 2012 2011 2010 7 / 32

  8. Program A Timeline Verification as a Toolbox David Cock 2003 2004 2005 2006 2007 Is Your System Correct? Verisoft Verified Systems 2005–Now 2008 Today’s Verification Toolbox What’s Next? 2009 2014 2013 2012 2011 2010 8 / 32

  9. Program A Timeline Verification as a Toolbox David Cock 2003 2004 2005 2006 2007 Is Your System Correct? Verisoft Verified Systems Verisoft XT 2005–Now 2008 Today’s Verification Toolbox What’s Next? 2009 2014 2013 2012 2011 2010 9 / 32

  10. Program A Timeline Verification as a Toolbox David Cock 2003 2004 2005 2006 2007 Is Your System Correct? Verisoft Verified Systems Verisoft XT 2005–Now seL4 2008 Today’s Verification Toolbox What’s Next? 2009 2014 2013 2012 2011 2010 10 / 32

  11. Program A Timeline Verification as a Toolbox David Cock 2003 2004 2005 2006 2007 Is Your System Correct? Verisoft Verified Systems Verisoft XT 2005–Now seL4 2008 Today’s Verification Toolbox What’s Next? 2009 seL4 Applications 2014 2013 2012 2011 2010 11 / 32

  12. Program A Timeline Verification as a Toolbox David Cock 2003 2004 2005 2006 2007 Is Your System Correct? Verisoft Verified Systems Verisoft XT 2005–Now seL4 2008 Today’s Verification CompCert Toolbox What’s Next? 2009 seL4 Applications 2014 2013 2012 2011 2010 12 / 32

  13. Program A Timeline Verification as a Toolbox David Cock 2003 2004 2005 2006 2007 Is Your System Correct? Verisoft Verified Systems Verisoft XT 2005–Now seL4 2008 Today’s Verification CompCert Toolbox What’s Next? 2009 seL4 Applications 2014 2013 2012 2011 2010 13 / 32

  14. Program A Timeline Verification as a Toolbox David Cock 2003 2004 2005 2006 2007 Is Your System Correct? Verisoft Verified Systems Verisoft XT 2005–Now seL4 2008 Today’s Verification CompCert Toolbox SIMPL C-SIMPL What’s Next? 2009 seL4 Applications 2014 2013 2012 2011 2010 14 / 32

  15. Program SIMPL/C Verification as a Toolbox David Cock Is Your System Correct? Verified Systems C is an awful language to reason about... 2005–Now Today’s Verification Toolbox What’s Next? 15 / 32

  16. Program SIMPL/C Verification as a Toolbox David Cock Is Your System Correct? Verified Systems C is an awful language to reason about... 2005–Now but it’s fast and universal. Today’s Verification Toolbox What’s Next? 16 / 32

  17. Program SIMPL/C Verification as a Toolbox David Cock Is Your System Correct? Verified Systems C is an awful language to reason about... 2005–Now but it’s fast and universal. Today’s Verification Toolbox What’s Next? *(a++) = ++*a-- + (*(a++))++ * *--a; 17 / 32

  18. Program SIMPL/C Verification as a Toolbox David Cock Is Your System Correct? Verified Systems C is an awful language to reason about... 2005–Now but it’s fast and universal. Today’s Verification Toolbox What’s Next? *(a++) = ++*a-- + (*(a++))++ * *--a; • We’ve now got a formal semantics for C 3 . 3 Winwood et. al., Mind the gap: A verification framework for low-level C, TPHOLS’09 18 / 32

  19. Program SIMPL/C Verification as a Toolbox David Cock Is Your System Correct? Verified Systems C is an awful language to reason about... 2005–Now but it’s fast and universal. Today’s Verification Toolbox What’s Next? *(a++) = ++*a-- + (*(a++))++ * *--a; • We’ve now got a formal semantics for C 3 . • As long as you don’t write nonsense like this. 3 Winwood et. al., Mind the gap: A verification framework for low-level C, TPHOLS’09 19 / 32

  20. Program A Timeline Verification as a Toolbox David Cock 2003 2004 2005 2006 2007 Is Your System Correct? Verisoft Verified Systems Verisoft XT 2005–Now seL4 2008 Today’s Verification CompCert Toolbox SIMPL C-SIMPL What’s Next? 2009 seL4 Applications 2014 2013 2012 2011 2010 20 / 32

  21. Program A Timeline Verification as a Toolbox David Cock 2003 2004 2005 2006 2007 Is Your System Correct? Verisoft Verified Systems Verisoft XT 2005–Now seL4 2008 Today’s Verification CompCert Toolbox SIMPL C-SIMPL What’s Next? CompCert 2009 seL4 Applications 2014 2013 2012 2011 2010 21 / 32

  22. Program seL4, VCC & CompCert Verification as a Toolbox David Cock Is Your System Correct? Verified Systems 2005–Now Today’s Verification Toolbox What’s Next? As of 2009, we’ve got: 22 / 32

  23. Program seL4, VCC & CompCert Verification as a Toolbox David Cock Is Your System Correct? Verified Systems 2005–Now Today’s Verification Toolbox What’s Next? As of 2009, we’ve got: • A verified kernel: seL4. 23 / 32

  24. Program seL4, VCC & CompCert Verification as a Toolbox David Cock Is Your System Correct? Verified Systems 2005–Now Today’s Verification Toolbox What’s Next? As of 2009, we’ve got: • A verified kernel: seL4. • A verifying compiler: CompCert. 24 / 32

  25. Program seL4, VCC & CompCert Verification as a Toolbox David Cock Is Your System Correct? Verified Systems 2005–Now Today’s Verification Toolbox What’s Next? As of 2009, we’ve got: • A verified kernel: seL4. • A verifying compiler: CompCert. • An automatic verifier for concurrent C: VCC. 25 / 32

  26. Program seL4, VCC & CompCert Verification as a Toolbox David Cock Is Your System Correct? Verified Systems 2005–Now Today’s Verification Toolbox What’s Next? As of 2009, we’ve got: • A verified kernel: seL4. • A verifying compiler: CompCert. • An automatic verifier for concurrent C: VCC. • seL4 compiles with CompCert... 26 / 32

  27. Program seL4, VCC & CompCert Verification as a Toolbox David Cock Is Your System Correct? Verified Systems 2005–Now Today’s Verification Toolbox What’s Next? As of 2009, we’ve got: • A verified kernel: seL4. • A verifying compiler: CompCert. • An automatic verifier for concurrent C: VCC. • seL4 compiles with CompCert... but VCC can’t (yet) verify seL4. 27 / 32

  28. Program A Timeline Verification as a Toolbox David Cock 2003 2004 2005 2006 2007 Is Your System Correct? Verisoft Verified Systems Verisoft XT 2005–Now seL4 2008 Today’s Verification CompCert Toolbox SIMPL C-SIMPL What’s Next? CompCert 2009 seL4 Applications 2014 2013 2012 2011 2010 28 / 32

  29. Program A Timeline Verification as a Toolbox David Cock 2003 2004 2005 2006 2007 Is Your System Correct? Verisoft Verified Systems Verisoft XT 2005–Now seL4 2008 Today’s Verification CompCert Toolbox SIMPL C-SIMPL What’s Next? AutoCorres ASM Verification CompCert 2009 seL4 Applications 2014 2013 2012 2011 2010 29 / 32

Recommend

Program Verification (Rosen, Sections 5.5) TOPICS Program Correctness Preconditions &

Program Verification (Rosen, Sections 5.5) TOPICS Program Correctness Preconditions &

Program Verification (Rosen, Sections 5.5) TOPICS Program Correctness Preconditions & Postconditions Program Verification Assignments Composition Conditionals Loops Proofs about Programs Why

537 views • 36 slides
presentation The Case Competition Toolbox About the Toolbox Disclaimer The Case Competition

presentation The Case Competition Toolbox About the Toolbox Disclaimer The Case Competition

presentation The Case Competition Toolbox About the Toolbox Disclaimer The Case Competition Toolbox is a collection of useful This Toolbox is a collection of useful tips, tools, advices guidelines and frameworks that will assist your case

552 views • 37 slides
From Program Verification to Program Synthesis Overview Jaak Ristioja March 30, 2010 1 / 91

From Program Verification to Program Synthesis Overview Jaak Ristioja March 30, 2010 1 / 91

From Program Verification to Program Synthesis Overview Jaak Ristioja March 30, 2010 1 / 91 Reference From Program Verification to Program Synthesis. @ POPL10; January 17-23, 2010 Saurabh Srivastava , University of Maryland, College Park

1.21k views • 91 slides
Preparing for Re-Verification Brief Mr. Terrence Moultrie Chief, Verification and Executive

Preparing for Re-Verification Brief Mr. Terrence Moultrie Chief, Verification and Executive

The Center for Verification and Evaluation (CVE) Preparing for Re-Verification Brief Mr. Terrence Moultrie Chief, Verification and Executive Support Services Agenda What is Re-Verification? o Simplified Reverification Program VIP

320 views • 21 slides
Towards full verification of concurrent libraries Viktor Vafeiadis Program verification

Towards full verification of concurrent libraries Viktor Vafeiadis Program verification

Towards full verification of concurrent libraries Viktor Vafeiadis Program verification Programs considered: Small (<100 LOC) Medium (KLOC) Large (MLOC) Simple

577 views • 45 slides
Quo Vadis Program Verification Krzysztof R. Apt CWI, Amsterdam, the Netherlands , University of

Quo Vadis Program Verification Krzysztof R. Apt CWI, Amsterdam, the Netherlands , University of

Quo Vadis Program Verification Krzysztof R. Apt CWI, Amsterdam, the Netherlands , University of Amsterdam Quo Vadis Program Verification p. 1/1 One Page Summary Assertional approach to program verification is here to stay. Gap between

629 views • 19 slides
DIVS DL/ID Verification Systems Verification of Legal Status DIVS Passport Verification

DIVS DL/ID Verification Systems Verification of Legal Status DIVS Passport Verification

DIVS DL/ID Verification Systems Verification of Legal Status DIVS Passport Verification Projects Birth Record Verification State to State Verification DIVS State to State Verification Service (S2S) Program Benefits Mission

349 views • 8 slides
Verification & Validation Verification is getting the system right : Verification and

Verification & Validation Verification is getting the system right : Verification and

Verification & Validation Verification is getting the system right : Verification and Validation Does the program you built do what you designed it to do? Dr. James A. Bednar Validation is getting the right system : jbednar@inf.ed.ac.uk

331 views • 8 slides
Program Verification (6EC version only) Erik Poll Digital Security Radboud University Nijmegen

Program Verification (6EC version only) Erik Poll Digital Security Radboud University Nijmegen

Program Verification (6EC version only) Erik Poll Digital Security Radboud University Nijmegen Overview Program Verification using Verification Condition Generators JML a formal specification language for Java Used for the

620 views • 41 slides
7. Refined Verification Condition Generation Program Verification ETH Zurich, Spring Semester

7. Refined Verification Condition Generation Program Verification ETH Zurich, Spring Semester

7. Refined Verification Condition Generation Program Verification ETH Zurich, Spring Semester 2018 Alexander J. Summers 158 Weakest Preconditions So Far Weakest preconditions provide a means of reducing the question: does a program have

339 views • 16 slides
Welcome to the Machine Learning Toolbox! Machine Learning Toolbox Supervised learning caret

Welcome to the Machine Learning Toolbox! Machine Learning Toolbox Supervised learning caret

MACHINE LEARNING TOOLBOX Welcome to the Machine Learning Toolbox! Machine Learning Toolbox Supervised learning caret R package Automates supervised learning (a.k.a. predictive modeling ) Target variable Machine Learning Toolbox

634 views • 16 slides
2010 PARTNERING CONFERENCE Project Managers Toolbox August 10, 2010 Ron Rigney, P.E. &

2010 PARTNERING CONFERENCE Project Managers Toolbox August 10, 2010 Ron Rigney, P.E. &

2010 PARTNERING CONFERENCE Project Managers Toolbox August 10, 2010 Ron Rigney, P.E. & P.L.S. Director Division of Program Management Project Managers Overview of KYTC Toolbox The following instructions are for accessing the

436 views • 10 slides
Why3 What is why3? A platform for deductive program verification What is why3? A platform

Why3 What is why3? A platform for deductive program verification What is why3? A platform

Why3 What is why3? A platform for deductive program verification What is why3? A platform for deductive program verification Made by: Franois Bobot Martin Clochard Lon Gondelman Jean-Christophe Fillitre Claude

98 views • 9 slides
SAT-based verification (BMC, temporal induction) Mary Sheeran, Chalmers SAT-based verification

SAT-based verification (BMC, temporal induction) Mary Sheeran, Chalmers SAT-based verification

SAT-based verification (BMC, temporal induction) Mary Sheeran, Chalmers SAT-based verification now hot Used here in Sweden since 1989 mostly in safety critical applications (railway control program verification) Bounded Model Checking a

468 views • 25 slides
Viktor Vafeiadis Software Analysis & Verification Full functional verification

Viktor Vafeiadis Software Analysis & Verification Full functional verification

Viktor Vafeiadis Software Analysis & Verification Full functional verification Compilers , concurrent programs , theorem provers Program equivalence / Compositional reasoning Compositional compiler verification

266 views • 3 slides
Higher-Order Model Checking: Principles and Applications to Program Verification and Security

Higher-Order Model Checking: Principles and Applications to Program Verification and Security

Higher-Order Model Checking: Principles and Applications to Program Verification and Security Part I: Types and Recursion Schemes for Higher-Order Program Verification Part II: Higher-Order Program Verification and Language-Based Security

836 views • 54 slides
Outline Outline Review of PSP Levels Overview Selecting Verification Methods Design

Outline Outline Review of PSP Levels Overview Selecting Verification Methods Design

Outline Outline Review of PSP Levels Overview Selecting Verification Methods Design Verification Design Standards Design Verification Verification Methods Approaches State Machines Program Tracing Program Correctness

499 views • 3 slides
The Audio Degradation Toolbox http://code.soundsoftware.ac.uk/projects/audio-degradation-toolbox/

The Audio Degradation Toolbox http://code.soundsoftware.ac.uk/projects/audio-degradation-toolbox/

The Audio Degradation Toolbox http://code.soundsoftware.ac.uk/projects/audio-degradation-toolbox/ and its Application to Robustness Evaluation Sebastian Ewert and Matthias Mauch Friday, 1 November 13 reverb photo by steveleenow Friday, 1

564 views • 32 slides
Abstract Interpretation and Program Verification Supratik Chakraborty IIT Bombay Program

Abstract Interpretation and Program Verification Supratik Chakraborty IIT Bombay Program

Abstract Interpretation and Program Verification Supratik Chakraborty IIT Bombay Program Analysis: An Example int x = 0, y = 0, z ; read(z); IDEAS? while ( f(x, z) > 0) { Run test cases Get code analyzed by if ( g(z, y) >

1.16k views • 76 slides
ESP - - Path Path- -Sensitive Sensitive ESP Program Verification in Program Verification in

ESP - - Path Path- -Sensitive Sensitive ESP Program Verification in Program Verification in

ESP - - Path Path- -Sensitive Sensitive ESP Program Verification in Program Verification in Polynomial Time Polynomial Time M. Das, S. Lerner, M. Seigle M. Das, S. Lerner, M. Seigle PLDI '02 PLDI '02 Partial program verification

705 views • 24 slides
Hibernate Search Hardy Ferentschik, Red Hat The toolbox The toolbox Build tool Ant/Maven The

Hibernate Search Hardy Ferentschik, Red Hat The toolbox The toolbox Build tool Ant/Maven The

Hibernate Search Hardy Ferentschik, Red Hat The toolbox The toolbox Build tool Ant/Maven The toolbox Build tool Ant/Maven Container Tomcat/JBoss The toolbox Build tool Ant/Maven Container Tomcat/JBoss MVC Struts/Seam The toolbox

1.18k views • 55 slides
Program Verification using JML and ESC/Java2 Erik Poll Radboud University Nijmegen p.1/36

Program Verification using JML and ESC/Java2 Erik Poll Radboud University Nijmegen p.1/36

Program Verification using JML and ESC/Java2 Erik Poll Radboud University Nijmegen p.1/36 Outline of this tutorial formal specifcation language JML program verification using ESC/Java2 p.2/36 The Java Modeling Language JML

471 views • 36 slides
Engineering Your SECME Program and SECME Toolbox Lynda Byrne Ramona Bryant SECME Education

Engineering Your SECME Program and SECME Toolbox Lynda Byrne Ramona Bryant SECME Education

Engineering Your SECME Program and SECME Toolbox Lynda Byrne Ramona Bryant SECME Education Program Manager SECME Program Coordinator lynda.byrne@coe.gatech.edu ramona.bryant@coe.gatech.edu 404-894-3304 www.secme.org Overview

671 views • 44 slides
Syntax-Guided Synthesis Rajeev Alur University of Pennsylvania 1 Program Verification Program

Syntax-Guided Synthesis Rajeev Alur University of Pennsylvania 1 Program Verification Program

Syntax-Guided Synthesis Rajeev Alur University of Pennsylvania 1 Program Verification Program P Specification S Verifier Proof of correctness or Witness of a bug 2 Classical Program Synthesis Specification S High Level WHAT

1.28k views • 59 slides

More recommend