Better Generalization in IC3 Zyad Hassan Aaron R. Bradley Fabio - PowerPoint PPT Presentation

Problem Solution Results Analysis Conclusions Better Generalization in IC3 Zyad Hassan Aaron R. Bradley Fabio Somenzi Department of Electrical, Computer, and Energy Engineering University of Colorado at Boulder Oct 23, 2013 Hassan, Bradley, Somenzi Better Generalization in IC3 1/31

Problem Solution Results Analysis Conclusions Outline Problem 1 Solution 2 Results 3 Analysis 4 Conclusions 5 Hassan, Bradley, Somenzi Better Generalization in IC3 2/31

Problem Solution Results Analysis Conclusions IC3 [Bradley 2010,2011] Model checking algorithm for invariance properties Attempts to construct an inductive strengthening of the property Construction is incremental: derives many simple lemmas Lemmas generation either: Results in an inductive strengthening Guides the search to a counterexample trace SAT-based: performs many relatively easy SAT queries Hassan, Bradley, Somenzi Better Generalization in IC3 4/31

Problem Solution Results Analysis Conclusions Generalization Key component of IC3 Lifts IC3 from explicit to symbolic More successful generalization ⇔ Fewer individual states examined What does IC3 generalize? Hassan, Bradley, Somenzi Better Generalization in IC3 5/31

Problem Solution Results Analysis Conclusions Overview of IC3 Prove the property by induction: All initial states satisfy the property All successors of good states are good Hassan, Bradley, Somenzi Better Generalization in IC3 6/31

Problem Solution Results Analysis Conclusions Counterexamples to Induction (CTIs): The Troublemakers 00 01 11 10 Hassan, Bradley, Somenzi Better Generalization in IC3 7/31

Problem Solution Results Analysis Conclusions Counterexamples to Induction (CTIs): The Troublemakers CTI 00 01 11 10 Hassan, Bradley, Somenzi Better Generalization in IC3 7/31

Problem Solution Results Analysis Conclusions Hassan, Bradley, Somenzi Better Generalization in IC3 8/31

Problem Solution Results Analysis Conclusions What does IC3 generalize? A state is unreachable within k steps to A set of states is unreachable within k steps Hassan, Bradley, Somenzi Better Generalization in IC3 9/31

Problem Solution Results Analysis Conclusions How does generalization work? For each state-bit: Drop bit Find the smallest superset of states that have no predecessors outside of it (if exists) Hassan, Bradley, Somenzi Better Generalization in IC3 10/31

Problem Solution Results Analysis Conclusions Successful Generalization 101 100 110 011 111 CTI Hassan, Bradley, Somenzi Better Generalization in IC3 11/31

Problem Solution Results Analysis Conclusions Successful Generalization 101 100 110 011 11 − 111 CTI Hassan, Bradley, Somenzi Better Generalization in IC3 11/31

Problem Solution Results Analysis Conclusions Successful Generalization 101 1 − − 100 110 011 111 CTI Hassan, Bradley, Somenzi Better Generalization in IC3 11/31

Problem Solution Results Analysis Conclusions Failed Generalization 010 011 111 110 000 101 100 001 CTI Hassan, Bradley, Somenzi Better Generalization in IC3 12/31

Problem Solution Results Analysis Conclusions Failed Generalization 010 011 111 110 000 101 100 001 CTI 10 − Hassan, Bradley, Somenzi Better Generalization in IC3 12/31

Problem Solution Results Analysis Conclusions Failed Generalization 010 011 111 110 000 101 100 001 CTI − − − Hassan, Bradley, Somenzi Better Generalization in IC3 12/31

Problem Solution Results Analysis Conclusions Ineffective Generalization Bad State Hassan, Bradley, Somenzi Better Generalization in IC3 13/31

Problem Solution Results Analysis Conclusions Counterexamples to Generalization (CTGs) CTG 010 011 111 110 000 101 100 001 CTI 10 − Hassan, Bradley, Somenzi Better Generalization in IC3 15/31

Problem Solution Results Analysis Conclusions Counterexamples to Generalization (CTGs) CTG 010 011 011 111 110 000 101 100 001 CTI 10 − Hassan, Bradley, Somenzi Better Generalization in IC3 15/31

Problem Solution Results Analysis Conclusions Counterexamples to Generalization (CTGs) CTG 010 011 011 111 110 000 101 100 001 CTI 1 − − Hassan, Bradley, Somenzi Better Generalization in IC3 15/31

Problem Solution Results Analysis Conclusions Counterexamples to Generalization (CTG) State preventing some generalization (dropping a specific state-bit) Unlike CTIs, not necessarily backward reachable Blocking CTGs: Backward reachable: if deep, saves IC3 explicit traversal Neither forward nor backward: never addressed by IC3 but could continue to obstruct generalization Hassan, Bradley, Somenzi Better Generalization in IC3 16/31

Problem Solution Results Analysis Conclusions ctgDown Instead of joining CTG with cube, turn attention to CTG Like CTIs, prove unreachable within k steps If successful: generalize CTG, re-attempt CTI generalization If failed: join Hassan, Bradley, Somenzi Better Generalization in IC3 17/31

Problem Solution Results Analysis Conclusions ctgDown Instead of joining CTG with cube, turn attention to CTG if limit is not exceeded Like CTIs, prove unreachable within k steps If successful: generalize CTG, re-attempt CTI generalization If failed: or exceeded maxCTGs limit, join, reset maxCTGs limit Hassan, Bradley, Somenzi Better Generalization in IC3 18/31

Problem Solution Results Analysis Conclusions Resetting Limit After Joins Hassan, Bradley, Somenzi Better Generalization in IC3 19/31

Problem Solution Results Analysis Conclusions Experimental Setup HWMCC’10+11+12 (beemb substituted by beemf) 900s timeout IImc and ABC Light-weight preprocessing 5 random seeds Hassan, Bradley, Somenzi Better Generalization in IC3 21/31

Better Generalization in IC3 Zyad Hassan Aaron R. Bradley Fabio - PowerPoint PPT Presentation

Problem Solution Results Analysis Conclusions Better Generalization in IC3 Zyad Hassan Aaron R. Bradley Fabio Somenzi Department of Electrical, Computer, and Energy Engineering University of Colorado at Boulder Oct 23, 2013 Hassan,

Deep learning: Challenges in learning and generalization Tomas Mikolov, Facebook AI What is

Generalization of Cycle-Covering Heuristics Clemens B uchner Department of Mathematics and

VC GENERALIZATION BOUND VC GENERALIZATION BOUND Matthieu Bloch March 12, 2020 1 LOGISTICS (AND

CSC321 Lecture 9: Generalization Roger Grosse Roger Grosse CSC321 Lecture 9: Generalization 1 /

A generalization of unitaries T. S. S. R. K. Rao StatMath Unit Indian Statistical Institute

decomposing generalization models of generic, habitual and episodic statements Venkata S

Local Substitutability for Sequence Generalization Fran cois Coste , Ga elle Garet , Jacques

Collaboration on an ontology for generalization Nicholas Gould - Manchester Metropolitan

Outline IAML: Overfitting and Capacity Control Generalization error Estimating

Data Anonymization - Generalization Algorithms Li Xiong, Slawek Goryczka CS573 Data Privacy and

Deep Model Generalization for Medical Image Computing at Scale DOU Qi Department of Computer

Assessing Generalization in Deep Reinforcement Learning Soo Jung Jang Background Before (ex:

Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer NNs

Generalization Bounds and Stability Lorenzo Rosasco Tomaso Poggio 9.520 Class 6 February, 23

Data Anonymization - Generalization Algorithms Li Xiong CS573 Data Privacy and Anonymity

Learning From Data Lecture 7 Approximation Versus Generalization The VC Dimension Approximation

Community-Preserving Generalization of Social Networks Jordi Casas-Roma 1 and Fran cois Rousseau

On the Influence of Input Noise On the Influence of Input Noise on a Generalization Error

Bijective proof and generalization of Siladi cs partition theorem Isaac KONAN IRIF, Paris

Generalization Ability of Majority Vote Point classifiers Akshat Agarwal Rahul K Sevakula

Boosting Constraint Acquisition via Generalization Queries

1 Classification by image fragments Cross-generalization = Let indicate whether

What? Discrimination is a generalization of sorting and partitioning that can be defined

An Algebraic Generalization of the Chomsky-Sch utzenberger-Theorem Hans Lei