preprocessing techniques
play

Preprocessing Techniques Marijn J.H. Heule - PowerPoint PPT Presentation

Aug 27, 2022 •111 likes •1.07k views

Preprocessing Techniques Marijn J.H. Heule http://www.cs.cmu.edu/~mheule/15816-f19/ Automated Reasoning and Satisfiability, September 19, 2019 1 / 47 Motivation Subsumption Variable Elimination Bounded Variable Addition Blocked Clause

  1. Preprocessing Techniques Marijn J.H. Heule http://www.cs.cmu.edu/~mheule/15816-f19/ Automated Reasoning and Satisfiability, September 19, 2019 1 / 47

  2. Motivation Subsumption Variable Elimination Bounded Variable Addition Blocked Clause Elimination Hyper Binary Resolution Unhiding Redundancy Concluding Remarks 2 / 47

  3. Motivation Subsumption Variable Elimination Bounded Variable Addition Blocked Clause Elimination Hyper Binary Resolution Unhiding Redundancy Concluding Remarks 3 / 47

  4. Interaction between different solving approaches Translator reencoding encoding Simplifier inprocessing preprocessing Clause Learner 4 / 47

  5. Interaction between different solving approaches Translator reencoding encoding Simplifier inprocessing preprocessing Clause Learner It all comes down to adding and removing redundant clauses 4 / 47

  6. Redundant clauses A clause is redundant with respect to a formula if adding it to the formula preserves satisfiability. For unsatisfiable formulas, all clauses can be added, including the empty clause ⊥ . 5 / 47

  7. Redundant clauses A clause is redundant with respect to a formula if adding it to the formula preserves satisfiability. For unsatisfiable formulas, all clauses can be added, including the empty clause ⊥ . A clause is redundant with respect to a formula if removing it from the formula preserves unsatisfiability. For satisfiable formulas, all clauses can be removed. 5 / 47

  8. Redundant clauses A clause is redundant with respect to a formula if adding it to the formula preserves satisfiability. For unsatisfiable formulas, all clauses can be added, including the empty clause ⊥ . A clause is redundant with respect to a formula if removing it from the formula preserves unsatisfiability. For satisfiable formulas, all clauses can be removed. Challenge regarding redundant clauses: How to check redundancy in polynomial time? Ideally find redundant clauses in linear time 5 / 47

  9. Preprocessing and Inprocessing in Practice 5000 4500 pre- & inprocessing disabled only clause elimination enabled 4000 base line without clause elimination Lingeling version aqw (base line) 3500 Runtime (sec) 3000 2500 2000 1500 1000 500 0 0 50 100 150 200 250 Number of solved application benchmarks of SAT Competition 2013 6 / 47

  10. Outline Motivation Subsumption Variable Elimination Bounded Variable Addition Blocked Clause Elimination Hyper Binary Resolution Unhiding Redundancy Concluding Remarks 7 / 47

  11. Motivation Subsumption Variable Elimination Bounded Variable Addition Blocked Clause Elimination Hyper Binary Resolution Unhiding Redundancy Concluding Remarks 8 / 47

  12. Tautologies and Subsumption Definition (Tautology) A clause C is a tautology if its contains two complementary literals x and ¯ x . Example The clause ( a ∨ b ∨ ¯ b ) is a tautology. Definition (Subsumption) Clause C subsumes clause D if and only if C ⊂ D . Example The clause ( a ∨ b ) subsumes clause ( a ∨ b ∨ ¯ c ) . 9 / 47

  13. Self-Subsuming Resolution Self-Subsuming Resolution C ∨ x D ∨ ¯ x ( a ∨ b ∨ x ) ( a ∨ b ∨ c ∨ ¯ x ) C ⊆ D D ( a ∨ b ∨ c ) resolvent D subsumes second antecedent D ∨ ¯ x 10 / 47

  14. Self-Subsuming Resolution Self-Subsuming Resolution C ∨ x D ∨ ¯ x ( a ∨ b ∨ x ) ( a ∨ b ∨ c ∨ ¯ x ) C ⊆ D D ( a ∨ b ∨ c ) resolvent D subsumes second antecedent D ∨ ¯ x Example Assume a CNF contains both antecedents . . . ( a ∨ b ∨ x )( a ∨ b ∨ c ∨ ¯ x ) . . . If D is added, then D ∨ ¯ x can be removed which in essence removes ¯ x from D ∨ ¯ x . . . ( a ∨ b ∨ x )( a ∨ b ∨ c ) . . . Initially in the SATeLite preprocessor, [EenBiere’07] now common in most solvers (i.e., as pre- and inprocessing) 10 / 47

  15. Self-Subsuming Example Self-Subsuming Resolution C ∨ x D ∨ ¯ x ( a ∨ b ∨ x ) ( a ∨ b ∨ c ∨ ¯ x ) C ⊆ D D ( a ∨ b ∨ c ) resolvent D subsumes second antecedent D ∨ ¯ x Example: Remove literals using self-subsumption ( a ∨ b ∨ c ) ∧ ( ¯ a ∨ b ∨ c ) ∧ c ) ∧ ( a ∨ ¯ (¯ a ∨ b ∨ ¯ b ∨ c ) ∧ a ∨ ¯ a ∨ ¯ b ∨ ¯ (¯ b ∨ d ) ∧ ( ¯ d ) ∧ c ∨ ¯ ( a ∨ ¯ c ∨ d ) ∧ ( a ∨ ¯ d ) 11 / 47

  16. Self-Subsuming Example Self-Subsuming Resolution C ∨ x D ∨ ¯ x ( a ∨ b ∨ x ) ( a ∨ b ∨ c ∨ ¯ x ) C ⊆ D D ( a ∨ b ∨ c ) resolvent D subsumes second antecedent D ∨ ¯ x Example: Remove literals using self-subsumption ( b ∨ c ) ∧ ( ¯ a ∨ b ∨ c ) ∧ c ) ∧ ( a ∨ ¯ (¯ a ∨ b ∨ ¯ b ∨ c ) ∧ a ∨ ¯ a ∨ ¯ b ∨ ¯ (¯ b ∨ d ) ∧ ( ¯ d ) ∧ c ∨ ¯ ( a ∨ ¯ c ∨ d ) ∧ ( a ∨ ¯ d ) 11 / 47

  17. Self-Subsuming Example Self-Subsuming Resolution C ∨ x D ∨ ¯ x ( a ∨ b ∨ x ) ( a ∨ b ∨ c ∨ ¯ x ) C ⊆ D D ( a ∨ b ∨ c ) resolvent D subsumes second antecedent D ∨ ¯ x Example: Remove literals using self-subsumption ( b ∨ c ) ∧ ( ¯ a ∨ b ∨ c ) ∧ ) ∧ ( a ∨ ¯ (¯ a ∨ b b ∨ c ) ∧ a ∨ ¯ a ∨ ¯ b ∨ ¯ (¯ b ∨ d ) ∧ ( ¯ d ) ∧ c ∨ ¯ ( a ∨ ¯ c ∨ d ) ∧ ( a ∨ ¯ d ) 11 / 47

  18. Self-Subsuming Example Self-Subsuming Resolution C ∨ x D ∨ ¯ x ( a ∨ b ∨ x ) ( a ∨ b ∨ c ∨ ¯ x ) C ⊆ D D ( a ∨ b ∨ c ) resolvent D subsumes second antecedent D ∨ ¯ x Example: Remove literals using self-subsumption ( b ∨ c ) ∧ ( ¯ a ∨ b ∨ c ) ∧ (¯ a ∨ b ) ∧ ( a ∨ c ) ∧ a ∨ ¯ a ∨ ¯ b ∨ ¯ (¯ b ∨ d ) ∧ ( ¯ d ) ∧ c ∨ ¯ ( a ∨ ¯ c ∨ d ) ∧ ( a ∨ ¯ d ) 11 / 47

  19. Self-Subsuming Example Self-Subsuming Resolution C ∨ x D ∨ ¯ x ( a ∨ b ∨ x ) ( a ∨ b ∨ c ∨ ¯ x ) C ⊆ D D ( a ∨ b ∨ c ) resolvent D subsumes second antecedent D ∨ ¯ x Example: Remove literals using self-subsumption ( b ∨ c ) ∧ ( ¯ a ∨ b ∨ c ) ∧ (¯ a ∨ b ) ∧ ( a ∨ c ) ∧ a ∨ ¯ a ∨ ¯ b ∨ ¯ (¯ b ) ∧ ( ¯ d ) ∧ c ∨ ¯ ( a ∨ ¯ c ∨ d ) ∧ ( a ∨ ¯ d ) 11 / 47

  20. Self-Subsuming Example Self-Subsuming Resolution C ∨ x D ∨ ¯ x ( a ∨ b ∨ x ) ( a ∨ b ∨ c ∨ ¯ x ) C ⊆ D D ( a ∨ b ∨ c ) resolvent D subsumes second antecedent D ∨ ¯ x Example: Remove literals using self-subsumption ( b ∨ c ) ∧ ( ¯ a ∨ b ∨ c ) ∧ (¯ a ∨ b ) ∧ ( a ∨ c ) ∧ a ∨ ¯ a ∨ ¯ b ∨ ¯ (¯ b ) ∧ ( ¯ d ) ∧ c ∨ ¯ ( a ∨ ¯ c ) ∧ ( a ∨ ¯ d ) 11 / 47

  21. Self-Subsuming Example Self-Subsuming Resolution C ∨ x D ∨ ¯ x ( a ∨ b ∨ x ) ( a ∨ b ∨ c ∨ ¯ x ) C ⊆ D D ( a ∨ b ∨ c ) resolvent D subsumes second antecedent D ∨ ¯ x Example: Remove literals using self-subsumption ( b ∨ c ) ∧ ( ¯ a ∨ b ∨ c ) ∧ (¯ a ) ∧ ( a ∨ c ) ∧ a ∨ ¯ a ∨ ¯ b ∨ ¯ (¯ b ) ∧ ( ¯ d ) ∧ c ∨ ¯ ( a ∨ ¯ c ) ∧ ( a ∨ ¯ d ) 11 / 47

  22. Self-Subsuming Example Self-Subsuming Resolution C ∨ x D ∨ ¯ x ( a ∨ b ∨ x ) ( a ∨ b ∨ c ∨ ¯ x ) C ⊆ D D ( a ∨ b ∨ c ) resolvent D subsumes second antecedent D ∨ ¯ x Example: Remove literals using self-subsumption ( b ∨ c ) ∧ ( ¯ a ∨ b ∨ c ) ∧ (¯ a ) ∧ ( a ) ∧ a ∨ ¯ a ∨ ¯ b ∨ ¯ (¯ b ) ∧ ( ¯ d ) ∧ c ∨ ¯ ( a ∨ ¯ c ) ∧ ( a ∨ ¯ d ) 11 / 47

  23. Self-Subsuming Example Self-Subsuming Resolution C ∨ x D ∨ ¯ x ( a ∨ b ∨ x ) ( a ∨ b ∨ c ∨ ¯ x ) C ⊆ D D ( a ∨ b ∨ c ) resolvent D subsumes second antecedent D ∨ ¯ x Example: Remove literals using self-subsumption ( b ∨ c ) ∧ ( ¯ a ∨ b ∨ c ) ∧ ( ) ∧ ( a ) ∧ a ∨ ¯ a ∨ ¯ b ∨ ¯ (¯ b ) ∧ ( ¯ d ) ∧ c ∨ ¯ ( a ∨ ¯ c ) ∧ ( a ∨ ¯ d ) 11 / 47

  24. Implementing Subsumption Definition (Subsumption) Clause C subsumes clause D if and only if C ⊂ D . Example The clause ( a ∨ b ) subsumes clause ( a ∨ b ∨ ¯ c ) . Forward Subsumption for each clause C in formula F do if C is subsumed by a clause D in F \ C then remove C from F 12 / 47

  25. Implementing Subsumption Definition (Subsumption) Clause C subsumes clause D if and only if C ⊂ D . Example The clause ( a ∨ b ) subsumes clause ( a ∨ b ∨ ¯ c ) . Forward Subsumption for each clause C in formula F do if C is subsumed by a clause D in F \ C then remove C from F Backward Subsumption for each clause C in formula F do remove all clauses D in F that are subsumed by C 12 / 47

  26. Implementing Subsumption Definition (Subsumption) Clause C subsumes clause D if and only if C ⊂ D . Example The clause ( a ∨ b ) subsumes clause ( a ∨ b ∨ ¯ c ) . Forward Subsumption for each clause C in formula F do if C is subsumed by a clause D in F \ C then remove C from F Backward Subsumption for each clause C in formula F do pick a literal x in C remove all clauses D in F x that are subsumed by C 12 / 47

  27. Motivation Subsumption Variable Elimination Bounded Variable Addition Blocked Clause Elimination Hyper Binary Resolution Unhiding Redundancy Concluding Remarks 13 / 47

  28. Variable Elimination [DavisPutnam’60] Definition (Resolution) Given two clauses C = ( x ∨ a 1 ∨ · · · ∨ a i ) and D = (¯ x ∨ b 1 ∨ · · · ∨ b j ), the resolvent of C and D on variable x (denoted by C ⊗ x D ) is ( a 1 ∨ · · · ∨ a i ∨ b 1 ∨ · · · ∨ b j ) Resolution on sets of clauses F x and F ¯ x (denoted by F x ⊗ x F ¯ x ) generates all non-tautological resolvents of C ∈ F x and D ∈ F ¯ x . 14 / 47

Recommend

20-03-28 9. General Improvement Techniques 9.1 Preprocessing There are several

20-03-28 9. General Improvement Techniques 9.1 Preprocessing There are several

20-03-28 9. General Improvement Techniques 9.1 Preprocessing There are several concepts/techniques to improve The following is based on slides by Michael M. Richter. learning results that are general enough to be applicable Data preprocessing

221 views • 3 slides
CS6220: DATA MINING TECHNIQUES Chapter 3: Data Preprocessing Instructor: Yizhou Sun

CS6220: DATA MINING TECHNIQUES Chapter 3: Data Preprocessing Instructor: Yizhou Sun

CS6220: DATA MINING TECHNIQUES Chapter 3: Data Preprocessing Instructor: Yizhou Sun yzsun@ccs.neu.edu January 15, 2013 Chapter 3: Data Preprocessing Data Preprocessing: An Overview Data Quality Major Tasks in Data Preprocessing

901 views • 61 slides
Preprocessing and Inprocessing Techniques in SAT Armin Biere Institute for Formal Models and

Preprocessing and Inprocessing Techniques in SAT Armin Biere Institute for Formal Models and

Preprocessing and Inprocessing Techniques in SAT Armin Biere Institute for Formal Models and Verification Johannes Kepler University Linz, Austria joint work with Marijn Heule and Matti J arvisalo WorKer11 3rd Workshop on Kernelization

1.03k views • 49 slides
TRACER TUTORIAL: TEXT REUSE DETECTION PREPROCESSING M arco B uchler, Emily Franzini and Greta

TRACER TUTORIAL: TEXT REUSE DETECTION PREPROCESSING M arco B uchler, Emily Franzini and Greta

TRACER TUTORIAL: TEXT REUSE DETECTION PREPROCESSING M arco B uchler, Emily Franzini and Greta Franzini TABLE OF CONTENTS 1. What is preprocessing? 2. Preprocessing techniques 3. Hacking 4. Conclusion and revision 2/100 HACKING,

675 views • 35 slides
Data Preprocessing Why Data Preprocessing? Chris Williams, School of Informatics University of

Data Preprocessing Why Data Preprocessing? Chris Williams, School of Informatics University of

Data Preprocessing Why Data Preprocessing? Chris Williams, School of Informatics University of Edinburgh Data in the real world is dirty. It is: Data preparation is a big issue for data mining. Cabena et al (1998) extimate that data

410 views • 8 slides
CS378 Introduction to Data Mining Data Exploration and Data Preprocessing Li Xiong Data

CS378 Introduction to Data Mining Data Exploration and Data Preprocessing Li Xiong Data

CS378 Introduction to Data Mining Data Exploration and Data Preprocessing Li Xiong Data Exploration and Data Preprocessing Data and Attributes Data exploration Data pre-processing Data Mining: Concepts and Techniques 2 What is

976 views • 74 slides
Data Preprocessing Data Mining and Exploration: Preprocessing Data preparation is a big issue for

Data Preprocessing Data Mining and Exploration: Preprocessing Data preparation is a big issue for

Data Preprocessing Data Mining and Exploration: Preprocessing Data preparation is a big issue for data mining. Cabena et al (1998) Amos Storkey, School of Informatics estimate that data preparation accounts for 60% of the effort in a

243 views • 3 slides
ATIR April 28, 2016 Motivation Simple Preprocessing Linguistics Further Preprocessing

ATIR April 28, 2016 Motivation Simple Preprocessing Linguistics Further Preprocessing

Advanced Topics in Information Retrieval Natural Language Processing for IR & IR Evaluation Vinay Setty Jannik Strtgen vsetty@mpi-inf.mpg.de jannik.stroetgen@mpi-inf.mpg.de ATIR April 28, 2016 Motivation Simple Preprocessing

1.18k views • 69 slides
Preprocessing and Dimensionality Reduction J er emy Fix CentraleSup elec

Preprocessing and Dimensionality Reduction J er emy Fix CentraleSup elec

Datasets Preprocessing Dimensionality reduction Preprocessing and Dimensionality Reduction J er emy Fix CentraleSup elec jeremy.fix@centralesupelec.fr 2017 1 / 73 Datasets Preprocessing Dimensionality reduction Where to get data

1.22k views • 73 slides
Preprocessing Data for Machine Learning P R E P R OC E SSIN G FOR MAC H IN E L E AR N IN G

Preprocessing Data for Machine Learning P R E P R OC E SSIN G FOR MAC H IN E L E AR N IN G

Preprocessing Data for Machine Learning P R E P R OC E SSIN G FOR MAC H IN E L E AR N IN G IN P YTH ON Sarah G u ido Senior Data Scientist What is data preprocessing ? Be y ond cleaning and e x plorator y data anal y sis Prepping data for

554 views • 22 slides
Data preprocessing Functional Programming and Intelligent Algorithms Que Tran Hgskolen i

Data preprocessing Functional Programming and Intelligent Algorithms Que Tran Hgskolen i

Data preprocessing Functional Programming and Intelligent Algorithms Que Tran Hgskolen i lesund 20th March 2017 1 Why data preprocessing? Real-world data tend to be dirty incomplete: lacking attribute values, certain attributes of

812 views • 22 slides
4. Lecture Image enhancement: Filtering 1 Image preprocessing Aims: Improvement of

4. Lecture Image enhancement: Filtering 1 Image preprocessing Aims: Improvement of

4. Lecture Image enhancement: Filtering 1 Image preprocessing Aims: Improvement of image data Suppress unwanted distortions Highlight interesting features Image preprocessing does not increase the information content

704 views • 44 slides
DATA MINING LECTURE 2 Data Preprocessing Exploratory Analysis Post-processing What is Data

DATA MINING LECTURE 2 Data Preprocessing Exploratory Analysis Post-processing What is Data

DATA MINING LECTURE 2 Data Preprocessing Exploratory Analysis Post-processing What is Data Mining? Data mining is the use of efficient techniques for the analysis of very large collections of data and the extraction of useful and possibly

1.38k views • 46 slides
Learning Aides Additional tools that can be applied to all techniques Learning From Data Lecture

Learning Aides Additional tools that can be applied to all techniques Learning From Data Lecture

Learning Aides Additional tools that can be applied to all techniques Learning From Data Lecture 27 Learning Aides Input Preprocessing Dimensionality Reduction and Feature Selection Preprocess data to account for arbitrary choices during data

430 views • 4 slides
Data Preparation Data cleaning Discretization (Data preprocessing) Data

Data Preparation Data cleaning Discretization (Data preprocessing) Data

Data Preprocessing Why preprocess the data? Data Preparation Data cleaning Discretization (Data preprocessing) Data integration and transformation Data reduction, Feature selection 2 Why Prepare Data? Why Prepare

462 views • 15 slides
Module 2 Image acquisition & preprocessing Uwe Springmann Centrum fr Informations- und

Module 2 Image acquisition & preprocessing Uwe Springmann Centrum fr Informations- und

Module 2 Image acquisition & preprocessing Uwe Springmann Centrum fr Informations- und Sprachverarbeitung (CIS) Ludwig-Maximilians-Universitt Mnchen (LMU) 2015-09-14 Uwe Springmann Module 2 Image acquisition & preprocessing

197 views • 18 slides
Web Usage Mining Reference : http://maya.cs.depaul.edu/~classes/ect584/papers/srivastava.pdf Dr

Web Usage Mining Reference : http://maya.cs.depaul.edu/~classes/ect584/papers/srivastava.pdf Dr

Web Usage Mining Reference : http://maya.cs.depaul.edu/~classes/ect584/papers/srivastava.pdf Dr Ahmed Rafea Outline Introduction Web Data Preprocessing Usage Preprocessing Content Preprocessing Structure

440 views • 27 slides
Data Warehousing and Machine Learning Preprocessing Thomas D. Nielsen Aalborg University

Data Warehousing and Machine Learning Preprocessing Thomas D. Nielsen Aalborg University

Data Warehousing and Machine Learning Preprocessing Thomas D. Nielsen Aalborg University Department of Computer Science Spring 2008 DWML Spring 2008 1 / 35 Preprocessing Before you can start on the actual data mining, the data may require

1.18k views • 84 slides
Intraday Techniques Intraday Techniques Intraday Techniques Intraday Techniques Combining

Intraday Techniques Intraday Techniques Intraday Techniques Intraday Techniques Combining

Intraday Techniques Intraday Techniques Intraday Techniques Intraday Techniques Combining intraday signals with longer time frame support or resistance. 141 Daily chart for support (slide 1 of 2) June 14 We see a solid band of support

979 views • 20 slides
PREPROCESSING IN DISPLACEMENT SPACE IN PREPARATION FOR ONSHORE

PREPROCESSING IN DISPLACEMENT SPACE IN PREPARATION FOR ONSHORE

PREPROCESSING IN DISPLACEMENT SPACE IN PREPARATION FOR ONSHORE SEISMIC PROCESSING: REMOVING GROUND ROLL AND GHOSTS WITHOUT DAMAGING THE REFLECTION DATA

610 views • 50 slides
UNIONS OF ONIONS Maarten L offler Wolfgang Mulzer Universiteit Utrecht Freie Universit at

UNIONS OF ONIONS Maarten L offler Wolfgang Mulzer Universiteit Utrecht Freie Universit at

UNIONS OF ONIONS Maarten L offler Wolfgang Mulzer Universiteit Utrecht Freie Universit at Berlin 1 CHAPTER I THE PROBLEM 2 PREPROCESSING PARADIGM 3 PREPROCESSING PARADIGM Once upon a time, we were given R . 3 PREPROCESSING

1.49k views • 118 slides
Preprocessing input data for machine learning by FCA Jan OUTRATA Dept. Computer Science

Preprocessing input data for machine learning by FCA Jan OUTRATA Dept. Computer Science

Preprocessing input data for machine learning by FCA Jan OUTRATA Dept. Computer Science Palack y University, Olomouc, Czech Republic CLA 2010, Oct 1921, Sevilla Jan Outrata (Palack y University) Preprocessing input data . . . CLA

1.4k views • 33 slides
Part 1: Preprocessing the Data MAC H IN E TR AN SL ATION IN P YTH ON Th u shan Ganegedara Data

Part 1: Preprocessing the Data MAC H IN E TR AN SL ATION IN P YTH ON Th u shan Ganegedara Data

Part 1: Preprocessing the Data MAC H IN E TR AN SL ATION IN P YTH ON Th u shan Ganegedara Data Scientist and A u thor Introd u ction to data Data en_text : A P y thon list of sentences , each sentence is a string of w ords separated b y spaces

498 views • 33 slides
FEA Modeling from Start to Finish Part 1: Preprocessing and Analysis IN THIS WEBINAR: PRESENTED

FEA Modeling from Start to Finish Part 1: Preprocessing and Analysis IN THIS WEBINAR: PRESENTED

FEA Modeling from Start to Finish Part 1: Preprocessing and Analysis IN THIS WEBINAR: PRESENTED BY: Geometry import and editing David Cross, Ph.D. Meshing and Applying loads Senior Aerospace Stress Engineer Running a static

673 views • 12 slides

More recommend