a simple near linear pseudopolynomial time randomized
play

A Simple Near-Linear Pseudopolynomial Time Randomized Algorithm for - PowerPoint PPT Presentation

Feb 21, 2023 •235 likes •832 views

A Simple Near-Linear Pseudopolynomial Time Randomized Algorithm for Subset Sum Ce Jin , Hongxun Wu Tsinghua University SOSA 2019 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

  1. A Simple Near-Linear Pseudopolynomial Time Randomized Algorithm for Subset Sum Ce Jin , Hongxun Wu Tsinghua University SOSA 2019 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 1 / 15

  2. Subset Sum Subset Sum Given a (multi)set S of n positive integers and a target integer t , does there exist a subset R ⊆ S that sums to exactly t ? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 2 / 15

  3. Subset Sum Subset Sum Given a (multi)set S of n positive integers and a target integer t , does there exist a subset R ⊆ S that sums to exactly t ? Example: S = { 1 , 1 , 3 , 10 } , t = 12 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 2 / 15

  4. Subset Sum Subset Sum Given a (multi)set S of n positive integers and a target integer t , does there exist a subset R ⊆ S that sums to exactly t ? Example: S = { 1 , 1 , 3 , 10 } , t = 12 YES! R = { 1 , 1 , 10 } , sum( R ) = 1 + 1 + 10 = 12 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 2 / 15

  5. Subset Sum Subset Sum Given a (multi)set S of n positive integers and a target integer t , does there exist a subset R ⊆ S that sums to exactly t ? Example: S = { 1 , 1 , 3 , 10 } , t = 12 YES! R = { 1 , 1 , 10 } , sum( R ) = 1 + 1 + 10 = 12 A classic NP-hard problem. O (2 n / 2 ) algorithm [Horowitz and Sahni, JACM 1974] . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 2 / 15

  6. Pseudopolynomial time algorithm Pseudopolynomial time algorithm: in poly( n , t ) time. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 3 / 15

  7. Pseudopolynomial time algorithm Pseudopolynomial time algorithm: in poly( n , t ) time. Dynamic programming algorithm [Bellman, 1957]: ( S = { s 1 , . . . , s n } ) f [ i , x ] := f [ i − 1 , x ] OR f [ i − 1 , x − s i ] f [0 , x ] := [ x == 0] Output f [ n , t ] . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 3 / 15

  8. Pseudopolynomial time algorithm Pseudopolynomial time algorithm: in poly( n , t ) time. Dynamic programming algorithm [Bellman, 1957]: ( S = { s 1 , . . . , s n } ) f [ i , x ] := f [ i − 1 , x ] OR f [ i − 1 , x − s i ] f [0 , x ] := [ x == 0] Output f [ n , t ] O ( nt ) time . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 3 / 15

  9. Pseudopolynomial time algorithm O ( nt ) [Bellman, 1957] . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 4 / 15

  10. Pseudopolynomial time algorithm O ( nt ) [Bellman, 1957] O ( n + √ nt ) deterministic algorithm. [Koiliaris and Xu, SODA 2017] ˜ ( ˜ O ( T ) stands for O ( T poly log T )) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 4 / 15

  11. Pseudopolynomial time algorithm O ( nt ) [Bellman, 1957] O ( n + √ nt ) deterministic algorithm. [Koiliaris and Xu, SODA 2017] ˜ ( ˜ O ( T ) stands for O ( T poly log T )) ˜ O ( n + t ) randomized algorithm. [Bringmann, SODA 2017] . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 4 / 15

  12. Pseudopolynomial time algorithm O ( nt ) [Bellman, 1957] O ( n + √ nt ) deterministic algorithm. [Koiliaris and Xu, SODA 2017] ˜ ( ˜ O ( T ) stands for O ( T poly log T )) ˜ O ( n + t ) randomized algorithm. [Bringmann, SODA 2017] ▶ more precisely, O ( n + t log t log 4 n ) time (failure probability 1 n ) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 4 / 15

  13. Pseudopolynomial time algorithm O ( nt ) [Bellman, 1957] O ( n + √ nt ) deterministic algorithm. [Koiliaris and Xu, SODA 2017] ˜ ( ˜ O ( T ) stands for O ( T poly log T )) ˜ O ( n + t ) randomized algorithm. [Bringmann, SODA 2017] ▶ more precisely, O ( n + t log t log 4 n ) time (failure probability 1 n ) ▶ uses color coding, layer splitting, FFT . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 4 / 15

  14. Pseudopolynomial time algorithm O ( nt ) [Bellman, 1957] O ( n + √ nt ) deterministic algorithm. [Koiliaris and Xu, SODA 2017] ˜ ( ˜ O ( T ) stands for O ( T poly log T )) ˜ O ( n + t ) randomized algorithm. [Bringmann, SODA 2017] ▶ more precisely, O ( n + t log t log 4 n ) time (failure probability 1 n ) ▶ uses color coding, layer splitting, FFT . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 4 / 15

  15. Pseudopolynomial time algorithm O ( nt ) [Bellman, 1957] O ( n + √ nt ) deterministic algorithm. [Koiliaris and Xu, SODA 2017] ˜ ( ˜ O ( T ) stands for O ( T poly log T )) ˜ O ( n + t ) randomized algorithm. [Bringmann, SODA 2017] ▶ more precisely, O ( n + t log t log 4 n ) time (failure probability 1 n ) ▶ uses color coding, layer splitting, FFT Near-optimal! (No t 1 − ε 2 o ( n ) time algorithm for any ε > 0, unless SETH fails) [Abboud, Bringmann, Hermelin, Shabtay, SODA 2019] . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 4 / 15

  16. Our result We present a randomized algorithm for Subset Sum in ˜ O ( n + t ) time. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 5 / 15

  17. Our result We present a randomized algorithm for Subset Sum in ˜ O ( n + t ) time. Our techniques are simple and quite different from Bringmann’s algorithm. generating functions FFT . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 5 / 15

  18. Our result We present a randomized algorithm for Subset Sum in ˜ O ( n + t ) time. Our techniques are simple and quite different from Bringmann’s algorithm. generating functions FFT n + t ) is O ( n + t log 2 t ). 1 Precise running time (with failure probability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 5 / 15

  19. Our result We present a randomized algorithm for Subset Sum in ˜ O ( n + t ) time. Our techniques are simple and quite different from Bringmann’s algorithm. generating functions FFT n + t ) is O ( n + t log 2 t ). 1 Precise running time (with failure probability Can be improved to O ( n + t log t ) time (slightly less simple). faster than Bringmann’s algorithm by a log 4 n factor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 5 / 15

  20. Our result We present a randomized algorithm for Subset Sum in ˜ O ( n + t ) time. Our techniques are simple and quite different from Bringmann’s algorithm. generating functions FFT n + t ) is O ( n + t log 2 t ). 1 Precise running time (with failure probability Can be improved to O ( n + t log t ) time (slightly less simple). faster than Bringmann’s algorithm by a log 4 n factor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 5 / 15

  21. Our approach: generating functions ( S = { s 1 , s 2 , . . . , s n } , target integer = t ) Consider the generating function of this instance ∏ (1 + x s i ) A ( x ) = 1 ≤ i ≤ n . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 6 / 15

  22. Our approach: generating functions ( S = { s 1 , s 2 , . . . , s n } , target integer = t ) Consider the generating function of this instance ∏ (1 + x s i ) A ( x ) = 1 ≤ i ≤ n Expand it ∑ a i x i A ( x ) = 1 + i ≥ 1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ce Jin , Hongxun Wu (Tsinghua University) SOSA 2019 6 / 15

Recommend

Outline The Simple Linear Regression Model (12.1) Fitting the Regression Line (12.2)

Outline The Simple Linear Regression Model (12.1) Fitting the Regression Line (12.2)

2/22/2007 219323 Probability and Statistics for Software Statistics for Software and Knowledge Engineers Lecture 13: Simple Linear Regression Simple Linear Regression and Correlation Monchai Sopitkamon, Ph.D. Outline The Simple Linear

968 views • 19 slides
Limits on Representing Functions by Linear Combinations of Simple Functions 0,1

Limits on Representing Functions by Linear Combinations of Simple Functions 0,1

Limits on Representing Functions by Linear Combinations of Simple Functions 0,1 0,1 ? simple simple simple simple simple simple Ryan Williams MIT The -linear Representation Problem Let be a class of

283 views • 14 slides
Mining Distance-Based Outliers in Near Linear Time with Randomization and a Simple Pruning Rule

Mining Distance-Based Outliers in Near Linear Time with Randomization and a Simple Pruning Rule

Mining Distance-Based Outliers in Near Linear Time with Randomization and a Simple Pruning Rule Stephen D. Bay 1 and Mark Schwabacher 2 1 Institute for the Study of Learning and Expertise sbay@apres.stanford.edu 2 NASA Ames Research Center

392 views • 24 slides
Linear time 8 / 3 -approx. of r -star guards in simple orthogonal art galleries obert Mezei 1

Linear time 8 / 3 -approx. of r -star guards in simple orthogonal art galleries obert Mezei 1

Linear time 8 / 3 -approx. of r -star guards in simple orthogonal art galleries obert Mezei 1 Ervin Gy ori & Tam as R ICGT 2018, July 9, Lyon 1 Alfr ed R enyi Institute of Mathematics, Hungarian Academy of Sciences 1/17 The

800 views • 68 slides
Decomposition of sum of squares 8 y y 6 y y y y 4 y y 2 2 4 6 8

Decomposition of sum of squares 8 y y 6 y y y y 4 y y 2 2 4 6 8

Simple Linear Regression: R 2 n Given no linear association: n We could simply use the sample mean to predict E(Y). The variability using this simple prediction is given by SST (to be defined shortly). n Given a linear association: n The use of X

591 views • 35 slides
can be done in linear time? Yuri Gurevich Tallinn, April 29, 2014 Agenda 1. What linear time?

can be done in linear time? Yuri Gurevich Tallinn, April 29, 2014 Agenda 1. What linear time?

What, if anything, can be done in linear time? Yuri Gurevich Tallinn, April 29, 2014 Agenda 1. What linear time? Why linear time? 2. Propositional primal infon logic 3. A linear time decision algorithm 4. Extensions with 1. Disjunction 2.

632 views • 48 slides
Linear Convergence of Randomized Primal-Dual Coordinate Method for Large-scale Linear Constrained

Linear Convergence of Randomized Primal-Dual Coordinate Method for Large-scale Linear Constrained

Linear Convergence of Randomized Primal-Dual Coordinate Method for Large-scale Linear Constrained Convex Programming Daoli Zhu and Lei Zhao Shanghai Jiao Tong University ICML 2020 July 16, 2020 PRO PRE CCR LCA NA CCL Outline 1 Research

731 views • 28 slides
Trendlines Simple Linear Regression Multiple Linear Regression Systematic Model

Trendlines Simple Linear Regression Multiple Linear Regression Systematic Model

Trendlines Simple Linear Regression Multiple Linear Regression Systematic Model Building Practical Issues Overfitting Categorical Variables Interaction Terms Non-linear Terms Linear y = a + bx Logarithmic

945 views • 65 slides
LINEAR REGRESSION LINEAR REGRESSION - FROM A MACHINE LEARNING POINT OF VIEW 25 SIMPLE LINEAR

LINEAR REGRESSION LINEAR REGRESSION - FROM A MACHINE LEARNING POINT OF VIEW 25 SIMPLE LINEAR

LINEAR REGRESSION LINEAR REGRESSION - FROM A MACHINE LEARNING POINT OF VIEW 25 SIMPLE LINEAR REGRESSION 20 Sales 15 Starting point 10 Simplest parametric function 5 Easy to interpret the parameters: 0 50 100 150 200 250

1.12k views • 13 slides
Which models can be fit with linear regression? Simple linear regression in Matlab X = rand(3,3)

Which models can be fit with linear regression? Simple linear regression in Matlab X = rand(3,3)

Which models can be fit with linear regression? Simple linear regression in Matlab X = rand(3,3) b = pinv(X) * y X = b = 0.0467 0.5188 0.5317 14.3966 0.6587 0.3323 0.5070 50.9428 0.7573 0.0428 0.2532 -50.8102 y = rand(3,1) b = X \

643 views • 13 slides
Randomized methods in linear algebra and their applications in data science November 17 19,

Randomized methods in linear algebra and their applications in data science November 17 19,

Brummer and Partners MathDataLab mini course Randomized methods in linear algebra and their applications in data science November 17 19, 2020 Per-Gunnar Martinsson The University of Texas at Austin Slides and links at:

1.74k views • 157 slides
Section 2.2: Simple Linear Regression: Predictions and Inference Jared S. Murray The University

Section 2.2: Simple Linear Regression: Predictions and Inference Jared S. Murray The University

Section 2.2: Simple Linear Regression: Predictions and Inference Jared S. Murray The University of Texas at Austin McCombs School of Business Suggested reading: OpenIntro Statistics, Chapter 7.4 1 Simple Linear Regression: Predictions and

701 views • 49 slides
Linear regression Linear regression is a simple approach to supervised learning. It assumes

Linear regression Linear regression is a simple approach to supervised learning. It assumes

Linear regression Linear regression is a simple approach to supervised learning. It assumes that the dependence of Y on X 1 , X 2 , . . . X p is linear. True regression functions are never linear! 7 6 f(X) 5 4 3 2 4 6 8 X

704 views • 48 slides
STAT 213 Simple Linear Regression I Colin Reimer Dawson Oberlin College 5 October 2016 Outline

STAT 213 Simple Linear Regression I Colin Reimer Dawson Oberlin College 5 October 2016 Outline

Outline Simple Linear Regression Model STAT 213 Simple Linear Regression I Colin Reimer Dawson Oberlin College 5 October 2016 Outline Simple Linear Regression Model Outline Simple Linear Regression Model Outline Simple Linear Regression

399 views • 16 slides
Multiple Linear Regression The population model In a simple linear regression model, a single

Multiple Linear Regression The population model In a simple linear regression model, a single

Multiple Linear Regression The population model In a simple linear regression model, a single response measure- ment Y is related to a single predictor (covariate, regressor) X for each observation. The critical assumption of the model is

859 views • 49 slides
Deterministic Edge Connectivity in Near-Linear Time Ken-ichi Kawarabayashi National Institute of

Deterministic Edge Connectivity in Near-Linear Time Ken-ichi Kawarabayashi National Institute of

Deterministic Edge Connectivity in Near-Linear Time Ken-ichi Kawarabayashi National Institute of Informatics, Japan Mikkel Thorup University of Copenhagen Edge connectivity and global min-cut Simple graph G = ( V , E ) (no parallel edges).

1.54k views • 132 slides
R01 - Simple linear regression STAT 587 (Engineering) Iowa State University October 17, 2020

R01 - Simple linear regression STAT 587 (Engineering) Iowa State University October 17, 2020

R01 - Simple linear regression STAT 587 (Engineering) Iowa State University October 17, 2020 Simple linear regression Telomere length Telomere length http://www.pnas.org/content/101/49/17312 People who are stressed over long periods tend to

351 views • 20 slides
ECS231 Least-squares problems (Introduction to Randomized Algorithms) May 21, 2019 1 / 12

ECS231 Least-squares problems (Introduction to Randomized Algorithms) May 21, 2019 1 / 12

ECS231 Least-squares problems (Introduction to Randomized Algorithms) May 21, 2019 1 / 12 Outline 1. linear least squares review 2. Solving LS by sampling 3. Solving LS by randomized preconditioning 4. Gradient-based optimization

259 views • 12 slides
Relation between Five Data Assimilation Methods for a Simplistic Weakly Non-linear Problem Trond

Relation between Five Data Assimilation Methods for a Simplistic Weakly Non-linear Problem Trond

Relation between Five Data Assimilation Methods for a Simplistic Weakly Non-linear Problem Trond Mannseth Uni Research CIPR Methods Methods Randomized Maximum Likelihood (RML) (Simultaneous estimation, Iterative updates) Methods Randomized

779 views • 55 slides
Lecture 10. Simple linear regression 2020 (1) Using one r.v. to predict another X and Y are

Lecture 10. Simple linear regression 2020 (1) Using one r.v. to predict another X and Y are

Lecture 10. Simple linear regression 2020 (1) Using one r.v. to predict another X and Y are random variables. What is the best linear predictor b 0 + b 1 X of Y ? Prediction error is e = Y ` b 0 ` b 1 X . For the best predictor, there is

523 views • 40 slides
Functional Encryption: Deterministic to Randomized Functions from Simple Assumptions Shashank

Functional Encryption: Deterministic to Randomized Functions from Simple Assumptions Shashank

Functional Encryption: Deterministic to Randomized Functions from Simple Assumptions Shashank Agrawal David J. Wu Public-Key Functional Encryption [BSW11, ON10] () Keys are associated with deterministic functions sk

1.47k views • 99 slides
Randomized Algorithms Randomized Algorithms Two Types of Randomized Algorithms Two Types of

Randomized Algorithms Randomized Algorithms Two Types of Randomized Algorithms Two Types of

Randomized Algorithms Randomized Algorithms Two Types of Randomized Algorithms Two Types of Randomized Algorithms and and Some Complexity Classes Some Complexity Classes Speaker: Chuang-Chieh Lin Advisor: Professor Maw-Shang Chang National

910 views • 52 slides
Linear and Sublinear Linear Algebra Algorithms: Preconditioning Stochastic Gradient Algorithms

Linear and Sublinear Linear Algebra Algorithms: Preconditioning Stochastic Gradient Algorithms

Linear and Sublinear Linear Algebra Algorithms: Preconditioning Stochastic Gradient Algorithms with Randomized Linear Algebra Michael W. Mahoney ICSI and Dept of Statistics, UC Berkeley ( For more info, see: http: // www. stat. berkeley. edu/

506 views • 36 slides
Simple linear regression STAT 401A - Statistical Methods for Research Workers Jarad Niemi Iowa

Simple linear regression STAT 401A - Statistical Methods for Research Workers Jarad Niemi Iowa

Simple linear regression STAT 401A - Statistical Methods for Research Workers Jarad Niemi Iowa State University October 4, 2013 Jarad Niemi (Iowa State) Simple linear regression October 4, 2013 1 / 9 Model Simple Linear Regression Recall

429 views • 9 slides

More recommend