Polynomial Hierarchy A polynomial-bounded version of Kleenes - PowerPoint PPT Presentation

Polynomial Hierarchy

“A polynomial-bounded version of Kleene’s Arithmetic Hierarchy becomes trivial if P = NP .” Karp, 1972 Computational Complexity, by Fu Yuxi Polynomial Hierarchy 1 / 44

Larry Stockmeyer and Albert Meyer introduced polynomial hierarchy. 1. Larry Stockmeyer and Albert Meyer. The Equivalence Problem for Regular Expressions with Squaring Requires Exponential Space. SWAT’72. Computational Complexity, by Fu Yuxi Polynomial Hierarchy 2 / 44

Synopsis 1. Meyer-Stockmeyer’s Polynomial Hierarchy 2. Stockmeyer-Wrathall Characterization 3. Chandra-Kozen-Stockmeyer Theorem 4. Infinite Hierarchy Conjecture 5. Time-Space Trade-Off Computational Complexity, by Fu Yuxi Polynomial Hierarchy 3 / 44

Meyer-Stockmeyer’s Polynomial Hierarchy Computational Complexity, by Fu Yuxi Polynomial Hierarchy 4 / 44

Problem Beyond NP Meyer and Stockmeyer observed that MINIMAL does not seem to have short witnesses. MINIMAL = { ϕ | ϕ DNF ∧ ∀ DNF ψ. | ψ | < | ϕ | ⇒ ∃ u . ¬ ( ψ ( u ) ⇔ ϕ ( u )) } . Notice that MINIMAL can be solved by an NDTM that queries SAT a polynomial time. ◮ Why DNF? Computational Complexity, by Fu Yuxi Polynomial Hierarchy 5 / 44

� P C P A , = A ∈C � NP C NP A . = A ∈C Computational Complexity, by Fu Yuxi Polynomial Hierarchy 6 / 44

Meyer-Stockmeyer’s Definition The complexity classes Σ p i , Π p i , ∆ p i are defined as follows: Σ p = P , 0 NP Σ p Σ p i , = i +1 P Σ p ∆ p i , = i +1 Π p Σ p = i . i The following hold: ◮ Σ p i ⊆ ∆ p i +1 ⊆ Σ p i +1 , ◮ Π p i ⊆ ∆ p i +1 ⊆ Π p i +1 . i +1 = coNP Σ p Notice that Π p i by definition. Computational Complexity, by Fu Yuxi Polynomial Hierarchy 7 / 44

The polynomial hierarchy is the complexity class PH = � i ≥ 0 Σ p i . Computational Complexity, by Fu Yuxi Polynomial Hierarchy 8 / 44

Natural Problem in the Second Level “Synthesizing circuits is exceedingly difficult. It is even more difficult to show that a circuit found in this way is the most economical one to realize a function. The difficulty springs from the large number of essentially different networks available.” Claude Shannon, 1949 Umans showed in 1998 that the following language is Σ p 2 -complete. MIN-EQ-DNF = {� ϕ, k � | ϕ DNF ∧ ∃ DNF ψ. | ψ | ≤ k ∧ ∀ u .ψ ( u ) ⇔ ϕ ( u ) } . ◮ MIN-EQ-DNF is the problem referred to by Shannon. ◮ The complexity of MINIMAL , as well as MINIMAL , is not known. Computational Complexity, by Fu Yuxi Polynomial Hierarchy 9 / 44

Natural Problem in the Second Level SUCCINCT SET COVER : Given a set S = { ϕ 1 , . . . , ϕ m } of 3-DNF’s and an integer k , is there a subset S ′ ⊆ { 1 , . . . , m } of size at most k such that � i ∈ S ′ ϕ i is a tautology? This is another Σ p 2 -complete problem. 1. C. Umans. The Minimum Equivalent DNF Problem and Shortest Implicants. JCSS, 597-611, 2001. Preliminary version in FOCS 1998. Computational Complexity, by Fu Yuxi Polynomial Hierarchy 10 / 44

Natural Problem in the Second Level EXACT INDSET refers to the following problem: {� G , k � | the largest independent sets of G are of size k } . It is in ∆ p 2 and is DP -complete. L ∈ DP if L = L 0 ∩ L 1 for some L 0 ∈ NP and some L 1 ∈ coNP . Clearly NP , coNP ⊆ DP . Computational Complexity, by Fu Yuxi Polynomial Hierarchy 11 / 44

Stockmeyer-Wrathall Characterization Computational Complexity, by Fu Yuxi Polynomial Hierarchy 12 / 44

In 1976, Stockmeyer defined Polynomial Hierarchy in terms of alternation of quantifier and Wrathall proved that it is equivalent to the original definition. 1. Larry Stockmeyer. The Polynomial-Time Hierarchy. Theoretical Computer Science, 3:1-22, 1976. 2. Celia Wrathall. Complete Sets and the Polynomial-Time Hierarchy. Theoretical Computer Science. 3:23-33, 1976. Computational Complexity, by Fu Yuxi Polynomial Hierarchy 13 / 44

Logical Characterization The following result generalizes the logical characterization of NP problems. Theorem . Suppose i ≥ 1. ◮ L ∈ Σ p i iff there exists a P-time TM M and a polynomial q such that for all x ∈ { 0 , 1 } ∗ , x ∈ L iff ∃ u 1 ∈{ 0 , 1 } q ( | x | ) ∀ u 2 ∈{ 0 , 1 } q ( | x | ) . . . Q i u i ∈{ 0 , 1 } q ( | x | ) . M ( x , � u ) = 1 . ◮ L ∈ Π p i iff there exists a P-time TM M and a polynomial q such that for all x ∈ { 0 , 1 } ∗ , x ∈ L iff ∀ u 1 ∈{ 0 , 1 } q ( | x | ) ∃ u 2 ∈{ 0 , 1 } q ( | x | ) . . . Q i u i ∈{ 0 , 1 } q ( | x | ) . M ( x , � u ) = 1 . 1. Celia Wrathall. Complete Sets and the Polynomial-Time Hierarchy. Theoretical Computer Science. 3:23-33, 1976. Computational Complexity, by Fu Yuxi Polynomial Hierarchy 14 / 44

Proof of Wrathall Theorem Let M be a P-time TM and q a polynomial such that x ∈ L if and only if ∃ u 1 ∈ { 0 , 1 } q ( | x | ) . . . Qu i +1 ∈ { 0 , 1 } q ( | x | ) . M ( x , u 1 , . . . , u i +1 ) = 1 . Given x an NDTM guesses a u 1 and asks if the following is true ∀ u 2 ∈ { 0 , 1 } q ( | x | ) . . . Qu i +1 ∈ { 0 , 1 } q ( | x | ) . M ( x , u 1 , . . . , u i +1 ) = 1 . By induction hypothesis the above formula can be evaluated by querying a Σ p i oracle. Computational Complexity, by Fu Yuxi Polynomial Hierarchy 15 / 44

Proof of Wrathall Theorem Let L be decided by a P-time NDTM N with access to some oracle A ∈ Σ p i . Now by Cook-Levin Theorem, x ∈ L if and only if ∃ � z . ∃ c 1 , . . . , c m , a 1 , . . . , a k . ∃ u 1 , . . . , u k . ( N accepts x using choices c 1 , . . . , c m and answers a 1 , . . . , a k to the queries u 1 , . . . , u k ) ∧ ( � i ∈ [ k ] a i = 1 ⇒ u i ∈ A ) ∧ ( � i ∈ [ k ] a i = 0 ⇒ u i ∈ A ), where � z are introduced by the Cook-Levin reduction. We are done by induction. Computational Complexity, by Fu Yuxi Polynomial Hierarchy 16 / 44

Σ i SAT Let Σ i SAT be the subset of TQBF that consists of all tautologies of the following form ∃ u 1 ∀ u 2 . . . Q i u i .ϕ ( u 1 , . . . , u i ) , where ϕ ( u 1 , . . . , u i ) is a propositional formula. Theorem (Meyer and Stockmeyer, 1972). Σ i SAT is Σ p i -complete. Proof. Clearly Σ i SAT ∈ Σ p i . The completeness is defined with regards to Karp reduction. Computational Complexity, by Fu Yuxi Polynomial Hierarchy 17 / 44

Theorem (Stockmeyer, Wrathall, 1976). PH ⊆ PSPACE . Computational Complexity, by Fu Yuxi Polynomial Hierarchy 18 / 44

Chandra-Kozen-Stockmeyer Theorem Computational Complexity, by Fu Yuxi Polynomial Hierarchy 19 / 44

Ashok Chandra, Dexter Kozen and Larry Stockmeyer introduced Alternating Turing Machines that give alternative characterization of complexity classes. 1. Alternation. Journal of the ACM, 28(1):114-133, 1981. Computational Complexity, by Fu Yuxi Polynomial Hierarchy 20 / 44

Alternating Turing Machine An Alternating Turing Machine (ATM) is an NDTM in which every state is labeled by an element of {∃ , ∀ , accept , halt } . We say that an ATM A accepts x if there is a subtree Tr of the execution tree of A ( x ) satisfying the following: ◮ The initial configuration is in Tr . ◮ All leaves of Tr are labeled by accept . ◮ If a node labeled by ∀ is in Tr , both children are in Tr . ◮ If a node labeled by ∃ is in Tr , one of its children is in Tr . NDTM’s are ATM’s. Computational Complexity, by Fu Yuxi Polynomial Hierarchy 21 / 44

Complexity via ATM For every T : N → N , we say that an ATM A runs in T ( n )-time if for every input x ∈ { 0 , 1 } ∗ and for all nondeterministic choices, A halts after at most T ( | x | ) steps. ◮ ATIME ( T ( n )) contains L if there is a cT ( n )-time ATM A for some constant c such that, for all x ∈ { 0 , 1 } ∗ , x ∈ L if and only if A ( x ) = 1. ◮ ASPACE ( S ( n )) is defined analogously. Computational Complexity, by Fu Yuxi Polynomial Hierarchy 22 / 44

Example of ATM TQBF is solvable by an ATM in quadratic time and linear space. Computational Complexity, by Fu Yuxi Polynomial Hierarchy 23 / 44

Complexity Class via ATM AL = ASPACE (log n ) , � ATIME ( n c ) , AP = c > 0 � ASPACE ( n c ) , = APSPACE c > 0 � ATIME (2 n c ) , AEXP = c > 0 � ASPACE (2 n c ) . AEXPSPACE = c > 0 Computational Complexity, by Fu Yuxi Polynomial Hierarchy 24 / 44

Theorem . Assume that the relevant time/space functions are constructible. 1. NSPACE ( S ( n )) ⊆ ATIME ( S 2 ( n )). 2. ATIME ( T ( n )) ⊆ SPACE ( T ( n )). 3. ASPACE ( S ( n )) ⊆ � c > 0 TIME ( c S ( n ) ). 4. TIME ( T ( n )) ⊆ ASPACE (log T ( n )). 1. Savitch’s proof. Recursive calls are implemented using ∀ -state. We need to assume that S ( n ) is constructible in S ( n ) 2 time. 2. Traversal of configuration tree. Counters of length T ( n ). We need to assume that T ( n ) is also space constructible. 3. Depth first traversal of configuration graph. 4. Backward guessing ( ∃ ) and parallel checking ( ∀ ) in the configuration circuit. Computational Complexity, by Fu Yuxi Polynomial Hierarchy 25 / 44

Chandra-Kozen-Stockmeyer Theorem ⊆ ⊆ ⊆ . . . AL AP APSPACE AEXP = = = = . . . ⊆ ⊆ ⊆ ⊆ . . . L P PSPACE EXP EXPSPACE Computational Complexity, by Fu Yuxi Polynomial Hierarchy 26 / 44

Bounded Alternation L ∈ Σ i TIME ( T ( n )) / Π i TIME ( T ( n )) if L is accepted by an O ( T ( n )) -time ATM A with q start labeled by ∃ / ∀ , and on every path the machine A may alternate at most i − 1 times. Computational Complexity, by Fu Yuxi Polynomial Hierarchy 27 / 44