undecidability of quantized state feedback control for
play

Undecidability of Quantized State Feedback Control for Discrete Time - PowerPoint PPT Presentation

Undecidability of Quantized State Feedback Control for Discrete Time Linear Hybrid Systems Federico Mari Igor Melatti Ivano Salvo Enrico Tronci Model Checking Group http://mclab.di.uniroma1.it/ Computer Science Department Sapienza


  1. Undecidability of Quantized State Feedback Control for Discrete Time Linear Hybrid Systems Federico Mari Igor Melatti Ivano Salvo Enrico Tronci Model Checking Group http://mclab.di.uniroma1.it/ Computer Science Department – Sapienza University of Rome September 21, 2012 ICTCS 2012 – Varese, Italy

  2. Motivations Problem Formulation Proof of Undecidability Conclusion and Future Work Outline Motivations 1 Problem Formulation 2 Proof of Undecidability 3 Conclusion and Future Work 4 Undecidability of Quantized State Feedback Control for Discrete Time Linear Hybrid Systems I. Salvo, Sapienza University

  3. Motivations Problem Formulation Proof of Undecidability Conclusion and Future Work Embedded Systems Examples Wikipedia: An embedded system is a computer system designed to do a few dedicated functions with real-time computing constraints Undecidability of Quantized State Feedback Control for Discrete Time Linear Hybrid Systems I. Salvo, Sapienza University

  4. Motivations Problem Formulation Proof of Undecidability Conclusion and Future Work Embedded Systems modelled as Hybrid Systems D / A Controller Plant A / D every T seconds do // sampling time x = AnalogToDigital ( read (plantState)) ˆ try { ˆ u = ctrLaw (ˆ x ) send ( DigitalToAnalog (ˆ u )) } catch ( notInCtrReg (ˆ x )) { FDIR (ˆ x ) } // fault isolation and recovery Undecidability of Quantized State Feedback Control for Discrete Time Linear Hybrid Systems I. Salvo, Sapienza University

  5. Motivations Problem Formulation Proof of Undecidability Conclusion and Future Work Control Software Synthesis (Ideally) Model Based Design [Henzinger, Sifakis, 2006] Specifications are easier to define than control software Input: Plant modelled as a (discrete time) Hybrid System Closed Loop System Level Specifications ( Safety + Liveness ) Implementation Specifications ( WCET , quantization , etc.) Output: Correct-by-construction automatically generated control software Guaranteed non functional requirements (WCET) Robustness (wrt plant parameter variations or disturbances) Undecidability of Quantized State Feedback Control for Discrete Time Linear Hybrid Systems I. Salvo, Sapienza University

  6. Motivations Problem Formulation Proof of Undecidability Conclusion and Future Work Controller Synthesis for DTLHSs The tool QKS [Mari, Melatti, Salvo, Tronci, CAV 2010, EMSOFT 2012, CDC 2012] Control Synthesis Problem Controller K + ( H , I , G , AD ) QKS controllable region D Sol Unknown NoSol I D no solution exists Unknown stems from undecidability of the problem Undecidability of Quantized State Feedback Control for Discrete Time Linear Hybrid Systems I. Salvo, Sapienza University

  7. Motivations Problem Formulation Proof of Undecidability Conclusion and Future Work Outline Motivations 1 Problem Formulation 2 Proof of Undecidability 3 Conclusion and Future Work 4 Undecidability of Quantized State Feedback Control for Discrete Time Linear Hybrid Systems I. Salvo, Sapienza University

  8. Motivations Problem Formulation Proof of Undecidability Conclusion and Future Work Discrete Time Linear Hybrid Systems (DTLHSs) A Discrete Time Linear Hybrid System (DTLHS) H is a tuple ( X , U , Y , N ) where: X is a finite sequence of present state variables . Next state variables X ′ are obtained by decorating with ′ all variables in X . U is a finite sequence of input variables , that models controllable inputs . Y is a finite sequence of auxiliary variables that models modes or uncontrollable inputs (e.g., disturbances ). N ( X , U , Y , X ′ ) is a linear predicate over X ∪ U ∪ Y ∪ X ′ defining the transition relation ( next state ) of the system. Each variable w ∈ W range over a bounded or unbounded integer or real interval D w . D W = � w ∈ W D w . Undecidability of Quantized State Feedback Control for Discrete Time Linear Hybrid Systems I. Salvo, Sapienza University

  9. Motivations Problem Formulation Proof of Undecidability Conclusion and Future Work DTLHS Semantics as Labeled Transition Systems (LTS) A Labeled Tranisition System (LTS) S is a tuple ( S , A , T ) S is a possibly infinite set of states , A is a possibly infinite set of actions T : S × A × S → B is the transition relation of S . A run for S is a sequence π = s 0 , a 0 , s 1 , a 1 , s 2 , a 2 , . . . of states s t and actions a t s. t. ∀ t ≥ 0 T ( s t , a t , s t +1 ). The dynamics of H is defined by LTS ( H ) = ( D X , D U , ¯ N ) where: N : D X × D U × D X → B is a function s.t. ¯ ¯ N ( x , u , x ′ ) = ∃ y ∈ D Y N ( x , u , y , x ′ ). Undecidability of Quantized State Feedback Control for Discrete Time Linear Hybrid Systems I. Salvo, Sapienza University

  10. Motivations Problem Formulation Proof of Undecidability Conclusion and Future Work Controller and Closed Loop System A formal definition A controller restricts the dynamics of an LTS S so that all states an initial region I will reach in one or more steps a givern goal region G ( Liveness Specifications ). A controller for S is a function K : S × A → B such that ∀ s ∈ S , ∀ a ∈ A , if K ( s , a ) then ∃ s ′ T ( s , a , s ′ ). S ( K ) denotes the closed loop system , that is the LTS ( S , A , T ( K ) ), where T ( K ) ( s , a , s ′ ) = T ( s , a , s ′ ) ∧ K ( s , a ). (i.e. the plant in parallel with the controller) Undecidability of Quantized State Feedback Control for Discrete Time Linear Hybrid Systems I. Salvo, Sapienza University

  11. Motivations Problem Formulation Proof of Undecidability Conclusion and Future Work LTS Reachability and Control Problem A reachability problem and a control problem are a triple ( S , I , G ), where: S is an LTS ( S , A , T ) and I , G ⊆ S . G is reachable from I if there exists a run π of S such that π ( S ) (0) ∈ I and π ( S ) ( t ) ∈ G for some t ∈ N . The control problem ( S , I , G ) has a solution if there exists a controller K such that all runs starting in I reach G in a finite number of steps in the closed loop system S ( K ) . Undecidability of Quantized State Feedback Control for Discrete Time Linear Hybrid Systems I. Salvo, Sapienza University

  12. Motivations Problem Formulation Proof of Undecidability Conclusion and Future Work LTS Reachability Control Problem Example (I) There is no quantized solution because of self–loops in state 1. The worst case distance of 0 from 1 is infinite . 0,1 0,1 0 0 1 2 0,1 0 0 1 -1 Undecidability of Quantized State Feedback Control for Discrete Time Linear Hybrid Systems I. Salvo, Sapienza University

  13. Motivations Problem Formulation Proof of Undecidability Conclusion and Future Work LTS Reachability Control Problem Example (II) Quantized solutions exist. 0 1 0 0 0 0 1 2 3 1 0,1 0,1 0 1 0 1 1 0 -1 -2 5 4 0 1 Undecidability of Quantized State Feedback Control for Discrete Time Linear Hybrid Systems I. Salvo, Sapienza University

  14. Motivations Problem Formulation Proof of Undecidability Conclusion and Future Work Quantized Control Problem Example (II) The controller that enables green actions is a solution. 0 1 0 0 0 0 1 2 3 1 0,1 0,1 0 1 0 1 1 0 -1 -2 5 4 0 1 Undecidability of Quantized State Feedback Control for Discrete Time Linear Hybrid Systems I. Salvo, Sapienza University

  15. Motivations Problem Formulation Proof of Undecidability Conclusion and Future Work DTLHS Reachability and Control Problem A DTLHS control problem ( reachability problem ) ( H , I , G ) is defined as the LTS control problem (reachability) ( LTS ( H ) , I , G ). Example . Let T be 1 / 10 (sampling time). Let H be ( { x } , { u } , ∅ , N ) where: x is a continuous variable, u is a boolean variable, and N ( x , u , x ′ ) ≡ [ u → x ′ = x + ( 5 / 4 − x ) T ] ∧ [ u → x ′ = x + ( x − 7 / 4 ) T ]. Let us consider the control problem P = ( H , I , G ), where: I ( x ) ≡ − 1 ≤ x ≤ 5 / 2 and G ( x ) ≡ 0 ≤ x ≤ 1 / 2 . A solution K to P is: K ( x , u ) = ( − 1 ≤ x < 0 ∧ u ) ∨ (0 ≤ x < 3 / 2 ∧ u ) ∨ ( 3 / 2 ≤ x ≤ 5 / 2 ∧ u ). Observe that N ( 5 / 4 , 0 , 5 / 4 ) and N ( 7 / 4 , 1 , 7 / 4 ) hold, hence no solution can enable action 0 in 5 / 4 and action 1 in 7 / 4 . Undecidability of Quantized State Feedback Control for Discrete Time Linear Hybrid Systems I. Salvo, Sapienza University

  16. Motivations Problem Formulation Proof of Undecidability Conclusion and Future Work Quantized Control Problem for DTLHSs A quantization function is a non-decreasing function γ x : D x ⊆ R �→ [ a , b ] ⊆ Z The quantization of a sequence of variables is a sequence of quantization functions: Γ = { γ x 1 , . . . , γ x n } Γ( s ) = � γ x 1 ( s 1 ) , . . . , γ x n ( s n ) � K is a quantized controller if there exists ˆ K : Γ( D X ) × Γ( D U ) → B , such that K ( s , a ) = ˆ K (Γ( s ) , Γ( a )). This enables a software implementation of the controller. Undecidability of Quantized State Feedback Control for Discrete Time Linear Hybrid Systems I. Salvo, Sapienza University

Recommend


More recommend