living on the edge safe search with unsafe heuristics
play

Living on the Edge: Safe Search with Unsafe Heuristics Erez Karpas - PowerPoint PPT Presentation

Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Living on the Edge: Safe Search with Unsafe Heuristics Erez Karpas Carmel Domshlak Faculty of


  1. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Living on the Edge: Safe Search with Unsafe Heuristics Erez Karpas Carmel Domshlak Faculty of Industrial Engineering and Management, Technion — Israel Institute of Technology June 6, 2011

  2. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Outline Safeness of Heuristics 1 Path Dependent Heuristics 2 Unjustified Actions 3 The Connection 4 5 More than a Pruning Mechanism Experimental Evaluation 6

  3. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Safe Heuristics A heuristic h is safe if it never declares a false dead end h ∗ ( s ) = ∞ ∀ s : h ( s ) = ∞ = ⇒ Looks like a good property

  4. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Safeness - Not Such a Good Idea Consider this example: s 0 s 1 s 2 We can prove there is a path from s 1 to the goal Is it safe to set h ( s 2 ) = ∞ ? Should it be?

  5. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Safeness - Not Such a Good Idea Consider this example: s 0 s 1 s 2 We can prove there is a path from s 1 to the goal Is it safe to set h ( s 2 ) = ∞ ? Should it be?

  6. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Global Safeness To address this, we suggest the following definitions Globally Safe (G-Safe) Heuristic Let Π be a solvable planning task. A heuristic h is globally-safe, if there exists a valid plan ρ for Π , such that for any state s along ρ , h ( s ) < ∞ . In other words, when h evaluates any state along ρ , it is not declared as a dead-end. If ρ is optimal, h is called Globally Optimally Safe (GO-Safe)

  7. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation G-Safe Heuristic Great — where can I get one of those? I don’t know. But I can tell how how to find path-dependent GO-Safe heuristic

  8. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation G-Safe Heuristic Great — where can I get one of those? I don’t know. But I can tell how how to find path-dependent GO-Safe heuristic

  9. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation G-Safe Heuristic Great — where can I get one of those? I don’t know. But I can tell how how to find path-dependent GO-Safe heuristic Globally Safe (G-Safe) Path Dependent Heuristic Let Π be a solvable planning task. A path dependent heuristic h is globally-safe, if there exists a valid plan ρ for Π , such that for any prefix ρ ′ of ρ , h ( ρ ′ ) < ∞ . Path dependent GO-Safeness is defined accordingly Since any state dependent heuristic is path dependent, this is the more general definition

  10. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Outline Safeness of Heuristics 1 Path Dependent Heuristics 2 Unjustified Actions 3 The Connection 4 5 More than a Pruning Mechanism Experimental Evaluation 6

  11. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Heuristic Search — Different Perspectives The Classical Approach Search space is given by initial state and black box successor generator Heuristic function is a black box In Planning State and Successor generator are structured and known Heuristic functions are not black boxes This has been exploited by preferred operators, symmetry detection, . . . But we can do more

  12. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Different Perspectives — Illustrated s 0 Classical Heuristic Search s h d s s g

  13. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Different Perspectives — Illustrated s 0 Planning (Helpful Actions) s d , π h h s π h s g

  14. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Different Perspectives — Illustrated s 0 But where did s come from? d , π h π s h π s s π h s g

  15. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Outline Safeness of Heuristics 1 Path Dependent Heuristics 2 Unjustified Actions 3 The Connection 4 5 More than a Pruning Mechanism Experimental Evaluation 6

  16. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation A Path Dependent Information Source - Unjustified Actions Informally, an action a along a plan ρ is unjustified if removing a from ρ does not invalidate ρ . For a formal definition, we need to define causal links Causl Link The triple � a i , p , a j � forms a causal link in action sequence � a 0 , a 1 ,... a n � if i < j , p ∈ add ( a i ) , p ∈ pre ( a j ) , p �∈ s i , and for i < k < j , p �∈ del ( a k ) ∪ add ( a k ) . In other words, p is achieved by a i and is not deleted or added by some other action until a j occurs, and is a precondition of a j . a i is called the supporter in this causal link, and a j is the consumer.

  17. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Unjustified Actions Unjustified Action An action occurrence a i � = END in plan ρ = � a 0 , a 1 ,... a n � is unjustified if there is no causal link in ρ , such that a i is the supporter in that causal link. Easy to see: Any unjusitified action occurrence can be removed from a valid 1 plan, and the plan is still valid Any optimal plan does not contain any unjustified actions 2

  18. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Hopeless Paths Hopeless Path Path π from s 0 to s is hopeless if there is no path π ′ from s to the goal, such that π · π ′ contains no unjustified actions. In other words, any continuation of π will always contain unjustified actions Hopeless paths are the connection between path dependent GO-Safe heuristics and unjustified actions

  19. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Outline Safeness of Heuristics 1 Path Dependent Heuristics 2 Unjustified Actions 3 The Connection 4 5 More than a Pruning Mechanism Experimental Evaluation 6

  20. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Path Dependent GO-Safe Heuristic Let h be any safe, path dependent heuristic for solvable planning task Π � if π is hopeless ∞ h ′ ( π ) := h ( π ) otherwise is a GO-safe path-dependent heuristic. This refers to the path π , not to the last state in that path

  21. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Caution is Needed — Example s 0 = {} a 12 a 1 a 2 , a 12 s 1 = { p 1 } s 2 = { p 1 , p 2 } END s g = { p 1 , p 2 , p g } a 1 = � / 0 , { p 1 } , / 0 � a 2 = �{ p 1 } , { p 2 } , / 0 � a 12 = � / 0 , { p 1 , p 2 } , / 0 � Path � a 1 , a 12 � is hopeless END = �{ p 1 , p 2 } , { p g } , / 0 � But it’s not safe to prune s 2

  22. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Caution is Needed — But Not Always Let h be any safe heuristic for solvable planning task Π � if some optimal path to s is hopeless ∞ h ′ ( s ) := h ( s ) otherwise is a GO-safe heuristic.

  23. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Searching with Unjustified Actions We know that if the path to s is optimal, h ′ ( s ) is GO-Safe. With A ∗ , we don’t know when the path to s is optimal. However, if we find a cheaper path to s , s will be reopened. So using A ∗ , but re-evaluating h ′ ( s ) whenever s is reopened, will ensure optimality.

  24. Safeness of Heuristics Path Dependent Heuristics Unjustified Actions The Connection More than a Pruning Mechanism Experimental Evaluation Outline Safeness of Heuristics 1 Path Dependent Heuristics 2 Unjustified Actions 3 The Connection 4 5 More than a Pruning Mechanism Experimental Evaluation 6

Recommend


More recommend