solving ai planning problems with sat
play

Solving AI Planning Problems with SAT SAT solving Invariants - PowerPoint PPT Presentation

Aug 31, 2023 •373 likes •1.49k views

Planning with SAT Introduction Encodings Solver Calls Solving AI Planning Problems with SAT SAT solving Invariants Conclusion References Jussi Rintanen EPCL, Dresden, November 2013 Reduction of AI Planning to SAT Kautz and Selman 1992

  1. ∃ -step plans: linear encoding Rintanen et al. 2006 [RHN06] Planning with SAT Introduction Encodings Choose an arbitrary fixed ordering of all actions a 1 , . . . , a n . Basics Parallel Plans Action a with effect l disables all later actions with precondition l . Solver Calls SAT solving Invariants v 2 v 4 v 5 Conclusion References a 1 a 2 a 3 a 4 a 5 This is needed for every literal.

  2. Disabling graphs Rintanen et al. 2006 [RHN06] Planning with SAT Introduction Encodings Basics Define a disabling graph with actions as nodes and with an arc Parallel Plans from a 1 to a 2 if p 1 ∪ p 2 and e 1 ∪ e 2 are consistent and e 1 ∪ p 2 is Solver Calls inconsistent. SAT solving Invariants The test for valid execution orderings can be limited to strongly Conclusion connected components (SCC) of the disabling graph. References In many structured problems all SCCs are singleton sets. = ⇒ No tests for validity of orderings needed during SAT solving.

  3. Scheduling the SAT Tests Planning with SAT The planning problem is reduced to SAT tests for Introduction Encodings Φ 0 = I @0 ∧ G @0 Solver Calls Φ 1 = I @0 ∧ R @0 ∧ G @1 Sequantial Strategy Φ 2 = I @0 ∧ R @0 ∧ R @1 ∧ G @2 Parallel Strategy A Parallel Strategy B Φ 3 = I @0 ∧ R @0 ∧ R @1 ∧ R @2 ∧ G @3 Parallel Strategy C Summary . . . SAT solving Invariants Φ u = I @0 ∧ R @0 ∧ R @1 ∧ · · · R @( u − 1) ∧ G @ u Conclusion References where u is the maximum possible plan length. Q: How to schedule these tests? How this is done has much more impact on planner performance than e.g. encoding details!

  4. The sequential strategy Planning with SAT Introduction Encodings Solver Calls 1 2 3 4 5 6 7 8 9 ... Sequantial Strategy Parallel Strategy A Parallel Strategy B Parallel Strategy C Complete satisfiability test for t before proceeding with t + 1 . Summary SAT solving This is breadth-first search / iterative deepening. Invariants Guarantees minimality of horizon length. Conclusion Slow. References

  5. The sequential strategy Planning with SAT Introduction Encodings Solver Calls 1 2 3 4 5 6 7 8 9 ... Sequantial Strategy Parallel Strategy A Parallel Strategy B Parallel Strategy C Complete satisfiability test for t before proceeding with t + 1 . Summary SAT solving This is breadth-first search / iterative deepening. Invariants Guarantees minimality of horizon length. Conclusion Slow. References

  6. The sequential strategy Planning with SAT Introduction Encodings Solver Calls 1 2 3 4 5 6 7 8 9 ... Sequantial Strategy Parallel Strategy A Parallel Strategy B Parallel Strategy C Complete satisfiability test for t before proceeding with t + 1 . Summary SAT solving This is breadth-first search / iterative deepening. Invariants Guarantees minimality of horizon length. Conclusion Slow. References

  7. The sequential strategy Planning with SAT Introduction Encodings Solver Calls 1 2 3 4 5 6 7 8 9 ... Sequantial Strategy Parallel Strategy A Parallel Strategy B Parallel Strategy C Complete satisfiability test for t before proceeding with t + 1 . Summary SAT solving This is breadth-first search / iterative deepening. Invariants Guarantees minimality of horizon length. Conclusion Slow. References

  8. The sequential strategy Planning with SAT Introduction Encodings Solver Calls 1 2 3 4 5 6 7 8 9 ... Sequantial Strategy Parallel Strategy A Parallel Strategy B Parallel Strategy C Complete satisfiability test for t before proceeding with t + 1 . Summary SAT solving This is breadth-first search / iterative deepening. Invariants Guarantees minimality of horizon length. Conclusion Slow. References

  9. The sequential strategy Planning with SAT Introduction Encodings Solver Calls 1 2 3 4 5 6 7 8 9 ... Sequantial Strategy Parallel Strategy A Parallel Strategy B Parallel Strategy C Complete satisfiability test for t before proceeding with t + 1 . Summary SAT solving This is breadth-first search / iterative deepening. Invariants Guarantees minimality of horizon length. Conclusion Slow. References

  10. The sequential strategy Planning with SAT Introduction Encodings Solver Calls 1 2 3 4 5 6 7 8 9 ... Sequantial Strategy Parallel Strategy A Parallel Strategy B Parallel Strategy C Complete satisfiability test for t before proceeding with t + 1 . Summary SAT solving This is breadth-first search / iterative deepening. Invariants Guarantees minimality of horizon length. Conclusion Slow. References

  11. The sequential strategy Planning with SAT Introduction Encodings Solver Calls 1 2 3 4 5 6 7 8 9 ... Sequantial Strategy Parallel Strategy A Parallel Strategy B Parallel Strategy C Complete satisfiability test for t before proceeding with t + 1 . Summary SAT solving This is breadth-first search / iterative deepening. Invariants Guarantees minimality of horizon length. Conclusion Slow. References

  12. The sequential strategy Planning with SAT Introduction Encodings Solver Calls 1 2 3 4 5 6 7 8 9 ... Sequantial Strategy Parallel Strategy A Parallel Strategy B Parallel Strategy C Complete satisfiability test for t before proceeding with t + 1 . Summary SAT solving This is breadth-first search / iterative deepening. Invariants Guarantees minimality of horizon length. Conclusion Slow. References

  13. The sequential strategy Planning with SAT Introduction Encodings Solver Calls 1 2 3 4 5 6 7 8 9 ... Sequantial Strategy Parallel Strategy A Parallel Strategy B Parallel Strategy C Complete satisfiability test for t before proceeding with t + 1 . Summary SAT solving This is breadth-first search / iterative deepening. Invariants Guarantees minimality of horizon length. Conclusion Slow. References

  14. Some runtime profiles Planning with SAT Evaluation times: logistics39-0 Introduction 700 Encodings Solver Calls 600 Sequantial Strategy Parallel Strategy A Parallel Strategy B 500 Parallel Strategy C time in secs Summary 400 SAT solving Invariants 300 Conclusion 200 References 100 0 0 2 4 6 8 10 12 14 16 18 20 time points

  15. Some runtime profiles Planning with SAT Evaluation times: gripper10 Introduction 500 Encodings 450 Solver Calls Sequantial Strategy 400 Parallel Strategy A Parallel Strategy B 350 Parallel Strategy C time in secs Summary 300 SAT solving 250 Invariants 200 Conclusion 150 References 100 50 0 0 10 20 30 40 50 60 time points

  16. Some runtime profiles Planning with SAT Evaluation times: satell20 Introduction 700 Encodings Solver Calls 600 Sequantial Strategy Parallel Strategy A Parallel Strategy B 500 Parallel Strategy C time in secs Summary 400 SAT solving Invariants 300 Conclusion 200 References 100 0 0 5 10 15 20 25 time points

  17. Some runtime profiles Planning with SAT Evaluation times: schedule51 Introduction 400 Encodings Solver Calls 350 Sequantial Strategy Parallel Strategy A 300 Parallel Strategy B Parallel Strategy C time in secs 250 Summary SAT solving 200 Invariants 150 Conclusion References 100 50 0 0 5 10 15 20 25 30 time points

  18. Some runtime profiles Planning with SAT Evaluation times: blocks22 Introduction 40 Encodings Solver Calls 35 Sequantial Strategy Parallel Strategy A 30 Parallel Strategy B Parallel Strategy C time in secs 25 Summary SAT solving 20 Invariants 15 Conclusion References 10 5 0 0 10 20 30 40 50 60 70 80 90 100 time points

  19. Some runtime profiles Planning with SAT Evaluation times: depot15 Introduction 200 Encodings 180 Solver Calls Sequantial Strategy 160 Parallel Strategy A Parallel Strategy B 140 Parallel Strategy C time in secs Summary 120 SAT solving 100 Invariants 80 Conclusion 60 References 40 20 0 0 5 10 15 20 time points

  20. n processes/threads Algorithm A [Rin04b, Zar04] Planning with SAT Introduction 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 ... Encodings Solver Calls Sequantial Strategy Generalization of the previous: n simultaneous SAT Parallel Strategy A Parallel Strategy B processes; when process t finishes, start process t + n . Parallel Strategy C Summary Gets past hard UNSAT formulas if n high enough. SAT solving Invariants Worst case: n times slower than the sequential strategy. Conclusion Higher memory requirements. References Skipping lengths is OK: 10 20 30 40 50 60 70 80 90 100 ... We have successfully used n = 20 .

  21. n processes/threads Algorithm A [Rin04b, Zar04] Planning with SAT Introduction 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 ... Encodings Solver Calls Sequantial Strategy Generalization of the previous: n simultaneous SAT Parallel Strategy A Parallel Strategy B processes; when process t finishes, start process t + n . Parallel Strategy C Summary Gets past hard UNSAT formulas if n high enough. SAT solving Invariants Worst case: n times slower than the sequential strategy. Conclusion Higher memory requirements. References Skipping lengths is OK: 10 20 30 40 50 60 70 80 90 100 ... We have successfully used n = 20 .

  22. n processes/threads Algorithm A [Rin04b, Zar04] Planning with SAT Introduction 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 ... Encodings Solver Calls Sequantial Strategy Generalization of the previous: n simultaneous SAT Parallel Strategy A Parallel Strategy B processes; when process t finishes, start process t + n . Parallel Strategy C Summary Gets past hard UNSAT formulas if n high enough. SAT solving Invariants Worst case: n times slower than the sequential strategy. Conclusion Higher memory requirements. References Skipping lengths is OK: 10 20 30 40 50 60 70 80 90 100 ... We have successfully used n = 20 .

  23. n processes/threads Algorithm A [Rin04b, Zar04] Planning with SAT Introduction 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 ... Encodings Solver Calls Sequantial Strategy Generalization of the previous: n simultaneous SAT Parallel Strategy A Parallel Strategy B processes; when process t finishes, start process t + n . Parallel Strategy C Summary Gets past hard UNSAT formulas if n high enough. SAT solving Invariants Worst case: n times slower than the sequential strategy. Conclusion Higher memory requirements. References Skipping lengths is OK: 10 20 30 40 50 60 70 80 90 100 ... We have successfully used n = 20 .

  24. n processes/threads Algorithm A [Rin04b, Zar04] Planning with SAT Introduction 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 ... Encodings Solver Calls Sequantial Strategy Generalization of the previous: n simultaneous SAT Parallel Strategy A Parallel Strategy B processes; when process t finishes, start process t + n . Parallel Strategy C Summary Gets past hard UNSAT formulas if n high enough. SAT solving Invariants Worst case: n times slower than the sequential strategy. Conclusion Higher memory requirements. References Skipping lengths is OK: 10 20 30 40 50 60 70 80 90 100 ... We have successfully used n = 20 .

  25. n processes/threads Algorithm A [Rin04b, Zar04] Planning with SAT Introduction 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 ... Encodings Solver Calls Sequantial Strategy Generalization of the previous: n simultaneous SAT Parallel Strategy A Parallel Strategy B processes; when process t finishes, start process t + n . Parallel Strategy C Summary Gets past hard UNSAT formulas if n high enough. SAT solving Invariants Worst case: n times slower than the sequential strategy. Conclusion Higher memory requirements. References Skipping lengths is OK: 10 20 30 40 50 60 70 80 90 100 ... We have successfully used n = 20 .

  26. n processes/threads Algorithm A [Rin04b, Zar04] Planning with SAT Introduction 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 ... Encodings Solver Calls Sequantial Strategy Generalization of the previous: n simultaneous SAT Parallel Strategy A Parallel Strategy B processes; when process t finishes, start process t + n . Parallel Strategy C Summary Gets past hard UNSAT formulas if n high enough. SAT solving Invariants Worst case: n times slower than the sequential strategy. Conclusion Higher memory requirements. References Skipping lengths is OK: 10 20 30 40 50 60 70 80 90 100 ... We have successfully used n = 20 .

  27. n processes/threads Algorithm A [Rin04b, Zar04] Planning with SAT Introduction 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 ... Encodings Solver Calls Sequantial Strategy Generalization of the previous: n simultaneous SAT Parallel Strategy A Parallel Strategy B processes; when process t finishes, start process t + n . Parallel Strategy C Summary Gets past hard UNSAT formulas if n high enough. SAT solving Invariants Worst case: n times slower than the sequential strategy. Conclusion Higher memory requirements. References Skipping lengths is OK: 10 20 30 40 50 60 70 80 90 100 ... We have successfully used n = 20 .

  28. n processes/threads Algorithm A [Rin04b, Zar04] Planning with SAT Introduction 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 ... Encodings Solver Calls Sequantial Strategy Generalization of the previous: n simultaneous SAT Parallel Strategy A Parallel Strategy B processes; when process t finishes, start process t + n . Parallel Strategy C Summary Gets past hard UNSAT formulas if n high enough. SAT solving Invariants Worst case: n times slower than the sequential strategy. Conclusion Higher memory requirements. References Skipping lengths is OK: 10 20 30 40 50 60 70 80 90 100 ... We have successfully used n = 20 .

  29. n processes/threads Algorithm A [Rin04b, Zar04] Planning with SAT Introduction 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 ... Encodings Solver Calls Sequantial Strategy Generalization of the previous: n simultaneous SAT Parallel Strategy A Parallel Strategy B processes; when process t finishes, start process t + n . Parallel Strategy C Summary Gets past hard UNSAT formulas if n high enough. SAT solving Invariants Worst case: n times slower than the sequential strategy. Conclusion Higher memory requirements. References Skipping lengths is OK: 10 20 30 40 50 60 70 80 90 100 ... We have successfully used n = 20 .

  30. n processes/threads Algorithm A [Rin04b, Zar04] Planning with SAT Introduction 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 ... Encodings Solver Calls Sequantial Strategy Generalization of the previous: n simultaneous SAT Parallel Strategy A Parallel Strategy B processes; when process t finishes, start process t + n . Parallel Strategy C Summary Gets past hard UNSAT formulas if n high enough. SAT solving Invariants Worst case: n times slower than the sequential strategy. Conclusion Higher memory requirements. References Skipping lengths is OK: 10 20 30 40 50 60 70 80 90 100 ... We have successfully used n = 20 .

  31. n processes/threads Algorithm A [Rin04b, Zar04] Planning with SAT Introduction 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 ... Encodings Solver Calls Sequantial Strategy Generalization of the previous: n simultaneous SAT Parallel Strategy A Parallel Strategy B processes; when process t finishes, start process t + n . Parallel Strategy C Summary Gets past hard UNSAT formulas if n high enough. SAT solving Invariants Worst case: n times slower than the sequential strategy. Conclusion Higher memory requirements. References Skipping lengths is OK: 10 20 30 40 50 60 70 80 90 100 ... We have successfully used n = 20 .

  32. n processes/threads Algorithm A [Rin04b, Zar04] Planning with SAT Introduction 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 ... Encodings Solver Calls Sequantial Strategy Generalization of the previous: n simultaneous SAT Parallel Strategy A Parallel Strategy B processes; when process t finishes, start process t + n . Parallel Strategy C Summary Gets past hard UNSAT formulas if n high enough. SAT solving Invariants Worst case: n times slower than the sequential strategy. Conclusion Higher memory requirements. References Skipping lengths is OK: 10 20 30 40 50 60 70 80 90 100 ... We have successfully used n = 20 .

  33. n processes/threads Algorithm A [Rin04b, Zar04] Planning with SAT Introduction 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 ... Encodings Solver Calls Sequantial Strategy Generalization of the previous: n simultaneous SAT Parallel Strategy A Parallel Strategy B processes; when process t finishes, start process t + n . Parallel Strategy C Summary Gets past hard UNSAT formulas if n high enough. SAT solving Invariants Worst case: n times slower than the sequential strategy. Conclusion Higher memory requirements. References Skipping lengths is OK: 10 20 30 40 50 60 70 80 90 100 ... We have successfully used n = 20 .

  34. SAT solving at different rates Planning with SAT Introduction Encodings Solver Calls Sequantial Strategy Parallel Strategy A With the previous algorithm, choosing n may be tricky: Parallel Strategy B Parallel Strategy C sometimes big difference e.g. between n = 10 and n = 11 . Summary Best to have a high n , but focus on the first SAT instances. SAT solving Invariants = ⇒ SAT solving at variable rates. Conclusion References

  35. Geometric rates Algorithm B [Rin04b] Planning with SAT Finding a plan for blocks22 with Algorithm B 45 Introduction Encodings 40 Solver Calls Sequantial Strategy 35 Parallel Strategy A Parallel Strategy B 30 Parallel Strategy C time in secs Summary 25 SAT solving Invariants 20 Conclusion 15 References 10 5 0 40 45 50 55 60 65 70 75 80 85 90 time points

  36. Geometric rates Algorithm B [Rin04b] Planning with SAT Finding a plan for blocks22 with Algorithm B 45 Introduction Encodings 40 Solver Calls Sequantial Strategy 35 Parallel Strategy A Parallel Strategy B 30 Parallel Strategy C time in secs Summary 25 SAT solving Invariants 20 Conclusion 15 References 10 5 0 40 45 50 55 60 65 70 75 80 85 90 time points

  37. Geometric rates Algorithm B [Rin04b] Planning with SAT Finding a plan for blocks22 with Algorithm B 45 Introduction Encodings 40 Solver Calls Sequantial Strategy 35 Parallel Strategy A Parallel Strategy B 30 Parallel Strategy C time in secs Summary 25 SAT solving Invariants 20 Conclusion 15 References 10 5 0 40 45 50 55 60 65 70 75 80 85 90 time points

  38. Geometric rates Algorithm B [Rin04b] Planning with SAT Finding a plan for blocks22 with Algorithm B 45 Introduction Encodings 40 Solver Calls Sequantial Strategy 35 Parallel Strategy A Parallel Strategy B 30 Parallel Strategy C time in secs Summary 25 SAT solving Invariants 20 Conclusion 15 References 10 5 0 40 45 50 55 60 65 70 75 80 85 90 time points

  39. Geometric rates Algorithm B [Rin04b] Planning with SAT Finding a plan for blocks22 with Algorithm B 45 Introduction Encodings 40 Solver Calls Sequantial Strategy 35 Parallel Strategy A Parallel Strategy B 30 Parallel Strategy C time in secs Summary 25 SAT solving Invariants 20 Conclusion 15 References 10 5 0 40 45 50 55 60 65 70 75 80 85 90 time points

  40. Geometric rates Algorithm B [Rin04b] Planning with SAT Finding a plan for blocks22 with Algorithm B 45 Introduction Encodings 40 Solver Calls Sequantial Strategy 35 Parallel Strategy A Parallel Strategy B 30 Parallel Strategy C time in secs Summary 25 SAT solving Invariants 20 Conclusion 15 References 10 5 0 40 45 50 55 60 65 70 75 80 85 90 time points

  41. Geometric rates Algorithm B [Rin04b] Planning with SAT Finding a plan for blocks22 with Algorithm B 45 Introduction Encodings 40 Solver Calls Sequantial Strategy 35 Parallel Strategy A Parallel Strategy B 30 Parallel Strategy C time in secs Summary 25 SAT solving Invariants 20 Conclusion 15 References 10 5 0 40 45 50 55 60 65 70 75 80 85 90 time points

  42. Geometric rates Algorithm B [Rin04b] Planning with SAT Finding a plan for blocks22 with Algorithm B 45 Introduction Encodings 40 Solver Calls Sequantial Strategy 35 Parallel Strategy A Parallel Strategy B 30 Parallel Strategy C time in secs Summary 25 SAT solving Invariants 20 Conclusion 15 References 10 5 0 40 45 50 55 60 65 70 75 80 85 90 time points

  43. Exponential length increase Planning with SAT Introduction Previous strategies restrictive when plans are very long (200, Encodings 500, 1000 steps or more). Solver Calls Sequantial Strategy Why not exponential steps to cover very long plans? Parallel Strategy A Parallel Strategy B Parallel Strategy C Works surprisingly well! (...as long as you have enough Summary memory...) SAT solving Invariants Dozens of previously unsolved instances solved. Conclusion Large slow-downs uncommon (but depends on SAT References heuristics being used and type of problems). 1 2 4 8 16 32 64 128 256 512 1024 2048 4096 8192

  44. Scheduling the SAT Tests: Summary Planning with SAT Introduction Encodings Solver Calls algorithm reference comment Sequantial Strategy Parallel Strategy A sequential [KS92, KS96] slow, guarantees min. horizon Parallel Strategy B Parallel Strategy C binary search [SS07] length upper bound needed Summary n processes [Rin04b, Zar04] fast, more memory needed SAT solving geometric [Rin04b] fast, more memory needed Invariants Conclusion exponential Rintanen 2012 fast, still more memory needed References

  45. SAT solvers Planning with SAT Introduction General-purpose SAT solvers (RSAT, Precosat, Lingeling) work Encodings very well with Solver Calls short plans ( < 10 ) with lots of actions in parallel, and SAT solving Depth-first Undirected small but hard problems. Evaluation Invariants Other problems more challenging for general-purpose solvers. Conclusion References long plans lots of actions and state variables This is so especially when compared to planners that use explicit state-space search driven by heuristics [BG01, RW10].

  46. Planning-specific heuristics [Rin10, Rin11, Rin12] Planning with SAT How to match the performance of explicit state-space search Introduction Encodings when solving large but “easy” problems? Solver Calls Planning-specific heuristics for SAT solving [Rin10] SAT solving Depth-first Observation: both I and G are needed for unsatisfiability. Undirected Evaluation (“set of support” strategies) Invariants Idea: fill in “gaps” in the current partial plan. Conclusion Force SAT solver to emulate backward chaining: References Start from a top-level goal literal. 1 Go to the latest preceding time where the literal is false. 2 Choose an action to change the literal from false to true. 3 Use the action variable as the CDCL decision variable. 4 If such action there already, do the same with its preconditions. 5

  47. Planning-specific heuristics [Rin10, Rin11, Rin12] Planning with SAT How to match the performance of explicit state-space search Introduction Encodings when solving large but “easy” problems? Solver Calls Planning-specific heuristics for SAT solving [Rin10] SAT solving Depth-first Observation: both I and G are needed for unsatisfiability. Undirected Evaluation (“set of support” strategies) Invariants Idea: fill in “gaps” in the current partial plan. Conclusion Force SAT solver to emulate backward chaining: References Start from a top-level goal literal. 1 Go to the latest preceding time where the literal is false. 2 Choose an action to change the literal from false to true. 3 Use the action variable as the CDCL decision variable. 4 If such action there already, do the same with its preconditions. 5

  48. Planning-specific heuristics [Rin10, Rin11, Rin12] Planning with SAT How to match the performance of explicit state-space search Introduction Encodings when solving large but “easy” problems? Solver Calls Planning-specific heuristics for SAT solving [Rin10] SAT solving Depth-first Observation: both I and G are needed for unsatisfiability. Undirected Evaluation (“set of support” strategies) Invariants Idea: fill in “gaps” in the current partial plan. Conclusion Force SAT solver to emulate backward chaining: References Start from a top-level goal literal. 1 Go to the latest preceding time where the literal is false. 2 Choose an action to change the literal from false to true. 3 Use the action variable as the CDCL decision variable. 4 If such action there already, do the same with its preconditions. 5

  49. Planning-specific heuristics [Rin10, Rin11, Rin12] Planning with SAT How to match the performance of explicit state-space search Introduction Encodings when solving large but “easy” problems? Solver Calls Planning-specific heuristics for SAT solving [Rin10] SAT solving Depth-first Observation: both I and G are needed for unsatisfiability. Undirected Evaluation (“set of support” strategies) Invariants Idea: fill in “gaps” in the current partial plan. Conclusion Force SAT solver to emulate backward chaining: References Start from a top-level goal literal. 1 Go to the latest preceding time where the literal is false. 2 Choose an action to change the literal from false to true. 3 Use the action variable as the CDCL decision variable. 4 If such action there already, do the same with its preconditions. 5

  50. Planning-specific heuristic for CDCL Case 1: goal/subgoal x has no support yet Planning with SAT Introduction Value of a state variable x at different time points: Encodings Solver Calls t − 8 t − 7 t − 6 t − 5 t − 4 t − 3 t − 2 t − 1 t SAT solving Depth-first x 0 0 0 1 1 1 1 Undirected Evaluation Invariants action 1 0 0 0 0 0 0 Conclusion action 2 0 0 0 0 References action 3 0 0 0 0 0 0 action 4 0 0 0 0

  51. Planning-specific heuristic for CDCL Case 1: goal/subgoal x has no support yet Planning with SAT Introduction Value of a state variable x at different time points: Encodings Solver Calls t − 8 t − 7 t − 6 t − 5 t − 4 t − 3 t − 2 t − 1 t SAT solving 0 0 0 1 1 1 Depth-first x 1 Undirected Evaluation Invariants action 1 0 0 0 0 0 0 Conclusion action 2 0 0 0 0 References action 3 0 0 0 0 0 0 action 4 0 0 0 0 Actions that can make x true.

  52. Planning-specific heuristic for CDCL Case 1: goal/subgoal x has no support yet Planning with SAT Introduction Value of a state variable x at different time points: Encodings Solver Calls t − 8 t − 7 t − 6 t − 5 t − 4 t − 3 t − 2 t − 1 t SAT solving x 0 0 0 1 1 1 Depth-first 1 Undirected Evaluation Invariants action 1 0 0 0 0 0 0 Conclusion action 2 0 0 0 0 References action 3 0 0 0 0 0 0 action 4 0 0 0 0 Actions that can make x true at t − 5 .

  53. Planning-specific heuristic for CDCL Case 1: goal/subgoal x has no support yet Planning with SAT Introduction Value of a state variable x at different time points: Encodings Solver Calls t − 8 t − 7 t − 6 t − 5 t − 4 t − 3 t − 2 t − 1 t SAT solving x 0 0 0 1 1 1 Depth-first 1 Undirected Evaluation Invariants action 1 0 0 0 0 0 0 Conclusion action 2 0 0 0 0 References action 3 0 0 0 0 0 0 action 4 0 0 0 0 Choose action 2 or 4 at t − 6 as the next CDCL decision variable.

  54. Planning-specific heuristic for CDCL Case 2: goal/subgoal x already has support Planning with SAT Introduction Goal/subgoal is already made true at t − 4 by action 4 at t − 5 . Encodings Solver Calls t − 8 t − 7 t − 6 t − 5 t − 4 t − 3 t − 2 t − 1 t SAT solving Depth-first x 0 0 0 1 1 1 1 Undirected Evaluation Invariants action 1 0 0 0 0 0 0 Conclusion action 2 0 0 0 0 References 0 0 0 0 0 0 action 3 0 0 1 0 0 action 4 Use precondition literals of action 4 as new subgoals at t − 5 .

  55. Planning-specific heuristic for CDCL Case 2: goal/subgoal x already has support Planning with SAT Introduction Goal/subgoal is already made true at t − 4 by action 4 at t − 5 . Encodings Solver Calls t − 8 t − 7 t − 6 t − 5 t − 4 t − 3 t − 2 t − 1 t SAT solving Depth-first x 0 0 0 1 1 1 1 Undirected Evaluation Invariants action 1 0 0 0 0 0 0 Conclusion action 2 0 0 0 0 References 0 0 0 0 0 0 action 3 0 0 1 0 0 action 4 Use precondition literals of action 4 as new subgoals at t − 5 .

  56. The variable selection scheme Version 1: strict depth-first search Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  57. The variable selection scheme Version 1: strict depth-first search Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  58. The variable selection scheme Version 1: strict depth-first search Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  59. The variable selection scheme Version 1: strict depth-first search Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  60. The variable selection scheme Version 1: strict depth-first search Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  61. The variable selection scheme Version 1: strict depth-first search Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  62. The variable selection scheme Version 1: strict depth-first search Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  63. The variable selection scheme Version 1: strict depth-first search Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  64. The variable selection scheme Version 1: strict depth-first search Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  65. The variable selection scheme Version 1: strict depth-first search Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  66. The variable selection scheme Version 1: strict depth-first search Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  67. The variable selection scheme Version 1: strict depth-first search Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  68. The variable selection scheme Version 2: undirectional action selection, with VSIDS-style weights Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  69. The variable selection scheme Version 2: undirectional action selection, with VSIDS-style weights Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  70. The variable selection scheme Version 2: undirectional action selection, with VSIDS-style weights Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  71. The variable selection scheme Version 2: undirectional action selection, with VSIDS-style weights Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  72. The variable selection scheme Version 2: undirectional action selection, with VSIDS-style weights Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  73. The variable selection scheme Version 2: undirectional action selection, with VSIDS-style weights Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  74. The variable selection scheme Version 2: undirectional action selection, with VSIDS-style weights Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  75. The variable selection scheme Version 2: undirectional action selection, with VSIDS-style weights Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  76. The variable selection scheme Version 2: undirectional action selection, with VSIDS-style weights Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  77. The variable selection scheme Version 2: undirectional action selection, with VSIDS-style weights Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  78. The variable selection scheme Version 2: undirectional action selection, with VSIDS-style weights Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  79. The variable selection scheme Version 2: undirectional action selection, with VSIDS-style weights Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  80. The variable selection scheme Version 2: undirectional action selection, with VSIDS-style weights Planning with SAT goal1 goal2 Introduction Encodings Solver Calls SAT solving Depth-first action1 action2 Undirected Evaluation Invariants Conclusion References action4 action5 action6 action3 action8 action9 action10 action7

  81. Impact on planner performance Planning with SAT Introduction Encodings Solver Calls SAT solving Outperforms VSIDS with almost all benchmark problems the Depth-first Undirected planning community is using. Evaluation Worse than VSIDS with small, hard, combinatorial problems. Invariants Conclusion Ganai [Gan10, Gan11] reports good performance of a References different heuristic with partly similar flavor, for BMC.

  82. Impact on planner performance Planning competition problems Planning with SAT all domains 1998-2011 1600 Introduction Encodings 1400 Solver Calls SAT solving number of solved instances 1200 Depth-first Undirected Evaluation 1000 Invariants Conclusion 800 References 600 SATPLAN M Mp 400 MpX LAMA08 200 LAMA11 FF FF-2 0 0.1 1 10 100 1000 time in seconds

  83. Impact on planner performance Planning competition problems Planning with SAT all instances 1000 Introduction Encodings Solver Calls 100 SAT solving Depth-first Undirected Evaluation time in seconds Mp Invariants 10 Conclusion References 1 0.1 0.01 0.01 0.1 1 10 100 1000 time in seconds M

Recommend

Planning Agents Chapter Overview planning problems from problem solving to planning

Planning Agents Chapter Overview planning problems from problem solving to planning

CPE/CSC 580-S06 Artificial Intelligence Intelligent Agents Planning Agents Chapter Overview planning problems from problem solving to planning representations for planning problems states, goals, actions, plans partial-order planning

640 views • 41 slides
Contents Planning vs. problem solving 1 Foundations of Artificial Intelligence Planning in the

Contents Planning vs. problem solving 1 Foundations of Artificial Intelligence Planning in the

Contents Planning vs. problem solving 1 Foundations of Artificial Intelligence Planning in the situation calculus 2 14. Planning STRIPS formalism 3 Solving Logically Specified Problems Step by Step 4 Non-linear planning Wolfram Burgard,

310 views • 14 slides
Foundations of Artificial Intelligence 14. Planning Solving Logically Specified Problems Step by

Foundations of Artificial Intelligence 14. Planning Solving Logically Specified Problems Step by

Foundations of Artificial Intelligence 14. Planning Solving Logically Specified Problems Step by Step Wolfram Burgard, Bernhard Nebel, and Martin Riedmiller Albert-Ludwigs-Universit at Freiburg August 2, 2011 Contents Planning vs. problem

586 views • 54 slides
Difficulty of real world problems Planning language Assume a problem-solving agent What is a

Difficulty of real world problems Planning language Assume a problem-solving agent What is a

Planning Planning The Planning problem Planning with State-space search Partial-order planning Based on slides prepared by Tom Lenaerts Planning graphs SWITCH, Vlaams Interuniversitair Instituut voor Biotechnologie Planning with propositional

597 views • 15 slides
Foundations of Artificial Intelligence 11. Action Planning Solving Logically Specified Problems

Foundations of Artificial Intelligence 11. Action Planning Solving Logically Specified Problems

Foundations of Artificial Intelligence 11. Action Planning Solving Logically Specified Problems using a General Problem Solver Joschka Boedecker and Wolfram Burgard and Bernhard Nebel Albert-Ludwigs-Universitt Freiburg Contents What is

782 views • 62 slides
Foundations of AI Planning in the situation calculus 1 3 . Planning STRIPS formalism

Foundations of AI Planning in the situation calculus 1 3 . Planning STRIPS formalism

Contents Planning vs. problem solving Foundations of AI Planning in the situation calculus 1 3 . Planning STRIPS formalism Non-linear planning The POP algorithm Solving Logically Specified Problems Graphplan

272 views • 14 slides
Solving Percent Problems Word Problems Find a Pattern Estimation Problems Fraction Problems

Solving Percent Problems Word Problems Find a Pattern Estimation Problems Fraction Problems

Slide 1 / 142 Slide 2 / 142 Table of Contents Strategies &amp; Plans for Problem Solving Rate Problems Solving Percent Problems Word Problems Find a Pattern Estimation Problems Fraction Problems Pre-Algebra LCM / GCF Problems Combination

477 views • 24 slides
Solving Non-deterministic Planning Problems with Pattern Database Heuristics Pascal Bercher

Solving Non-deterministic Planning Problems with Pattern Database Heuristics Pascal Bercher

, Formalization &amp; Search PDB-Heuristic Benchmarks Conclusion Solving Non-deterministic Planning Problems with Pattern Database Heuristics Pascal Bercher Robert Mattm uller Institute of Artificial Intelligence Department of Computer

865 views • 28 slides
Foundations of AI 3. Solving Problems by Searching Problem-Solving Agents, Formulating

Foundations of AI 3. Solving Problems by Searching Problem-Solving Agents, Formulating

Foundations of AI 3. Solving Problems by Searching Problem-Solving Agents, Formulating Problems, Search Strategies Luc De Raedt and Wolfram Burgard and Bernhard Nebel Contents Problem-Solving Agents Formulating Problems Problem

662 views • 41 slides
Solving Word Problems The strategy for solving word problems, presented in written form, may be

Solving Word Problems The strategy for solving word problems, presented in written form, may be

Solving Word Problems The strategy for solving word problems, presented in written form, may be summarized in three words: Alan H. SteinUniversity of Connecticut Solving Word Problems The strategy for solving word problems, presented in written

877 views • 49 slides
Compiling Uncertainty Away: Solving Conformant Planning Problems Using a Classical Planner

Compiling Uncertainty Away: Solving Conformant Planning Problems Using a Classical Planner

WS on Planning with Uncertainty and Execution - ICAPS - 2006 Palacios &amp; Geffner Compiling Uncertainty Away: Solving Conformant Planning Problems Using a Classical Planner (Sometimes) H ector Palacios H ector Geffner UPF ICREA/UPF

688 views • 54 slides
Contents Foundations of Artificial Intelligence Problem-Solving Agents 1 3. Solving Problems by

Contents Foundations of Artificial Intelligence Problem-Solving Agents 1 3. Solving Problems by

Contents Foundations of Artificial Intelligence Problem-Solving Agents 1 3. Solving Problems by Searching Formulating Problems 2 Problem-Solving Agents, Formulating Problems, Search Strategies Problem Types 3 Wolfram Burgard, Bernhard

319 views • 12 slides
MODELLING AND SOLVING SCHEDULING PROBLEMS USING CONSTRAINT PROGRAMMING CONSTRAINT PROGRAMMING Two

MODELLING AND SOLVING SCHEDULING PROBLEMS USING CONSTRAINT PROGRAMMING CONSTRAINT PROGRAMMING Two

Roman Bartk (Charles University in Prague, Czech Republic) y g p MODELLING AND SOLVING SCHEDULING PROBLEMS USING CONSTRAINT PROGRAMMING CONSTRAINT PROGRAMMING Two worlds Two worlds planning vs. scheduling planning is about finding

189 views • 15 slides
Solving Very Hard Problems: Cube-and-Conquer, a Hybrid SAT Solving Method Marijn J.H. Heule

Solving Very Hard Problems: Cube-and-Conquer, a Hybrid SAT Solving Method Marijn J.H. Heule

Solving Very Hard Problems: Cube-and-Conquer, a Hybrid SAT Solving Method Marijn J.H. Heule Joint work with Armin Biere, Oliver Kullmann, and Victor W. Marek Parallel Constraint Reasoning August 6, 2017 1/19 Satisfiability (SAT) Solving Has

463 views • 31 slides
Continuous Improvement Solving Problems That Change Lives CI Skills Development Problem Solving

Continuous Improvement Solving Problems That Change Lives CI Skills Development Problem Solving

Continuous Improvement Solving Problems That Change Lives CI Skills Development Problem Solving Identify and solve the root causes of problems using CI tools 2 Agenda Welcome Ground Rules Introductions Problem Solving Tools

1.37k views • 51 slides
Solving Problems by Searching Chapter 3 Ch. 03 p.1/49 Outline Problem-solving agents

Solving Problems by Searching Chapter 3 Ch. 03 p.1/49 Outline Problem-solving agents

Solving Problems by Searching Chapter 3 Ch. 03 p.1/49 Outline Problem-solving agents Problem types Problem formulation Example problems Basic search algorithms Ch. 03 p.2/49 Problem-solving agents

1.4k views • 49 slides
Solving Problems Using Problem Solving Concrete operational: Formal operational: classification

Solving Problems Using Problem Solving Concrete operational: Formal operational: classification

Piagetian Development: Solving Problems Using Problem Solving Concrete operational: Formal operational: classification control of variables Dr. David C. Stone conservation combinatorial reasoning Department of Chemistry decentering

480 views • 4 slides
Outline Problem solving agents and search Solving Problems by Examples Properties

Outline Problem solving agents and search Solving Problems by Examples Properties

Outline Problem solving agents and search Solving Problems by Examples Properties of search algorithms Searching Uninformed search CS486/686 Breadth first Depth first University of Waterloo Iterative Deepening

413 views • 6 slides
Boolean Satisfiability Based Planning and Analysis of Planning Sections 11.5 and 11.6 Sec.

Boolean Satisfiability Based Planning and Analysis of Planning Sections 11.5 and 11.6 Sec.

Boolean Satisfiability Based Planning and Analysis of Planning Sections 11.5 and 11.6 Sec. 11.5,6 p.1/25 Outline Background and overview The Satplan algorithm Converting planning problems into Boolean formulas Solving Booelan formulas

387 views • 25 slides
EE562: Robot Motion Planning Slides on Discrete Planning Abubakr Muhammad Discrete Planning

EE562: Robot Motion Planning Slides on Discrete Planning Abubakr Muhammad Discrete Planning

EE562: Robot Motion Planning Slides on Discrete Planning Abubakr Muhammad Discrete Planning Planning (robotics) or Problem Solving (AI) ? We will study Discrete configuration spaces or state spaces Modeling planning problems as

626 views • 27 slides
Composing &amp; Solving Maths Problems Chris Harman 27 years on AMC Problems Committee Well and

Composing &amp; Solving Maths Problems Chris Harman 27 years on AMC Problems Committee Well and

Composing &amp; Solving Maths Problems Chris Harman 27 years on AMC Problems Committee Well and truly retired to Coolum, 10 years ago from USQ harmanchris@gmail.com Australian Mathematics Competition (AMC) Turning a concrete context into

474 views • 21 slides
Four r Impo porta rtant nt The hemes mes Emphasis is on problems (and solving them)

Four r Impo porta rtant nt The hemes mes Emphasis is on problems (and solving them)

Four r Impo porta rtant nt The hemes mes Emphasis is on problems (and solving them) rather than on behaviors (and modifying them) upstream (not downstream) The problem solving is collaborative rather than unilateral something

585 views • 20 slides
Solving problems by searching Chapter 3 Some slide credits to Hwee Tou Ng (Singapore) Outline

Solving problems by searching Chapter 3 Some slide credits to Hwee Tou Ng (Singapore) Outline

Solving problems by searching Chapter 3 Some slide credits to Hwee Tou Ng (Singapore) Outline Problem-solving agents Problem types Problem formulation Example problems Basic search algorithms Heuristics 2013 CS 325 -

886 views • 87 slides
Chapter 6 Programming Most of the material is left for your to study yourself. Solving Problems

Chapter 6 Programming Most of the material is left for your to study yourself. Solving Problems

Chapter 6 Programming Most of the material is left for your to study yourself. Solving Problems using a Computer Methodologies for creating computer programs that perform a desired function. Problem Solving How do we figure out what to

685 views • 32 slides

More recommend