Alternative plan generation and merging (3/3) - Example Original All-outcomes probabilistic determinization actions a 11 a 12 a 2 a 1 a 31 For this example, we use as an a 2 * aversion metric, a 32 1 π = πππ‘π’ π ππ + a 3 ππ ππ π½ππ +1 a 41 a 4 a 42 a 5 a 6 a 51 a 7 * a 52 * (deterministic) a 61 a 62 a 7 ICTAI 2014 - Session A23. Planning 22/49
Alternative plan generation and merging (3/3) - Example Original All-outcomes probabilistic determinization actions a 11 a 12 a 2 a 1 a 31 For this example, we use as an a 2 * aversion metric, a 32 1 π = πππ‘π’ π ππ + a 3 ππ ππ π½ππ +1 a 41 a 4 a 42 a 5 a 6 a 51 a 7 * a 52 * (deterministic) a 61 a 62 a 7 ICTAI 2014 - Session A23. Planning 22/49
Alternative plan generation and merging (3/3) - Example Original All-outcomes probabilistic determinization actions a 11 a 12 a 2 a 1 a 31 For this example, we use as an a 2 * aversion metric, a 32 1 π = πππ‘π’ π ππ + a 3 ππ ππ π½ππ +1 a 41 a 4 a 42 a 5 a 6 a 51 a 7 * a 52 * (deterministic) a 61 a 62 a 7 ICTAI 2014 - Session A23. Planning 22/49
Alternative plan generation and merging (3/3) - Example Original All-outcomes probabilistic determinization actions a 11 a 12 a 2 a 1 a 31 For this example, we use as an a 2 * aversion metric, a 32 1 π = πππ‘π’ π ππ + a 3 ππ ππ π½ππ +1 a 41 a 4 a 42 a 5 a 6 a 51 a 7 * a 52 * (deterministic) a 61 a 62 a 7 ICTAI 2014 - Session A23. Planning 22/49
Alternative plan generation and merging (3/3) - Example Plan Prob Cost Aversion π 11 0.8 4 4.55 ICTAI 2014 - Session A23. Planning 23/49
Alternative plan generation and merging (3/3) - Example Plan Prob Cost Aversion 1 = 4 + 0.8 + 1 π 11 0.8 4 4.55 π = πππ‘π’ π ππ + 1 ππ ππ π½ππ +1 ICTAI 2014 - Session A23. Planning 23/49
Alternative plan generation and merging (3/3) - Example Plan Prob Cost Aversion 1 = 4 + 0.8 + 1 π 11 0.8 4 4.55 π 2, π 31 0.8 5 6.05 ICTAI 2014 - Session A23. Planning 23/49
Alternative plan generation and merging (3/3) - Example Plan Prob Cost Aversion = 1 β 0.8 1 = 2 + = 0.8 1 + 1 1 + 3 + π 11 0.8 4 4.55 0.8 + 1 π 2, π 31 0.8 5 6.05 ICTAI 2014 - Session A23. Planning 23/49
Alternative plan generation and merging (3/3) - Example Plan Prob Cost Aversion = 1 β 0.8 1 = 2 + = 0.8 1 + 1 1 + 3 + π 11 0.8 4 4.55 0.8 + 1 π 2, π 31 0.8 5 6.05 ICTAI 2014 - Session A23. Planning 23/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 11 1 4.55 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 ICTAI 2014 - Session A23. Planning 24/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 11 1 4.55 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 4 π 42 , π 61 , π 7 17.96 ICTAI 2014 - Session A23. Planning 25/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 11 1 4.55 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 4 π 42 , π 61 , π 7 17.96 π 41 , π 51 , π 62 5 19.91 ICTAI 2014 - Session A23. Planning 26/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 11 1 4.55 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 4 π 42 , π 61 , π 7 17.96 π 41 , π 51 , π 62 5 19.91 π 42 , π 62 6 31.74 ICTAI 2014 - Session A23. Planning 27/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 11 1 4.55 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 4 π 42 , π 61 , π 7 17.96 Circular nodes π 41 , π 51 , π 62 5 19.91 = Chance nodes π 42 , π 62 6 31.74 ICTAI 2014 - Session A23. Planning 28/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 11 1 4.55 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 4 π 42 , π 61 , π 7 17.96 Circular nodes π 41 , π 51 , π 62 5 19.91 = Chance nodes π 42 , π 62 6 31.74 ICTAI 2014 - Session A23. Planning 28/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 11 1 4.55 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 4 π 42 , π 61 , π 7 17.96 Grey nodes π 41 , π 51 , π 62 5 19.91 potentially lead π 42 , π 62 6 31.74 to the goal ICTAI 2014 - Session A23. Planning 29/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 11 1 4.55 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 4 π 42 , π 61 , π 7 17.96 White nodes π 41 , π 51 , π 62 5 19.91 donβt lead to the π 42 , π 62 6 31.74 goal ICTAI 2014 - Session A23. Planning 30/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 11 1 4.55 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 4 π 42 , π 61 , π 7 17.96 π 41 , π 51 , π 62 5 Triangular nodes 19.91 π 42 , π 62 6 = end nodes 31.74 ICTAI 2014 - Session A23. Planning 31/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 11 1 4.55 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 4 π 42 , π 61 , π 7 17.96 π 41 , π 51 , π 62 5 19.91 Goal node π 42 , π 62 6 31.74 ICTAI 2014 - Session A23. Planning 32/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 11 1 4.55 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 4 π 42 , π 61 , π 7 17.96 π 41 , π 51 , π 62 5 19.91 Dead-end node π 42 , π 62 6 31.74 ICTAI 2014 - Session A23. Planning 33/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion Best plan = a 11 First action = a 11 π 11 1 4.55 Deterministic = a 11 ο Probabilistic = a 1 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 4 π 42 , π 61 , π 7 17.96 π 41 , π 51 , π 62 5 19.91 π 42 , π 62 6 31.74 ICTAI 2014 - Session A23. Planning 34/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion Best plan = a 11 First action = a 11 π 11 1 4.55 Deterministic = a 11 ο Probabilistic = a 1 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 4 π 42 , π 61 , π 7 17.96 π 41 , π 51 , π 62 5 19.91 π 42 , π 62 6 31.74 ICTAI 2014 - Session A23. Planning 34/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion Best plan = a 11 First action = a 11 π 11 1 4.55 Deterministic = a 11 ο Probabilistic = a 1 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 4 π 42 , π 61 , π 7 17.96 π 41 , π 51 , π 62 5 19.91 π 42 , π 62 6 31.74 π‘π£ππππ‘π‘ππ£π ππ¦πππ£π’πππ ππ πππ’πππ ICTAI 2014 - Session A23. Planning 34/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion Best plan = a 11 First action = a 11 π 11 1 4.55 Deterministic = a 11 ο Probabilistic = a 1 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 4 π 42 , π 61 , π 7 17.96 π 41 , π 51 , π 62 5 19.91 π 42 , π 62 6 31.74 π‘π£ππππ‘π‘ππ£π ππ¦πππ£π’πππ ππ πππ’πππ ππππππ ππ¦πππ£π’πππ ππ πππ’πππ ICTAI 2014 - Session A23. Planning 34/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion Best plan = a 11 First action = a 11 π 11 1 4.55 Deterministic = a 11 ο Probabilistic = a 1 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 4 π 42 , π 61 , π 7 17.96 π 41 , π 51 , π 62 5 19.91 π 42 , π 62 6 31.74 π‘π£ππππ‘π‘ππ£π ππ¦πππ£π’πππ ππ πππ’πππ ππππππ ππ¦πππ£π’πππ ππ πππ’πππ π»πππ! ICTAI 2014 - Session A23. Planning 34/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion Best plan = a 11 First action = a 11 π 11 1 4.55 Deterministic = a 11 ο Probabilistic = a 1 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 4 π 42 , π 61 , π 7 17.96 π 41 , π 51 , π 62 5 19.91 π 42 , π 62 6 31.74 π‘π£ππππ‘π‘ππ£π ππ¦πππ£π’πππ ππ πππ’πππ ππππππ ππ¦πππ£π’πππ ππ πππ’πππ πππ¦π’? π»πππ! ICTAI 2014 - Session A23. Planning 34/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion Best plan = a 11 First action = a 11 π 11 1 4.55 Deterministic = a 11 ο Probabilistic = a 1 π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 4 π 42 , π 61 , π 7 17.96 π 41 , π 51 , π 62 5 19.91 π 42 , π 62 6 31.74 π‘π£ππππ‘π‘ππ£π ππ¦πππ£π’πππ ππ πππ’πππ ππππππ ππ¦πππ£π’πππ ππ πππ’πππ πππ¦π’? π»πππ! Current plan = a 11 does not contain any more actions Compute possible valid plans ICTAI 2014 - Session A23. Planning 34/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 4.55 π 2, π 31 2 6.05 If a plan in the set of valid plans contains at any point actions that have π 41 , π 51 , π 61 , π 7 3 13.13 already been executed in the current branch 4 π 42 , π 61 , π 7 17.96 π 41 , π 51 , π 62 5 19.91 π 42 , π 62 6 31.74 is the only one contained in the current branch β’ that has already been inserted ICTAI 2014 - Session A23. Planning 35/49
Alternative plan generation and merging (3/3) - Example Remember assumption : β’ If an action was executed with a particular result it has this result for its entire branch. β’ No delete effects or negated Compute possible valid # Plan Aversion preconditions ο output effects still hold; plans no need for re- execution π 11 1 4.55 π 2, π 31 2 6.05 If a plan in the set of valid plans contains at any point actions that have π 41 , π 51 , π 61 , π 7 3 13.13 already been executed in the current branch 4 π 42 , π 61 , π 7 17.96 If executed action had the same outcome as the one in the plan ο insert 1) π 41 , π 51 , π 62 5 19.91 plan into branch without the particular action π 42 , π 62 6 31.74 is the only one contained in the current branch β’ that has already been inserted ICTAI 2014 - Session A23. Planning 35/49
Alternative plan generation and merging (3/3) - Example Remember assumption : β’ If an action was executed with a particular result it has this result for its entire branch. β’ No delete effects or negated Compute possible valid # Plan Aversion preconditions ο output effects still hold; plans no need for re- execution π 11 1 4.55 π 2, π 31 2 6.05 If a plan in the set of valid plans contains at any point actions that have π 41 , π 51 , π 61 , π 7 3 13.13 already been executed in the current branch 4 π 42 , π 61 , π 7 17.96 If executed action had the same outcome as the one in the plan ο insert 1) π 41 , π 51 , π 62 5 19.91 plan into branch without the particular action π 42 , π 62 6 31.74 If executed action had a different outcome as the one in the plan ο the 2) entire plan is rejected for this particular branch is the only one contained in the current branch β’ that has already been inserted ICTAI 2014 - Session A23. Planning 35/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 4.55 π 2, π 31 2 6.05 If a plan in the set of valid plans contains at any point actions that have π 41 , π 51 , π 61 , π 7 3 13.13 already been executed in the current branch 4 π 42 , π 61 , π 7 17.96 If executed action had the same outcome as the one in the plan ο insert 1) π 41 , π 51 , π 62 5 19.91 plan into branch without the particular action π 42 , π 62 6 31.74 If executed action had a different outcome as the one in the plan ο the 2) entire plan is rejected for this particular branch Set of valid plans may not be the same as the original one β’ some actions may have been removed from the plans due to (1) is the only one β’ their cost and probability of successful execution have also changed contained in the current branch β’ plans are sorted again by their ascending aversion factors β’ that β’ some plans may have been removed from the set due to (2) has already been inserted ICTAI 2014 - Session A23. Planning 35/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 4.55 π 2, π 31 2 6.05 If a plan in the set of valid plans contains at any point actions that have π 41 , π 51 , π 61 , π 7 3 13.13 already been executed in the current branch 4 π 42 , π 61 , π 7 17.96 If executed action had the same outcome as the one in the plan ο insert 1) π 41 , π 51 , π 62 5 19.91 plan into branch without the particular action π 42 , π 62 6 31.74 If executed action had a different outcome as the one in the plan ο the 2) entire plan is rejected for this particular branch Set of valid plans may not be the same as the original one β’ some actions may have been removed from the plans due to (1) π 1 is the only one contained in β’ β’ their cost and probability of successful execution have also changed the current branch β’ plans are sorted again by their ascending aversion factors β’ Action aa 1 1 is the only one β’ some plans may have been removed from the set due to (2) contained in the current branch that β’ has already been inserted ICTAI 2014 - Session A23. Planning 35/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 4.55 π 2, π 31 2 6.05 If a plan in the set of valid plans contains at any point actions that have π 41 , π 51 , π 61 , π 7 3 13.13 already been executed in the current branch 4 π 42 , π 61 , π 7 17.96 If executed action had the same outcome as the one in the plan ο insert 1) π 41 , π 51 , π 62 5 19.91 plan into branch without the particular action π 42 , π 62 6 31.74 If executed action had a different outcome as the one in the plan ο the 2) entire plan is rejected for this particular branch Set of valid plans may not be the same as the original one β’ some actions may have been removed from the plans due to (1) π 1 is the only one contained in β’ β’ their cost and probability of successful execution have also changed the current branch β’ plans are sorted again by their ascending aversion factors β’ only present in PPllaan 1 β’ some plans may have been removed from the set due to (2) tha t has already been inserted β’ inserted that β’ has already been inserted ICTAI 2014 - Session A23. Planning 35/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 4.55 π 2, π 31 2 6.05 If a plan in the set of valid plans contains at any point actions that have π 41 , π 51 , π 61 , π 7 3 13.13 already been executed in the current branch 4 π 42 , π 61 , π 7 17.96 If executed action had the same outcome as the one in the plan ο insert 1) π 41 , π 51 , π 62 5 19.91 plan into branch without the particular action π 42 , π 62 6 31.74 If executed action had a different outcome as the one in the plan ο the 2) entire plan is rejected for this particular branch Set of valid plans may not be the same as the original one β’ some actions may have been removed from the plans due to (1) π 1 is the only one contained in β’ β’ their cost and probability of successful execution have also changed the current branch β’ plans are sorted again by their ascending aversion factors β’ only present in PPllaan 1 β’ some plans may have been removed from the set due to (2) tha t has already been inserted β’ All other plans β’ can be inserted intact β’ retain their aversion factor ICTAI 2014 - Session A23. Planning 35/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion Best plan = π 2, π 31 π 2, π 31 2 6.05 First action = a 2 π 41 , π 51 , π 61 , π 7 3 13.13 π 42 , π 61 , π 7 4 17.96 5 π 41 , π 51 , π 62 19.91 π 42 , π 62 6 31.74 ICTAI 2014 - Session A23. Planning 36/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion Best plan = π 2, π 31 π 2, π 31 2 6.05 First action = a 2 π 41 , π 51 , π 61 , π 7 3 13.13 π 42 , π 61 , π 7 4 17.96 5 π 41 , π 51 , π 62 19.91 π 42 , π 62 6 31.74 ICTAI 2014 - Session A23. Planning 36/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion Best plan = π 2, π 31 π 2, π 31 2 6.05 First action = a 2 π 41 , π 51 , π 61 , π 7 3 13.13 π 42 , π 61 , π 7 4 17.96 5 π 41 , π 51 , π 62 19.91 π 42 , π 62 6 31.74 π‘π£ππππ‘π‘ππ£π ππ¦πππ£π’πππ ππ πππ’πππ ICTAI 2014 - Session A23. Planning 36/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion Best plan = π 2, π 31 π 2, π 31 2 6.05 First action = a 2 π 41 , π 51 , π 61 , π 7 3 13.13 π 42 , π 61 , π 7 4 17.96 5 π 41 , π 51 , π 62 19.91 π 42 , π 62 6 31.74 π‘π£ππππ‘π‘ππ£π ππ¦πππ£π’πππ ππ πππ’πππ πΈππ’ππ πππππ‘π’ππ ππππππ’ ππππ ICTAI 2014 - Session A23. Planning 36/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion Best plan = π 2, π 31 π 2, π 31 2 6.05 First action = a 2 π 41 , π 51 , π 61 , π 7 3 13.13 π 42 , π 61 , π 7 4 17.96 5 π 41 , π 51 , π 62 19.91 π 42 , π 62 6 31.74 π‘π£ππππ‘π‘ππ£π ππ¦πππ£π’πππ ππ πππ’πππ πΈππ’ππ πππππ‘π’ππ ππππππ’ ππππ Next action in plan = a 31 Deterministic = a 31 ο Probabilistic = a 3 ICTAI 2014 - Session A23. Planning 36/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 π 42 , π 61 , π 7 4 17.96 5 π 41 , π 51 , π 62 19.91 π 42 , π 62 6 31.74 ICTAI 2014 - Session A23. Planning 37/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 π 42 , π 61 , π 7 4 17.96 5 π 41 , π 51 , π 62 19.91 π 42 , π 62 6 31.74 π‘π£ππππ‘π‘ππ£π ππ¦πππ£π’πππ ππ πππ’πππ ICTAI 2014 - Session A23. Planning 37/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 π 42 , π 61 , π 7 4 17.96 5 π 41 , π 51 , π 62 19.91 π 42 , π 62 6 31.74 π‘π£ππππ‘π‘ππ£π ππ¦πππ£π’πππ ππ πππ’πππ ππππππ ππ¦πππ£π’πππ ππ πππ’πππ ICTAI 2014 - Session A23. Planning 37/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 π 42 , π 61 , π 7 4 17.96 5 π 41 , π 51 , π 62 19.91 π 42 , π 62 6 31.74 π‘π£ππππ‘π‘ππ£π ππ¦πππ£π’πππ ππ πππ’πππ ππππππ ππ¦πππ£π’πππ ππ πππ’πππ π»πππ! ICTAI 2014 - Session A23. Planning 37/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 π 42 , π 61 , π 7 4 17.96 5 π 41 , π 51 , π 62 19.91 π 42 , π 62 6 31.74 π‘π£ππππ‘π‘ππ£π ππ¦πππ£π’πππ ππ πππ’πππ ππππππ ππ¦πππ£π’πππ ππ πππ’πππ πππ¦π’? π»πππ! ICTAI 2014 - Session A23. Planning 37/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 2, π 31 2 6.05 π 41 , π 51 , π 61 , π 7 3 13.13 π 42 , π 61 , π 7 4 17.96 5 π 41 , π 51 , π 62 19.91 π 42 , π 62 6 31.74 π‘π£ππππ‘π‘ππ£π ππ¦πππ£π’πππ ππ πππ’πππ ππππππ ππ¦πππ£π’πππ ππ πππ’πππ πππ¦π’? π»πππ! Current plan does not contain any more actions Compute possible valid plans ICTAI 2014 - Session A23. Planning 37/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 4.55 π 2, π 31 2 6.05 Current branch contains actions π 12 , π 2 , π 32 π 41 , π 51 , π 61 , π 7 3 13.13 All actions are only present in ππππ 1 and ππππ 2 ; β’ 4 π 42 , π 61 , π 7 17.96 π 2 has already been executed with the same result ο removed β’ π 41 , π 51 , π 62 5 19.91 and π 3 have already been inserted with different results β’ π 42 , π 62 6 31.74 β’ ππππ 1 and ππππ 2 are rejected β’ All other plans β’ can be inserted intact β’ retain their aversion factor ICTAI 2014 - Session A23. Planning 38/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 4.55 π 2, π 31 2 6.05 π 1 and π 3 ππ π 3 3 π 3 have already been inserted with different π 41 , π 51 , π 61 , π 7 3 13.13 results 4 π 42 , π 61 , π 7 17.96 Current branch contains actions π 12 , π 2 , π 32 π 41 , π 51 , π 62 5 19.91 All actions are only present in ππππ 1 and ππππ 2 ; β’ π 42 , π 62 6 31.74 β’ π 2 has already been executed with the same result ο removed β’ π 1 1 1 and π 3 have already been inserted with different results ππππ 1 and ππππ 2 are rejected β’ β’ All other plans β’ can be inserted intact β’ retain their aversion factor ICTAI 2014 - Session A23. Planning 38/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 4.55 π 2, π 31 2 6.05 π 1 and π 3 ππ π 3 3 π 3 have already been inserted with different π 41 , π 51 , π 61 , π 7 3 13.13 results 4 π 42 , π 61 , π 7 17.96 Current branch contains actions π 12 , π 2 , π 32 π 41 , π 51 , π 62 5 19.91 All actions are only present in ππππ 1 and ππππ 2 ; β’ π 42 , π 62 6 31.74 β’ π 2 has already been executed with the same result ο removed β’ π 1 1 1 and π 3 have already been inserted with different results ππππ 1 and ππππ 2 are rejected β’ β’ All other plans β’ can be inserted intact β’ retain their aversion factor ICTAI 2014 - Session A23. Planning 38/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 4.55 π 2, π 31 2 6.05 π 1 and π 3 ππ π 3 3 π 3 have already been inserted with different π 41 , π 51 , π 61 , π 7 3 13.13 results 4 π 42 , π 61 , π 7 17.96 Current branch contains actions π 12 , π 2 , π 32 π 41 , π 51 , π 62 5 19.91 All actions are only present in ππππ 1 and ππππ 2 ; β’ π 42 , π 62 6 31.74 β’ π 2 has already been executed with the same result ο removed β’ PPllaan 1 and ππππ 2 are rejected ππ 1 and ππππ 2 are rejected β’ ππππ 1 and ππππ 2 are rejected β’ β’ All other plans β’ can be inserted intact β’ retain their aversion factor ICTAI 2014 - Session A23. Planning 38/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 4.55 π 2, π 31 2 6.05 π 1 and π 3 ππ π 3 3 π 3 have already been inserted with different π 41 , π 51 , π 61 , π 7 3 13.13 results 4 π 42 , π 61 , π 7 17.96 Current branch contains actions π 12 , π 2 , π 32 π 41 , π 51 , π 62 5 19.91 All actions are only present in ππππ 1 and ππππ 2 ; β’ π 42 , π 62 6 31.74 β’ π 2 has already been executed with the same result ο removed β’ PPllaan 1 and ππππ 2 are rejected β’ All other plans β’ can be inserted intact β’ retain their aversion factor β’ can be inserted intact β’ retain their aversion factor ICTAI 2014 - Session A23. Planning 38/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 41 , π 51 , π 61 , π 7 13.13 3 π 42 , π 61 , π 7 17.96 4 π 41 , π 51 , π 62 19.91 5 π 42 , π 62 31.74 6 ICTAI 2014 - Session A23. Planning 39/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 41 , π 51 , π 61 , π 7 13.13 3 π 42 , π 61 , π 7 17.96 4 π 41 , π 51 , π 62 19.91 5 π 42 , π 62 31.74 6 π‘π£ππππ‘π‘ ICTAI 2014 - Session A23. Planning 39/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 41 , π 51 , π 61 , π 7 13.13 3 π 42 , π 61 , π 7 17.96 4 π 41 , π 51 , π 62 19.91 5 π 42 , π 62 31.74 6 π‘π£ππππ‘π‘ π‘π£ππππ‘π‘ ICTAI 2014 - Session A23. Planning 39/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 41 , π 51 , π 61 , π 7 13.13 3 π 42 , π 61 , π 7 17.96 4 π 41 , π 51 , π 62 19.91 5 π 42 , π 62 31.74 6 π‘π£ππππ‘π‘ π‘π£ππππ‘π‘ πππππ£π π ππππ β πππ! ICTAI 2014 - Session A23. Planning 39/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 41 , π 51 , π 61 , π 7 13.13 3 π 42 , π 61 , π 7 17.96 4 π 41 , π 51 , π 62 19.91 5 π 42 , π 62 31.74 6 π‘π£ππππ‘π‘ π‘π£ππππ‘π‘ πππππ£π π π‘π£ππππ‘π‘ ππππ β πππ! ICTAI 2014 - Session A23. Planning 39/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 41 , π 51 , π 61 , π 7 13.13 3 π 42 , π 61 , π 7 17.96 4 π 41 , π 51 , π 62 19.91 5 π 42 , π 62 31.74 6 π‘π£ππππ‘π‘ π‘π£ππππ‘π‘ πππππ£π π π‘π£ππππ‘π‘ ππππ β πππ! πππππ£π π ICTAI 2014 - Session A23. Planning 39/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 41 , π 51 , π 61 , π 7 13.13 3 π 42 , π 61 , π 7 17.96 4 π 41 , π 51 , π 62 19.91 5 π 42 , π 62 31.74 6 π‘π£ππππ‘π‘ π‘π£ππππ‘π‘ πππππ£π π π‘π£ππππ‘π‘ ππππ β πππ! πππππ£π π ππππ β πππ! ICTAI 2014 - Session A23. Planning 39/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 41 , π 51 , π 61 , π 7 13.13 3 π 42 , π 61 , π 7 17.96 4 π 41 , π 51 , π 62 19.91 5 π 42 , π 62 31.74 6 π‘π£ππππ‘π‘ π‘π£ππππ‘π‘ πππππ£π π π‘π£ππππ‘π‘ ππππ β πππ! πππππ£π π π‘π£ππππ‘π‘ ππππ β πππ! π»πππ! ICTAI 2014 - Session A23. Planning 39/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 41 , π 51 , π 61 , π 7 13.13 3 π 42 , π 61 , π 7 17.96 4 π 41 , π 51 , π 62 19.91 5 π 42 , π 62 31.74 6 πππππ£π π ICTAI 2014 - Session A23. Planning 39/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 41 , π 51 , π 61 , π 7 13.13 3 π 42 , π 61 , π 7 17.96 4 π 41 , π 51 , π 62 19.91 5 π 42 , π 62 31.74 6 πππππ£π π πππ¦π’? Current plan does not contain any more actions Compute possible valid plans ICTAI 2014 - Session A23. Planning 39/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 π 2, π 31 2 Current branch contains actions π 12 , π 2 , π 32 , π 42 π 41 , π 51 , π 61 , π 7 3 β’ All plans contain one of those actions 4 π 42 , π 61 , π 7 and ππππ 2 contain π 1 and π 3 with different results β’ π 41 , π 51 , π 62 5 ππππ 1 and ππππ 2 are rejected β’ π 42 , π 62 6 β’ ππππ 3 and ππππ 5 contain π 4 with a different result β’ ππππ 3 and ππππ 5 are rejected ππππ 3 and ππππ 5 contain π 4 with the same result β’ π 42 is removed, as it has already been executed β’ β’ Since they now comprise different actions β’ new (smaller, as they are more probable) aversion factor ICTAI 2014 - Session A23. Planning 40/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 π 2, π 31 2 Current branch contains actions π 12 , π 2 , π 32 , π 42 π 41 , π 51 , π 61 , π 7 3 β’ All plans contain one of those actions 4 π 42 , π 61 , π 7 PPllaan 1 and ππππ 2 contain π 1 and π 3 with different β’ π 41 , π 51 , π 62 5 results π 42 , π 62 6 β’ contain π 1 and π 3 with different results β’ ππππ 1 and ππππ 2 are rejected ππππ 3 and ππππ 5 contain π 4 with a different result β’ ππππ 3 and ππππ 5 are rejected β’ ππππ 3 and ππππ 5 contain π 4 with the same result β’ β’ π 42 is removed, as it has already been executed β’ Since they now comprise different actions β’ new (smaller, as they are more probable) aversion factor ICTAI 2014 - Session A23. Planning 40/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 π 2, π 31 2 Current branch contains actions π 12 , π 2 , π 32 , π 42 π 41 , π 51 , π 61 , π 7 3 β’ All plans contain one of those actions 4 π 42 , π 61 , π 7 PPllaan 1 and ππππ 2 contain π 1 and π 3 with different β’ π 41 , π 51 , π 62 5 results π 42 , π 62 6 β’ contain π 1 and π 3 with different results β’ ππππ 1 and ππππ 2 are rejected ππππ 3 and ππππ 5 contain π 4 with a different result β’ ππππ 3 and ππππ 5 are rejected β’ ππππ 3 and ππππ 5 contain π 4 with the same result β’ β’ π 42 is removed, as it has already been executed β’ Since they now comprise different actions β’ new (smaller, as they are more probable) aversion factor ICTAI 2014 - Session A23. Planning 40/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 π 2, π 31 2 Current branch contains actions π 12 , π 2 , π 32 , π 42 π 41 , π 51 , π 61 , π 7 3 β’ All plans contain one of those actions 4 π 42 , π 61 , π 7 PPllaan 1 and ππππ 2 contain π 1 and π 3 with different β’ π 41 , π 51 , π 62 5 results π 42 , π 62 6 β’ PPllaan 1 and ππππ 2 are rejected β’ ππ 1 and ππππ 2 are rejected ππππ 1 and ππππ 2 are rejected β’ ππππ 3 and ππππ 5 contain π 4 with a different result β’ ππππ 3 and ππππ 5 are rejected β’ β’ ππππ 3 and ππππ 5 contain π 4 with the same result β’ π 42 is removed, as it has already been executed β’ Since they now comprise different actions β’ new (smaller, as they are more probable) aversion factor ICTAI 2014 - Session A23. Planning 40/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 π 2, π 31 2 lt π 41 , π 51 , π 61 , π 7 3 Current branch contains actions π 12 , π 2 , π 32 , π 42 4 π 42 , π 61 , π 7 β’ All plans contain one of those actions π 41 , π 51 , π 62 5 PPllaan 1 and ππππ 2 contain π 1 and π 3 with different β’ π 42 , π 62 6 results β’ PPllaan 1 and ππππ 2 are rejected PPllaan 3 and ππππ 5 contain π 4 with a different res π£ β’ contain π 4 with a different result ππππ 1 and ππππ 2 are rejected β’ β’ ππππ 3 and ππππ 5 contain π 4 with a different result β’ ππππ 3 and ππππ 5 are rejected ππππ 3 and ππππ 5 contain π 4 with the same result β’ π 42 is removed, as it has already been executed β’ β’ Since they now comprise different actions β’ new (smaller, as they are more probable) aversion factor ICTAI 2014 - Session A23. Planning 40/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 π 2, π 31 2 lt π 41 , π 51 , π 61 , π 7 3 Current branch contains actions π 12 , π 2 , π 32 , π 42 4 π 42 , π 61 , π 7 β’ All plans contain one of those actions π 41 , π 51 , π 62 5 PPllaan 1 and ππππ 2 contain π 1 and π 3 with different β’ π 42 , π 62 6 results β’ PPllaan 1 and ππππ 2 are rejected PPllaan 3 and ππππ 5 are rejected β’ ππ 3 and ππππ 5 are rejected β’ ππππ 1 and ππππ 2 are rejected β’ β’ ππππ 3 and ππππ 5 contain π 4 with a different result β’ ππππ 3 and ππππ 5 are rejected ππππ 3 and ππππ 5 contain π 4 with the same result β’ π 42 is removed, as it has already been executed β’ β’ Since they now comprise different actions β’ new (smaller, as they are more probable) aversion factor ICTAI 2014 - Session A23. Planning 40/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 π 2, π 31 2 π 41 , π 51 , π 61 , π 7 3 lt 4 π 42 , π 61 , π 7 Current branch contains actions π 12 , π 2 , π 32 , π 42 π 41 , π 51 , π 62 5 β’ All plans contain one of those actions π 42 , π 62 6 β’ PPllaan 1 and ππππ 2 contain π 1 and π 3 with different results PPllaan 1 and ππππ 2 are rejected β’ PPllaan 3 and ππππ 5 are rejected β’ PPllaan 3 and ππππ 5 contain π 4 with the same resul π’ contain π 4 β’ with the same result β’ ππππ 1 and ππππ 2 are rejected ππππ 3 and ππππ 5 contain π 4 with a different result β’ ππππ 3 and ππππ 5 are rejected β’ ππππ 3 and ππππ 5 contain π 4 with the same result β’ β’ π 42 is removed, as it has already been executed β’ Since they now comprise different actions β’ new (smaller, as they are more probable) aversion factor ICTAI 2014 - Session A23. Planning 40/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 π 2, π 31 2 2 π 42 is removed, as it has already been executed π 41 , π 51 , π 61 , π 7 3 4 π 42 , π 61 , π 7 lt π 41 , π 51 , π 62 5 Current branch contains actions π 12 , π 2 , π 32 , π 42 π 42 , π 62 6 β’ All plans contain one of those actions β’ PPllaan 1 and ππππ 2 contain π 1 and π 3 with different results PPllaan 1 and ππππ 2 are rejected β’ PPllaan 3 and ππππ 5 are rejected β’ β’ π 4 42 42 is removed, as it has already been executed β’ ππππ 1 and ππππ 2 are rejected ππππ 3 and ππππ 5 contain π 4 with a different result β’ ππππ 3 and ππππ 5 are rejected β’ ππππ 3 and ππππ 5 contain π 4 with the same result β’ β’ π 42 is removed, as it has already been executed β’ Since they now comprise different actions β’ new (smaller, as they are more probable) aversion factor ICTAI 2014 - Session A23. Planning 40/49
Alternative plan generation and merging (3/3) - Example Compute possible valid # Plan Aversion plans π 11 1 π 2, π 31 2 2 π 42 is removed, as it has already been executed π 41 , π 51 , π 61 , π 7 3 4 π 42 , π 61 , π 7 17.96 7.05 lt π 41 , π 51 , π 62 5 Current branch contains actions π 12 , π 2 , π 32 , π 42 π 42 , π 62 6 31.74 20.83 β’ All plans contain one of those actions β’ PPllaan 1 and ππππ 2 contain π 1 and π 3 with different results PPllaan 1 and ππππ 2 are rejected β’ PPllaan 3 and ππππ 5 are rejected β’ β’ Since they now comprise different actions β’ new (smaller, as they are more probable) aversion factor ππππ 3 and ππππ 5 contain π 4 with a different result β’ ππππ 3 and ππππ 5 are rejected β’ ππππ 3 and ππππ 5 contain π 4 with the same result β’ β’ π 42 is removed, as it has already been executed β’ Since they now comprise different actions β’ new (smaller, as they are more probable) aversion factor ICTAI 2014 - Session A23. Planning 40/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 42 , π 61 , π 7 7.05 4 π 42 , π 62 20.83 6 ICTAI 2014 - Session A23. Planning 41/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 42 , π 61 , π 7 7.05 4 π 42 , π 62 20.83 6 π‘π£ππππ‘π‘ ICTAI 2014 - Session A23. Planning 41/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 42 , π 61 , π 7 7.05 4 π 42 , π 62 20.83 6 π‘π£ππππ‘π‘ π‘π£ππππ‘π‘ ICTAI 2014 - Session A23. Planning 41/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 42 , π 61 , π 7 7.05 4 π 42 , π 62 20.83 6 π‘π£ππππ‘π‘ π‘π£ππππ‘π‘ π»πππ! Current plan does not contain any more actions Compute possible valid plans ICTAI 2014 - Session A23. Planning 41/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 42 , π 61 , π 7 7.05 4 π 42 , π 62 20.83 6 π‘π£ππππ‘π‘ π‘π£ππππ‘π‘ π»πππ! Current plan does not contain any more actions Compute possible valid plans ICTAI 2014 - Session A23. Planning 41/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 42 , π 61 , π 7 7.05 4 π 42 , π 62 20.83 6 Current plan does not contain any more actions Compute possible valid plans ICTAI 2014 - Session A23. Planning 41/49
Alternative plan generation and merging (3/3) - Example # Plan Aversion π 42 , π 61 , π 7 7.05 4 π 42 , π 62 20.83 6 π‘π£ππππ‘π‘ π»πππ! Current plan does not contain any more actions Compute possible valid plans ICTAI 2014 - Session A23. Planning 41/49
β’ Introduction β’ Background o Problem formulation β’ Related Work o Non-Deterministic planning o WSC β’ Alternative plan generation and merging o Example Evaluation β’ o Results β’ Conclusion ICTAI 2014 - Session A23. Planning 42/49
Evaluation (1/4) Evaluation based on two domains β’ o Variation of the one presented as an example o Modified version of the evaluation domain from Hatzi et al. (2011) o A user desires to purchase a book through an electronic bookstore o knows book title / author, credit card information, and shipping address o r esult: bookβs purchase, shipping date, and customs cost for the item o Both domains have two versions uni ) o uniform costs for the web services ( Dom x var ) o variant cost for each web service ( Dom x o Domain costs o start from 1 o taken from exponential probability density function, f π¦ = π β π¦β1 , π¦ β₯ 1 ICTAI 2014 - Session A23. Planning 43/49
Recommend
More recommend