decision making in endless space 2 background our studio
play

Decision making in Endless Space 2 Background Our Studio 40 20 - PowerPoint PPT Presentation

Nov 22, 2023 •451 likes •1.24k views

Adrien Allard Florian Brulhart Sebastien Broussaud Decision making in Endless Space 2 Background Our Studio 40 20 Dev 30 Dev 60 Dev 12 Dev 2011 2012 2013 2014 2015 2016 2017 Our 4X Explore Amplitude touch Exploit Search points

  1. Adrien Allard Florian Brulhart Sebastien Broussaud Decision making in Endless Space 2

  2. Background

  3. Our Studio 40 20 Dev 30 Dev 60 Dev 12 Dev 2011 2012 2013 2014 2015 2016 2017

  4. Our 4X Explore Amplitude touch Exploit Search points of interest Build / research Asymmetric factions Discover the world Gather resources Quests Gather Intel Optimize economy Expand Exterminate Diplomacy Fight in battles Increase territory Relation with players Unit management Expand to new places Evaluate deals War management

  5. Post-mortem: Endless Legend Control Understand Technical • • • Decisions are difficult to control Code is spread and duplicated Heuristic results are just numbers • • • AI doesn’t have global strategy Code base is not incremental No access to intermediate friendly reasons • Diplomatic relations can seem • • irrational Decision process is opaque Tools are too complex

  6. Objectives For design For debugging For programming • • • High level control Understand each decision Incremental • • • Low level control Understand resource Allow different AI techniques • • Handle each resource allocation Isolate data refining from • differently User friendly decision

  7. Meet E.N.F.E.R.

  8. Process Overview Sync Analysis Tasks generation Data Game Execution Tasks allocation

  9. Process Overview Tasks generation Game Tasks allocation

  10. Tasks generation

  11. Situation

  12. Designer needs Aaah, the Cravers are invading! The AI should definitely defend its system here!

  13. Goal Defend system against enemies Defend System

  14. Designer needs Hum ok … but how do you defend the system?

  15. Designer needs Details, schmetails … erm... well… you know… it could build defenses or create ships.

  16. Tasks Create ships Defend system against enemies Defend System Build defense

  17. Designer needs Hum ok … but how does the AI decide which action to take?

  18. Designer needs Well, we're talking about Cravers. Insectoid, psycho, warmachines. We need the best defense against them.

  19. Scoring Create ships 0.4 Defend system against enemies Defend System Build defense 0.8

  20. Designer needs Oh, but I forgot, it's that crappy system we stole from the Lumeris earlier. The AI shouldn't prioritise it.

  21. Scoring Create ships 0.4 Defend system against enemies Defend System Build defense 0.8

  22. Scoring Create ships 0.4 Defend system against enemies Defend System 0.5 Build defense 0.8

  23. Scoring 0.2 Create ships Defend system against enemies Defend System 0.5 0.4 Build defense

  24. Designer needs And one more thing! If the AI's planning a war against the Cravers in any case, ships should be preferred.

  25. Multiple reasons Create ships 0.2 Defend system against enemies Defend System 0.5 Build defense 0.4

  26. Multiple reasons Improve military power to attack Attack Cravers 0.7 Create ships 0.2 Defend system against enemies Defend System 0.5 Build defense 0.4

  27. Multiple reasons Improve military power to attack Attack Cravers 0.7 Create ships 0.5 Defend system against enemies Defend System 0.5 Build defense 0.4

  28. Multiple reasons Reduce upkeep 0.9 Improve military power to attack Attack Cravers 0.7 Create ships 0.5 Defend system against enemies Defend System 0.5 Build defense 0.4

  29. Multiple reasons Reduce upkeep 0.9 Improve military power to attack Attack Cravers 0.7 Create ships 0.3 Defend system against enemies Defend System 0.5 Build defense 0.4

  30. Associated tool

  31. Post-mortem • Ability to iterate before implementation • Force separation between each decision step • Improve decision debugging • Feedback decision chains • Understand decision at different granularity

  32. Tasks allocation

  33. Tasks allocation Context • Tasks in the game have costs • Can I afford this task? • Concurrence between tasks are due to shared resources Create ships 0.6 Build defense 0.3

  34. Tasks allocation Context • Tasks in the game have costs • Can I afford this task? • Concurrence between tasks are due to shared resources 100 Create ships 0.6 10 80 Build defense 0.3

  35. Tasks allocation Objectives • Use motivation to split resources • Task motivation must be independent from the cost • Each resource has its own way of being split • Handle tasks with multiple resources 100 Create ships 0.6 10 80 Build defense 0.3

  36. Tasks allocation 0/100 Create ships 0.6 0/10 0/80 Build defense 0.3

  37. Tasks allocation allocator 0/100 Stock: 100 Create ships 0.6 0/10 0/80 Build defense 0.3

  38. Tasks allocation allocator 100/100 Stock: 0 Create ships 0.6 0/10 0/80 Build defense 0.3

  39. Tasks allocation 100/100 Create ships 0.6 0/10 allocator 0/80 Stock: 0 Build defense 0.3

  40. Tasks allocation 100/100 Create ships 0.6 0/10 allocator 0/80 Stock: 0 Build defense 0.3

  41. Multiple resources 100/100 Create ships 0.6 0/10 0/80 Build defense 0.3

  42. Multiple resources 100/100 allocator Create ships 0.6 0/10 Stock: 0 0/80 Build defense 0.3

  43. Multiple resources 100/100 allocator Create ships 0.6 0/10 Stock: 0 0/80 Build defense 0.3

  44. Resource reallocation 100/100 Create ships 0.6 0/10 0/80 Build defense 0.3

  45. Resource reallocation allocator 100/100 Stock: 0 Create ships 0.6 0/10 0/80 Build defense 0.3

  46. Resource reallocation allocator 0/100 Stock: 100 Create ships 0.6 0/10 0/80 Build defense 0.3

  47. Resource reallocation 0/100 Create ships 0.6 0/10 allocator 0/80 Stock: 100 Build defense 0.3

  48. Resource reallocation 0/100 Create ships 0.6 0/10 allocator 80/80 Stock: 20 Build defense 0.3

  49. Validate tasks for execution 0/100 Create ships 0.6 0/10 80/80 Build defense 0.3

  50. Associated tool

  51. Post-mortem • Simplify the task generation by removing cost handling • Handle concurrence between tasks • Centralize allocation algorithms • Each resource behaves differently so we can allocate them differently

  52. Uses and improvements

  53. Where to integrate features Decision graph Economy Fleet management Diplomatic contracts Fleet production

  54. Where to integrate features Analysis Decision graph Diplomacy Economy relations Fleet War topology management Diplomatic Ship/Fleet contracts Design Fleet production

  55. Where to integrate features Analysis Decision graph Execution Battle Diplomacy Economy behavior relations Fleet Fleet War topology management behavior Diplomatic Ship/Fleet contracts Design Fleet production

  56. Diplomatic relation behavior mpire destroyed our explorer AND e are a military faction Prepare war Ask for Alliance In alliance Decision graph Analysis

  57. Diplomatic relation behavior mpire destroyed our explorer AND e are a military faction Increase Prepare war ship number Ask for Alliance In alliance Decision graph Analysis

  58. Diplomatic relation behavior mpire destroyed our explorer AND e are a military faction Prepare war Ask for Build alliance Alliance contract In alliance Decision graph Analysis

  59. Fleet Management A fleet is a resource for military decisions Defend empire Defend attacked system Defend system 0.6 Defend empire 0.9 Pegasus

  60. Fleet Management A fleet is a resource for military decisions Defend empire Defend attacked system Taskforce Defend system 0.6 Defend empire 0.9 Pegasus

  61. Advance tasks generation Goals can generate goals Defend empire Defend attacked system Defend system Defend empire 0.3 0.9 Pegasus

  62. Advance tasks generation Goals can generate goals Defend empire Defend attacked system Defend constellation Defend system Defend Defend empire 0.5 0.9 0.3 Pegasus constellation

  63. Advance tasks generation Tasks can generate tasks Defend empire Defend attacked system Defend system Taskforce Defend empire 0.3 0.9 Pegasus

  64. Advance tasks generation Tasks can generate tasks pire Defend attacked system Defend system Taskforce Defend empire 0.3 0.9 Escort defense Taskforce Pegasus 0.2 fleet Assist

  65. Advance tasks generation Link tasks with an allocation rule Build wonder 1000 Build unique wonder 0.3 on Pegasus Build wonder 1000 Build unique wonder 0.6 on Andromeda

  66. Advance tasks generation Link tasks with an allocation rule Build wonder 1000 Build unique wonder 0.3 on Pegasus Only one in empire Build wonder 1000 Build unique wonder 0.6 on Andromeda

  67. Advance tasks generation Link tasks with an allocation rule Build wonder 1000 Build unique wonder 0.3 on Pegasus Only one in empire Build wonder 1000 Build unique wonder 0.6 on Andromeda

  68. Advance tasks generation Link tasks with an allocation rule Build wonder 1000 Build unique wonder 0.3 on Pegasus Only one in empire Build wonder 1000 Build unique wonder 0.6 on Andromeda

  69. Multiple Personalities We have 8 different factions.

  70. Multiple Personalities And we want to add some flashy, new, exotic gameplay!

Recommend

DECISION MAKING readysetpresent.com Decision Making Program Objectives ( 1 of 2 ) To examine

DECISION MAKING readysetpresent.com Decision Making Program Objectives ( 1 of 2 ) To examine

DECISION MAKING readysetpresent.com Decision Making Program Objectives ( 1 of 2 ) To examine different decision making models. To maximize creativity and logic in decision making. To acquire decision making tips and techniques that

2.35k views • 175 slides
MI MI and Shared MI MI and Shared and Shared Decision Making and Shared Decision Making

MI MI and Shared MI MI and Shared and Shared Decision Making and Shared Decision Making

The project PRECIOUS has received funding from the European Union s Seventh Framework Programme under Grant Agreement n 611366" MI MI and Shared MI MI and Shared and Shared Decision Making and Shared Decision Making Decision Making

412 views • 20 slides
Decision Making 1 Decision Making Skills Establishing a positive decision-making environment.

Decision Making 1 Decision Making Skills Establishing a positive decision-making environment.

Decision Making 1 Decision Making Skills Establishing a positive decision-making environment. Generating potential solutions. Evaluating the solutions. Deciding. How did you score? Checking the decision. Communicating and

938 views • 50 slides
$ Lesson One Making Decisions 04/09 the decision-making process The decision-making process

$ Lesson One Making Decisions 04/09 the decision-making process The decision-making process

Presentation Slides $ Lesson One Making Decisions 04/09 the decision-making process The decision-making process Identify the problem Gather information and list possible alternatives Consider consequences of each

314 views • 7 slides
6 Decision- -Making Making MVC (revisited) 6 Decision MVC (revisited) decision

6 Decision- -Making Making MVC (revisited) 6 Decision MVC (revisited) decision

6 Decision- -Making Making MVC (revisited) 6 Decision MVC (revisited) decision decision - - m m a a king and games king and games model state instance core structures levels of decision levels of decision- -making

148 views • 4 slides
A Shared Space: Fostering Parent Engagement in Education Decision Making

A Shared Space: Fostering Parent Engagement in Education Decision Making

A Shared Space: Fostering Parent Engagement in Education Decision Making https://www.portlandempowered.org/ Supporting this work Portland, Maine Population 66,300 21% residents in poverty Portland Schools 6,800 students 66 Languages Spoken

391 views • 12 slides
S C DECISION E N C E decision science SDS CMU What is Decision Science? Behavioral

S C DECISION E N C E decision science SDS CMU What is Decision Science? Behavioral

S C DECISION E N C E decision science SDS CMU What is Decision Science? Behavioral and analytical approaches to understanding decision making Understand and improve human decision making Based in Psychology + integrates

571 views • 10 slides
My Research Background General problems that I am interested: decision making under

My Research Background General problems that I am interested: decision making under

My Research Background General problems that I am interested: decision making under uncertainty - resilient infrastructure planning/design; traffic management/operation in stochastic a network data acquisition, integration, and

271 views • 3 slides
Shared Decision Making Workgroup January 25 th , 2019 Agenda Welcome and Introductions

Shared Decision Making Workgroup January 25 th , 2019 Agenda Welcome and Introductions

Shared Decision Making Workgroup January 25 th , 2019 Agenda Welcome and Introductions Bree Collaborative Overview Background Past Work Implementation Open Public Meetings Act Review Previous Shared Decision Making

272 views • 25 slides
STUDIO V G A P s h e d GAP SHED 1 GOOD AGRICULTURAL PRACTICES OVERVIEW 2 SPACE PLANNING

STUDIO V G A P s h e d GAP SHED 1 GOOD AGRICULTURAL PRACTICES OVERVIEW 2 SPACE PLANNING

STUDIO V G A P s h e d GAP SHED 1 GOOD AGRICULTURAL PRACTICES OVERVIEW 2 SPACE PLANNING 3 MATERIALS 4 CLEANING 5 COOLING 6 ENERGY & WATER STUDIO V GAP SHED 7 MOBILE AND MODULAR DESIGN STUDIO V G A P s h e d GAP SHED 1

508 views • 39 slides
Decision Making 1 Think ( Decision Making , Problem Solving, Trouble-shooting, ...) Attend

Decision Making 1 Think ( Decision Making , Problem Solving, Trouble-shooting, ...) Attend

IE 545, Human Factors Engineering Decision Making 1 Think ( Decision Making , Problem Solving, Trouble-shooting, ...) Attend Remember Observe Think Act calculate decide solve develop alternatives choose alternative responses stimuli

751 views • 29 slides
Decision Making 1 Think ( Decision Making , Problem Solving, Trouble-shooting, ...) Attend

Decision Making 1 Think ( Decision Making , Problem Solving, Trouble-shooting, ...) Attend

IE 545, Human Factors Engineering Decision Making 1 Think ( Decision Making , Problem Solving, Trouble-shooting, ...) Attend Remember Observe Think Act calculate decide solve develop alternatives choose alternative responses stimuli

526 views • 30 slides
CORTEX FOR DECISION MAKING Sandrine Duverne Paris, Dec 02, 2019 Decision making A SERIES OF

CORTEX FOR DECISION MAKING Sandrine Duverne Paris, Dec 02, 2019 Decision making A SERIES OF

Master of Integrative Biology Neuroscience Specialization UE 5NB04 INFORMATION PROCESSING IN THE PREFRONTAL CORTEX FOR DECISION MAKING Sandrine Duverne Paris, Dec 02, 2019 Decision making A SERIES OF INTERWEAVED CHOICES IN EVER-CHANGING

1.13k views • 61 slides
Decision Making Under Decision Making . . . General Set Uncertainty: Proof of This Result

Decision Making Under Decision Making . . . General Set Uncertainty: Proof of This Result

Need for Decision . . . From Interval to Set . . . Additivity: the Main . . . Decision Making . . . Decision Making Under Decision Making . . . General Set Uncertainty: Proof of This Result Remaining Problem Additivity Approach Main Result

519 views • 22 slides
Decision Making Under Uncertainty Making Decisions Under Uncertainty AI C LASS 10 (C H .

Decision Making Under Uncertainty Making Decisions Under Uncertainty AI C LASS 10 (C H .

Todays Class Decision Making Under Uncertainty Making Decisions Under Uncertainty AI C LASS 10 (C H . 15.1-15.2.1, 16.1-16.3) Tracking Uncertainty over Time Decision Making under Uncertainty sensors Decision Theory ?

229 views • 8 slides
Endless LLP Access to Finance Event Richard Harrison 18 January 2017 1 Introduction to Endless

Endless LLP Access to Finance Event Richard Harrison 18 January 2017 1 Introduction to Endless

Endless LLP Access to Finance Event Richard Harrison 18 January 2017 1 Introduction to Endless 1 A TRANSFORMATIONAL INVESTOR Endless LLP is a UK based private equity investor with one distinct goal: to make business better for everybody.

652 views • 17 slides
Decision-making and implementation Tuesday 2 May 2017 Kimberly Crawford Sustainability

Decision-making and implementation Tuesday 2 May 2017 Kimberly Crawford Sustainability

Decision-making and implementation Tuesday 2 May 2017 Kimberly Crawford Sustainability Engagement Coordinator Agenda Decision-making for sustainability (Christine Byrne) 1 Decision-making tools for strata (Dr Hazel Easthope ) 2 Facilitating

176 views • 16 slides
Decision making A decision is an intention to use/not to use a factor at a given level:

Decision making A decision is an intention to use/not to use a factor at a given level:

Decision making A decision is an intention to use/not to use a factor at a given level: Use 4 kg of concentrates per cow Cull cow no. 678 Call for the vet! Build a new barn. 1 Necessary information When a decision is made

474 views • 13 slides
Decision Making Under Uncertainty 14.123 Microeconomic Theory III Muhamet Yildiz Decision

Decision Making Under Uncertainty 14.123 Microeconomic Theory III Muhamet Yildiz Decision

2/11/2014 Decision Making Under Uncertainty 14.123 Microeconomic Theory III Muhamet Yildiz Decision Making Under Risk Summary C = Finite set of consequences X = P = lotteries (prob. distributions on C ) Expected Utility

197 views • 8 slides
Decision Making in IT Ventures March 25 th , 2014 Vittoria Aiello, MBA, IT 496 Instructor

Decision Making in IT Ventures March 25 th , 2014 Vittoria Aiello, MBA, IT 496 Instructor

Decision Making in IT Ventures March 25 th , 2014 Vittoria Aiello, MBA, IT 496 Instructor Laboratory for IT Entrepreneurship Transforming IT ideas into ventures Agenda Definition of Decision Making Key steps in the Decision Making Process

545 views • 29 slides
Moving in a New Direction Subjective Decision-Making Objective Decision-Making Lack of

Moving in a New Direction Subjective Decision-Making Objective Decision-Making Lack of

1/24/2017 An Evidence-Based Decision- Making Platform: Fairness and Equity in the Juvenile Justice System Shay Bilchik, J.D. Research Professor/Center Director Center for Juvenile Justice Reform Georgetown McCourt School of Public Policy

322 views • 10 slides
Agenda Conservatorship is a legal process, wherein: The Court appoints an individual or an

Agenda Conservatorship is a legal process, wherein: The Court appoints an individual or an

Supported Decision Supported Decision- -Making Making Supported Decision Supported Decision - - Making Making Civil Liberties Civil Liberties Civil Liberties Civil Liberties 1) The Problem with Conservatorships & & &

529 views • 5 slides
AIXI: Universal Optimal Sequential Decision Making Marcus Hutter (2005) Reinforcement Learning

AIXI: Universal Optimal Sequential Decision Making Marcus Hutter (2005) Reinforcement Learning

AIXI: Universal Optimal Sequential Decision Making Marcus Hutter (2005) Reinforcement Learning State space , Action space , Policy , Reward (, ) Goal: Find policy which maximizes expected cumulative reward.

552 views • 27 slides
Module 9 LAO* CS 886 Sequential Decision Making and Reinforcement Learning University of

Module 9 LAO* CS 886 Sequential Decision Making and Reinforcement Learning University of

Module 9 LAO* CS 886 Sequential Decision Making and Reinforcement Learning University of Waterloo Large State Space Value Iteration, Policy Iteration and Linear Programming Complexity at least quadratic in || Problem: ||

128 views • 11 slides

More recommend