General Atari 2600 Game Playing Michael Bowling Work with: Joel - PowerPoint PPT Presentation

Jan 31, 2024 •259 likes •502 views

General Atari 2600 Game Playing Michael Bowling Work with: Joel Veness, Marc Bellemare, Anna Koop, Mostafa Vafadoost http://www.arcadelearningenvironment.org Friday, September 14, 2012 Friday, September 14, 2012

General Atari 2600 Game Playing Michael Bowling Work with: Joel Veness, Marc Bellemare, Anna Koop, Mostafa Vafadoost http://www.arcadelearningenvironment.org Friday, September 14, 2012
Friday, September 14, 2012
http://www.arcadelearningenvironment.org Friday, September 14, 2012
Independent Many Varied Interesting Friday, September 14, 2012
Friday, September 14, 2012
Friday, September 14, 2012
Reinforcement Learning A.I. 0100010101...00001110101 Friday, September 14, 2012
Planning A.I. 0100010101...00001110101 Friday, September 14, 2012
Model Learning Model A.I. Friday, September 14, 2012
Imitation/Apprenticeship Learning Expert A.I. Friday, September 14, 2012
Transfer Learning A.I. Pitfall! . . . Pitfall II Friday, September 14, 2012
Intrinsic Motivation A.I. Friday, September 14, 2012
Friday, September 14, 2012
Training Testing Games Games Friday, September 14, 2012
Friday, September 14, 2012
(Bellemare et al., AAAI 2012) Contingency Awareness: knowing what you control Friday, September 14, 2012
(Bellemare et al., AAAI 2012) Contingency Awareness: knowing what you control Contingency Aware Unaware Friday, September 14, 2012
(Bellemare et al., AAAI 2012) Contingency Awareness: knowing what you control Inter-Algorithm Score Distribution 1.0 Fraction of Games Extended 0.5 Basic MaxCol Extended MaxCol 0.0 1.0 0.8 0.6 0.4 0.2 0 Inter-Algorithm Score Friday, September 14, 2012
(Bellemare et al., NIPS 2012) Sketch-Based Hashing: tug-of-war vs. standard hashing Hash Table Size: 1000 Hash Table Size: 5000 Hash Table Size: 20,000 1.0 1.0 1.0 Tug-of-War Tug-of-War Fraction of games Fraction of games Fraction of games Standard 0.5 0.5 0.5 Standard Tug-of-War Standard 0.0 0.0 0.0 1.0 0.8 0.6 0.4 0.2 0 1.0 0.8 0.6 0.4 0.2 0 1.0 0.8 0.6 0.4 0.2 0 Inter-algorithm score Inter-algorithm score Inter-algorithm score 55 Testing Games Friday, September 14, 2012
(Bellemare et al., In Prep) Model Learning: pixels, probabilities, and priors Friday, September 14, 2012
(Bellemare et al., In Prep) Model Learning: pixels, probabilities, and priors Friday, September 14, 2012
Questions? http://www.arcadelearningenvironment.org Source code for ALE and all agents available! Friday, September 14, 2012
Friday, September 14, 2012
Will there be a competition? No vs. Friday, September 14, 2012

Recommend

Remember these? Playing Atari Games using RL VARSHA LALWANI AKSHAY MASARE Motivation May be we

Remember these? Playing Atari Games using RL VARSHA LALWANI AKSHAY MASARE Motivation May be we can design game players for each one of them! But, how about an AI agent who can learn to play them all ! This is where the concept of a general game

491 views • 11 slides

KR-Techniques for General Game Playing Michael Thielscher Roadmap 1. General Game Playing a

KR-Techniques for General Game Playing Michael Thielscher Roadmap 1. General Game Playing a Grand AI Challenge 2. KR-Aspects Formalizing game rules: Compact representations of state machines Challenge I: Mapping game descriptions to

651 views • 62 slides

Inductive general game playing Andrew Cropper, Richard Evans, and Mark Law General game playing

Inductive general game playing Andrew Cropper, Richard Evans, and Mark Law General game playing competition Game description language initial game state legal moves how moves update the game state how the game terminates Game

610 views • 33 slides

Game Playing Game playing AI Class 8 Ch. 5.1-5.3, 5.4.1, 5.5 State of the art and

Todays Class Game Playing Game playing AI Class 8 Ch. 5.1-5.3, 5.4.1, 5.5 State of the art and resources Framework Weve seen multi-agent Game trees systems, and search problems Minimax where another agents moved

234 views • 6 slides

1-bit Audio and the Arduino David J. Zielinski Overview 1. Terminology of Sound 2. Atari 2600

1-bit Audio and the Arduino David J. Zielinski Overview 1. Terminology of Sound 2. Atari 2600 a. clock division frequencies b. linear feedback shift registers 3. Arduino Uno a. Specifications b. Audio Generation Methods c. Code Examples

816 views • 47 slides

General Game Playing HANNES BERGENFALK Why u Dream of AI research is strong general intelligence

General Game Playing HANNES BERGENFALK Why u Dream of AI research is strong general intelligence u Systems like Deep Blue and Alpha go are amazing but they can only do one thing. u General Game Playing systems will still not be general

346 views • 12 slides

Inductive general game playing Andrew Cropper, Richard Evans, and Mark Law Learning game rules

Inductive general game playing Andrew Cropper, Richard Evans, and Mark Law Learning game rules Andrew Cropper, Richard Evans, and Mark Law General game playing competition Game description language initial game state legal moves

833 views • 35 slides

Set 4: Game-Playing ICS 271 Fall 2016 Kalev Kask Overview Computer programs that play

Set 4: Game-Playing ICS 271 Fall 2016 Kalev Kask Overview Computer programs that play 2-player games game-playing as search with the complication of an opponent General principles of game-playing and search game tree

1.02k views • 77 slides

General Game Playing in AI Research and Education Michael Thielscher GGP in AI Research &

General Game Playing in AI Research and Education Michael Thielscher GGP in AI Research & Education What is General Game Playing (GGP)? The Many Facets of GGP Research The Potential for GGP in AI Teaching General Game Playing

1.06k views • 60 slides

Chenhao Tan 1 Can machines think? (Turing, 1950) 2 3 4 Atari game (Bonus: try Google

Chenhao Tan 1 Can machines think? (Turing, 1950) 2 3 4 Atari game (Bonus: try Google image search atari breakout) 5 Minh et al. 2013 https://www.youtube.com/watch?v=V1e YniJ0Rnk 6 Ghazvininejad, Shi, Choi, and

348 views • 34 slides

Game Playing Tail end of Constraint Satisfaction Ch. 5.1-5.3, 5.4.1, 5.5 Questions Game

On to Games Game Playing Tail end of Constraint Satisfaction Ch. 5.1-5.3, 5.4.1, 5.5 Questions Game playing from reading? Framework Game trees Weve seen search problems Minimax where other agents moves Alpha-beta

227 views • 7 slides

Inductive general game playing Andrew Cropper, Richard Evans, and Mark Law Inverse general game

Inductive general game playing Andrew Cropper, Richard Evans, and Mark Law Inverse general game playing Andrew Cropper, Richard Evans, and Mark Law Inducing game rules Andrew Cropper, Richard Evans, and Mark Law General game playing

538 views • 30 slides

Evolving Game Playing Evolving Game Playing Strategies (4.4.3) Strategies (4.4.3) Darren

Evolving Game Playing Evolving Game Playing Strategies (4.4.3) Strategies (4.4.3) Darren Gerling Jason Gerling Jared Hopf Colleen Wtorek Overview Overview 1) Introduction - Agent Based Modeling 2) Prisoners Dilemma 3) Deterministic

724 views • 48 slides

Game Playing Why do AI researchers study game playing? 1. Its a good reasoning problem, formal

Game Playing Why do AI researchers study game playing? 1. Its a good reasoning problem, formal and nontrivial. 2. Direct comparison with humans and other computer programs is easy. 1 What Kinds of Games? Mainly games of strategy with the

703 views • 42 slides

Game Playing Introduc3on One of the earliest areas in

Game Playing Introduc3on One of the earliest areas in ar3ficial intelligence is game playing. Two-person zero-sum game. Games for which

292 views • 10 slides

New Trends in General Game Playing Michael Thielscher, Dresden Chess Players The 1 st Chess

IJCAI'09 Tutorial New Trends in General Game Playing Michael Thielscher, Dresden Chess Players The 1 st Chess Computer (Turk, 18 th Century) Alan Turing & Claude Shannon (~1950) Deep-Blue Beats World Champion (1997) In the early

1.24k views • 91 slides

PLAYING ATARI WITH DEEP REINFORCEMENT LEARNING NEURAL NETWORK VISION FOR ROBOT DRIVING ARJUN

PLAYING ATARI WITH DEEP REINFORCEMENT LEARNING NEURAL NETWORK VISION FOR ROBOT DRIVING ARJUN CHANDRASEKARAN DEEP LEARNING AND PERCEPTION (ECE 6504) PLAYING ATARI WITH DEEP REINFORCEMENT LEARNING NEURAL NETWORK VISION FOR ROBOT DRIVING

1.07k views • 62 slides

Game Playing Philipp Koehn 27 February 2019 Philipp Koehn Artificial Intelligence: Game Playing

Game Playing Philipp Koehn 27 February 2019 Philipp Koehn Artificial Intelligence: Game Playing 27 February 2019 Outline 1 Games Perfect play minimax decisions pruning Resource limits and approximate evaluation

878 views • 58 slides

Adversarial Search (Game Playing) Chapter 5 Adapted from materials by Tim Finin, Marie

Artificial Intelligence Adversarial Search (Game Playing) Chapter 5 Adapted from materials by Tim Finin, Marie desJardins, and Charles R. Dyer Outline Game playing State of the art and resources Framework Game trees Minimax

426 views • 23 slides

General Game Playing Michael Thielscher, Dresden Some of the material presented in this tutorial

AAAI'08 Tutorial Chess Players General Game Playing Michael Thielscher, Dresden Some of the material presented in this tutorial originates in work by Michael Genesereth and the Stanford Logic Group. We greatly appreciate their contribution.

558 views • 38 slides

Artificial Intelligence Game Playing Continued Lecture 9 CS 444 Spring 2019 Dr. Kevin

Artificial Intelligence Game Playing Continued Lecture 9 CS 444 Spring 2019 Dr. Kevin Molloy Department of Computer Science James Madison University Outline Moving forward with game playing How to play games of chance Example

286 views • 13 slides

Game Playing Philipp Koehn 29 September 2015 Philipp Koehn Artificial Intelligence: Game

Game Playing Philipp Koehn 29 September 2015 Philipp Koehn Artificial Intelligence: Game Playing 29 September 2015 Outline 1 Games Perfect play minimax decisions pruning Resource limits and approximate evaluation

1.07k views • 58 slides

Game Playing Chapter 6 Additional references for the slides: Lugers AI book (2005). Robert

Game Playing Chapter 6 Additional references for the slides: Lugers AI book (2005). Robert Wilenskys CS188 slides: www.cs.berkeley.edu/~wilensky/cs188/lectures/index.html Tim Huangs slides for the game of Go. 1 Game playing Games

709 views • 32 slides

ATARI October 2015 7- 8 th , 2015 Summary 1. Atari today 2. Market / Products / Opportunities

ATARI October 2015 7- 8 th , 2015 Summary 1. Atari today 2. Market / Products / Opportunities 3. Organization 4. Finances October 2015 2 Atari Today 1. Atari Today October 2015 3 Atari at a Glance With an Atari is a Globally

645 views • 33 slides