Theory of Computer Games Tsan-sheng Hsu tshsu@iis.sinica.edu.tw

Theory of Computer Games Tsan-sheng Hsu tshsu@iis.sinica.edu.tw http://www.iis.sinica.edu.tw/~tshsu 1

Goal Course name: Theory of Computer Games • 十十十四四週週週年年年 !!! 四 Prerequisite: Computer Programming, Linux/Unix, C/C++, and Data Structure and Algorithms. • Enjoy playing classical board games! • Heavy programming projects! Goal: This course introduces techniques for computers to play various games which include Chinese chess and Go. Disclaimers: • NOT yet a course on game theory. • NOT yet a course on video games. • NOT yet a course on war game simulations. Web page: http://www.iis.sinica.edu.tw/ ~ tshsu/tcg/2020 TCG: Syllabus, 20200917, Tsan-sheng Hsu c � 2

About this course Time and Place: Every Thursday from 2:20pm to 5:20pm at Room 105 (NTU CSIE building). Sep 17 24 Oct 1 8 15 22 29 Nov 5 12 19 26 Dates: Dec 3 10 17 24 31 Jan 7 14 (?) 21 Format: • Lectures. • Presentations for homework projects (optional). • Invited lectures: TBA. Class materials 腦對對對局局局導導導論 • textbook: 電電電腦腦論論 , 臺臺臺大大出出出版版中中中心心心 , June 2017 ; ISBN: 978-986- 大版 350-237-1 • Class notes • Collection of papers TCG: Syllabus, 20200917, Tsan-sheng Hsu c � 3

Textbook 勘誤表 : http://www.iis.sinica.edu.tw/~tshsu/tcg/errata20191125.pdf TCG: Syllabus, 20200917, Tsan-sheng Hsu c � 4

電腦對局導論 Computers and classical board games: An Introduction 2017 年 6 月一版勘誤表 November 25, 2019 內容頁碼 / 位置修改前修改後預官退伍之後，讚昇出國到美國德州奧預官退伍之後，讚昇出國到美國德州大 p.I 序一的第二段斯汀大學深造，專攻演算法研究。學奧斯汀校區深造，專攻演算法研究。 2005 年 8 月，讚昇與我共同主辦第十屆國 2005 年 8 月，讚昇與我共同主辦第十屆國際電腦奧林匹亞大賽和 CG2005 電腦對局際電腦奧林匹亞大賽和 CG2005 電腦對局 p.I 序一的第三段國際會議，開啟 ICGA 國際電腦對局學會國際會議，開啟 ICGA 國際電腦對局學會在亞洲地區舉辨活動的新頁。在亞洲地區舉辦活動的新頁。圖目錄之 2.4 混合雙佇列實作佇列之示意混合雙佇列實作佇列之示意圖六貫棋性質證明：連接各行中的黑方棋圖目錄之 4.4 六貫棋性質證明：連接黑方棋子子圖目錄之 5.7 位在中央的騎士騎士的影響圖目錄之 5.14 栓鏈的範例栓鏈圖目錄之 5.19 欠行局例欠行斥候演算法搜尋的節點數比 Alpha-Beta 斥候搜尋時 TEST 拜訪的節點數比圖目錄之 7.4 切捨演算法拜訪的節點數多的例子 Alpha-Beta 切捨多的例子圖目錄之 7.8 斥候演算法拜訪最少的節點數的例子斥候演算法拜訪最少節點數的例子演算法目錄之 15 ′ (position p ) ′ (position p , integer depth ) 15 F 15 F ′ (position p ) ′ (position p , integer depth ) 演算法目錄之 16 16 G 16 G 演算法目錄之 17 17 F(position p ) 17 F(position p , integer depth ) ′ (position p , value alpha , value ′ (position p , value alpha , value 18 F2 18 F1 演算法目錄之 18 beta ) beta ) ′ (position p , value alpha , value ′ (position p , value alpha , value 19 G2 19 G1 演算法目錄之 19 beta ) beta ) 20 F2(position p , value alpha , value 20 F2(position p , value alpha , value 演算法目錄之 20 beta ) beta , integer depth ) 21 F2(position p , value alpha , value 21 F2(position p , value alpha , value 演算法目錄之 21 beta ) beta , integer depth ) 29 IDAS(position p , integer limit , 29 IDAS(position p , integer limit , value 演算法目錄之 29 integer threshold ) threshold ) ′ (position p , integer limit , ′ (position p , integer limit , value 30 IDAS 30 IDAS 演算法目錄之 30 integer threshold ) threshold ) TCG: Syllabus, 20200917, Tsan-sheng Hsu c � ′ (position p , value alpha , value ′ (position p , value alpha , value 5 36 F4.4 36 F4.4 演算法目錄之 36 beta , integer depth , Boolean do null ) beta , integer depth , Boolean in null ) ′ (position p , value alpha , value ′ (position p , value alpha , value 37 F4.5 37 F4.5 演算法目錄之 37 beta , integer depth , Boolean do lmr ) beta , integer depth , Boolean in lmr ) 演算法目錄之 45 45 UCT 45 MCTS

Acknowledgements Thanks to TA’s and the students of this course for providing constructive feedbacks on the slides. • Classes of 2007, 2008, 2009, 2010, 2011, 2012, 2013, 2014, 2015, 2016, 2017, 2018 and 2019. Special thanks to the following students. • Yuh-Jie Chen (class of 2008) • Jennya Chang (class of 2011) • Jessica Lin (class of 2011) TA of previous years • 陳陳陳柏柏柏年年年 • 陳陳陳冠冠冠伶伶伶 • 許許許祐祐祐程程程 • 張張紘張紘紘睿睿睿 • 樂樂樂正正正鍾詠詠詠先先先 • 鍾鍾 • 陳陳陳約約廷廷廷約 • 郭郭郭麗麗麗莎莎莎 TCG: Syllabus, 20200917, Tsan-sheng Hsu c � 6

Evaluation (1/3) Homework (30%) • One homework project about single-agent search (15%) ⊲ About single agent search, single-person project, Linux/Unix knowledge is required. ⊲ Implement different techniques learned from the class and compare the results. • One homework project about Monte-Carlo simulation (15%) ⊲ A 2-player game with a strong Monte Carlo flavor, single-person project, Linux/Unix knowledge is required. ⊲ Your program against TA’s program, and against all other students. Written exam: midterm exam (30%) TCG: Syllabus, 20200917, Tsan-sheng Hsu c � 7

Evaluation (2/3) Final project (40%) • An alpha-beta based computer game program for Chinese Dark Chess. ⊲ A sample code with GUI will be provided. ⊲ The usage of this sample code is restricted for anything related to this course only. • The 14th NTU-TCG Cup. • A whole day tournament, attendance is required!! • Submitted package: Code + documents. Class participation • Bonus for good participation • Students being recorded as not attending the classes will be penalized • More rules will be announced during the lectures TCG: Syllabus, 20200917, Tsan-sheng Hsu c � 8

Backup plans In case of unexpected circumstances due to COVID-19 or others. Possible options: • A final exam. • Off-line competition. ⊲ Code submitted and then executed by TA. ⊲ Game logs are provided. ⊲ Multiple runs. TCG: Syllabus, 20200917, Tsan-sheng Hsu c � 9

Evaluation (3/3) Presentation/Report of a research paper on game tree search. • If we have more than 16 students, then ⊲ Bonus for selected students who are obviously falling behind. If we have less than 17 students, then ⊲ This is required for each student. ⊲ This will be 10% of your score in which case the two programming homework each take 10%. • If time allows, give an in-class presentation. ⊲ Discussion before presentation. ⊲ 30-minute talk. ⊲ ≤ 30 slides in PDF format. ⊲ 10–15 minutes of Q & A. ⊲ Each student asks ≥ 1 non-trivial question. ⊲ Submit your revised set of slides one week later. • If time does not allow, submit a written report. ⊲ Pick a paper related to the course. ⊲ Write a report with at least 1000 words in PDF format. ⊲ Summary of results in the paper. ⊲ Comments about this paper, its strength, weakness and potential im- provements. TCG: Syllabus, 20200917, Tsan-sheng Hsu c � 10

Lecturing format For each topic • The first and most influential papers are introduced. • A list of recent and latest papers is provided for further readings and/or topics for presentations. TCG: Syllabus, 20200917, Tsan-sheng Hsu c � 11

Course at a glance (1/2) Introduction: an A.I. oriented overview Single-player games • Basic techniques • Advanced techniques Homework 1: October Two-player perfect information games • Survey • Introduction from Chess’s point of view • Alpha-beta and its extensions Midterm exam: November TCG: Syllabus, 20200917, Tsan-sheng Hsu c � 12

Course at a glance (2/2) Two-player perfect information games • Monte-Carlo based method Homework 2: December Practical considerations • Memorizing knowledge ⊲ Transposition tables ⊲ Endgame databases • Advanced pruning techniques • Parallelization (?) • The graph-history interaction (GHI) problem • Opponent model (?) • Timing control • Hardware enhancements (?) Conclusion Final project/Final written exam: January TCG: Syllabus, 20200917, Tsan-sheng Hsu c � 13

Introduction and an A.I. oriented overview Relations between computer games and Artificial Intelligence. • Why we study computer games? • Why we play or study games? History [SvdH02] [Sha50a] • The Turk, a chess playing “machine” at 1780’s [LN82] • The endgame playing machine at 1910’s [McC04] • C. E. Shannon (1950) [Sha50b] and A. Samuel (1960) [Sam60] Games that machines have beaten human champions [SvdH02] [Sch00] • Chess [CHH02] • Othello [Bur97] • Checker [SLLB96] • Go [SHM + 16] • · · · TCG: Syllabus, 20200917, Tsan-sheng Hsu c � 14

Theory of Computer Games Tsan-sheng Hsu tshsu@iis.sinica.edu.tw - PowerPoint PPT Presentation