Temporal difference learning for Connect6

I-Chen Wu; Hsin Ti Tsai; Hung Hsuan Lin; Yi Shan Lin; Chieh Min Chang; Ping Hung Lin

doi:10.1007/978-3-642-31866-5_11

Temporal difference learning for Connect6

I-Chen Wu^*, Hsin Ti Tsai, Hung Hsuan Lin, Yi Shan Lin, Chieh Min Chang, Ping Hung Lin

^*Corresponding author for this work

Department of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

7 Scopus citations

Abstract

In this paper, we apply temporal difference (TD) learning to Connect6, and successfully use TD(0) to improve the strength of a Connect6 program, NCTU6. The program won several computer Connect6 tournaments and also many man-machine Connect6 tournaments from 2006 to 2011. From our experiments, the best improved version of TD learning achieves about a 58% win rate against the original NCTU6 program. This paper discusses three implementation issues that improve the program. The program has a convincing performance in removing winning/losing moves via threat-space search in TD learning.

Original language	English
Title of host publication	Advances in Computer Games - 13th International Conference, ACG 2011, Revised Selected Papers
Pages	121-133
Number of pages	13
DOIs	https://doi.org/10.1007/978-3-642-31866-5_11
State	Published - 20 Aug 2012
Event	13th International Conference on Advances in Computer Games, ACG 2011 - Tilburg, Netherlands Duration: 20 Nov 2011 → 22 Nov 2011

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	7168 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	13th International Conference on Advances in Computer Games, ACG 2011
Country/Territory	Netherlands
City	Tilburg
Period	20/11/11 → 22/11/11

Access to Document

10.1007/978-3-642-31866-5_11

Cite this

Wu, I.-C., Tsai, H. T., Lin, H. H., Lin, Y. S., Chang, C. M., & Lin, P. H. (2012). Temporal difference learning for Connect6. In Advances in Computer Games - 13th International Conference, ACG 2011, Revised Selected Papers (pp. 121-133). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7168 LNCS). https://doi.org/10.1007/978-3-642-31866-5_11

@inproceedings{c18424ed4c5142068104736c834c3f75,

title = "Temporal difference learning for Connect6",

abstract = "In this paper, we apply temporal difference (TD) learning to Connect6, and successfully use TD(0) to improve the strength of a Connect6 program, NCTU6. The program won several computer Connect6 tournaments and also many man-machine Connect6 tournaments from 2006 to 2011. From our experiments, the best improved version of TD learning achieves about a 58% win rate against the original NCTU6 program. This paper discusses three implementation issues that improve the program. The program has a convincing performance in removing winning/losing moves via threat-space search in TD learning.",

author = "I-Chen Wu and Tsai, {Hsin Ti} and Lin, {Hung Hsuan} and Lin, {Yi Shan} and Chang, {Chieh Min} and Lin, {Ping Hung}",

year = "2012",

month = aug,

day = "20",

doi = "10.1007/978-3-642-31866-5_11",

language = "English",

isbn = "9783642318658",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "121--133",

booktitle = "Advances in Computer Games - 13th International Conference, ACG 2011, Revised Selected Papers",

note = "13th International Conference on Advances in Computer Games, ACG 2011 ; Conference date: 20-11-2011 Through 22-11-2011",

}

Wu, I-C, Tsai, HT, Lin, HH, Lin, YS, Chang, CM & Lin, PH 2012, Temporal difference learning for Connect6. in Advances in Computer Games - 13th International Conference, ACG 2011, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 7168 LNCS, pp. 121-133, 13th International Conference on Advances in Computer Games, ACG 2011, Tilburg, Netherlands, 20/11/11. https://doi.org/10.1007/978-3-642-31866-5_11

Temporal difference learning for Connect6. / Wu, I-Chen; Tsai, Hsin Ti; Lin, Hung Hsuan et al.
Advances in Computer Games - 13th International Conference, ACG 2011, Revised Selected Papers. 2012. p. 121-133 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7168 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Temporal difference learning for Connect6

AU - Wu, I-Chen

AU - Tsai, Hsin Ti

AU - Lin, Hung Hsuan

AU - Lin, Yi Shan

AU - Chang, Chieh Min

AU - Lin, Ping Hung

PY - 2012/8/20

Y1 - 2012/8/20

N2 - In this paper, we apply temporal difference (TD) learning to Connect6, and successfully use TD(0) to improve the strength of a Connect6 program, NCTU6. The program won several computer Connect6 tournaments and also many man-machine Connect6 tournaments from 2006 to 2011. From our experiments, the best improved version of TD learning achieves about a 58% win rate against the original NCTU6 program. This paper discusses three implementation issues that improve the program. The program has a convincing performance in removing winning/losing moves via threat-space search in TD learning.

AB - In this paper, we apply temporal difference (TD) learning to Connect6, and successfully use TD(0) to improve the strength of a Connect6 program, NCTU6. The program won several computer Connect6 tournaments and also many man-machine Connect6 tournaments from 2006 to 2011. From our experiments, the best improved version of TD learning achieves about a 58% win rate against the original NCTU6 program. This paper discusses three implementation issues that improve the program. The program has a convincing performance in removing winning/losing moves via threat-space search in TD learning.

UR - http://www.scopus.com/inward/record.url?scp=84865017988&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-31866-5_11

DO - 10.1007/978-3-642-31866-5_11

M3 - Conference contribution

AN - SCOPUS:84865017988

SN - 9783642318658

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 121

EP - 133

BT - Advances in Computer Games - 13th International Conference, ACG 2011, Revised Selected Papers

T2 - 13th International Conference on Advances in Computer Games, ACG 2011

Y2 - 20 November 2011 through 22 November 2011

ER -

Wu IC, Tsai HT, Lin HH, Lin YS, Chang CM, Lin PH. Temporal difference learning for Connect6. In Advances in Computer Games - 13th International Conference, ACG 2011, Revised Selected Papers. 2012. p. 121-133. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-642-31866-5_11

Temporal difference learning for Connect6

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this