Arimaa Forum - Print Page


    
      
        Arimaa Forum
        (http://arimaa.com/arimaa/forum/cgi/YaBB.cgi)
      

        Arimaa >> Off Topic Discussion >> Article on neural-net poker AI
        
(Message started by: half_integer on Oct 24^th, 2013, 7:00pm)

Title: Article on neural-net poker AI
Post by half_integer on Oct 24^th, 2013, 7:00pm

I found the following article today and thought it would be of interest to many of those interested in Arimaa AI as well.

http://www.nytimes.com/2013/09/08/magazine/poker-computer.html

Title: http://www.bkgm.Re: Article on neural-net poker AI
Post by dht on Oct 28^th, 2013, 7:50am

Quote:

He started with backgammon, though. While a student at the University of Oslo, where he concentrated on computer science, he developed a penchant for the game. He once made it to the finals of the Norwegian National Backgammon Championships. “One thing I learned from backgammon is how to handle losses, no matter how well I play,” he says. “It is not a good game for sore losers.”

Rather than be sore, he used computers to improve his play. Dahl created a neural net that predicted the probability of winning a backgammon match from each position on the board, at every possible stage in a game. Any individual situation is easy enough to solve, Dahl says; the challenge was determining all possible situations, giving value to the importance of each one and choosing a play. “The program needed to self-train and discover these strategies itself,” Dahl says.

That's jellyfish... I think it uses TD-Lambda? :)

http://www.edcollins.com/backgammon/technology.htm <--- Background

http://www.bkgm.com/articles/page07.html <--- Lots of useful stuff here

The daddy of all neural network backgammon playing things was TD-Gammon

http://www.scholarpedia.org/article/User:Gerald_Tesauro/Proposed/Td-gammon

http://www.bkgm.com/articles/tesauro/tdl.html

And random links of ancient stuff since I'm link dumping anyway

http://www.bkgm.com/articles/Berliner/BackgammonProgramBeatsWorldChamp/index.html <--- From 1980

http://minnie.tuhs.org/cgi-bin/utree.pl?file=4.4BSD/usr/src/games/chess