Arimaa Forum - Print Page


    
      
        Arimaa Forum
        (http://arimaa.com/arimaa/forum/cgi/YaBB.cgi)
      

        Arimaa >> Bot Development >> Best practices for testing Bots
        
(Message started by: TheVinenator on Oct 20^th, 2011, 9:52am)

Title: Best practices for testing Bots
Post by TheVinenator on Oct 20^th, 2011, 9:52am

hi,

I'm developing a bot and I want to test the interface. the bot doesn't generate move (correctly) yet, but i want to test other aspects of the program too.

is there a test realm where "mistakes" can be made that won't annoy everybody else?

what is the best practice here.

thanks

vince

Title: Re: Best practices for testing Bots
Post by rbarreira on Oct 20^th, 2011, 10:57am

As long as you're not playing dozens of games per hour for a long period I don't think anyone will be bothered if your bot plays some stupid games with illegal moves etc.

In early development my bot did have its fair share of timeouts due to crashes, illegal moves etc.

Title: Re: Best practices for testing Bots
Post by Fritzlein on Oct 20^th, 2011, 12:43pm

People who analyze the game database usually exclude unrated games, so if you play unrated, you won't be bugging anyone. But also analysis often only uses games where both players are rated above a certain level, say 1800, so playing lame games against ArimaaScoreP1 probably won't bug anyone even if they are rated.

Title: Re: Best practices for testing Bots
Post by TheVinenator on Oct 25^th, 2011, 2:25pm

is there a python script that emulates a AEI server and plays out games? even random moves would be good.

does someone have one?

i test now by entering commands into the program's console window, but automating that would be helpful.

Title: Re: Best practices for testing Bots
Post by rbarreira on Oct 25^th, 2011, 2:31pm

There is the roundrobin.py script included in the AEI distribution. And there's this:

http://arimaa.com/arimaa/forum/cgi/YaBB.cgi?board=devTalk;action=display;num=1266712867;start=12#12