Arimaa Forum - Print Page


    
      
        Arimaa Forum
        (http://arimaa.com/arimaa/forum/cgi/YaBB.cgi)
      

        Arimaa >> General Discussion >> Snapshot of current Arimaa theory
        
(Message started by: omar on Jan 7^th, 2007, 10:08am)

Title: Snapshot of current Arimaa theory
Post by omar on Jan 7^th, 2007, 10:08am

It would be interesting for someone in the future to glance back and see what the early players knew about Arimaa. This could potentially be learned by looking at the game archive, but it would probably be too tedious. It would also be nice to see what was written about the game.

Thus at the beginning of each year, I would like to preserve a snapshot of the content at:

http://en.wikipedia.org/wiki/Arimaa
and
http://en.wikibooks.org/wiki/Arimaa

I tried using wget to do this, but the robot.txt file on these sites disallow wget; probably because it to download too fast.

I would like to use a program that is friendly to the sites in how it does the downloads and isn't blocked. Does anyone know of such a program?

Title: Re: Snapshot of current Arimaa theory
Post by Janzert on Jan 7^th, 2007, 2:53pm

Probably easiest and what I would most likely do is just add "-e robots=off -w 2" to the wget options used.

"-e robots=off" causes wget to ignore any robots.txt and "-w 2" will place a 2 second pause in between each file retrieved so the download will be server friendly.

Janzert

Title: Re: Snapshot of current Arimaa theory
Post by omar on Jan 9^th, 2007, 8:48am

Thanks. I didn't know about the "-e robots=off" option. I'll give it a try.