Author |
Topic: bots are hard to beat (Read 3516 times) |
|
ocmiente
Forum Guru
Arimaa player #3996
Gender: 
Posts: 194
|
 |
bots are hard to beat
« on: Feb 3rd, 2012, 1:22pm » |
 Quote  Modify
|
I've been playing Arimaa for almost three years now. My game room rating is currently over 2000. So, I feel somewhat qualified to write what follows.
Shortly after I started playing, in March of 2009, I gave up playing for 4 or 5 months because I just wasn't making progress learning new Arimaa strategies, and I wasn't inclined to ask anyone for help. It wasn't until Fritzlein's book came out that I was able to enjoy playing the game.
Even with the new knowledge of camel hostages, horse frames, elephant horse attacks, and the like, I would still get thrashed by bots from time to time. In fact, I still get thrashed by bots on a regular basis.
I think that there are many strong bots on the Arimaa site, and if it seems difficult to beat a particular bot, that's not surprising. Most people on the planet would probably have a hard time beating most of the bots in the Arimaa game room.
The reason I am posting this is because this thought has been stewing in my mind for a while: I found it a little frustrating at times when reading some post that a particular bot was brain dead (I'm exaggerating a little - but not much) while I was struggling to beat that particular bot more than 50% of the time. Bomb, in particular, is the one that bugged me for the longest time. If you are a new player, you should expect to be beaten by bots... a lot! There are few prodigies who can zip through the ladder, but those are few and far between. It may take 2 or more years before you can regularly beat all of the bots in the game room - and it may take longer than that since the bots are getting better.
What has kept me coming back for more beatings is that I have been able to see continual progress in my ability to play over the past couple of years, and it looks like I have at least a couple more years worth of things I can get better at.
|
|
 IP Logged |
|
|
|
Fritzlein
Forum Guru
Arimaa player #706
Gender:
Posts: 5928
|
|
Re: bots are hard to beat
« Reply #1 on: Feb 3rd, 2012, 3:51pm » |
Quote Modify
|
As a math student, I perpetually have a similar problem. Many things in math have an almost vertical learning curve, which is to say they are completely opaque and mysterious up until the point that you see what is happening, and thereafter they are trivially obvious. It is disheartening when someone who gets X says how easy X is when you are on the outside looking in, understanding nothing.
There is a real problem with language, because we need a way to distinguish between things that are obvious once you see them, and things that are still tricky and difficult after you have gotten the gist of them. (There are some of the latter in math too!) Unfortunately, we re-use the same words for that distinction that we also use to distinguish things that are difficult to gain an understanding of in the first place.
When I say a bot is brain-dead, I mean that there is something it doesn't get that is obvious to me. The bot seems even dumber because it never catches on. It will lose every game the same way. How can it never, ever see something that is so clear and so simple? But that doesn't mean it was easy for me to come by the strategic knowledge that is now second nature to me.
Relating this to the Arimaa Challenge, I won't be able to defend it for too many more years unless I learn some more of these "obvious" signposts. If I am trying to outduel a bot at something "hard", I will make more mistakes than the bot. My only hope of winning is to have understood something that bot doesn't understand at all, i.e. for my future self to think that the bot is brain-dead in some way, even if right now I can't beat that bot without a mighty struggle.
I sympathize with your frustration about bots being hard to beat in reality when so much of our talk is about how easy they are to beat. On the other hand, there are many bots you can now beat without breaking a sweat. It would just feel wrong if you were to go on about how tough it is to beat ShallowBlue. That sort of language would be just as misplaced, and would prompt someone else to open a thread entitled, "Bots are easy to beat!"
The difficulty is that the hard/easy distinction doesn't get us any closer to the gist of the matter. For me the fun of a game is in the strategic learning, and strategic learning is by its nature both hard and easy. It is hard to acquire, and it is easy to use once you have it. There's a song by the Indigo Girls with a lyric that I like: "The hardest to learn was the least complicated."
|
|
IP Logged |
|
|
|
SpeedRazor
Forum Guru
Skepticism is the Immune System of Science
Gender:
Posts: 72
|
|
Re: bots are hard to beat
« Reply #2 on: Feb 4th, 2012, 1:36am » |
Quote Modify
|
Wow, I really like this thread.
It's like searching for a door on an opaque wall, with little to no clues. Once you find it, and cross over, it's now mundanely easy for you. You now are the holder of the Hallowed Arcane Knowledge.
How often in history has this happened? Maybe by perspiration/inspiration; some weird intuition that even you don't understand; or just blind serendipity?
Mr. Firestone accidentally dropping latex into warm sulfuric acid? (Volcanized rubber) Albert Hoffman getting a tiny drop of a liquid - he surmises - from a weird ergot fungus on his skin? (LSD-25) [...] ...
You're right Ocmiente/Fritzlein, there needs to be terms for this. Does anybody have any ideas what, though? It should be catchy enough to become a meme, or it won't be fit to survive.
|
| « Last Edit: Feb 4th, 2012, 3:26am by SpeedRazor » |
IP Logged |
|
|
|
clyring
Forum Guru
Arimaa player #6218
Gender: 
Posts: 362
|
|
Re: bots are hard to beat
« Reply #3 on: Feb 4th, 2012, 7:12am » |
Quote Modify
|
I feel that I have found the door for the majority of bots, but that I trip and fall going through it due to bad tactics... =S
|
|
IP Logged |
I administer the Endless Endgame Event (EEE). Players welcome!
|
|
|
Fritzlein
Forum Guru
Arimaa player #706
Gender:
Posts: 5928
|
|
Re: bots are hard to beat
« Reply #4 on: Feb 4th, 2012, 8:11am » |
Quote Modify
|
on Feb 4th, 2012, 7:12am, clyring wrote:| I feel that I have found the door for the majority of bots, but that I trip and fall going through it due to bad tactics... =S |
|
Good tactics (at least for humans) also rely on simplifying principles. It's not like we can practice up until we learn to examine a millions options per second. Top players examine the same number of positions per second, but they have a good intuition as to which are the important ones that must be checked.
There is still a distinction between tactics and strategy, but both of them are made human-tractable by guiding principles that aren't immediately obvious.
|
|
IP Logged |
|
|
|
ocmiente
Forum Guru
Arimaa player #3996
Gender:
Posts: 194
|
|
Re: bots are hard to beat
« Reply #5 on: Feb 6th, 2012, 11:27am » |
Quote Modify
|
This past weekend, bot_marwin was rated as the top player by its game room rating. Does anyone know the last time a bot was at the top of that list?
|
|
IP Logged |
|
|
|
Fritzlein
Forum Guru
Arimaa player #706
Gender:
Posts: 5928
|
|
Re: bots are hard to beat
« Reply #6 on: Feb 7th, 2012, 8:57am » |
Quote Modify
|
on Feb 6th, 2012, 11:27am, ocmiente wrote:This past weekend, bot_marwin was rated as the top player by its game room rating. Does anyone know the last time a bot was at the top of that list?
|
|
Judging from this graph, I'd say that a bot last topped the game room rating list in January of 2004, i.e. eight years ago, as discussed in this forum thread. After I joined arimaa.com in July 2004, I became one of the bot-bashers, i.e. people who inflate their ratings by beating bots over and over. I gave up that project some years ago when it became boring, but others carried the torch. Until recently the list was topped by a human bot-basher rated about 2700. I believe humans drop off the list if they are inactive for over a year; otherwise a human would still top the list.
Perhaps if I get the time, I will try to get a 2800 gameroom rating. It certainly wouldn't be boring at first, as the bots have caught up to me substantially in recent years, but (assuming that I was able to recapture some semblance of dominance) it would probably get boring before I managed to set a new human gameroom rating record. Presumably it would only stay interesting if I am no longer reliably able to defend the Arimaa Challenge. 
|
| « Last Edit: Feb 7th, 2012, 10:18am by Fritzlein » |
IP Logged |
|
|
|
SpeedRazor
Forum Guru
Skepticism is the Immune System of Science
Gender:
Posts: 72
|
|
Re: bots are hard to beat
« Reply #7 on: Feb 7th, 2012, 6:13pm » |
Quote Modify
|
This is probably the wrong place to pose this question, but Ocmiente's last post got me thinking. What if the greatest Arimaa player is a human - massively better than anything else: higher rating (2800²) ... Bobby Fischer in '70, etc.
(S)He wins his/her part of the Arimaa Challenge - of course, but the next two wet-ware players, playing their hearts out, lose to the silicon beast. Software beats human 2:1. A clear victory. But everybody knows that the greatest Arimaa player in the world is a human.
Please tell me that I'm wrong all these years, but doesn't the programmer only need to win two out of three? Even if the undeniable greatest Arimaa player is a still a Human?
|
|
IP Logged |
|
|
|
rbarreira
Forum Guru
Arimaa player #1621
Gender:
Posts: 605
|
|
Re: bots are hard to beat
« Reply #8 on: Feb 7th, 2012, 6:17pm » |
Quote Modify
|
on Feb 7th, 2012, 6:13pm, SpeedRazor wrote:This is probably the wrong place to pose this question, but Ocmiente's last post got me thinking. What if the greatest Arimaa player is a human - massively better than anything else: higher rating (2800²) ... Bobby Fischer in '70, etc.
(S)He wins his/her part of the Arimaa Challenge - of course, but the next two wet-ware players, playing their hearts out, lose to the silicon beast. Software beats human 2:1. A clear victory. But everybody knows that the greatest Arimaa player in the world is a human.
Please tell me that I'm wrong all these years, but doesn't the programmer only need to win two out of three? Even if the undeniable greatest Arimaa player is a still a Human? |
|
The bot needs to win 2 out of 3 games against each human in order to win the challenge.
|
|
IP Logged |
|
|
|
SpeedRazor
Forum Guru
Skepticism is the Immune System of Science
Gender:
Posts: 72
|
|
Re: bots are hard to beat
« Reply #9 on: Feb 7th, 2012, 6:18pm » |
Quote Modify
|
Thnx  Cool
Then, maybe, the humans have a few more years yet. No way it's going to 2020, though...
|
| « Last Edit: Feb 7th, 2012, 6:26pm by SpeedRazor » |
IP Logged |
|
|
|
Fritzlein
Forum Guru
Arimaa player #706
Gender:
Posts: 5928
|
|
Re: bots are hard to beat
« Reply #10 on: Feb 9th, 2012, 9:15am » |
Quote Modify
|
on Feb 7th, 2012, 8:57am, Fritzlein wrote:| Until recently the list was topped by a human bot-basher rated about 2700. I believe humans drop off the list if they are inactive for over a year; otherwise a human would still top the list. |
|
My memory was off. iteY only broke 2600; it was Arimanator who topped 2700. Both of them retired on top and were only removed later due to inactivity or else they would still be the top two, as no bots have ever reached that level even temporarily. Here are the top peak gameroom ratings:
2715 Arimanator
2646 chessandgo
2619 iteY
2540 syed
2529 Fritzlein
Unless you believe that the entire rating system has deflated by a couple hundred points (and I don't), the appearance of a bot at the top of the ratings list must be related to the sport of botbashing going out of style. Of course I realize the bots are getting stronger too, yadda yadda.
|
| « Last Edit: Feb 9th, 2012, 9:20am by Fritzlein » |
IP Logged |
|
|
|
ocmiente
Forum Guru
Arimaa player #3996
Gender:
Posts: 194
|
|
Re: bots are hard to beat
« Reply #11 on: Feb 9th, 2012, 1:14pm » |
Quote Modify
|
I suggest that someone with a bot start bot bashing other bots, to show that bots are better at bot bashing than humans. Hopefully, this would stop people from running bait and tackle against bomb just to get a high number in the game room.
I'm pretty sure that bots are better at the particular repetitive task of bot bashing than humans are. I just don't think anyone's tried it to the degree necessary to get to the top for good.
On second thought, I hope nobody takes this seriously. It's silly enough that people do it. It would be even more silly if bits did it.
|
| « Last Edit: Feb 9th, 2012, 2:46pm by ocmiente » |
IP Logged |
|
|
|
Fritzlein
Forum Guru
Arimaa player #706
Gender:
Posts: 5928
|
|
Re: bots are hard to beat
« Reply #12 on: Feb 9th, 2012, 3:33pm » |
Quote Modify
|
on Feb 9th, 2012, 1:14pm, ocmiente wrote:| On second thought, I hope nobody takes this seriously. It's silly enough that people do it. It would be even more silly if bits did it. |
|
Let me suggest that the reason bots are so high the gameroom rating list is essentially that they have already engaged in bot-bashing. They all beat inferior bots repetitively. Yes, they were required to do so as part of qualifying for the Computer Championship, but the official sanction for bots bashing bots doesn't mean their current ratings are any more accurate than mine would be if I engaged in a round of bot-bashing. What do you think would happen to my rating if I went through the qualifying that the top bots just did? Do you think my rating would remain about the same, because I am approximately accurately rated relative to the six qualifying bots? Or maybe I would go down?
If there is something silly going on, it may be the extent to which you are taking it as a significant indicator that a bot topped the gameroom rating list, even though you are wise enough to dismiss the gameroom ratings of human bot bashers.
|
| « Last Edit: Feb 9th, 2012, 3:53pm by Fritzlein » |
IP Logged |
|
|
|
hyperpape
Forum Guru
Arimaa player #7113
Gender:
Posts: 80
|
|
Re: bots are hard to beat
« Reply #13 on: Feb 9th, 2012, 4:23pm » |
Quote Modify
|
It seems like the natural thing to do is compute some bot ratings excluding the BvB games.
|
|
IP Logged |
|
|
|
ocmiente
Forum Guru
Arimaa player #3996
Gender:
Posts: 194
|
|
Re: bots are hard to beat
« Reply #14 on: Feb 9th, 2012, 5:08pm » |
Quote Modify
|
I don't think that would solve the problem of the game room ratings being inaccurate. If you were to do that, you should probably eliminate all of the bait and tackle games against bomb that humans have played - or just declare bomb to be so broken that no rating is possible. But what's the point? The game room ratings are only a rough indicator anyway.
And sorry for using the term 'silly'. That was probably too harsh. If someone gets joy out of seeing a high game room rating, then I'm happy for them.
After looking at bot_marwin's recent games, it appears that it was involved in some kind of bot bashing, even if it was unintentional. It won several games against an earlier version of itself. If marwin were a person, I would think there was something odd about beating up a younger version of itself.
|
|
IP Logged |
|
|
|
|
Home
Help
Search
Members
Login
Register
Reply
Notify of replies
Send Topic
Print