|
||||||||
Title: Cyborg vs Human Arimaa Post by rbarreira on Apr 18th, 2012, 8:14am Cyborg = Bot-assisted human Arimaa player Has there ever been an Arimaa game involving Cyborgs? I sometimes think it would be interesting because despite the fact that my bot is much stronger than me (mainly due to tactics and overlooking responses by the bot), I can still often see that it's going in a wrong strategic direction, and I'm a weak player myself... We can see a cyborg in two different ways - a bot with someone to correct some of its strategic flaws, or a human with a tool to correct their tactics, check for blunders and avoiding blind spots. One or the other perspective would be more accurate depending on the situation (on a very tactical endgame the human might resort to simply playing the move suggested by the bot). At a live time control it might be hard to play in this way (at least until we start having neural-computer interfaces), as it requires some back and forth checking of different lines in order for the cyborg to show their power. But at a postal time control (1-7 days per move) it looks very feasible. Does anyone else think this sounds interesting? Just another random idea that has been kicking around in my head for some time... |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by Fritzlein on Apr 18th, 2012, 10:09am I am also interested in this question, because I believe chess cyborgs had some success in live "freestyle" tournaments. And hasn't computer analysis already proved fruitful for Arimaa in the postal Mob games? |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by mistre on Apr 18th, 2012, 10:12am Very interesting idea. Yes, this would definitely work best in a postal setting. I envision something like the bot supplying its top 3 move options and then the player has the option to choose one of them or choose their own move. At the end of the game, we could show the percentage of time the player chose their own move/vs a bot move and also see the choices on a move by move basis. Ideally the bot should have about an equal playing strength to the player. My hunch is that a player will decide to choose a bot move increasingly more often towards the end game. I would volunteer for such an experiment! |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by Katsunami on Apr 18th, 2012, 12:24pm on 04/18/12 at 10:09:49, Fritzlein wrote:
Yes, indeed. Even while the best chess engines play at supergrandmaster strength, the strength still improved when assisted by humans. The improvement is mostly strategic. The other way is also true. Humans improve tactically when assisted by a chess engine. The combination of a top grandmaster and a top engine is consistently stronger than either alone. It's estimated that such a combination of a 2800 ELO player assisted by a top engine will have a 3000+ rating. I don't expect it to be different for Arimaa; therefore I think rbarreira's line of thinking is correct. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by Adanac on Apr 18th, 2012, 12:57pm This article highlighted some interesting results from a cyborg chess match. Apparently knowing how to use your bot is more important than having the best bot or being the best player. http://www.collisiondetection.net/mt/archives/2010/02/why_cyborgs_are.php Lured by the substantial prize money, several groups of strong grandmasters working with several computers at the same time entered the competition. At first, the results seemed predictable. The teams of human plus machine dominated even the strongest computers. The chess machine Hydra, which is a chess-specific supercomputer like Deep Blue, was no match for a strong human player using a relatively weak laptop. Human strategic guidance combined with the tactical acuity of a computer was overwhelming. The surprise came at the conclusion of the event. The winner was revealed to be not a grandmaster with a state-of-the-art PC but a pair of amateur American chess players using three computers at the same time. Their skill at manipulating and “coaching” their computers to look very deeply into positions effectively counteracted the superior chess understanding of their grandmaster opponents and the greater computational power of other participants. Weak human + machine + better process was superior to a strong computer alone and, more remarkably, superior to a strong human + machine + inferior process. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by Katsunami on Apr 18th, 2012, 2:10pm So.... Strong player + powerful computer + optimized process = epic playing. That means that both humans and computers can still learn a lot, even in Chess. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by rbarreira on Apr 18th, 2012, 3:12pm I could be wrong, but I feel that in Arimaa even a weak player can make a good combination with a bot. I probably would not be able to avoid all of my bot's weak strategic moves, but still many of them. Would that be enough to give a strong player a hard time, I don't know... If someone wants to challenge the combination of me + my bot some time, we are available. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by Katsunami on Apr 18th, 2012, 4:51pm You saw that Briareus was able to give chessandgo a hard time on it's own, because the bot is such a great defender. I think that a combination of a strong bot such as Briarius and a human, to supplement the bot's strategic play, is already stronger than the best humans of this moment. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by hyperpape on Apr 19th, 2012, 8:51am I suspect a lot of the trick would be interface related: creating a tree of variations, figuring out which moves the bot thinks are strong resistance, being able to easily say "look deeper at this line", etc. Of course you can manually do this from logs and inputting positions as strings, but I imagine that it would be slower and more difficult than it would be with a good interface. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by rbarreira on Apr 19th, 2012, 9:16am on 04/19/12 at 08:51:53, hyperpape wrote:
So far I have found that the plan window suffices for doing this kind of analysis with the bot. The only thing I feel is missing is a way to exclude certain moves from analysis, which is useful both for finding the "second best", "third best" moves etc. and also to stop the bot from sticking to bad moves that it happens to like. If someone wanted to play a game like this against me I would definitely implement this and use it in my analysis. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by Fritzlein on Apr 19th, 2012, 10:59am on 04/19/12 at 09:16:00, rbarreira wrote:
Would you be interested in assisting briareus in our Postal Mixer game? I am curious what it would feel like, and I don't mind the hit to my WHRP if I lose. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by Dolus on Apr 19th, 2012, 11:35am We should try a Cyborg vs. The Mob game. :) One of our top players teamed up with a top bot, against the community. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by Hippo on Apr 19th, 2012, 11:48am on 04/18/12 at 08:14:17, rbarreira wrote:
Nice idea ... Tize could dominate this field. I would still concentrate on developping standalone bot. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by rbarreira on Apr 19th, 2012, 1:16pm on 04/19/12 at 10:59:28, Fritzlein wrote:
That would be a bit messy as I would have to hack the bot to let me input a move for a game, and the postal controller to avoid thinking for your game by itself. It would be error prone too, any mistake on my part and the bot would lose by illegal move. I agree it would be interesting though. Maybe we can set up a new postal game for it? I can even create an account starting with cyborg_ instead of bot_. The regular postal time control would be fine but a slightly slower one would be a bit more relaxed for me. What would you prefer? |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by Fritzlein on Apr 20th, 2012, 7:45am on 04/19/12 at 13:16:08, rbarreira wrote:
Perhaps I should wait until I demonstrate that I can handle the postal games I already have before starting anything new. At the moment I really shouldn't take on new commitments. I hope you get a chance to try out the experiment somehow, though. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by arimaa_master on Apr 20th, 2012, 8:12am on 04/19/12 at 13:16:08, rbarreira wrote:
Since Fritzlein is on his full capacity already I would be honored to play such postal game against cyborg_briareus. However only if you think that I am a decent match for such game otherwise I understand that you don´t want to waste your time. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by rbarreira on Apr 20th, 2012, 8:37am on 04/20/12 at 08:12:26, arimaa_master wrote:
That would be great. You beat briareus postally so you're definitely strong enough. And for all I know I could make briareus weaker by interfering too much :P. What time control do you prefer? I would be OK with anything from 1 day to 2 days per move. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by Adanac on Apr 20th, 2012, 8:46am on 04/20/12 at 08:37:38, rbarreira wrote:
If you want to try two games at the same time, I'll give it a try also. Two days per move is fine with me. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by rbarreira on Apr 20th, 2012, 8:50am on 04/20/12 at 08:46:37, Adanac wrote:
I'm not sure that I have the energy/time/computer time to do two games at the same time! Let me see how it goes in the beginning against arimaa_master and I'll let you know in maybe a few weeks! |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by arimaa_master on Apr 20th, 2012, 8:53am on 04/20/12 at 08:37:38, rbarreira wrote:
Thanks, two days per move would be best for me. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by rbarreira on Apr 20th, 2012, 9:09am on 04/20/12 at 08:53:50, arimaa_master wrote:
OK, I just sent the invite with time control 2d/60d/100/0/0d/21d I flipped a coin at www.random.org and it came out with you playing Gold. I had to play two games against ArimaaScoreP1 first or it wouldn't let me invite... (fortunately bot assistance was not required for those two games :P) |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by Dolus on May 1st, 2012, 10:26am Let us know the game number when it starts so we can watch. :D |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by arimaa_master on May 2nd, 2012, 6:50am on 05/01/12 at 10:26:19, Dolus wrote:
It is already started! It is move four for cyborg_briareus. Game Number 285052 |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by browni3141 on May 2nd, 2012, 9:30am This is interesting. Now I want to try too! If any bot developers have the time and find me worthy then I'd love to give it a shot. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by minderbinder on May 2nd, 2012, 10:28am Just as a question, I'm wondering if significant improvement to the "cyborg" team can be had by expanding the definition of what a cyborg can be (not that cyborgs would really need the help, since even in chess cyborgs still far outmatch everything else). The idea is that the cyborg would not only be human + bot, but human + bot + other digital tools. For example, imagine a program designed to indicate, for each region ('region' can have many definitions), which player has the most control - perhaps producing some sort of map of the board. Or a program to identify vulnerable pieces on both sides, or vulnerable traps, or possible goal routes, etc. Or maybe even just a function to identify the most important elements in a position (i.e. "goal attack in east" or "potential camel hostage" or something like that). Maybe all these functions can be handled by bots as they are - I'm not familiar enough with bot development to know for sure (I believe that most bots are an evaluation function combined with a search function - is this accurate?). I was just curious what someone with more familiarity with bot development thinks of this. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by supersamu on May 2nd, 2012, 2:47pm @rbarreira : could you also please write down on what moves you interfered with the bot and what moves the bot preferred at that time? It would also be interesting to know what your intentions were when you made another move as the one the bot proposed. This will certainly be interesting to watch. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by rbarreira on May 3rd, 2012, 7:42am on 05/02/12 at 14:47:34, supersamu wrote:
For the sake of posterity I will try to write my thoughts on at least some of the moves and perhaps a description of how I got to each move, even if many of my comments about the game turn out to be cringe/facepalm-worthy. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by rbarreira on May 3rd, 2012, 7:47am on 05/02/12 at 10:28:41, minderbinder wrote:
I suppose that for any decent cyborg team, the human would be in the best position to identify those strategic markers. I believe most bot developers would agree that making tools for identifying them with good reliability is not an easy task. To a certain extent, bots that have some strategic knowledge should help to identify such things, by providing suggestions for moves which highlight the dangers/opportunities in a position. But at the level bots are at now, the human cannot rely on the bot to always sniff out those things... |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by hyperpape on May 3rd, 2012, 11:03am Posting the link for our convenience: http://arimaa.com/arimaa/java/ys/ms4/v5/js_sit.cgi?sid=6005324419&grid=3&rand=54147169 |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by omar on May 4th, 2012, 7:16pm Interesting experiment. I've added a link to this game in the announcements. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by browni3141 on May 4th, 2012, 7:41pm on 05/04/12 at 19:16:30, omar wrote:
Check the spelling, it currently says "arimaa_mater". I suppose this is a good time to bring up the error on the game record pages http://arimaa.com/arimaa/gameroom/pastrecord.cgi?id=XXXX, the losses column says "Loses". Edit: Hey, that actually links to a real player! |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by omar on May 4th, 2012, 8:46pm Thanks, fixed it. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by browni3141 on Aug 11th, 2012, 10:36pm Since the game against arimaa_master is almost over as of 25g ;), it seems to be a good time to revive this thread. I'm very curious to know about your process and how often you overrode the bot, and how often you let it decide, or did you pretty much act as a team every move with each part giving approximately equal input? Also, I'd be honored to be the next to take the challenge if you're ready. I think I've done enough to prove myself worthy. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by rbarreira on Aug 12th, 2012, 4:57pm on 08/11/12 at 22:36:19, browni3141 wrote:
I am happy to do at least 1-2 more games like this, but I think Adanac has his turn now if he wants it, as he was the first to propose a game after arimaa_master. But after Adanac it seems you'd be next. I will paste the notes I wrote during the game in a few days after the game is over, although I ended up not writing notes for many of the moves. In the opening I interfered a lot, in some particular moves the bot was having mostly stupid ideas, so in those moves it just checked my ideas for mistakes the bot can see quickly. But there were many moves where those roles were reversed, and also many moves where I played the bot's suggestion with none or almost no analysis by me. In terms of computation time, I often let the bot analyze overnight or even longer (on a computer which is about 2x slower than the one bot_briareus uses for the postal). |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by Adanac on Aug 13th, 2012, 8:01am You should go ahead. Browni3141 is one of the fastest improving players in Arimaa and it'll be interesting to see how he does in a cyborg match. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by browni3141 on Aug 15th, 2012, 2:04pm on 08/13/12 at 08:01:44, Adanac wrote:
Thank you, Adanac. I hope I'm not taking anything away from you though. If you were looking forward to the game then I can wait. Either way I think it will be one worth watching. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by browni3141 on Aug 16th, 2012, 8:14pm Adanac has given the clear go-ahead in a PM, so go ahead and challenge me when you're ready. You can choose the time control, I don't really care what it is as long as it is within reason. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by rbarreira on Aug 17th, 2012, 1:07pm Thanks arimaa_master for the game, you definitely made me/us sweat during the opening. Here is the little I have written of my thoughts during the game. Due to laziness and lack of organization/time It only goes up to move 10s, and even then not all moves have comments. From move 11s on the bot did almost all of the analysis. Quote:
|
||||||||
Title: Re: Cyborg vs Human Arimaa Post by browni3141 on Aug 17th, 2012, 8:16pm A link to the game: http://arimaa.com/arimaa/gameroom/opengamewin.cgi?client=1&gameid=306132&role=v&side=w I'm pretty sure I did it right this time. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by arimaa_master on Aug 18th, 2012, 6:04pm on 08/17/12 at 13:07:55, rbarreira wrote:
Thanks for the game too. Especially thanks for the comments - because I didn´t know when I went wrong - now I have some clues. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by Fritzlein on Aug 18th, 2012, 9:26pm Thanks for the commentary, Ricardo. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by browni3141 on Oct 13th, 2012, 12:19pm rbarreira brought this up in the game comments, but it was never addressed. Why is this game (http://arimaa.com/arimaa/gameroom/comments.cgi?gid=241423) not rated? While it shouldn't be WHRH rated, there is no reason for it not to be gameroom rated. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by aaaa on Oct 13th, 2012, 1:20pm I unrated the game because the "cyborg_" prefix isn't an official prefix and I believe that there should be transparency in how rating lists are calculated. Being used for official purposes, the WHRH ratings should, in my opinion, cleanly follow from the database of games and not depend on further arcane exceptions, thus making it easily reproducible by those not aware of them. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by browni3141 on Oct 13th, 2012, 2:40pm on 10/13/12 at 13:20:26, aaaa wrote:
I'm talking about the site's gameroom rating system though. The game is not gameroom rated. Aren't they two different systems? Can't the game be gameroom rated but not WHRH rated? The type of player doesn't matter for gameroom ratings. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by rbarreira on Oct 13th, 2012, 2:44pm on 10/13/12 at 13:20:26, aaaa wrote:
It would have been nice if some sort of comment was posted to the game explaining this (or did I miss it?). Then we could have had a normal discussion about what to do instead of a stealth unrating. It was strange to see the game turn into an unrated one after woh said that he added the exception for cyborg_ players, as I understand it his WHRH calculation now ignores those players. For example I might propose that cyborg_ be made into an "official" prefix, if Omar thinks that's a good idea. BTW thanks browni for re-asking this question. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by aaaa on Oct 13th, 2012, 3:18pm OK, that was a misjudgment on my part, for which I apologize. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by Nombril on Oct 13th, 2012, 9:33pm Oh, I am surprised that it wasn't played as a U game in the first place. If two human players collaborated on a game, we would expect it to be U. When we played the simul games, they were U. My expectation is that all rated games are a single player against another player. I caught some flack for not playing U games when I was playing multiple bots at one time. I think the reverse question would be more appropriate, why should a game be rated when one player was computer aided and the other was not? |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by browni3141 on Oct 13th, 2012, 10:34pm on 10/13/12 at 21:33:26, Nombril wrote:
It's interesting to me that you ask that question, because before I thought it was "obvious" that the games should be rated, and that everyone else would think so too. The circumstances you describe are all different from cyborg_briareus' games in the same way. In all of those scenarios the player's output is different somehow from their normal output. For cyborg_briareus games, a human assisted by computer IS the norm. I think that the human+computer should be treated as a single entity if all games are played that way, not a human being assisted by a bot. cyborg_briareus is a single player. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by rbarreira on Oct 14th, 2012, 2:32pm on 10/13/12 at 21:33:26, Nombril wrote:
Not necessarily, I think it could be OK to have usernames for a team and play rated games with them. As long as it's fully disclosed what a certain username is, anything's fair game IMO. The only issue is that it affects the WHRH, but that can be handled (and in the cyborg_ case it was handled after someone pointed out this problem, which I hadn't thought of when I made the game rated). Quote:
Quote:
There's a good argument for simultaneous games to be unrated, the player who's doing the simuls is playing at a much weaker strength than usual, due to having his mind on many games and not using the whole time control. If those games were rated it would cause a distortion in the gameroom ratings. A cyborg player or a team of players does not have the same issue, as long as they always play with the same team composition. Quote:
I think we should allow rated play as long as we're playing Arimaa (and not a variation like the EEE games or handicap games) and the entities playing under both usernames are reasonably constant and fully disclosed. I say reasonably constant because it wouldn't be reasonable for a bot to be playing on a home computer during even months and on a supercomputer in odd months. Same thing for players doing simuls on one week and single games on the next week. It puts too much stress (and misinformation) into the ratings. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by browni3141 on Oct 14th, 2012, 3:28pm I would also like to suggest that this account's games be included in WHRP. I don't see a reason for it not to be. |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by browni3141 on Oct 15th, 2012, 10:53pm Hey, omar. Could you update the gameroom page if you get the chance? |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by Fritzlein on Oct 16th, 2012, 10:06am on 10/15/12 at 22:53:31, browni3141 wrote:
Do you mean the announcements? I think I have permissions to edit that. But I can't edit the link to the game in the upper right. Since Omar isn't keeping up with the forum, send site requests via http://arimaa.com/arimaa/contact/ |
||||||||
Title: Re: Cyborg vs Human Arimaa Post by woh on Oct 16th, 2012, 4:49pm on 10/14/12 at 15:28:52, browni3141 wrote:
The game was included in WHRP of August 21st and 28th. Since the WHRP of September 4th the game was no longer included because it had been unrated. To include the games of cyborg_briareus in the WHRP they should stay rated. They will not be included in WHRH because I have added cyborg_briareus to the list of players to exclude. I added this option some time ago for calculating a specific bot ranking. on 10/30/09 at 15:22:46, aaaa wrote:
|
||||||||
Arimaa Forum » Powered by YaBB 1 Gold - SP 1.3.1! YaBB © 2000-2003. All Rights Reserved. |