Arimaa Forum (http://arimaa.com/arimaa/forum/cgi/YaBB.cgi)
Arimaa >> Site Discussion >> Site is back up
(Message started by: omar on Sep 1st, 2005, 10:42pm)

Title: Site is back up
Post by omar on Sep 1st, 2005, 10:42pm
Wow it was pretty hectic the last few days.

The disk on the arimaa.com site crashed. I was lucky to have a second disk that I backup to each night. So most everything was recovered. Since the crashed disk was not totally destroyed, I tried to get as much from that as possible.

I decided that since the site is down anyways, lets just get a new server and transfer everything to that. This is why it took a couple days to get the site going again.

Im having problems getting the Chat to work on the new server right now. But other than that most things seem to be working. If you notice anything broken, let me know.

Sorry about the inconvience.


Title: Re: Site is back up
Post by PMertens on Sep 1st, 2005, 11:49pm
Thanks for all the hard work you put into this :-)

Title: Re: Site is back up
Post by Arimanator on Sep 2nd, 2005, 2:17am
Wow Omar, you did a fantastic job here, considering what you were up against and many thanks. I was already wandering the streets soliciting people at random for my Arimaa fix.  ;)

Title: Re: Site is back up
Post by Fritzlein on Sep 2nd, 2005, 4:21am
Thank you, Omar, for getting the site back up so quickly.  I didn't realize just how addicted I was until I lost the ability to even look what games other people are playing.  The Arimaa server is a contribution to the happiness of mankind from the generosity of your heart.

Title: Re: Site is back up
Post by RonWeasley on Sep 2nd, 2005, 9:39am
Thanx, Omar.  This again reminded me that we are guests in your house.  

Title: Re: Site is back up
Post by PMertens on Sep 3rd, 2005, 4:19pm
thanks for the chat :-)

could it be that I do not get any mail-notifications for comments on my games at the moment ?

Title: Re: Site is back up
Post by omar on Sep 5th, 2005, 1:33pm
Thanks for the nice comments guys.

But just when I thought the server was stable it crashed again. It went down on Sunday night about 3pm EST. Unfortunately I didn't notice it till about 10am.

Looked like it needed a reboot so I called the support number and got an answering machine  ???

I left a message and opened a trouble ticket and waited around for a couple of hours and didn't get any reply. Apparently this company doesn't provide much support on the weekends >:(  They've been very responsive on weekdays. I had to go to my uncles place and I didn't get back until about 11pm. When I got back I found that the server had been rebooted. I was able to login and get the site going. I haven't been able to find what caused it to crash yet  :-[ But tech support emailed me that the second disk on the server was making noises and they replaced it.

Title: Re: Site is back up
Post by Arimanator on Sep 5th, 2005, 6:08pm
As the say goes "When it rains it pours" (You all know how fond I am of proverb, don't you?  ;) ), anyway, thanks for the dedication you put into getting this room back up and running as fast as you do. As has been said before, we are only guests in your house, but right now I feel like an honored guest in a palace. If there were more people like you ( and maybe less like me?    :-[ ) the world would be a much better place.

Title: Re: Site is back up
Post by megamau on Sep 7th, 2005, 3:50am
Just a quick comment. The address www.arimaa.net seems to still show the "server down" comment.
I don't know if someone with an old bookmark is able to connect.

Maurizio

Title: Re: Site is back up
Post by Fritzlein on Sep 9th, 2005, 8:12am
Thanks again, Omar, for getting the site back up a second time.  I know you put a tremendous amount of time into Arimaa month after month, but when there is trouble we are even more appreciative of all you do.

Very small note: I can't seem to start Bomb2004CC.  I thought perhaps it was related to the crash.  Of course, since it is an outdated bot it doesn't matter so much, but I just happened to be hankering for a 3-minutes-per-move game.

Title: Re: Site is back up
Post by Arimanator on Sep 10th, 2005, 6:19am

on 09/03/05 at 16:19:32, PMertens wrote:
thanks for the chat :-)

could it be that I do not get any mail-notifications for comments on my games at the moment ?


I don't get those mail-notifications anymore either.

Title: Re: Site is back up
Post by omar on Sep 14th, 2005, 5:55am

on 09/09/05 at 08:12:43, Fritzlein wrote:
Very small note: I can't seem to start Bomb2004CC.  I thought perhaps it was related to the crash.  Of course, since it is an outdated bot it doesn't matter so much, but I just happened to be hankering for a 3-minutes-per-move game.


Thanks for pointing that out. I've fixed it.

There's so much to the site now that I can't possibly test everything after moving the site. I appreciate you guys mentioning the problems as you find them.

Title: Re: Site is back up
Post by omar on Sep 18th, 2005, 6:30am
I think most of the obsucure problems have been fixed now. It was due mostly to slight differences in the newer version of the OS and application programs.

I want to thank the Arimaa community for putting up with the moving pains and helping me find the problems.

Im glad we got this out of way before the tounament season starts :-)

The new server is a dual P4 3.0 GHz system with 1 GB of RAM and two 120 GB hard drives. So the hardware is about 4 times faster than the old server.

Im also working on trying to make the programs run faster. It could provide another 4x or more speed up.


Title: Re: Site is back up
Post by Fritzlein on Sep 18th, 2005, 8:36am

on 09/18/05 at 06:30:09, omar wrote:
I want to thank the Arimaa community for putting up with the moving pains and helping me find the problems.


We thank you.  I think it is a testament to the addictive power of Arimaa that there has only been a small dip in activity despite the various server problems.  The wonderful service you offer to the community free of charge is amazing enough, but the fact that you are so receptive to complaints puts you in a category with saints.


Quote:

Im glad we got this out of way before the tounament season starts :-)


I am glad too.  I think we are poised for the best tournament season ever, with more strong bots, more strong humans, and interesting new tournament formats.


Quote:
The new server is a dual P4 3.0 GHz system with 1 GB of RAM and two 120 GB hard drives. So the hardware is about 4 times faster than the old server.

Im also working on trying to make the programs run faster. It could provide another 4x or more speed up.


As I am posting in another thread, the evidence so far is that doubled thinking time is giving Clueless an edge of about 75 rating points in self play.  I still can't quite believe it, but if it turns out to be a linear function, and it holds for other bots besides Clueless, and it holds also for play against humans, then your quadrupling the server speed should give the variable-performance bots a boost of about 150 rating points.  Humans, beware!

Title: Re: Site is back up
Post by Arimanator on Sep 18th, 2005, 3:13pm
Which means that my recent beating in 14 moves of Clueless fast is equivallent to a beating of the old 2005CC with less thinking time on my end, thanks for pointing that out Fritz.  ;D

Title: Re: Site is back up
Post by omar on Sep 20th, 2005, 3:18pm
Every time I think the system is stable, something new pops up. Yesterday the system began thrashing. That means it started up so many processes that it was spending more time switching between processes than it was doing useful work. I think it was caused by the web server settings allowing too many processes to get started. I've changed the settings now and hopefully it won't happen again.

Title: Re: Site is back up
Post by omar on Sep 23rd, 2005, 6:17am
I ran a lot of tests on the new system to see what might have been causing the high load. The system looks really solid and I can't get it to start thrashing like it did before.

I am starting to suspect that there might have been some denial of service type attacks on the server through the network which caused the high load and slow network response. I am contacting the ISP to follow up on this.

Im really sorry about having the server down so long, but I really needed to try and trace this problem. I especially wanted to make sure it was not due to a hardware problem with the new server. Im pretty sure now that the problem was due to receiving a lot of traffic on the network and not due to any hardware or OS configuration problems.

Im bringing the gameroom back up, but keep in mind that the attack could happen again. I have a feeling that this hosting company does not have any hardware in place to prevent DOS attacks on their network; but I still need to check with them about it.

I figured the Arimaa addicts would start having withdrawl symptoms if I didn't bring the gameroom online soon :-)


Title: Re: Site is back up
Post by Fritzlein on Sep 23rd, 2005, 6:55am

on 09/23/05 at 06:17:52, omar wrote:
I figured the Arimaa addicts would start having withdrawl symptoms if I didn't bring the gameroom online soon :-)


Only too true in my case.  I had a miserable day at work today in part because I couldn't get my Arimaa fix last night.  I almost turned to OCTI in desperation...

Title: Re: Site is back up
Post by PMertens on Sep 23rd, 2005, 8:16am
my hands were shaking

Title: Re: Site is back up
Post by omar on Sep 27th, 2005, 4:10am
I think the problem with the site getting overloaded and becoming unusable has been fixed now.

When I was fixing the problem with Arimaazilla stopping and not coming back online I had made some test changes to Arimaazilla's bot.cfg file. After fixing that problem I forgot to change the bot.cfg file back to the way it was. This turned out to be the root of the problem. Hopefully I've fixed it now without introducing another problem :-)

Title: Re: Site is back up
Post by Janzert on Sep 27th, 2005, 11:21am
Sounds like you found the problem, but just in case here are a few more datapoints.

Last night at about 2:20am edt, the front page would load fine, but neither the forums or the game room would. Also the ping to the server was low and fairly stable, suggesting to me that it wasn't network related. Below is the summary from a ping run.


Code:
51 packets transmitted, 51 packets received, 0% packet loss
round-trip min/avg/max/stddev = 37.454/40.930/68.186/5.569 ms


Janzert

Title: Re: Site is back up
Post by omar on Sep 27th, 2005, 3:07pm
Thanks for the input. You're right it wasn't so much network related as I had originally thought. It was actually due to the bot script consuming all the system memory and causing the problem.

Title: Re: Site is back up
Post by Arimanator on Sep 27th, 2005, 3:55pm

on 09/27/05 at 15:07:00, omar wrote:
Thanks for the input. You're right it wasn't so much network related as I had originally thought. It was actually due to the bot script consuming all the system memory and causing the problem.

I like it when a problem gets a clear cut solution because it usually means that we're done with it.



Arimaa Forum » Powered by YaBB 1 Gold - SP 1.3.1!
YaBB © 2000-2003. All Rights Reserved.