Server Downtime - 2012-08-08

Language: JP EN DE FR
users online
Forum » FFXIAH.com » News » Server Downtime - 2012-08-08
Server Downtime - 2012-08-08
 Fenrir.Scragg
Administrator
Offline
Server: Fenrir
Game: FFXI
user: Scragg
Posts: 2579
By Fenrir.Scragg 2012-08-08 11:08:23
Link | Quote | Reply
 
Database locked up around 5AM central time. It started the backup process and it never was able to complete it and I don't know why. I couldn't gracefully shut it down so I had to kill dash nine it. Looks like a database table has gone missing and I will be pulling it from backup. As a result some pages might not load. I will keep you informed.
[+]
 Quetzalcoatl.Moonsshadow
Offline
Server: Quetzalcoatl
Game: FFXI
Posts: 1032
By Quetzalcoatl.Moonsshadow 2012-08-08 11:10:14
Link | Quote | Reply
 
Oh, good, I thought it was me putting too many animated gifs in the lol thread. (>.<)
[+]
 Phoenix.Professoroak
Offline
Server: Phoenix
Game: FFXI
user: prophets
Posts: 43
By Phoenix.Professoroak 2012-08-08 11:11:13
Link | Quote | Reply
 
Me getting "Application error" when try to view someone's page is temporary or unrelated?
[+]
 Odin.Godofgods
Offline
Server: Odin
Game: FFXI
Posts: 4013
By Odin.Godofgods 2012-08-08 11:13:40
Link | Quote | Reply
 
Fenrir.Scragg said: »
Database locked up around 5AM central time. It started the backup process and it never was able to complete it and I don't know why. I couldn't gracefully shut it down so I had to kill dash nine it. Looks like a database table has gone missing and I will be pulling it from backup. As a result some pages might not load. I will keep you informed.

wish i had knowledge to understand what you just said for the most part.. lol
[+]
By volkom 2012-08-08 11:15:07
Link | Quote | Reply
 
Odin.Godofgods said: »
Fenrir.Scragg said: »
Database locked up around 5AM central time. It started the backup process and it never was able to complete it and I don't know why. I couldn't gracefully shut it down so I had to kill dash nine it. Looks like a database table has gone missing and I will be pulling it from backup. As a result some pages might not load. I will keep you informed.

wish i had knowledge to understand what you just said for the most part.. lol

stuff got stuck. Commander Scragg got it unstuck.
[+]
 Carbuncle.Shayala
Offline
Server: Carbuncle
Game: FFXI
user: Shayala
Posts: 184
By Carbuncle.Shayala 2012-08-08 11:15:35
Link | Quote | Reply
 
Phoenix.Professoroak said: »
Me getting "Application error" when try to view someone's page is temporary or unrelated?

I'm having the same problem.
[+]
 Ragnarok.Ashman
Offline
Server: Ragnarok
Game: FFXI
user: Ashman
Posts: 4251
By Ragnarok.Ashman 2012-08-08 11:19:49
Link | Quote | Reply
 
It may or may not be related but I couldn't search for any items sporatically yesterday/see item sets. Maybe a data error? I don't know I am not good with computer etc etc
[+]
 Bismarck.Rinomaru
Offline
Server: Bismarck
Game: FFXI
Posts: 2056
By Bismarck.Rinomaru 2012-08-08 11:20:23
Link | Quote | Reply
 
The one day i wake up before 1pm, it was horrible.
[+]
 Asura.Tamoa
Offline
Server: Asura
Game: FFXI
user: Tamoa
Posts: 1341
By Asura.Tamoa 2012-08-08 11:21:51
Link | Quote | Reply
 
Carbuncle.Shayala said: »
Phoenix.Professoroak said: »
Me getting "Application error" when try to view someone's page is temporary or unrelated?

I'm having the same problem.

Ditto.

I assume it's got to do with what Scragg's saying about some pages might not load.
[+]
 Siren.Calnus
Offline
Server: Siren
Game: FFXI
user: Calnus
Posts: 796
By Siren.Calnus 2012-08-08 11:23:24
Link | Quote | Reply
 
I've noticed the site has been acting screwy or messing up in very different areas lately lol.
[+]
 Odin.Hirokei
Offline
Server: Odin
Game: FFXI
user: Kaisuko
Posts: 287
By Odin.Hirokei 2012-08-08 11:27:29
Link | Quote | Reply
 
Feels like I have problems with the AH almost anytime I'm on around 5~7am EST. Pages always load slow or the connection times out. Been this way for as long as I can remember. And it's only FFXIAH that does it, anywhere else is just fine and dandy, so I don't believe anything is wrong on my side.

Idk if this has any relevance to this happening, but I thought I'd share.
[+]
 Carbuncle.Elvaanmoq
Guildwork Premium
Offline
Server: Carbuncle
Game: FFXI
user: Imoq
Posts: 215
By Carbuncle.Elvaanmoq 2012-08-08 11:44:15
Link | Quote | Reply
 
kill -9... ouchie :x
 Bismarck.Rinomaru
Offline
Server: Bismarck
Game: FFXI
Posts: 2056
By Bismarck.Rinomaru 2012-08-08 11:52:39
Link | Quote | Reply
 
I havn't had LS community auto-update in a few weeks
then again they suck.
 Bahamut.Savannahlynn
Offline
Server: Bahamut
Game: FFXI
user: Savannah
Posts: 1742
By Bahamut.Savannahlynn 2012-08-08 11:54:14
Link | Quote | Reply
 
Odin.Hirokei said: »
Feels like I have problems with the AH almost anytime I'm on around 5~7am EST. Pages always load slow or the connection times out. Been this way for as long as I can remember. And it's only FFXIAH that does it, anywhere else is just fine and dandy, so I don't believe anything is wrong on my side.

Idk if this has any relevance to this happening, but I thought I'd share.

That's around the time of back up. It's normal.
 Bahamut.Dannyl
Offline
Server: Bahamut
Game: FFXI
user: dannyl
Posts: 1550
By Bahamut.Dannyl 2012-08-08 11:58:45
Link | Quote | Reply
 
Scragg, not sure if anyone has told you this, but you're doing Altana's work.

Thanks,
 Fenrir.Scragg
Administrator
Offline
Server: Fenrir
Game: FFXI
user: Scragg
Posts: 2579
By Fenrir.Scragg 2012-08-08 12:05:06
Link | Quote | Reply
 
I restored the missing table and as far as I know there was just one missing.

The DB size (not counting sales) is around 50GB. Dumping the data while maintaining data integrity requires locking tables, which makes users on the website wait until the operation is done. This also includes compression and transfer.

I'm going to suspend the daily backups until I find a better solution.

Carbuncle.Elvaanmoq said: »
kill -9... ouchie :x
I was very patient with it. I know forcing a DB to stop doesn't end well.
 Ramuh.Austar
Offline
Server: Ramuh
Game: FFXI
user: Austar
Posts: 10481
By Ramuh.Austar 2012-08-08 12:07:11
Link | Quote | Reply
 
Can you fix the giant list of 99 empyreans too? :(
 Lakshmi.Byrth
VIP
Offline
Server: Lakshmi
Game: FFXI
user: Byrthnoth
Posts: 6184
By Lakshmi.Byrth 2012-08-08 12:07:12
Link | Quote | Reply
 
I feel obligated to do this:
NSFW: http://graphics.stanford.edu/~monzy/KillDashNine.mp3
[+]
Offline
Posts: 27938
By Fyyvoaa 2012-08-08 12:20:32
Link | Quote | Reply
 
Ick :| yeah the site has been screwy for the past few days, locking up and not loading at all at times!


Hopefully you can get it all back up and running good~
 Ragnarok.Sekundes
Offline
Server: Ragnarok
Game: FFXI
user: Sekundes
Posts: 4189
By Ragnarok.Sekundes 2012-08-08 12:28:22
Link | Quote | Reply
 
Lakshmi.Byrth said: »
I feel obligated to do this:
NSFW: http://graphics.stanford.edu/~monzy/KillDashNine.mp3
I'm not a fan of any thing rap-like but this is win.
 Ifrit.Phlow
Offline
Server: Ifrit
Game: FFXI
user: Phlow
Posts: 169
By Ifrit.Phlow 2012-08-08 12:38:57
Link | Quote | Reply
 
You doing incremental database backups? Or full backup?

Incremental might take longer recovery times, but should be far less intensive backing up. And, I don't know why I'm suggesting anything, at this point you probably know way more about server admin than I do.
 Caitsith.Mahayaya
Offline
Server: Caitsith
Game: FFXI
user: Trebold
Posts: 3341
By Caitsith.Mahayaya 2012-08-08 12:43:37
Link | Quote | Reply
 
Lakshmi.Byrth said: »
I feel obligated to do this:
NSFW: http://graphics.stanford.edu/~monzy/KillDashNine.mp3

Wooooooow, I feel nerdy for understanding it lol.
 Asura.Tamoa
Offline
Server: Asura
Game: FFXI
user: Tamoa
Posts: 1341
By Asura.Tamoa 2012-08-08 13:37:21
Link | Quote | Reply
 
"Application error" is back when trying to view someone's page, at least for me.
[+]
Offline
Posts: 11
By zifferous1 2012-08-08 13:44:31
Link | Quote | Reply
 
I am getting the same error when looking at someone's page as well
 Odin.Daemun
Offline
Server: Odin
Game: FFXI
user: daemun
Posts: 2027
By Odin.Daemun 2012-08-08 14:09:23
Link | Quote | Reply
 
Ragnarok.Ashman said: »
I am not good with computer etc etc


Glad to see you have us back up and running Scragg.
[+]
 Fenrir.Kuzuryu
Offline
Server: Fenrir
Game: FFXI
user: demendred
Posts: 34
By Fenrir.Kuzuryu 2012-08-08 15:41:47
Link | Quote | Reply
 
Thank you very much Scragg for keeping us informed.
 Quetzalcoatl.Rumaha
Offline
Server: Quetzalcoatl
Game: FFXI
user: Rumaha
Posts: 3087
By Quetzalcoatl.Rumaha 2012-08-08 15:44:03
Link | Quote | Reply
 
Told me my password was wrong and wouldn't let me log in for about 20 minutes before, assuming that was due to issues mentioned here and its gonna work now? (I'm clearly logged in now)
Offline
Posts: 42689
By Jetackuu 2012-08-08 18:32:58
Link | Quote | Reply
 
anything us users could do to help lighten the load of the backup?

or feature you could change, that we may not need, etc
 Ramuh.Yarly
Offline
Server: Ramuh
Game: FFXI
user: nignog
Posts: 802
By Ramuh.Yarly 2012-08-08 18:34:47
Link | Quote | Reply
 


kill. dash. nine.

edit: totally beat by byrth oh well!
[+]
 Asura.Bitesized
Offline
Server: Asura
Game: FFXI
user: Bitesized
Posts: 157
By Asura.Bitesized 2012-08-08 18:56:20
Link | Quote | Reply
 
Ramuh.Yarly said: »
kill. dash. nine.

edit: totally beat by byrth oh well!

I had no idea what kill dash nine is but this video is great.
Log in to post.