Server Downtime log

Discussion in 'Server/Website Chat' started by Spykodemon, 19 Dec 2009.

  1. A huge amount of things are currently broken, probably won't have time to fix until tomorrow
     
  2. NomNom Chompski BURNING LOVEEEE

    @Dark, shits hitting the fan yo
    [​IMG]
     
    Last edited by a moderator: 28 Dec 2016
    • Agree Agree x 1
    • Useful Useful x 1
    • List
  3. Fixed:

    - Forums (updated to XF 1.5 also)
    - imgkk uploading
    - Logging into sourcebans


    Still broken:

    - Pretty much all my old dodgy PHP scripts which used shit that is removed in PHP 7 - so sprays, homepage widgets, dsock, etc.
    - Anything managed by DSM, ie the gameservers
    - HLstatsX
    - The Kirino bot
    - My custom changes to Murmur ([[limit:x]] tag on channels)


    On the bright side PHP 7 is a lot faster so I guess all this effort is worth it
     
    • Funny Funny x 3
    • Optimistic Optimistic x 1
    • List
  4. NomNom Chompski BURNING LOVEEEE

    Wait, you upgraded to PHP7? dayum, forums super speedy though.
     
  5. spidEY シスコン

    [​IMG]

    Also, dat PHP 7 spaceship operator.
     
    Last edited by a moderator: 28 Dec 2016
  6. Fixed:

    - Sprays
    - DSock core
    - Servers sidebar widget
    - Gameservers/DSM


    Not fixed:

    - Mumble sidebar widget (will need rewrite or wait for PHP 7 ICE extension)
    - HLstatsX web panel (horrible old code, needs further investigation for PHP 7)
    - Murmur custom shit (don't really see the need)
    - Kirino bot
     
    Last edited: 5 Jan 2016
  7. The issue that initially crashed the system has happened another 3 times and appears to be connected to the gameservers, so they will be down for at least another day
     
  8. Fixed:

    - Gameservers, I think
    - Remaining parts of DSock
    - Kirino bot
    - Most of MGE stats
     
  9. Fixed:

    - HLstatsX
    - Mumble channel limit
    - Mumble sidebar widget (holy fucking shit the amount of hoops I had to jump through)
     
    • Funny Funny x 2
    • Like Like x 1
    • Wizard Wizard x 1
    • List
  10. annnnd another kernel crash and the tf2 servers are all running twice each and constantly restarting and sapping all the cpu

    fml
     
    • Wizard Wizard x 1
    • Friendly Friendly x 1
    • List
  11. Apart from a hard disk that's been slowly failing for months (need to get off my ass and go to london to replace it), things actually seem ok now
     
  12. Humpers GM's Resident #420Fag and general twat

    Stare into the servers soul that'll fix it
     
  13. NomNom Chompski BURNING LOVEEEE

    Enterprise spec drives when?
     
  14. It's the made in china 3tb

    It's exhibiting the same symptoms as the Samsung drives that were in there ages ago - the intense vibration makes it slightly miss a write now and again, rendering the sector unreadable until it is overwritten with zeroes. According to smart it is not actually reallocating the sector, so its not a bad sector in the traditional sense

    To be fair to it, it lasted 3.5 years 24/7 until any corruption started

    Conclusion: only use ssds or enterprise hdds in anything with 5 digit rpm fans
     
  15. Cactus The key is to never give up

    Get on the phone wit the CEO of ITunes. Give them the ok to add the most powerful servers to handle this
     
    • Funny Funny x 2
    • Agree Agree x 1
    • List
  16. NomNom Chompski BURNING LOVEEEE

    Seagate (shivers) enterprise drives are meant to be one of the best according to LTT and backblaze
     
  17. Literally running on fumes at this point

    Definitely will have to replace the ssd too when I get round to doing the hard disk

    Thank fuck SSDs don't just fail at random, still 10% rated life left, enough for a few months
     
    • Optimistic Optimistic x 3
    • Funny Funny x 1
    • Friendly Friendly x 1
    • List
  18. NomNom Chompski BURNING LOVEEEE

    "enough for a few months" famous last words.
     
  19. Was down for 30 mins there for some preventative maintenance for the ssd, which consisted of turning the entire server off for a few mins - seems to have helped, no longer clocking up wear levelling count every 10 mins
     
  20. 1% ssd lifetime left :ohdear:

    mfw 'a few months' turns out to be < 3 weeks
     
    • Useful Useful x 6
    • Funny Funny x 1
    • List

Users Viewing Thread (Users: 0, Guests: 0)