Hello! We are moving the main server this weekend have moved! If anything seems weird, let me know in the comments, or contact me. Thanks!

Breakdown

Here’s a summary of what’s happening. Generally speaking, we have 4 servers.

  • Current Server (ServInt DC) – WordPress Website [6 Core Xeon, 12 GB RAM, HDD]
  • New Core Server (Linode New Jersey) – New Custom Website [1 Core XEON VPS, 1 GB RAM, SSD]
  • New DB Server (Linode New Jersey) – New Custom Website [1 Core XEON VPS, 1 GB RAM, SSD]
  • Legacy Server (Scaleway Paris) – New home of WordPress Website [4 Core Atom, 8 GB RAM, SSD]
  • Legacy Server (Scaleway Paris) – New home of WordPress Website [8 Core Atom, 32 GB RAM, 50+250 GB SSD]

The Current Server is the server you’re using right now to read this post. All that data is being moved to the Legacy Server, which despite the name is actually another new server I’ve set up. It’s a little less powerful than the Current Server, but it has SSD hard drives and modern software, which should make a difference.

As with all things, the reason for the change is price. We’re paying about $189 US per month for the Current Server, and it’s replacement the Legacy Server costs ~$16 ~$27. For reference, the Linode servers cost about $10 each.

Theoretically it should be faster for those of you in the EU, and about 40-60 ms more latent for those of us in North America. That said, thanks to the SSD, responses should be quicker in general, so you may not even notice.

Eventually, the Legacy Server will truly be the Legacy Server. We’ll have moved all Ludum Dare operations to the New Server(s), and it will be kept around to reference data we don’t migrate over (comments, spammer user accounts, etc). The Theme Selection process is handled entirely on the New Servers (using a crazy workaround to authenticate using your Legacy Ludum Dare account).

EDIT: Ah, as is always the case, I found I needed a bit more oomph. I’ve decided instead to bump this up to a stronger server. Monthly cost is now ~$27, not ~$16. 😉

EDIT 2: I did some I/O benchmarking. The replacement server has roughly 3x faster writes, and 5x faster reads from disk. The new server is slower when it comes to raw CPU performance (Intel Xeon vs. Atom), but my same benchmark still reported a whopping 80% of the performance of the Current Server for files cached in RAM. The faster disk I/O combined with 2 extra CPU cores, nearly 3x the RAM (32 GB vs 12 GB), and again “modern software”, I think it’ll do just fine. I’m fairly confident this is going to be okay.

EDIT 3: Video updates on progress. Almost there, and HOLY SPEEDUP BATMAN!!

EDIT 4: Oh, and software wise, the Current Server (i.e. old) runs Apache, MySQL, and PHP 5.6 (with OpCache). The replacement Legacy Server runs OpenLiteSpeed, MariaDB, and PHP 7 (with OpCache). i.e. The same software I’ve been running on the New Server(s). Remember this is old data, so our databases were actually in MyISAM format previously, now InnoDB (or whatever MariaDB’s variant wants to call itself). This doubled the database disk usage (2 GB to 4 GB), but we have 32 GB of RAM now. We can fit the whole thing (and then some) in RAM. 😀

So on paper the Current Server should have been faster (6 core Xeon vs. 8 core Atom), but an excess of RAM, the speed of SSDs, and me actually knowing how to set up this stuff now, yeah, it’s faster. :)

I’m hoping tonight to be able to finally hit the switch, and permanently change ludumdare.com to point to this replacement server.

EDIT 5: I was able to hack together a dummy WordPress plugin to fix the DKIM email issues. A bit more work left on the e-mail server (TLS support, DMARC?), some more general server hardening, and get off-site backups working. This Monday seems to have been eaten up by other distractions, so I’m shooting for Tuesday to flip the switch.

EDIT 6: Okay, e-mail stuff appears to be good now. TLS and DMARC are working. Our web server software was just updated today (Thursday), so I want to test and see if that works before we go live (there was a bug in the previous version, so we had to run an older version).

EDIT 7: Hello! Welcome to the new server. I’m still doing some final configurations and testing, but hey, you made it!

EDIT 8: Okay, I think all the issues people were having since the move are fixed. On my end I need to get backups working again, as well as a few minor e-mail issues resolved (mainly affecting me). But hey, we’re almost ready to shut-down the old server.

Thank you everyone for your bug reports!


50 Responses to “Moving Servers (Status: Done. Bonjour! Welcome to the Legacy Server)”

  1. Donni11 says:

    Shooting for April ?

  2. Geckoo1337 says:

    All seems to me good. Stable ++

  3. Nevercade says:

    I can’t do anything with the theme suggestion page, when I login it says Error: Empty and then freezes. Could be to do with this new server?

  4. ChronusZ says:

    In Firefox the timer sometimes overlaps the text: http://i.imgur.com/STR5u0k.png

    This only seems to happen at 30%, 50%, 60%, 100%, 150%, 160%, 170%, 180%, 200%, 220%, 230%, and 240% zoom, by my testing.

  5. hunttis says:

    Ho-lee poop!

    The speed is ah-mazing on this new server. Almost like browsing a locally hosted site 😀

    (From Finland, on a 100/100 LAN connection to the net)

  6. timtipgames says:

    Good job, thanks for all your hard work!

  7. Not a huge problem, but I did notice some broken images and exposed PHP code on my author page: http://imgur.com/QdnVmLN

  8. feiss says:

    Holly smokes, this goes fast!! I feel I can fly!

  9. Jwatt says:

    I was like, hunh, the LD site doesn’t lag?

    Well, that’s one tradition I can do without.

  10. Javabot says:

    Umm, in the minild there is the game “battle quack” which I cannot play due to “Fatal error: Uncaught Error: Call to undefined function imagejpeg() …

  11. ALobker says:

    If you look at older ludum dares, the icons are not working (for me).
    http://ludumdare.com/compo/ludum-dare-33/?action=top

  12. Jerre says:

    I’m not sure what happened exactly but I went to http://ludumdare.com/compo/2016/04/06/who-wants-some-sick-beatz/#respond and than got a 520 error that it was not cached, Amsterdam server, went back to reload, got the same, but in the upper right corner it said “load live” or something like that, I clicked it, and then it worked.

    • PoV says:

      I’ve seen this twice before too. I’m not entirely sure why this happens (obviously CloudFlare related). I just hope it doesn’t crop up too much next weekend.

  13. hunttis says:

    Went to check on my votes and noticed Round 2 had opened. Clicked the votes and then switched over to Round 1, my votes had disappeared. Clicked to Round 2, my votes there had disappeared too!

    Tried to refresh page, votes gone.
    Are they really gone?

    Not a big problem to click the votes again, but if they can disappear at random, that might be a problem 😀

  14. Ironhead says:

    Created an account this morning to participate in my first LD. Made my first “I’m in” post and submitted it for review and it hasn’t been approved yet. Not sure if you’ve just not gotten to it yet or if this is a bug.

    • Ironhead says:

      Dunno, guess maybe I did something wrong or didnt do something right. tells me its pending.

      • Ironhead says:

        Tried to trash the post and got this error:

        Error 520 Ray ID: 291a2e9bf6c91fb2 • 2016-04-11 00:04:38 UTC

        tried to trash it a few more times and each time it just said: Error in moving to trash.

    • PoV says:

      Yeah sorry, I can be a little slow on approving posts. I usually switch the site to automatically make everyone that signs up an author, but I forgot to do this (and if I don’t hit the switch before you make your account, it doesn’t work).

  15. Troyan says:

    I can’t see my entrys at author page

  16. Docjekyll says:

    My author page doesn’t show anything (http://ludumdare.com/compo/author/docjekyll/) but I can see author pages for other people.
    Do I need to have made a “post” before? I have made 3 games for LD but never made a blog post.

  17. quaternary says:

    Will the server still crash when the theme is announced? I hope so, that’s the best part.

    If not, damn you and your money-saving schemes! 😉

  18. Sri Harsha Chilakapati says:

    I’m getting 403’s on the theme site since an hour: http://i.imgur.com/9KymTiT.png

    That pic shows the error in my chrome console.

  19. Madball says:

    When I click “+New POST”, it asks me to log in WordPress, even though I’m already logged in the LD website, and I ticked “Remember Me” the last several times. More than that, I logged in and wrote a post, and when I clicked “Submit”, it asked me to log in again.

  20. Tselmek says:

    I don’t know if the problem was existant with the old server, but an imported gif won’t display correctly in a post. Instead, it show a deformed version of one frame (i’m guessing the first one) and doesn’t animate. My guess is that it’s related to WordPress directly but I thought it was worth mentioning. :)

  21. pixzleone says:

    Comments are buggy! Throws all kinds of errors, seems like it tried to comment twice when I replied to someone.

  22. gelisam says:

    On http://ludumdare.com/compo/about-ludum-dare/, the embedded video disappears immediately after being loaded.

  23. Max Amaden says:

    It’s probably not high on your list of priorities, but it appears that my author page does not exist.

    eg. when I try to visit http://ludumdare.com/compo/author/maxamaden/ it says page not found 😛

  24. Not sure if this is the server or the site, but I rated and commented on a game, it let me without error, but since it was a few hours since my last activity my login cookie must have expired, and my rate and comment did not save.

Leave a Reply

You must be logged in to post a comment.

[cache: using cached page]