Pages

Friday, January 24, 2014

APB Storm Watch; dealing with DDoS attacks

Here’s what’s going on right now:

For the last few weeks miscreants have been messing with APB by attempting both small and large DDoS attacks daily. The attacks range from small scale attempts, all the way to Derp Trolling taking down APB during their big take-down spree against Eve Online, LoL, Steam and Battle.net (on an aside, if anyone has any information about these events, we, and the FBI, are all ears and we will share more info on how the community can help out too).

In the meantime, choosing a mitigation response that is both effective and doesn’t destroy performance is hard, but that part is complete and a first solution has now been deployed. Unfortunately there is no free lunch; in this case, mitigating attacks comes at the cost of higher latency in the short term. 

We are now working with our provider to optimize the mitigation to bring pings back down with DDOS mitigation turned on. As if our job wasn’t hard enough without this extra layer of work, thankfully our team has added this challenge to the long list things they just ‘have to do.’

Being DDOSed sucks, but at least dealing with it is our job. Unfortunately for you, this whole mess is harming how you’re trying to spend time when you should be just relaxing and having fun in APB.

To that end we’re sending out 10 days of Premium to everyone who logged in to the game anytime between January 1 and January 23. It doesn't make up for the fact that you had to go through this with us, but hopefully it helps you get back on your feet and back to enjoying the game.

Along those same lines, let’s talk about the game engine's performance. This is an ongoing issue that we’ve made great strides toward solving. Additional deep network logging in the last four weeks helped us identify several deeply buried culprits in the game code itself, and we are rolling out code fixes to those issues in the next couple of patches. In December we rolled out more Overkill servers to Joker, and we’re rolling out two more this month (though the DDOS attacks have disrupted that schedule a bit).

Yesterday we also found and corrected an issue with the mail system. This change comes with certain limits on mail volumes users can send, so we’ll be looking at the effects of that going forward. This may cut down on scamming; it may also potentially impact players who use the mail system as a pseudo-inventory. Have any thoughts on this? Please share them in the comments so we can make an informed decision on how these tradeoffs might affect your quality of life. Edit: This change will not impact your stored mails or your ability to continue to store mails or attachments.

Finally, our system-wide Unreal engine upgrade is coming along on schedule. Currently progress is being made on rendering, the lighting system and the district/client interactions. I hope to share something more tangible in the coming weeks so you can see just how far along it’s come.

And while we’re smack in the middle of a Winter Warmup event, we’re also looking ahead towards Valentine’s Day events, which you'll see in a couple weeks.

Lastly, we've also noticed recently that the number of new players logging in for the first time has steadily increased. If this means you, welcome to the game! Soon we'll be rolling out early game content to help new players such as yourself find your bearings in the sometimes harsh and unforgiving streets of San Paro.

Thanks for reading, and thanks for playing APB!


Tl;dr DDOS solution in place but causing high pings (which we're working on), 10-days Premium free for everyone logged in January so far, engine still being upgraded, fixed a mail abuse bug, performance being worked on, more overkill servers, and more in-game events around the corner.

40 comments:

  1. About the mail system being a pseudo inventory, will there be a new type of external inventory/bank implemented in the coming update?

    ReplyDelete
  2. It's seems some crims have fun but don't worry we have some Enfo and time to bust that ass :) i SUPPORT FIGTH :)

    ReplyDelete
  3. I think you handled this well actually. Good job.

    ReplyDelete
  4. This comment has been removed by the author.

    ReplyDelete
  5. For god sake make a trade system so we can trade properly , its isnt that hard and this game needs it!

    ReplyDelete
    Replies
    1. please


      also, any response to when Tiggs mentioned/responded about a window of time for mailing JMB legendary weapons would be sick. There's a lot of us that want to share weapons with friends but don't want to fall for marketplace bots. thanks

      Delete
    2. this option was available wayyy back then but they removed it...i think G1 is leaving it this way to make more money...you want a legendary weapon you want already but in another character? buy 100dollars of jokerboxes on your other character and get all the 3day weapons you already own permanent. story of my life <3 but if they can bring the weapon mailing system back for the legendary weapon would be realy great.

      Delete
  6. Please don't delete any mails :(( My clan clothing system that I worked on really hard will be ruined!

    ReplyDelete
  7. "Yesterday we also found and corrected an issue with the mail system. This change comes with certain limits on mail volumes users can send, so we’ll be looking at the effects of that going forward. This may cut down on scamming; it may also potentially impact players who use the mail system as a pseudo-inventory. Have any thoughts on this? Please share them in the comments so we can make an informed decision on how these tradeoffs might affect your quality of life."

    Sell. Inventory. Slots. Imma be pretty irked if my stuff just disappears from my mail. I hope we are at least warned so I can store it on my alt chars instead of my in my mail.

    ReplyDelete
  8. How about this:
    Make Joker legendaries sendable via mail only to characters which are on the same account. Would make life for players and the support staff much easier.

    ReplyDelete
    Replies
    1. g1 wants to make money so basically if u wanna share ur legendary weapon on ur other character buy more jokerboxes

      Delete
    2. Find your post completely retarded. If you read the Blog it clearly states they are up for idea's to solve the mailing issue. The biggest issue is that people KEEP being SCAMMED through the mailing system, or it can be abused if people have their accounts hijacked, simply send all the goods to another account. Instead of writing garbage make some useful suggestions.

      Delete
    3. Hey there Kage, I'm not sure if you understood my suggestion.
      It goes like this:
      Step 1: Attach a tradable weapon to a mail.
      Step 2: Put a recipient on the mail.
      Step 3: Send the mail.
      Step 4: The mail system checks: is the recipient on the same account as the sender?

      If yes, mail will be sent.

      If no, the mail will not be sent.

      Therefore, people who hijack other peoples accounts, will not be able to obtain tradable weapons by just sending them over.

      Therefore, sending weapons to another player in order to trade them will not be possible.

      Delete
  9. I'm happy to see something being mentioned about client-server performance. Thanks for the write-up Linus, I can't wait to see more on the engine overhaul next blog post.

    ReplyDelete
  10. in the pass on my mod days on a online game there was some guys in game that always push this events more like it is new bronze or T guys for what i can see in game i had report few to g1 with same regular messages if you guys make a team just for this problems we may can help and serve better i am that always look in anyway to help so if you guys do something with community please let me know i hope this stop soon

    ReplyDelete
  11. Hi Linus and APB crew! Just passing thru to let you know how I use my mail system. I use to leave all the important NPC mails where I get a mod or maxed out that contact just for the record, also I store all my empty mails from my important purchases and legendary guns I won. I like to do that because it reminds me of the date when I had important events in my APB life. I can live without all those mails but also I have lots, but lots of mails with stuff such as clothes, vehicles and symbols!! Symbols are the most important thing in anyone s APB life! I need to keep a master copy of all my symbols since playing along 2 or 3 years makes you go thru lot of creations, and it is cool to preserve them! That's why I found the mail system so useful as a secondary inventory. Hope it helps to understand our side of things and keep it up with the great and hard work you all are doing guys!! H5.

    ReplyDelete
  12. Great news and good work but.... Most of these "new players" are just rerolled ex banns only a small number of these rerolls are legit never before played apb or players who have switched servers ect... Maybe this new engine will stop that and it will be 100% legit new\rerolled players,.. Only time will tell.

    ReplyDelete
  13. These new players are people who have been banned wrongfully, or who have came back to rage hack. This game gets no new players, sorry, everyone who is here have already been here for a while.

    ReplyDelete
    Replies
    1. This comment has been removed by the author.

      Delete
    2. Been playing since Closed Beta and I've personally come across a LOT of new players over the past 2 months or so, tons of silvers that barely know what to do each and every objective.

      Delete
  14. It is January, I have just logged in, but no free 10-day premium for me.

    ReplyDelete
    Replies
    1. To be clear - the blog text has been fixed. If you had logged in during the period of DDoS attacks, which was PRIOR to the posting of the blog post, then you automatically received a free 10 day premium. If you just logged in first the first time in a long time today (or later) you are not part of the free premium group, but if you stick around and continue logging consistently I am sure you will qualify for future freebies.

      Delete
  15. I want official confirmation that Joker's Overkill hardware is in fact inferior to Colby's.

    ReplyDelete
    Replies
    1. It is not. However Joker and Colby have different mitigation setups and different network configs.

      Delete
    2. I've just noticed that from day one of Joker's Overkill, the districts have had trouble maintaining a steady 33ms (30 server fps) even under the 45/45 instance cap. Colby's never seemed to have this issue. Thank you for clearing this up.

      I want nothing more than to see this game thrive. I am looking forward to the payoff from all your hard work on these critical issues.

      Delete
  16. This comment has been removed by the author.

    ReplyDelete
  17. At present I find it difficult to understand that what was better, to play with DDOS attacks on game servers, OR to play with a delay 300-500, but already with "protection" against these Ddos attacks.As for 10 days of account premium, it is simply ridiculous.... You should fix the latency, it is simple... just for possibility to play it

    ReplyDelete
  18. I nearly got 4 years of premium left .. u got something else for me? <3

    ReplyDelete
  19. I would like it if G1 can put "gift to friends" in the game for example if i have g1 and i want to buy my friend or my girlfriend a jokerbox or clothing in armas marketplace for example buying it to send it to there account, buy as gift. should be good also and ik here are peoples around here that would like that also...and legendary weapons to be send to ur other character in ur account via mailing..would be nice also.

    ReplyDelete
    Replies
    1. Thanks for the suggestion. It's something we've specced out, we just need some free room way from dealing with things like the attacks to actually focus on it.

      Delete
  20. How about an account based inventory? A Bank of sort, perhaps make it function through the same terminal as the mailing system since players already use it to store stuff.

    Appreciate the update and thanks for the premium.

    ReplyDelete
    Replies
    1. That's a really great suggestion, thanks!

      Delete
  21. What is the best there? I want send outfit my friend and i must wait, because it throws an error when I want to send more clothes at once. We could go back to that mail is working properly and that they can send weapons. If anyone fall for the scam, it's not a problem to you, but to a man who thinks for himself.

    ReplyDelete
  22. Bla bla bla bullshit, is your fault dont kwno how to stop the DDoS. Then stop cry and fix servers noobs.

    ReplyDelete
    Replies
    1. Sigh. Moron.

      Research what a DDoS is before making stupid ridiculous comments. You don't need to show us how retarded you are.

      Many thanks!

      Delete
    2. Research what a DDoS?

      What do you mean?, A DDoS attack can not be stopped? You are the only retarded here. Lot of companies recives DDoS attacks and they solved it, G1 cant solved? shut up dude.

      Delete
    3. G1 -> null-route an ip is bullshit, work to fix servers correctly.

      Delete
  23. Thank you for 10 Day premium but i say it must be hell to you as it for the players i hope you get DDOS attackers in jail or just pay to you like couple millions to improve the game much much more i just hope u someday get the game fully working without any bugs or stuff and i will be paying for the game as much as my wallet is opening to this THX alot for information sometimes it is littlebit missing but now good that you info people Thx goes to you by OnEGod

    ReplyDelete

Please keep comments on-topic and reasonably civilized. The moderators reserve the right to remove any off topic, uncivilized or troll-ish comments.