Register Register

Author Topic: Time Outs  (Read 2260 times)

Moonsword

  • Acutus Gladius
  • Global Moderator
  • Colonel
  • *
  • Posts: 16256
  • You interrupted me reading TROs for this?
Time Outs
« on: 16 August 2011, 12:46:42 »
Periodically, the entire site (including things available directly from www.classicbattletech.com, not just the forums) becomes completely inaccessible for a minute or two.  Connections to other sites are fine but my connection here keeps timing out.

deathshadow

  • Lieutenant
  • *
  • Posts: 854
  • Special Tasks Group
    • Cut Code Down - Minimalist Semantic Markup
Re: Time Outs
« Reply #1 on: 16 August 2011, 14:38:03 »
We've been experiencing some heavy hits from e-mail spammers that have caused performance issues -- SpamAssassin and ClamAV working triple time just to try and keep up with the FLOODS. I've implemented a bunch more wide IP address bans that should help, but these guys go through proxies like toilet tissue.
There are those who know how, those who understand why, and then there are the people making websites these days...
CUTCODEDOWN.COM

Moonsword

  • Acutus Gladius
  • Global Moderator
  • Colonel
  • *
  • Posts: 16256
  • You interrupted me reading TROs for this?
Re: Time Outs
« Reply #2 on: 16 August 2011, 14:41:03 »
Yikes.  Kind of explains a few things I've been seeing over at BTU from forum spam bots, too.  Thanks for the fast response.

deathshadow

  • Lieutenant
  • *
  • Posts: 854
  • Special Tasks Group
    • Cut Code Down - Minimalist Semantic Markup
Re: Time Outs
« Reply #3 on: 16 August 2011, 15:51:25 »
Yikes.  Kind of explains a few things I've been seeing over at BTU from forum spam bots, too.  Thanks for the fast response.

it's why we've implemented a plugin for http://www.stopforumspam.com/ here at CBT. It has mods for every major browser software, and does a great job of kicking them clean off... "157568 Spammers blocked up until today" and that's since the forum restart in january? That's SIX THOUSAND spam join attempts per DAY for these forums that have been told to kiss off.

Which is why I think they've been going after our FTP and e-mail instead... SpamAssassin and Fail2Ban are kicking their asses, but starting to hog the CPU away from actually doing what we need done.

I've got to look at this problem with a wee bit bigger microscope.

It's funny because a major source of spam was killed off about two years ago, and we got a wee bit of a breather... the past... nine months things have gotten exponentially worse -- spammers trying to knock up forums seems to have DOUBLED monthly, with no end of the onslaught in sight. I'm watching a lot of forums that used to be able to keep it under control starting to buckle under the load.

As it is the 5800 or so daily that are flat out rejected, I've got to manually go through 160+ a day that could be false positives, rejecting usually 99% of them... To the point it's a miracle I've got time to do anything else.
« Last Edit: 16 August 2011, 15:56:25 by deathshadow »
There are those who know how, those who understand why, and then there are the people making websites these days...
CUTCODEDOWN.COM

Moonsword

  • Acutus Gladius
  • Global Moderator
  • Colonel
  • *
  • Posts: 16256
  • You interrupted me reading TROs for this?
Re: Time Outs
« Reply #4 on: 16 August 2011, 15:59:47 »
Any idea why all of that's going on?  I thought a few more botnets were toppled recently.

ItsTehPope

  • Catalyst Demo Team
  • Lieutenant
  • *
  • Posts: 1565
Re: Time Outs
« Reply #5 on: 16 August 2011, 16:05:44 »
Tagging this because it's proving to be an interesting read.
If you actually care to listen to my thoughts outside of Battletech, find me at www.uselessblot.com

(4:37:55 PM) moonsword134: You're a bastard.
(4:38:11 PM) moonsword134: And so's the talking whiskey monkey who lives in bottles of tequila to give you ideas.

(4:52:52 PM) ShinjoJinturi: simply by having tag on the field, even in a game that appears to not have any lrms or arrows on the board, you can inspire fear

greatsarcasmo

  • Fabricator General
  • Global Moderator
  • Lieutenant Colonel
  • *
  • Posts: 6421
  • Ordo Scriptorum
Re: Time Outs
« Reply #6 on: 16 August 2011, 16:31:45 »
Anything the community can do to help?
Maker of big things.

Knightmare

  • Happiness Guru
  • System Admin
  • Master Sergeant
  • *
  • Posts: 395
  • Wrench'in it
    • BattleTech.com
Re: Time Outs
« Reply #7 on: 25 August 2011, 13:17:55 »
Have you considered on doubling up with HoneyPot and running through Bad Behavior to examine HTTP requests? It uses a bit more server, but I run round trip DNS and block empty user agents since I'm not running any ecommerce.
BeemerCon Summarized. Knightmare, end of turn: "How come none of my weapons fired?"
Look, dude, when you are a real mechwarrior you don't need to get all dressed up in cooling suits and cool helmets to work on your mech. You just strip down to your 1980s panties and crop top vest and start wrenchin' it.
Yen Lo Wang = David Lo Pan