Go Back   Freethought Forum > Public Works > Forum Administration

Reply
 
Thread Tools Display Modes
  #1  
Old 05-13-2024, 09:37 PM
JoeP's Avatar
JoeP JoeP is offline
Solipsist
 
Join Date: Jul 2004
Location: Kolmannessa kerroksessa
Gender: Male
Images: 18
Default 509 Bandwidth Limit Exceeded

For the whole day.

vm did something to fix it (he'll say the hosting company did it, but that's just being modest).
__________________

:roadrun:
Free thought! Please take one!

:unitedkingdom:   :southafrica:   :unitedkingdom::finland:   :finland:
Reply With Quote
Thanks, from:
BrotherMan (05-14-2024), Crumb (05-13-2024), Pan Narrans (05-14-2024), Stormlight (05-14-2024)
  #2  
Old 05-13-2024, 10:10 PM
viscousmemories's Avatar
viscousmemories viscousmemories is offline
Admin
 
Join Date: Apr 2004
Location: Ypsilanti, Mi
Gender: Male
Posts: XXXDCCCLXI
Blog Entries: 1
Images: 9
Default Re: 509 Bandwidth Limit Exceeded

Our bandwidth usage almost tripled starting April 29th and has remained at that level every day since. I can upgrade to get more bandwidth allotment for relatively little money, but before I do I think I want to try disallowing the ahrefs, semrush, and facebook crawlers. Of the last 1000 visitors about 900 were one of those three. Thoughts?
Reply With Quote
Thanks, from:
beyelzu (05-14-2024), BrotherMan (05-14-2024), ceptimus (05-13-2024), Crumb (05-13-2024), Ensign Steve (05-15-2024), JoeP (05-14-2024), mickthinks (05-13-2024), Pan Narrans (05-14-2024), ShottleBop (05-25-2024), slimshady2357 (05-14-2024), Sock Puppet (05-14-2024), Stormlight (05-14-2024)
  #3  
Old 05-13-2024, 10:21 PM
viscousmemories's Avatar
viscousmemories viscousmemories is offline
Admin
 
Join Date: Apr 2004
Location: Ypsilanti, Mi
Gender: Male
Posts: XXXDCCCLXI
Blog Entries: 1
Images: 9
Default Re: 509 Bandwidth Limit Exceeded

Added to robots.txt:

Code:
User-Agent: facebookexternalhit
Disallow: /

User-Agent: SemrushBot
Disallow: /

User-Agent: AhrefsBot
Disallow: /
Reply With Quote
Thanks, from:
Ari (05-13-2024), beyelzu (05-14-2024), BrotherMan (05-14-2024), ceptimus (05-13-2024), Crumb (05-13-2024), Ensign Steve (05-15-2024), fragment (05-14-2024), JoeP (05-14-2024), slimshady2357 (05-14-2024), specious_reasons (05-13-2024), Stormlight (05-14-2024)
  #4  
Old 05-13-2024, 10:24 PM
LarsMac's Avatar
LarsMac LarsMac is offline
Pontificating Old Fart
 
Join Date: Nov 2012
Location: On the Road again
Gender: Male
Posts: MMMDCCCLXXVII
Default Re: 509 Bandwidth Limit Exceeded

Away all Boats! Er,..., Bots!
__________________
“Logic is a defined process for going wrong with Confidence and certainty.” —CF Kettering
Reply With Quote
Thanks, from:
beyelzu (05-14-2024), BrotherMan (05-14-2024), Stormlight (05-14-2024)
  #5  
Old 05-14-2024, 05:05 AM
BrotherMan's Avatar
BrotherMan BrotherMan is online now
A Very Gentle Bort
 
Join Date: Jan 2005
Location: Bortlandia
Gender: Male
Posts: XVMMXLVIII
Blog Entries: 5
Images: 63
Default Re: 509 Bandwidth Limit Exceeded

At first I was like :freakout:

Then I settled into :hyperventilate:

And to the butts I say :ironfist:
__________________
\V/_
I COVLD TEACh YOV BVT I MVST LEVY A FEE
Reply With Quote
Thanks, from:
Crumb (05-14-2024), JoeP (05-14-2024), LarsMac (05-14-2024), Stormlight (05-14-2024), viscousmemories (05-14-2024)
  #6  
Old 05-14-2024, 01:23 PM
viscousmemories's Avatar
viscousmemories viscousmemories is offline
Admin
 
Join Date: Apr 2004
Location: Ypsilanti, Mi
Gender: Male
Posts: XXXDCCCLXI
Blog Entries: 1
Images: 9
Default Re: 509 Bandwidth Limit Exceeded

Looking at the data with a fresh set of eyes it looks like our bandwidth usage actually increased by about 10x on April 29th. It already looks much better today but we might have another outage because we're so close to the ceiling of monthly allotment.

Screenshot 2024-05-14 at 8.22.18 AM.png
Reply With Quote
Thanks, from:
Ari (05-14-2024), ceptimus (05-14-2024), Crumb (05-14-2024), JoeP (05-14-2024), specious_reasons (05-14-2024), Stormlight (05-14-2024)
  #7  
Old 05-14-2024, 03:19 PM
Ari's Avatar
Ari Ari is offline
I read some of your foolish scree, then just skimmed the rest.
 
Join Date: Jan 2005
Location: Bay Area
Gender: Male
Posts: XMCMLVII
Blog Entries: 8
Default Re: 509 Bandwidth Limit Exceeded

If I'm reading that right that's potentially 12gbs a day, what the hell are the bots doing with all that bandwidth!
Reply With Quote
Thanks, from:
Stormlight (05-14-2024), viscousmemories (05-15-2024)
  #8  
Old 05-14-2024, 03:45 PM
Crumb's Avatar
Crumb Crumb is offline
Adequately Crumbulent
 
Join Date: Jan 2005
Location: Cascadia
Gender: Male
Posts: LXMMDCCXLIX
Blog Entries: 22
Images: 355
Default Re: 509 Bandwidth Limit Exceeded

They are stealing our smilies! :noid:
__________________
:joecool2: :cascadia: :ROR: :portland: :joecool2:
Reply With Quote
Thanks, from:
Ari (05-14-2024), BrotherMan (05-14-2024), JoeP (05-14-2024), mickthinks (05-14-2024), Pan Narrans (05-15-2024), slimshady2357 (05-14-2024), Sock Puppet (05-14-2024), Stormlight (05-14-2024), viscousmemories (05-15-2024)
  #9  
Old 05-14-2024, 04:16 PM
mickthinks's Avatar
mickthinks mickthinks is offline
Mr. Condescending Dick Nose
 
Join Date: May 2007
Location: Augsburg
Gender: Male
Posts: VMMDCCCXXX
Images: 19
Default Re: 509 Bandwidth Limit Exceeded

My guess is that the bots are compiling LLM corpuses. It’s the new black.
__________________
... it's just an idea
Reply With Quote
Thanks, from:
Ari (05-14-2024), JoeP (05-14-2024), Stephen Maturin (05-15-2024), Stormlight (05-14-2024), viscousmemories (05-15-2024)
  #10  
Old 05-14-2024, 05:12 PM
Stormlight's Avatar
Stormlight Stormlight is offline
Quality Contributor
 
Join Date: Jun 2005
Location: Luxembourg
Gender: Male
Posts: XLVDXXIII
Images: 92
Default Re: 509 Bandwidth Limit Exceeded

Freethought Forum BANNED from the internet. The reason why will SHOCK you!
__________________
Reply With Quote
Thanks, from:
Ari (05-14-2024), BrotherMan (05-14-2024), ceptimus (05-14-2024), Crumb (05-15-2024), Pan Narrans (05-15-2024), Stephen Maturin (05-15-2024), viscousmemories (05-15-2024)
  #11  
Old 05-14-2024, 05:16 PM
BrotherMan's Avatar
BrotherMan BrotherMan is online now
A Very Gentle Bort
 
Join Date: Jan 2005
Location: Bortlandia
Gender: Male
Posts: XVMMXLVIII
Blog Entries: 5
Images: 63
Default Re: 509 Bandwidth Limit Exceeded

AND NOT A ONE OF THEM ARE LINKING TO US.
__________________
\V/_
I COVLD TEACh YOV BVT I MVST LEVY A FEE
Reply With Quote
Thanks, from:
Stormlight (05-15-2024), viscousmemories (05-15-2024)
  #12  
Old 05-14-2024, 08:21 PM
Sock Puppet's Avatar
Sock Puppet Sock Puppet is offline
THIS IS REALLY ADVANCED ENGLISH
 
Join Date: Oct 2005
Location: so far out, I'm too far in
Gender: Bender
Posts: XMVDCCCLXXXVI
Blog Entries: 7
Images: 120
Default Re: 509 Bandwidth Limit Exceeded

I blame all the SOLZHENITSOF groupies.
__________________
hide, witch, hide / the good folks come to burn thee / their keen enjoyment hid behind / a gothic mask of duty - P. Kantner

:sockpuppet:...........
Reply With Quote
Thanks, from:
BrotherMan (05-15-2024), JoeP (05-16-2024), Stephen Maturin (05-15-2024), Stormlight (05-15-2024), viscousmemories (05-15-2024)
  #13  
Old 05-14-2024, 09:09 PM
-FX-'s Avatar
-FX- -FX- is offline
Forum gadfly
 
Join Date: Feb 2011
Location: In your head
Gender: Male
Posts: MMCXCI
Blog Entries: 1
Default Re: 509 Bandwidth Limit Exceeded

It's all fun and games until your database is gone
















forever
__________________
"Have no respect whatsoever for authority; forget who said it and instead look what he starts with, where he ends up, and ask yourself, "Is it reasonable?""

- Richard P. Feynman
Reply With Quote
  #14  
Old 05-14-2024, 11:23 PM
Ari's Avatar
Ari Ari is offline
I read some of your foolish scree, then just skimmed the rest.
 
Join Date: Jan 2005
Location: Bay Area
Gender: Male
Posts: XMCMLVII
Blog Entries: 8
Default Re: 509 Bandwidth Limit Exceeded

Quote:
Originally Posted by mickthinks View Post
My guess is that the bots are compiling LLM corpuses. It’s the new black.
Once they fully integrate the binary counting thread, they will be unstoppable!
Reply With Quote
Thanks, from:
Ensign Steve (05-15-2024), JoeP (05-16-2024), mickthinks (05-15-2024), Pan Narrans (05-15-2024), Stormlight (05-15-2024), viscousmemories (05-15-2024)
  #15  
Old 05-15-2024, 12:24 AM
Ensign Steve's Avatar
Ensign Steve Ensign Steve is offline
California Sober
 
Join Date: Jul 2004
Location: Silicon Valley
Gender: Bender
Posts: XXXMMCCCLVIII
Images: 66
Default Re: 509 Bandwidth Limit Exceeded

Quote:
Originally Posted by Ari View Post
If I'm reading that right that's potentially 12gbs a day, what the hell are the bots doing with all that bandwidth!
Mining bitcoin, I hope.
__________________
:kiwf::smurf:
Reply With Quote
Thanks, from:
slimshady2357 (05-15-2024), viscousmemories (05-15-2024)
Reply

  Freethought Forum > Public Works > Forum Administration


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

 

All times are GMT +1. The time now is 10:26 PM.


Powered by vBulletin® Version 3.8.2
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Page generated in 0.48276 seconds with 16 queries