There is often 14, or ever sometimes more, web spiders indexing SRL Forums constantly. Why does SRL not just set a robots.txt file in their main directory and block all webspiders except for the Adsence bot for the ads?Each one of those spiders make SRL use more bandwidth, making SRL cost more per month.
That's a list I got of them. Isn't that a great waste of SRL's bandwidth??Google Spider
Viewing Thread
What does 'tut' mean?
03:05 PM Google AdSense Spider
Viewing Thread
FrugooScape Autoclicker
02:53 PM Yahoo! Slurp Spider
Viewing User Profile
03:05 PM Google Spider
Viewing Index
SRL-Forums
03:05 PM Google Spider
Viewing Thread
Dodian Script Pack
03:05 PM Google Spider
Viewing Thread
VERY easy way to add smart
02:57 PM Google Spider
Viewing Index
SRL-Forums
03:04 PM Google Spider
Viewing Index
SRL-Forums
03:05 PM Google Spider
Viewing Index
SRL-Forums
02:56 PM Google AdSense Spider
Viewing Thread
How much GP have you made from autoing? (staking is allowed, too)
03:01 PM Google Spider
Viewing Index
SRL-Forums
03:04 PM Google AdSense Spider
Viewing Index
SRL-Forums
-Discuss![]()






Each one of those spiders make SRL use more bandwidth, making SRL cost more per month.
Reply With Quote









) they want SRL to be kept private, excluded from Google. Although, I don't know what their statements are now



) It's worth a bit of lag that more people do come to SRL.
