[3.3.x] Support Forum • Re: Rate Limiting GoogleBot?

The lines in question are not for phpBB syntax, but I added the phpBB equivalents to my robots.txt.

Code:

Disallow: *sid=Disallow: */index.php?p=

Offhand I don't know how effective they are with Google bots, since Google hasn't been hammering my site anyway. They should work though.

I can kind of understand what the *sid= does, but I'm having trouble understanding what the second disallow might accomplish. My thinking is that p= would be for viewtopic.php?p=, not index.php?p=.

Statistics: Posted by Gumboots — Sat May 03, 2025 9:48 pm