| re: Bots and Crawlers |
| [47129] by "Tom 7" (h-68-166-177-37.phlapafg.dynamic.covad.net)
on Mon 28 Feb 2005 18:25:08
[ reply ] [ up ]
|
It's easier than that... "robots.txt" allows you to exclude certain pages from being crawled by bots. But, like I said, I want the games to be on the search engines.
I just made it so that games with no words played can't qualify for "highest number of words" in the hall of fame. |
|
|
|