[tommyboy123x]

how do sites like webmasterworld configure the robots.txt (or other file) so that google does not cache it, but you can still read snippets of it in the google search?

[office politics]

http://www.robotstxt.org/wc/norobots.html

[tommyboy123x]

i know how to set up a normal robots.txt file....

Originally posted by tommyboy123x
how do sites like webmasterworld configure the robots.txt (or other file) so that google does not cache it, but you can still read snippets of it in the google search?