 |
|
 |
Newsgroups : Alt : alt.internet.search-engines : 2006 Sep : how to stop crawler to index web page?
|
|
|
| Subject: | how to stop crawler to index web page? |
| Posted by: | "John" (javac..@gmail.com) |
| Date: | 22 Sep 2006 19:13:47 |
Is there a way to stop web crawler from indexing or parsing my web
pages? I saw xanga.com has a feature that allows the user to do that.
Please advice. thanks!!
|
|
|
|