 |
|
 |
Newsgroups : Alt : alt.internet.search-engines : 2006 Oct : can i browse a web site as a web crawler identity?
|
|
|
| Subject: | can i browse a web site as a web crawler identity? |
| Posted by: | "subscribe" (samplestrate..@gmail.com) |
| Date: | 17 Oct 2006 02:08:20 |
can a normal browser's identity, IE or firefox, be changed to a web
spider?
or is there a browser which pretends to be a web crawler?
|
|
|
|