 |
|
 |
Newsgroups : Alt : alt.internet.search-engines : 2006 Oct : why some web pages can be access by a web crawler but not a normal browser?
|
|
|
| Subject: | why some web pages can be access by a web crawler but not a normal browser? |
| Posted by: | "index-match" (mailtumeng..@gmail.com) |
| Date: | 19 Oct 2006 03:21:09 |
why some web pages can be access by a web crawler but not a normal
browser? besides cloaking, are any other cases existed?
|
|
|
|