 |
|
 |
Newsgroups : Alt : alt.internet.search-engines : 2007 Feb : How could this page be indexed ?
|
|
|
| Subject: | How could this page be indexed ? |
| Posted by: | "Alexandre Oberlin" (alex@nospam.com.invalid) |
| Date: | Tue, 6 Feb 2007 01:27:07 |
Hi all,
I recently added a subdir with PHP files to my site, while no link AFAIK
could possibly be pointing at it. So I didn't bother to disallow it in
robots.txt at first.
Yet google, yahoo and msn retrieved those pages...
This even brought me some some visitors.
I tried the search done by a visitor picked from my logs but did not get
to my site.
Also I had "Options -Indexes" in the .htaccess file.
Has someone a clue ?
Regards,
AO
|
|
|
|