Newsgroups : Alt : alt.internet.search-engines : 2006 Apr : robots.txt

robots.txt

Subject:	robots.txt
Posted by:	"Per-Erik Skramstad" (webmast..@korrekturavdelingen.no)
Date:	Wed, 12 Apr 2006 14:48:30 +0200

View Replies

What am I to write in the robots.txt file to make robots ignore a whole
folder? I tried Disallow: /foldername/ but it didn't seem to help

--
pe

Glossary

TXT FILE

File Types

.txt

Replies:

Re: robots.txt posted by Big Bill on Wed, 12 Apr 2006
- Re: robots.txt posted by Per-Erik Skramstad on Wed, 12 Apr 2006
  - Re: robots.txt posted by dk_sz on Wed, 12 Apr 2006
  - Re: robots.txt posted by Borek on Wed, 12 Apr 2006
    - Re: robots.txt posted by Jez on Wed, 12 Apr 2006
      - Re: robots.txt posted by Big Bill on Wed, 12 Apr 2006
  - Re: robots.txt posted by Big Bill on Wed, 12 Apr 2006
  - Re: robots.txt posted by Eric Johnston on Thu, 13 Apr 2006
    - Re: robots.txt posted by Roy Schestowitz on Fri, 21 Apr 2006
      - Re: robots.txt posted by Borek on Fri, 21 Apr 2006
        Re: robots.txt posted by Roy Schestowitz on Fri, 21 Apr 2006