Is this correctly formatted?
User-agent: ia_archiver
Disallow: /
User-agent: Googlebot-Image
Disallow: /*.gif$
User-agent: Googlebot-Image
Disallow: /*.jpg$
User-agent: *
Disallow: /norobots/
What I'm hoping to accomplish is:
1. to keep the ia_archiver bot (waybackmachine) from archiving any part
of my site.
2. to keep any of my images (gif or jpg) from appearing in the Google
Image search.
3. to allow all other bots to index and follow any part of my site with
the exception of anything that is located in the /norobots/ folder.
I also have a NOARCHIVE tag inserted in the META of each page on my
site - which I guess is a little redundant in the case of the IA bot,
but oh well :)
Thanks.
