[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Savannah-hackers] Added a few 'Disallow's to /robots.txt
From: |
Elfyn McBratney |
Subject: |
[Savannah-hackers] Added a few 'Disallow's to /robots.txt |
Date: |
Sun, 18 Apr 2004 06:49:44 +0000 |
User-agent: |
KMail/1.6.1 |
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hello,
I've just added the following to /robots.txt:
User-agent: *
Disallow: /admin/*
Disallow: /bugs/admin/*
Disallow: /files/admin/*
Disallow: /mail/admin/*
Disallow: /news/admin/*
Disallow: /patch/admin/*
Disallow: /people/admin/*
Disallow: /pm/admin/*
Disallow: /project/admin/*
Disallow: /support/admin/*
Disallow: /task/admin/*
Disallow: /include/*
Disallow: /*/CVS/*
(commented out for now.) If no one objects, I'll enable this later this
evening. Oh, and this will only stop robots
Elfyn
- --
Elfyn McBratney, EMCB
mailto:address@hidden
http://www.emcb.co.uk/
PGP Key ID: 0x456548B4
PGP Key Fingerprint:
29D5 91BB 8748 7CC9 650F 31FE 6888 0C2A 4565 48B4
Error: quote_machine(): Dry humour detected.
>> ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ <<
<< ~ Linux london 2.6.5-emcb-241 #2 i686 GNU/Linux ~ >>
>> ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ <<
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.4 (GNU/Linux)
iD8DBQFAgiUIaIgMKkVlSLQRApeHAJ9C7jK59j17NjAkPOpK1hEiP0/x+wCfd++R
s+M9mGX5+3aorTy1TEG4mzc=
=7Vjq
-----END PGP SIGNATURE-----
[Prev in Thread] |
Current Thread |
[Next in Thread] |
- [Savannah-hackers] Added a few 'Disallow's to /robots.txt,
Elfyn McBratney <=