savannah-hackers
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Savannah-hackers] Added a few 'Disallow's to /robots.txt


From: Elfyn McBratney
Subject: [Savannah-hackers] Added a few 'Disallow's to /robots.txt
Date: Sun, 18 Apr 2004 06:49:44 +0000
User-agent: KMail/1.6.1

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hello,

I've just added the following to /robots.txt:

  User-agent: *
  Disallow: /admin/*
  Disallow: /bugs/admin/*
  Disallow: /files/admin/*
  Disallow: /mail/admin/*
  Disallow: /news/admin/*
  Disallow: /patch/admin/*
  Disallow: /people/admin/*
  Disallow: /pm/admin/*
  Disallow: /project/admin/*
  Disallow: /support/admin/*
  Disallow: /task/admin/*
  Disallow: /include/*
  Disallow: /*/CVS/*

(commented out for now.)  If no one objects, I'll enable this later this 
evening.  Oh, and this will only stop robots

Elfyn

- -- 
Elfyn McBratney, EMCB
mailto:address@hidden
http://www.emcb.co.uk/

PGP Key ID: 0x456548B4
PGP Key Fingerprint:
  29D5 91BB 8748 7CC9 650F  31FE 6888 0C2A 4565 48B4

Error: quote_machine(): Dry humour detected.

>> ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ <<
<< ~  Linux london 2.6.5-emcb-241 #2 i686 GNU/Linux  ~ >>
>> ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ <<
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.4 (GNU/Linux)

iD8DBQFAgiUIaIgMKkVlSLQRApeHAJ9C7jK59j17NjAkPOpK1hEiP0/x+wCfd++R
s+M9mGX5+3aorTy1TEG4mzc=
=7Vjq
-----END PGP SIGNATURE-----




reply via email to

[Prev in Thread] Current Thread [Next in Thread]