Re: [Savannah-hackers-public] permission denied when mirroring

[Sylvain Beucler]

Hi Kapetanakis,

The permissions are defined by the admins of each hosted project.

For example, the 'scat' reported errors happened because the admin
first uploaded the file with too little permissions, but he fixed them
later on.

A few GNU project accounts are also 'private', which is probably why
their download area is not opened to the public. It's not visible from
Apache (because it doesn't show files if there's not enough
permissions) but it's visible from rsync :)

So you'll probably always get transfer errors from time to time. I
think you can ignore errors when rsync returns with code 23 or 24
("permission error" and "file vanished during mirroring") - a
technique used by tools such as rsnapshot. I don't think exclusion
rules would help because these permissions are subject to change.


I also usually specify '--delete' when mirroring, I don't think
there's an issue doing deletions first (unless you had previous bad
experience with this).


Feel free to ask us if you have other questions :)

Regards,

-- 
Sylvain


On Wed, Jul 04, 2007 at 05:30:35PM -0500, Karl Berry wrote:
> The admin in Greece doing the mirroring reported the following
> permission errors with his rsync.  Can we exclude these somehow?
> 
> (I advised him to omit --delete-after, which is apparently why the
> deletions were not happening, but it still seems like something that
> should be fixed.)
> 
> >    I'm using  -aHSv --timeout=600 --delete-after
> > 
> > These are the errors I get.
> > receiving file list ... rsync: opendir "mastermailer" (in releases) 
> > failed: Permission denied (13)
> > rsync: opendir "fsf-ams" (in releases) failed: Permission denied (13)
> > rsync: opendir "ruf" (in releases) failed: Permission denied (13)
> > rsync: opendir "gnumail" (in releases) failed: Permission denied (13)
> > done
> > 00_TIME.txt
> > rsync: send_files failed to open "epiwm/EPIwm-0.5.6-1.i586.rpm" (in 
> > releases): Permission denied (13)
> > rsync: send_files failed to open "epiwm/EPIwm-0.5.6-1.src.rpm" (in 
> > releases): Permission denied (13)
> > rsync: send_files failed to open "scat/Scat-0.0.2.tar.gz.sig" (in 
> > releases): Permission denied (13)
> > rsync: send_files failed to open "scat/scat-0.0.10.tar.gz.sig" (in 
> > releases): Permission denied (13)
> > rsync: send_files failed to open "scat/scat-0.0.3.tar.gz.sig" (in 
> > releases): Permission denied (13)
> > rsync: send_files failed to open "scat/scat-0.0.5.tar.gz.sig" (in 
> > releases): Permission denied (13)
> > rsync: send_files failed to open "scat/scat-0.0.6.tar.gz.sig" (in 
> > releases): Permission denied (13)
> > rsync: send_files failed to open "scat/scat-0.0.7.tar.gz.sig" (in 
> > releases): Permission denied (13)
> > rsync: send_files failed to open "scat/scat-0.0.8.tar.gz.sig" (in 
> > releases): Permission denied (13)
> > rsync: send_files failed to open "scat/scat-0.0.9.tar.gz.sig" (in 
> > releases): Permission denied (13)
> > IO error encountered -- skipping file deletion
> > ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> > 
> > sent 341 bytes  received 413979 bytes  63741.54 bytes/sec
> > total size is 6105659984  speedup is 14736.58
> > rsync error: some files could not be transferred (code 23) at main.c(1385) 
> > [generator=2.6.9]
> > 
> > The IO error is in your server.
> > Also I get some permission denied on the files and directories above.
> > 
> > Giannis
> > ps. I deleted administration/ myself