[Gluster-devel] Re: NFS reexport status

[Brent A Nelson]

With unified AFR (and AFR for namespace), even du doesn't work properly 
with NFS reexport:

du -sk usr*
263152  usr0
223612  usr0-copy
277536  usr1
du: cannot access `usr1-copy/share/perl/5.8.8/unicore/lib/gc_sc/\a': No 
such file or directory
du: cannot access `usr1-copy/include/bits/\f': No such file or directory
du: cannot access `usr1-copy/include/bits/"P\001': No such file or 
directory
202304  usr1-copy

du -sk usr* (from GlusterFS client)
406684  usr0
406708  usr0-copy
406684  usr1
406716  usr1-copy

Thanks,

Brent

On Thu, 2 Aug 2007, Brent A Nelson wrote:

> NFS reexport of a unified GlusterFS seems to be working fine as of TLA 409. 
> I can make identical copies of a /usr area local-to-glusterfs and 
> glusterfs-to-glusterfs, hardlinks and all.  Awesome!
>
> However, this is not true when AFR is added to the mix (rsync 
> glusterfs-to-glusterfs via NFS reexport):
>
> rsync: readdir("/tmp/blah/usr0/lib/perl/5.8.8/auto/POSIX"): Input/output 
> error (5)
> rsync: readdir("/tmp/blah/usr0/share/perl/5.8.8"): Input/output error (5)
> rsync: readdir("/tmp/blah/usr0/share/i18n/locales"): Input/output error (5)
> rsync: readdir("/tmp/blah/usr0/share/locale-langpack/en_GB/LC_MESSAGES"): 
> Input/output error (5)
> rsync: readdir("/tmp/blah/usr0/share/groff/1.18.1/font/devps"): Input/output 
> error (5)
> rsync: readdir("/tmp/blah/usr0/share/man/man1"): Input/output error (5)
> rsync: readdir("/tmp/blah/usr0/share/man/man8"): Input/output error (5)
> rsync: readdir("/tmp/blah/usr0/share/man/man7"): Input/output error (5)
> rsync: readdir("/tmp/blah/usr0/share/X11/xkb/symbols"): Input/output error 
> (5)
> rsync: readdir("/tmp/blah/usr0/share/zoneinfo/right/Africa"): Input/output 
> error (5)
> rsync: readdir("/tmp/blah/usr0/share/zoneinfo/right/Asia"): Input/output 
> error (5)
> rsync: readdir("/tmp/blah/usr0/share/zoneinfo/right/America"): Input/output 
> error (5)
> rsync: readdir("/tmp/blah/usr0/share/zoneinfo/Asia"): Input/output error (5)
> rsync: readdir("/tmp/blah/usr0/share/doc"): Input/output error (5)
> rsync: readdir("/tmp/blah/usr0/share/consolefonts"): Input/output error (5)
> rsync: readdir("/tmp/blah/usr0/bin"): Input/output error (5)
> rsync: 
> readdir("/tmp/blah/usr0/src/linux-headers-2.6.20-16/include/asm-sparc64"): 
> Input/output error (5)
> rsync: readdir("/tmp/blah/usr0/src/linux-headers-2.6.20-16/include/linux"): 
> Input/output error (5)
> rsync: 
> readdir("/tmp/blah/usr0/src/linux-headers-2.6.20-16/include/asm-mips"): 
> Input/output error (5)
> rsync: 
> readdir("/tmp/blah/usr0/src/linux-headers-2.6.20-16/include/asm-parisc"): 
> Input/output error (5)
> file has vanished: 
> "/tmp/blah/usr0/src/linux-headers-2.6.20-16/include/asm-sparc/\#012"
> rsync: 
> readdir("/tmp/blah/usr0/src/linux-headers-2.6.20-16-server/include/config"): 
> Input/output error (5)
> rsync: 
> readdir("/tmp/blah/usr0/src/linux-headers-2.6.20-16-server/include/linux"): 
> Input/output error (5)
> ...
>
> Any ideas? Meanwhile, I'll try to track it down in strace (the output will be 
> huge, but maybe I'll get lucky)...
>
> Thanks,
>
> Brent