state of CVS Automake

[Ralf Wildenhues]

I ran a round of tests of CVS Automake, posting some bug fixes along the
way ... could you have guessed?  ;-)  With those, CVS Automake as of the
last couple of months fares as follows on a number of systems.  The list
is sorted by OS then CPU; duplicate entries denote different computers.

I've been trying to use native tools only, as present, esp. I did
usually _not_ have GNU make in $PATH if the native one is different;
GNU m4 everywhere, and varying CVS Autoconf versions from during the
last few weeks; usually I did not try to ensure that a GCC version
was in PATH, even on systems that had it installed somewhere.

Systems from the HP testdrive project are marked as such; some of those
exhibit issues not found on other installations of similar systems,
i.e., same or similar $host value.  If some of these can be shown to be
system configuration issues, it'd be good to sort them out and report
them.  Anyways, kudos to HP for providing this service!

Logs with VERBOSE=x are available, in case you're interested; most
issues should have been reported on one of the automake lists, however.
Items marked `fixed' have been fixed since the test run, for issues
marked `patch pending', surprisingly, a patch has been posted since.

I realize that, because GNU make, gcc, libtool and some other tools
required by some of the test are not installed on those systems or need
special configuration flags to be accessible, the test suite exposure is
less complete that it could have been.  Oh well.

Cheers,
Ralf

(*) denotes issues for which no separate report has been posted (yet).

powerpc-ibm-aix4.3.3.0
=====================================
2 of 455 tests failed
(136 tests were not run)
=====================================
        longlin2        fixed
        mkinst3         fixed

powerpc-ibm-aix5.1.0.0
=====================================
2 of 454 tests failed
(137 tests were not run)
=====================================
        automake.test   fixed
        longlin2.test   fixed

powerpc-ibm-aix5.2.0.0
=====================================
1 of 454 tests failed
(137 tests were not run)
=====================================
        automake.test   fixed

powerpc-ibm-aix5.3.0.0
=======================================================
All 454 tests behaved as expected (3 expected failures)
(137 tests were not run)
=======================================================

i686-pc-cygwin
=====================================
11 of 552 tests failed
(39 tests were not run)
=====================================
        txinfo3.test
        txinfo13.test
        txinfo16.test
        txinfo18.test
        txinfo21.test
        txinfo22.test
        txinfo23.test
        txinfo24.test
        txinfo25.test
        txinfo28.test
        version7.test
These failures are similar to what Markus Elfring reported here:
http://lists.gnu.org/archive/html/bug-automake/2006-04/msg00017.html
http://lists.gnu.org/archive/html/bug-automake/2006-05/msg00001.html
presumably because the Cygwin TeX installation seems broken.

powerpc-apple-darwin8.2.0
=======================================================
All 536 tests behaved as expected (3 expected failures)
(55 tests were not run)
=======================================================

i386-unknown-freebsd5.4
=======================================================
All 497 tests behaved as expected (3 expected failures)
(94 tests were not run)
=======================================================

i386-unknown-freebsd5.4 (testdrive)
=======================================================
All 502 tests behaved as expected (3 expected failures)
(89 tests were not run)
=======================================================

ia64-unknown-freebsd6.0 (testdrive)
=====================================
1 of 497 tests failed
(94 tests were not run)
=====================================
        remake4.test    NFS oddity?

alpha-unknown-freebsd6.0
=======================================================
All 502 tests behaved as expected (3 expected failures)
(89 tests were not run)
=======================================================

hppa2.0-hp-hpux10.20
=====================================
1 of 453 tests failed
(138 tests were not run)
=====================================
        distdir.test    fixed

hppa2.0w-hp-hpux11.00
=====================================
1 of 453 tests failed
(138 tests were not run)
=====================================
        distdir.test    fixed

hppa2.0w-hp-hpux11.11
=====================================
1 of 458 tests failed
(133 tests were not run)
=====================================
        distdir.test    fixed

hppa2.0w-hp-hpux11.23
=====================================
1 of 453 tests failed
(138 tests were not run)
=====================================
        distdir.test    fixed

ia64-hp-hpux11.23
=====================================
1 of 453 tests failed
(138 tests were not run)
=====================================
        distdir.test    fixed

mips-sgi-irix6.5
=====================================
1 of 454 tests failed
(137 tests were not run)
=====================================
        depcomp6.test:  patch pending   bug with depmode=sgi
        java.test:      fixed           (skipped due to nonexistent compiler)

x86_64-unknown-linux-gnu (RHEL4)
=======================================================
All 533 tests behaved as expected (3 expected failures)
(58 tests were not run)
=======================================================

x86_64-unknown-linux-gnu (FC3)
=======================================================
All 591 tests behaved as expected (3 expected failures)
=======================================================
        (this is with the gettext patch applied)

i686-pc-mingw32
=====================================
6 of 510 tests failed
(82 tests were not run)
=====================================
        automake.test   fixed
        pr401.test      patch pending (perl -i)
        pr401c.test     likewise
        python11.test   likewise
        symlink.test    "ln -s" is emulated by "cp -p" (*)
        tar.test        MinGW tar is too old for ustar (*)

i386-unknown-netbsdelf3.0 (testdrive)
=====================================
2 of 505 tests failed
(86 tests were not run)
=====================================
        automake.test   fixed
        remake4.test    NFS oddity?

i386-unknown-openbsd3.8
=====================================
1 of 491 tests failed
(100 tests were not run)
=====================================
        depcomp6.test   fixed

alphaev5-dec-osf4.0d
=====================================
2 of 454 tests failed
(137 tests were not run)
=====================================
        distdir.test    fixed
        acloca18.test   patch pending   (diff /dev/null)

alphaev67-dec-osf5.1
=====================================
2 of 454 tests failed
(137 tests were not run)
=====================================
        distdir.test    fixed
        acloca18.test   patch pending   (diff /dev/null)

alphaev7-dec-osf5.1b (testdrive)
=====================================
6 of 492 tests failed
(99 tests were not run)
=====================================
        acloca18.test   patch pending   (diff /dev/null)
        automake.test   fixed
        distdir.test    fixed
        instspc.test    build-/install-failures on ^H, ^M, ^L, (*)
        pr401.test      patch pending   LIBOBJDIR and BSD make
        pr401c.test     likewise

alphaev68-dec-osf5.1b (testdrive)
=====================================
7 of 457 tests failed
(134 tests were not run)
=====================================
        acloca18.test   patch pending   (diff /dev/null)
        automake.test   fixed
        distdir.test    fixed
        missing.test    $sleep, NFS oddity?
        missing2.test   likewise
        missing4.test   likewise
        spy.test        non-upating-redirection

sparc-sun-solaris2.6
=====================================
5 of 453 tests failed
(138 tests were not run)
=====================================
        distdir.test    VPATH subdir issue (foo/bar, not ./joe)
        extra6.test     likewise
        pr9.test        likewise
        subpkg3.test    likewise
        java.test       fixed

sparc-sun-solaris2.7
=======================================================
All 453 tests behaved as expected (3 expected failures)
(138 tests were not run)
=======================================================

sparc-sun-solaris2.8
=======================================================
All 453 tests behaved as expected (3 expected failures)
(138 tests were not run)
=======================================================

sparc-sun-solaris2.9
=====================================
1 of 453 tests failed
(138 tests were not run)
=====================================
        automake.test   fixed

sparc-sun-solaris2.10
=======================================================
All 454 tests behaved as expected (3 expected failures)
(137 tests were not run)
=======================================================