Re: [GNU Autoconf 2.67] testsuite: 193 199 233 253 254 failed on Haiku

[scott mc]

On Tue, Aug 3, 2010 at 8:48 PM, Ralf Wildenhues <address@hidden> wrote:
> Hi Scott,
>
> thanks for the test feedback.
>
> * scott mc wrote on Tue, Aug 03, 2010 at 10:22:55PM CEST:
>> [Moderator Note: The original message was very large at 203803 bytes.
>> I gzip'd the log files down to 16K and 18K, re-attached the files and
>> re-mailed the message. --Bob Proulx]
>
> thanks Bob!
>
>> Haiku currently uses autoconf-2.65, I have attached the test results
>> from running make check with 2.65 and 2.67.  With the regression in
>> 2.66 we rolled back to 2.65.  iku.
>> This was run on Haiku r37150 which was built on June 15th, 2010.
>
> These results do not actually point at a regression in Autoconf; here's
> why:
>
> |  193: autotest.at:1250   parallel test execution
> |       autotest
>
> This looks like the stdout output from the shell redirected to a file in
> append mode: >>"$at_stdout" did not actually catch all output.  To me,
> that seems like a race condition hidden in file handling on Haiku
> somewhere.  Or in the shell.
>
> If you run this test 20 times, how often do you get failures?
>  for run in `seq 10`; do
>    make check TESTSUITEFLAGS=193
>  done
>

I just ran test 193 ten times on Haiku r37908 (Aug 4th 2010 build) and
it passes 9 out of 10 times, with just the one failure, on the 7th or
8th pass:

/bin/sh ./testsuite 193
## ----------------------------- ##
## GNU Autoconf 2.67 test suite. ##
## ----------------------------- ##
193: parallel test execution                         FAILED (autotest.at:1313)

## ------------- ##
## Test results. ##
## ------------- ##

ERROR: 1 test was run,
1 failed unexpectedly.
## -------------------------- ##
## testsuite.log was created. ##
## -------------------------- ##

Please send `tests/testsuite.log' and all information you think might help:

   To: <address@hidden>
   Subject: [GNU Autoconf 2.67] testsuite: 193 failed

You may investigate any problem if you feel able to do so, in which
case the test suite provides a good starting point.  Its output may
be found below `tests/testsuite.dir'.

make[1]: *** [check-local] Error 1
make[1]: Leaving directory
`/boot/develop/haikuports/sys-devel/autoconf/work/autoconf-2.67/tests'
make: *** [check-am] Error 2
make  check-local
make[1]: Entering directory
`/boot/develop/haikuports/sys-devel/autoconf/work/autoconf-2.67/tests'
/bin/sh ./testsuite 193
## ----------------------------- ##
## GNU Autoconf 2.67 test suite. ##
## ----------------------------- ##
193: parallel test execution                         ok

## ------------- ##
## Test results. ##
## ------------- ##

1 test was successful.