Re: [GnuCOBOL 3.1.2] testsuite: 413 728 783 799 failed

[Jeffrey Walton]

On Fri, Jan 8, 2021 at 12:19 PM Simon Sobisch <simonsobisch@web.de> wrote:
>
> ...
>   728: run_file.at:340    OUTPUT on INDEXED file to missing directory
>   799: run_file.at:6579   INDEXED partial keys
>
> are related to the VBISAM you're using. 728 is an unexpected io-status
> only, so likely no issue, 799 is a feature this version of VBISAM does
> not have (we work on an official and big update of VBISAM for this year).
> The possibility of VBISAM passing some tests "unexpected" and failing
> other is noted in the NEWS entry, so I don't consider these "important
> issues" for now.

Maybe it would be a good idea to add 728 and 799 to XFAIL. XFAIL will
likely stop most of the noise. When 728 and 799 are a FAIL they have
to be reported. Or users feel obligated to report them.

It's OK to release often. The 3.1.3 could be fixes for self tests
only, like moving 728 and 799 to XFAIL. That will stop the extra
noise. Otherwise, you will get reports like this for years.

Jeff