Re: TAP support in automake

[Bob Friesenhahn]

On Sun, 1 Apr 2012, Stefano Lattarini wrote:

> On 03/31/2012 11:47 PM, Bob Friesenhahn wrote:
> > how does one re-execute just one test in order to see the details
> > of how it failed?
> With Automake, one shouldn't -- he should write his test to be verbose
> enough so that a perusing of the logs is sufficient to reveal the reason
> of the failure.

Ok, now I hear that there are still log files similar to 
parallel-tests (presumably using the identical facility).  It does not 
seem that Russ's C TAP Harness offers this quite wonderful feature 
since the instructions advise to re-run just the one test to see more 
verbose output (similar to what I have experienced from perl).

> You mean running only a given test case in a given TAP test script, or all
> the test cases in a given TAP test script?  Currently, there is no transparent
> way way to do the former (which is hardly surprising), but for the latter,
> you would use the same interface you use for "simple" tests:
>
>  make check TESTS=granular.tap
>
> or even:
>
>  make check TEST_LOGS=granular.log

So Automake TAP still supports the same parallel-tests facility but 
treats files with the ".tap" extension as being TAP test scripts? 
That sounds like a useful approach.

An issue with using the TAP facility to reduce the number of tests (to 
fix command line length issues) is that it reduces the amount of 
available test parallelism.

Bob
--
Bob Friesenhahn
address@hidden, http://www.simplesystems.org/users/bfriesen/
GraphicsMagick Maintainer,    http://www.GraphicsMagick.org/