Re: TAP support in automake

[Bob Friesenhahn]

On Sat, 31 Mar 2012, Russ Allbery wrote:
> This isn't the case if you have a sufficiently new version of the TAP
> driver.  The TAP protocol allows the tests to not be numbered.  You lose
> some robustness, since you then potentially don't know if a test was
> skipped silently, but it's supported by C TAP Harness in the runtests.c
> driver.  (The basic C TAP library doesn't support generating that style of
> output, but that's because the library takes care of the counting for you,
> so you don't need to keep track of test numbers.)

The numbers are useful.  TAP is documented to support reporting the 
number of tests at the end of the test run rather than at the 
beginning.

Using your TAP test driver, and under the umbrella of Automake, how 
does one re-execute just one test in order to see the details of how 
it failed?  The sample tests in your test harness expect that SOURCE 
and BUILD have already been set in the environment by Automake so just 
running via the suggested 'runtests -o' results in a failed test.

In Automake I do this like

  make TESTS=mytest

Using Perl's test driver I can execute one test like

  make TEST_VERBOSE=1 TEST_FILES=t/mytest.t test

How will the Automake 1.12 TAP driver handle this common special case?

Bob
--
Bob Friesenhahn
address@hidden, http://www.simplesystems.org/users/bfriesen/
GraphicsMagick Maintainer,    http://www.GraphicsMagick.org/