Re: [PATCH 11] Fix LAZY_TEST_SUITE handling and $(TEST_SUITE_LOG) recreation.

[Akim Demaille]

Le 14 mars 09 à 13:39, Akim Demaille a écrit :
> I often use
>
>         STRICT_TEST_LOGS = $(shell $(LIST_FAILED_TEST_LOGS))
>
> which makes all failing test strict.  In other words, successful  
> tests are not rerun by "make check", but failing tests are.  This is  
> because our test suite sometimes hits the limit of the machine, and  
> tests timeout for no sound reason.  So there is no reason to rerun  
> successful tests, but failing test might pass if the machine has a  
> lesser load.

FWIW, I also noticed that we sometimes had tests that were removed/ 
renamed that were still marked as XFAILs.  So I use this in some of my  
test suites:

# Check that XFAIL tests do exist.
check-test-list-%:
        @exit=true;                                             \
        for f in $($*); do                                      \
          if test ! -f $$f && test ! -f $(srcdir)/$$f; then     \
            echo >&2 "$*: $$f does not exist";                 \
            exit=false;                                         \
          fi;                                                   \
        done;                                                   \
        $$exit

.PHONY check-TESTS: check-tests
check-tests: check-test-list-XFAIL_TESTS check-test-list-TFAIL_TESTS