automake
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Why is there a miscount in the parallel test results?


From: Arthur Schwarz
Subject: Why is there a miscount in the parallel test results?
Date: Thu, 28 May 2015 22:07:40 -0700

Cutting out the chatter, I ran a simple test case today (thanks Eric) and
the test results shows 2 test being run but only one test reported. Any
reason for this?

--------------- test results ---------------
PASS: test4.sh
============================================
Testsuite summary for test 0.5
============================================
# TOTAL: 2
# PASS:  1
# SKIP:  0
# XFAIL: 0
# FAIL:  0
# XPASS: 0
# ERROR: 0
===========================================

--------------- Makefile.am ---------------
## Process this file with automake to produce Makefile.in

# select testing format
AUTOMAKE_OPTIONS = parallel-tests 


# test options
TEST_EXTENSIONS    = .abc 
ABC_LOG_DRIVER     =  driver.sh
ABC_LOG_DRIVER_FLAGS = -def --ghi --jkl=mno

# Testing 
check_SCRIPTS      = test3.abc driver.sh test4.sh
TESTS              = test3.abc test4.sh

test3.abc:
        echo '#!/bin/bash'                                  > test3.abc
        echo 'echo test3.abc "$$# [ $$@ ]"'                >> test3.abc
        echo "echo I am a test script"                     >> test3.abc
        chmod +x test3.abc

test4.sh:
        echo '#!/bin/bash'                                  > test4.sh
        echo 'echo test4.sh  "$$# [ $$@ ]"'                >> test4.sh
        echo "echo I use a default driver"                 >> test4.sh
      echo 'echo exit 77'                                >> test4.sh
        chmod +x test4.sh
   
driver.sh:
        echo "#!/usr/bin/bash"                              > driver.sh
        echo 'echo driver.sh "$$# [ $$@ ]"   >> test3.log' >> driver.sh
        echo "echo :copy-in-global-log: yes  >> test3.trs" >> driver.sh
        echo "echo :test-global-result: pass >> test3.trs" >> driver.sh
        echo "echo :test-result: pass        >> test3.trs" >> driver.sh
        echo "echo I am a custom driver      >> test3.log" >> driver.sh
        chmod +x driver.sh

CLEANFILES         = $(test_SOURCES)
 
Maintenance turns design into chaos





reply via email to

[Prev in Thread] Current Thread [Next in Thread]