[Octave-bug-tracker] [bug #49507] test: allow unit tests to signal that a test is expected to fail based on arbitrary runtime check

[Mike Miller]

URL:
  <http://savannah.gnu.org/bugs/?49507>

                 Summary: test: allow unit tests to signal that a test is
expected to fail based on arbitrary runtime check
                 Project: GNU Octave
            Submitted by: mtmiller
            Submitted on: Tue 01 Nov 2016 10:58:09 AM PDT
                Category: Octave Function
                Severity: 1 - Wish
                Priority: 5 - Normal
              Item Group: Feature Request
                  Status: Confirmed
             Assigned to: None
         Originator Name: 
        Originator Email: 
             Open/Closed: Open
         Discussion Lock: Any
                 Release: dev
        Operating System: Any

    _______________________________________________________

Details:

This was discussed on the mailing list but not copied to a bug report.

It would be nice if unit test blocks could run arbitrary code and based on
some runtime condition, raise a particular error or return a particular exit
status that indicates to the test runner that the test is expected to fail /
skip / do not report as a failure.

This came up in the context of Java tests. All tests are conditioned on
HAVE_JAVA, which is fine as a compile-time condition, but also need to test
whether the JRE can be loaded at runtime.

Similar tests could occur for existence of gnuplot, or existence of a DISPLAY
/ headless environment (Octave function have_window_system()), or for
existence of optional functions, runtime libraries, etc.




    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?49507>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/