Re: [Axiom-developer] unit testing

[Martin Rubey]

Waldek Hebisch <address@hidden> writes:

> > Dear all,
> > 
> > I'm discussing with Christian Aistleitner unit testing in Axiom, and I
> > wondered, how the regression tests are currently run. I only found the 
> > .input
> > files, but cannot find any files containing the corresponding "should be"
> > output.
> > 
> > Furthermore, how is "should be" and "is" currently compared?
> > 
> 
> The procedure I use for wh-sandbox is as follows.  First, when a change
> is developed I use ad hoc methods to verify that the change is having
> intended effect typically going trough many iterations.  When I am
> satisfied with change I do a full build and compare test output and
> generated .pht pages.  For recent changes to algebra bootstrap and to
> interpreter (switch from boot to Shoe) I also compared generated Lisp.

Oh, I meant, results of computations using axiom...

> - big problem is how to find correct answer to compare with test result.  For
> indefinite integrals we can just integrate derivatives.  For definite
> integrals (and possibly some other expressions) we may compare numerical
> evaluation of symbolic result with result of numerical integration.  Another
> possibility is are multi-CAS competitions: compare outputs of different
> systems.

Yes, that's what I have in mind - although, for the moment, static only. I.e.,
a rather large database of results, which are checked after a change in the
algebra is made

Martin