Re: verify regression tests

[Marc Hohl]

Am 02.10.2012 23:24, schrieb Janek Warchoł:
> Hi Marc,
>
> On Sun, Sep 30, 2012 at 9:14 PM, Marc Hohl <address@hidden> wrote:
> > I got strange results with the regression tests, and studying the
> > CG more carefully, I spotted some differences:
> >
> > http://lilypond.org/doc/v2.17/Documentation/contributor/regtest-comparison
> >
> > says that you should do
> >
> > make test-baseline && make check
> >
> > [changed the code; if needed 'make']
> >
> > make test-redo && make check (the latter is rather implicitly hidden in the
> > text)
> >
> > After all looks good, do a
> >
> > make test-clean && make check
> >
> > to restore the system to a clean state.
> >
> > http://lilypond.org/doc/v2.17/Documentation/contributor/verify-regression-tests
> >
> > is more overviewish, but it lacks the final
> >
> > make check
> >
> > which is needed after make test-clean, IIUC.
> I think the intended difference is that in the first set of
> instructions the final 'make test-clean' wipes out the test results so
> that they may be ran once more "from scratch".  I the second place,
> 'make test-clean' is just cleaning after yourself for the sake of any
> future testing (i.e. there's just no "final check made again from
> scratch").
Ah, I see. But IMHO it would make sense to mention that a complete
start from scratch needs the 'make check' afterwards.

Regards,

Marc
> hope i got it right
> Janek