RE: create code tests

[lilypond]

> -----Original Message-----
> From: Dan Eble <address@hidden>
> Sent: Thursday, November 28, 2019 10:00 PM
> To: address@hidden
> Cc: address@hidden
> Subject: Re: create code tests
> 
> On Nov 28, 2019, at 15:07, address@hidden wrote:
> 
> > Is het possible to do this kind of tests in the current lilypond
> > regression test environment?
> 
> Jaap,
> 
> I don't have a comprehensive knowledge of LilyPond's tests, but I have worked
> on some of the infrastructure recently, so maybe I can help you.
> 
> Please provide more detail.  What are the inputs and outputs of your tests?
> What steps are involved?  Are expectations coded such that your script can
> detect whether the tests passed or failed, or is human review required? etc.
> —
> Dan

Dan,

I did not write a test yet, I only did it by hand, but there are a lot of tests 
which I want to do.
When I have the right test environment / tools it should be possible to write 
scripts in such a way that no human intervention is required.
The first bunch of tests will be a script running in guile, that generates xml 
files, to test code I have written.
Next step is to run a test to check whether those xml files are according to 
the expectation.
The next bunch will be several lilypond files that must be processed by 
lilypond.
As a result musicxml files will be created, of which also must be checked if 
they met the expectation.

So what I want: 
run guile script1 check result with a script (possible python, but shell 
scripts or other programs are also possible)
Run guile script 2 check result
.. script n check result
Run lilypond on file1 check result with script
Run lilypond on file2 check result with script
-- on file m check result with script.

And I want to know which possibilities I have to do this kind of things within 
the lilypond developer environment.

So that when I do 
$make LILYPOND_BRANCH=mybranch lilypond

I can find the results of the tests I have written in the test log

Jaap