Re: verbosity of test failure feedback (was: Automake 1.11.1 glitch?)

[Stefano Lattarini]

On Wednesday 08 September 2010, Bob Friesenhahn wrote:
> On Tue, 7 Sep 2010, Ralf Wildenhues wrote:
> > Actually, I haven't come across many test failures where more
> > information was necessary.  At least in this case I think it was
> > crystal clear from the silent5.log file, no?  ;-)
> > 
> > One practical problem with sending test directory contents by
> > default is that they can be pretty large.  When multiple
> > failures occur, say, all Libtool-related tests fail due to a
> > Libtool installation bug, we're speaking of several MB packed. 
> > I don't really want this sent to a public mailing list read by
> > dozens of people.
> 
> Yes, and as a point of fact, my message was rejected by the mailing
> list and only made it to Stefano due to being listed in the Cc:.
Ouch.  You are right, unfortunately.

What about creating a separeted tarball for any failed/skipped test
(maybe in a proper common subdirectory `tests/test-suite.dir'), then
displaiyng a message which tells the user "detailed information about
tests' failures are available in files saved in `tests/test-suite.dir';
please copy this directory to a safe known place, and write to the
mailing list <address@hidden> for more information regarding
how to send these information over to package maintainers"?

Would that help IYO (In Your Opinion)?

Regards,
  Stefano