Re: Testing lots of Texinfo files

[Gavin Smith]

On Fri, Jan 22, 2021 at 11:17:53PM +0000, Gavin Smith wrote:
> On Thu, Jan 21, 2021 at 07:04:19PM -0600, Jacob Bachmeyer wrote:
> > As a maintainer of DejaGnu, the DejaGnu manual is important to me and
> > getting an up-to-date copy just might point the way to getting more Texinfo
> > sources.  The latest revision is available at
> > <URL:https://git.savannah.gnu.org/cgit/dejagnu.git/tree/doc/dejagnu.texi>
> > and its only dependencies are "version.texi" (which is common with
> > Automake-using projects and can be easily stubbed out) and "fdl.texi" (the
> > text of the GFDL).
> > 
> > I expect that many GNU projects are likely to have manual sources in
> > analogous locations on Savannah.

> I wasn't sure if it would be the case, but all the git repositories
> are listed at:
> 
> https://git.savannah.gnu.org/cgit/
> 
> I guess this is an interface to git repositories so the files you see
> there may not be easily downloadable with a script without actually
> cloning the git repository themselves, which would use a lot of
> network data.  You could probably write a script to do a shallow git
> clone of some of these repositories, especially where they have a
> doc subdirectory.  (Over 1000 are listed there). Preferrably in a way
> that doesn't use 10's or even 100's of GB of network traffic.

It was a good suggestion.  I have been able to mass clone repos
that looked like they might have had a Texinfo manual in them.
(I didn't clone everything, just repos which had a doc or a man
directory in them.)

The directory on my computer containing them is 5.7G in size (as
measured with du -h).  It gave me about 140 extra directories to test
with (although may not be exact due to different naming conventions,
duplicate manuals, packages containing more than one manual, etc.).
It'll take some time to sort these out to run my scripts on them.