Re: luatex problems with texinfo.tex

[Gavin Smith]

On 4 January 2016 at 14:06, Masamichi HOSODA <address@hidden> wrote:
> But, still another errors occur while making LilyPond documents.
> Attached files --- macro-html.texi and macro-quotation.texi --- are minimal 
> examples.
>
> By pdfTeX, both they are worked fine.
> By LuaTeX, both they are failed like following:

Thanks for preparing the test files. Experimenting, I found it wasn't
related to the character encoding problem, because removing the
\directlua code made no difference.

I got it down to the following:

\input texinfo.tex

@tracingmacros=1
@tracingcommands=1

@example
@scanmacro{
and more
}

@scanmacro{and more2
}
@end example

bbb

@bye

With pdftex, both lines "and more" and "and more2" would be output,
but with luatex, only the second appears. \scantokens in LuaTeX
appears to be buggy.

(LuaTeX reports its version as

This is LuaTeX, Version beta-0.87.0 (TeX Live 2016/dev)
(format=luatex 2016.1.2)  4 JAN 2016 16:14)

This discussion on the lualatex-dev mailing list suggested the problem
could be related to \newlinechar:
http://tug.org/pipermail/lualatex-dev/2011-November/001379.html

I tried commenting out the use of \newlinechar in \scanmacro in
texinfo.tex, and this changed the results: both lines appeared from
the example above.

The page http://tracker.luatex.org/view.php?id=733 reports this bug as
fixed, although according to
http://tug.org/pipermail/luatex/2015-March/005149.html, it wasn't
fixed in March 2015.