Re: Eliminate MARKUP_IDENTIFIER and MARKUPLIST_IDENTIFIER (issue 6561053)

[Janek Warchoł]

On Sat, Sep 29, 2012 at 4:30 PM,  <address@hidden> wrote:
> Actually, it is not really "simplifying" the grammar.  At the current
> point of time, the lexer has to make decisions about the type of
> identifiers (and functions) at a point of time where those decisions are
> actually premature.  As a result of those decisions, different tokens
> are generated for identifiers and functions.  I am moving towards
> generating only one kind of token.  The same kind of decisions as before
> still have to be made, and since the lexer no longer makes them, the
> decisions are instead taken in the actions of the parser.  The results
> of those decisions are only apparent in the parser rules when those
> decisions lead to "synthetic" tokens (similar to the previous "real"
> ones) being generated in the parser actions.

ok.  That's what i meant when i said "have things happen on higher
level" (i expect that it's not a technically correct statement, of
course :) )
thanks for explanations!
Janek