Re: Overlay mechanic improvements

[Stephen Leake]

Richard Stallman <address@hidden> writes:

> [[[ To any NSA and FBI agents reading my email: please consider    ]]]
> [[[ whether defending the US Constitution against all enemies,     ]]]
> [[[ foreign or domestic, requires you to follow Snowden's example. ]]]
>
>     The problem here is that tokens are not just lexemes(token text). To
>     be general and granular enough one also has to remember dependencies
>     between tokens. So, a token is: ["lexeme", lookback, lookahead,
>     position].
>
> Ok, but why is it a "problem"?  It seems easy enough to construct a
> list (LEXEME LOOKBACK LOOKAHEAD) and put it as the value of the
> `token' property for all the characters in the token.
>
> There is no need to include POSITION in this list, since you can
> find the start of the token by calling
> `previous-char-property-change'.

No need to store LEXME, either; just call buffer-substring-no-properties
when you need the text.


-- 
-- Stephe