[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Which lexer do people use?
From: |
Christian Schoenebeck |
Subject: |
Re: Which lexer do people use? |
Date: |
Mon, 06 Jul 2020 15:04:31 +0200 |
On Montag, 6. Juli 2020 14:00:17 CEST Maury Markowitz wrote:
> > On Jul 4, 2020, at 6:46 AM, Christian Schoenebeck
> > <schoenebeck@crudebyte.com> wrote: The only thing that people are missing
> > once in a while on scanner side is unicode support
>
> I am missing the capability to support grammars with optional spaces between
> elements. In BASIC:
>
> FORI=1TO5
>
> is equivalent to:
>
> FOR I=1 TO 5
>
> I have yet to see an elegant way to model this in Flex. This topic comes up
> time to time here, so I don't think Unicode is the "only" thing.
You would simply add a RegEx pattern & rule like this:
[ \t\r\n]* /* eat up white space */
and/or the same for 'any other unknown input':
. /* drop anything else i.e. 'unknown' input */
Best regards,
Christian Schoenebeck
- Which lexer do people use?, Daniele Nicolodi, 2020/07/03
- Re: Which lexer do people use?, Akim Demaille, 2020/07/04
- Re: Which lexer do people use?, Christian Schoenebeck, 2020/07/04
- Re: Which lexer do people use?, Akim Demaille, 2020/07/06
- Re: Which lexer do people use?, Maury Markowitz, 2020/07/06
- Re: Which lexer do people use?,
Christian Schoenebeck <=
- Parsing a language with optional spaces, Maury Markowitz, 2020/07/06
- Re: Parsing a language with optional spaces, Christian Schoenebeck, 2020/07/06
- Re: Parsing a language with optional spaces, Maury Markowitz, 2020/07/06
- Re: Parsing a language with optional spaces, Christian Schoenebeck, 2020/07/06
- Re: Parsing a language with optional spaces, Akim Demaille, 2020/07/08
- Re: Parsing a language with optional spaces, Akim Demaille, 2020/07/06
- Re: Parsing a language with optional spaces, Maury Markowitz, 2020/07/06
- Re: Parsing a language with optional spaces, Akim Demaille, 2020/07/06
- Re: Parsing a language with optional spaces, John P. Hartmann, 2020/07/07
- Re: Parsing a language with optional spaces, uxio prego, 2020/07/07