janware/jw-python
1
mirror of ssh://git.janware.com/srv/git/janware/proj/jw-python synced 2026-01-15 01:52:56 +01:00
Code Releases Activity

grammar.py and friends: Make list parsing run through

Browse source 
First time parsing doesn't error out with a syntax error. No usable AST
is produced, strings are not returned from lexer, and AST lists aren't
lists, really.

TEXT:="Hello world!"; had to be excluded from the example, because I
don't get how this could be parsed with the given syntax. There's a
special sequence "all visible characters", but any lexer regex I could
think of will also match the types defining "alphabetic character" and
return the respective tokens (e.g. T_A) or vice-versa, depending on the
order in the lexer input file. I suppose, the only sensible way to
handle this, is to define "all visible characters" by defining the
tokens for the missing characters, and then use them along T_A ... T_Z
or their derived types.

Signed-off-by: Jan Lindemann <jan@janware.com>
This commit is contained in:
Jan Lindemann 2017-11-02 13:47:19 +01:00
commit a3a8313ce8
6 changed files with 61 additions and 30 deletions
Download patch file Download diff file Expand all files Collapse all files

20
make/generate-flex-bison.mk
View file

@ -34,16 +34,16 @@ GENERATE ?= python ./$(GENERATE_PY) --log-level $(GENERATE_LOG_LEVEL
--fix-extensions $(FIX_EXTENSIONS) \
--unroll-lists \
--unroll-options \
--unroll-alternatives \
--replace-whitespace \
$(OPT_CHECK_SYMBOLS) \
$(OPT_CONFIG_FILE) \
--trim-symbols=$(shell echo $(TRIM_SYMBOLS) | sed 's/ */,/g') \
--cut-symbols=$(shell echo $(CUT_SYMBOLS) | sed 's/ */,/g') \
--irrelevant-symbols=$(shell echo $(IRRELEVANT_SYMBOLS) | sed 's/ */,/g') \
--namespace=$(NAMESPACE_IN_GENERATED) \
--includes=$(shell echo $(INCLUDED_BY_GENERATED) | sed 's/ */,/g') \
$(CREATE_EXTRA_ARGS)
--unroll-alternatives \
--replace-whitespace \
$(OPT_CHECK_SYMBOLS) \
$(OPT_CONFIG_FILE) \
--trim-symbols=$(shell echo $(TRIM_SYMBOLS) | sed 's/ */,/g') \
--cut-symbols=$(shell echo $(CUT_SYMBOLS) | sed 's/ */,/g') \
--irrelevant-symbols=$(shell echo $(IRRELEVANT_SYMBOLS) | sed 's/ */,/g') \
--namespace=$(NAMESPACE_IN_GENERATED) \
--includes=$(shell echo $(INCLUDED_BY_GENERATED) | sed 's/ */,/g') \
$(CREATE_EXTRA_ARGS)
include $(TOPDIR)/make/proj.mk
include $(MODDIR)/make/flex-bison.mk
include $(MODDIR)/make/py-defs.mk