Add utf8 support to tokenizer (#945)

Browse Source

* add utf8 support to tokenizer

* wrap utf8 functions in string table using a 'u' prefix

* document new utf8 functions

...

This commit is contained in:

Jefferson González

2022-04-26 09:42:02 -04:00

committed by GitHub

parent 7dd83bb737

commit e572c58f24

9 changed files with 5431 additions and 26 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

src/api/utf8.c

+1305

File diff suppressed because it is too large Load Diff