Add utf8 support to tokenizer (#945)

* add utf8 support to tokenizer

* wrap utf8 functions in string table using a 'u' prefix

* document new utf8 functions
This commit is contained in:
Jefferson González
2022-04-26 09:42:02 -04:00
committed by GitHub
parent 7dd83bb737
commit e572c58f24
9 changed files with 5431 additions and 26 deletions
+2
View File
@@ -35,6 +35,8 @@ table.unpack = table.unpack or unpack
bit32 = bit32 or require "core.bit"
require "core.utf8string"
-- Because AppImages change the working directory before running the executable,
-- we need to change it back to the original one.
-- https://github.com/AppImage/AppImageKit/issues/172