Set initial tokenizer state to a NULL byte
This commit is contained in:
@@ -136,7 +136,7 @@ function tokenizer.tokenize(incoming_syntax, text, state)
|
|||||||
return { "normal", text }
|
return { "normal", text }
|
||||||
end
|
end
|
||||||
|
|
||||||
state = state or ""
|
state = state or string.char(0)
|
||||||
-- incoming_syntax : the parent syntax of the file.
|
-- incoming_syntax : the parent syntax of the file.
|
||||||
-- state : a string of bytes representing syntax state (see above)
|
-- state : a string of bytes representing syntax state (see above)
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user