aboutsummaryrefslogtreecommitdiff
path: root/data/core/tokenizer.lua
AgeCommit message (Expand)Author
2025-03-15syntax: warn against malformed patterns and disable them (#2029)Takase
2024-10-22Fix multi-type usage in delimited patterns (#1740)Guldoman
2024-04-15Skip patterns matching nothing in `tokenizer` (#1743)Guldoman
2023-11-29Fix patterns starting with `^` in `tokenizer` (#1645)Guldoman
2023-07-09Return state when tokenizing plaintext syntaxesGuldoman
2023-04-01Allow `tokenizer` to pause and resume in the middle of a line (#1444)Guldoman
2023-02-06Allow groups to be used in end delimiter patterns in tokenizer (#1317)Guldoman
2022-12-27Fix popping subsyntaxes that end consecutively (#1246)xwii
2022-12-11Add `regex.find_offsets`, `regex.find`, improve `regex.match` (#1232)Guldoman
2022-11-15Set initial tokenizer state to a `NULL` byteGuldoman
2022-11-15Add `tokenizer.extract_subsyntaxes`Guldoman
2022-11-03tokenizer: remove the limit of 3 subsyntaxes depth (#1186)Jefferson González
2022-06-22Merge pull request #1040 from Guldoman/PR_tokenizer_errors_alertJefferson González
2022-06-15Merge pull request #1034 from Guldoman/PR_escape_start_patternsJefferson González
2022-06-15Warn if token type is a table when not neededGuldoman
2022-06-15Add helper function to report bad patterns in tokenizerGuldoman
2022-06-15Fix malformed pattern check for group patterns in tokenizerGuldoman
2022-06-12Check if "open" pattern is escapedGuldoman
2022-06-12Convert more byte offsets to utf-8 pos in regex tokenizerGuldoman
2022-05-31Show error if language plugin pattern has mismatching number of groupsGuldoman
2022-05-31Fix UTF-8 matches in regex group `tokenizer`Guldoman
2022-05-28Allow using regex groups to split tokensGuldoman
2022-05-13tokenizer: fix next utf8 char retrieval bugjgmdev
2022-04-26Add utf8 support to tokenizer (#945)Jefferson González
2022-03-04Force syntax patterns starting with `^` to match with the whole lineGuldoman
2022-01-12Add bit32 polyfill globallyGuldoman
2021-12-31Migrate to Lua 5.4Jan200101
2021-12-11Consume unmatched character correctlyGuldoman
2021-11-23Manual merge of into .Adam Harrison
2021-10-23Fix problem checking utf-8 cont at end of stringFrancesco Abbate
2021-10-11Correctly identify the start of the next character in `tokenizer`Guldoman
2021-08-29replace unpack() with table.unpack()takase1121
2021-06-02Add PCRE to support regular expressionsAdam
2021-05-20Tokenizer cleanup (#198)Adam
2021-05-19support for multiple groups in one pattern (#196)liquidev
2021-05-18fixed mixed indentationlqdev
2021-05-01Nested Syntax Highlighting (#160)adamharrison
2020-05-14Made tokenizer skip parsing process on plain-text filesrxi
2020-05-07Moved highlighter code from `DocView` to `Doc`rxi
generated by cgit v1.2.3 (git 2.39.1) at 2025-12-28 07:34:47 +0000