summaryrefslogtreecommitdiff
path: root/data
AgeCommit message (Collapse)Author
2025-09-29java: Add tokens support for Java 21Joel Klinghed
Some new keywords, I opted to modify java-8 grammar to use the new names, even if they are not going to match anything. Makes the tokenizer easier to write.
2025-09-29java: Add tokensJoel Klinghed
Only parses Java 8 tokens for now.
2025-09-10Add unicode general category lookupJoel Klinghed
Generate the lookup tables from UnicodeData.txt, do to that, add gen_ugc, which uses csv, buffers, line, io and other modules to do the job.