jkc.git/src/u8.hh, branch WIPUnnamed repository; edit this file 'description' to name the repository.
https://git.spawned.biz/jkc.git/atom?h=WIP2025-09-18T21:57:56Zjava::uescape: Unicode reader that knows about Java's \uXXXX escapes2025-09-18T21:57:56ZJoel Klinghedthe_jk@spawned.biz2025-09-18T21:57:56Zurn:sha1:50348284f5d82ccfd65b0c803ba0ba895912ceffAdd .clang-format2025-09-15T19:15:53ZJoel Klinghedthe_jk@spawned.biz2025-09-15T19:15:53Zurn:sha1:aa49abdf239bae6065fddd0839ec67a404c9748c
Make it easier to keep a consistent style
uio: Unicode reader2025-09-15T18:52:51ZJoel Klinghedthe_jk@spawned.biz2025-09-15T18:52:51Zurn:sha1:18a622f378b403788c67fc785d30f4609caa3fc7
Reads UTF-8 and UTF-16 into UTF-8 or UTF-16 strings.
If strict is true, fails at first invalid character.
If strict is false, invalid characters are replaced with U+FFFD.
For the replacement, I changed behavior if uN::read_replace to only
jump one byte. Otherwise a common invalid case when ISO-8859-1 or
WIN-1252 are read as UTF-8 would skip many characters.
If skip_bom is true any bom at start of stream is ignored.
If skip_bom is false any bom will be included.
Input format can be forced, if not detect is used which will
try to guess and then fallback to UTF-8.
fixup! Make clang-tidy happy2025-09-10T20:11:27ZJoel Klinghedthe_jk@spawned.biz2025-09-10T20:11:27Zurn:sha1:cf99d0c865474105c14b2348fdbd1c83d87d5a29Make clang-tidy happy2025-09-08T21:09:37ZJoel Klinghedthe_jk@spawned.biz2025-09-08T21:09:21Zurn:sha1:677265461b3c596ab2a88858e74b0970196198feAdd UTF-8, UTF-16 and Modified UTF-8 support2025-09-04T20:24:13ZJoel Klinghedthe_jk@spawned.biz2025-09-04T20:24:13Zurn:sha1:65860e6c873e6e056fe3d1dadd1d309b1bd66e7b