diff options
| author | Joel Klinghed <the_jk@spawned.biz> | 2025-09-15 20:52:51 +0200 |
|---|---|---|
| committer | Joel Klinghed <the_jk@spawned.biz> | 2025-09-15 20:52:51 +0200 |
| commit | 18a622f378b403788c67fc785d30f4609caa3fc7 (patch) | |
| tree | 9d13f4ef49a06c9e4837487f61bc90b734ad9b9a /src/location.hh | |
| parent | 28c6425e4ed1cd2eab538e7cba08c18aa83d8af5 (diff) | |
uio: Unicode reader
Reads UTF-8 and UTF-16 into UTF-8 or UTF-16 strings.
If strict is true, fails at first invalid character.
If strict is false, invalid characters are replaced with U+FFFD.
For the replacement, I changed behavior if uN::read_replace to only
jump one byte. Otherwise a common invalid case when ISO-8859-1 or
WIN-1252 are read as UTF-8 would skip many characters.
If skip_bom is true any bom at start of stream is ignored.
If skip_bom is false any bom will be included.
Input format can be forced, if not detect is used which will
try to guess and then fallback to UTF-8.
Diffstat (limited to 'src/location.hh')
0 files changed, 0 insertions, 0 deletions