The goal of this library is to bring painless unicode support to C++ with simple and easy to understand APIs.
The API naming conventions are chosen to look familiar to those using the C++ standard libary.
- API for accessing UCD properties
- UTF8 <-> UTF32 conversion
- wcwidth equivalent (
int unicode::width(char32_t)
) - grapheme segmentation (UTS algorithm)
- symbol/emoji segmentation (UTS algorithm)
- script segmentation UTS 24
- unit tests for most parts (wcwidth / segmentation)
- generic text run segmentation (top level segmentation API suitable for text shaping implementations)
- word segmentation (UTS algorithm)
- CLI tool:
uc-inspect
for inspecting input files by code point properties, grapheme cluster, word, script, ...
- UTS 11 - character width
- UTS 24 - script property
- UTS 29 - text segmentation (grapheme cluster, word boundary)
- UTS 51 - Emoji
git submodule add --name libunicode https://github.com/contour-terminal/libunicode 3rdparty/libunicode
add_subdirectory(3rdparty/libunicode)
add_executable(your_tool your_tool.cpp)
target_link_libraries(your_tool PRIVATE unicode::unicode)
- for filing issues please visit: https://github.com/contour-terminal/libunicode/issues
- fork and create pull requests: https://github.com/contour-terminal/libunicode/pulls
- I am also happy to just receive code reviews
- you can help with documentation, or
- general feedback is also very welcome
This library is -in terms of features- by no means competive to the ICU library, but it attempts to provide a clean and intuitive modern C++ API for those that do not want to fight legacy-style C APIs.
I hope that over time we can add more and more features to this library to conform to the Unicode specification eventually at some point and I welcome everyone to contribute to it by forking the library, creating pull requests, or even just constructive feedback.
libunicode - a modern C++20 unicode library
-------------------------------------------
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.