Unicode version 1.19.0

Bug Fixes

• Unicode.properties/1 no longer does an Enum.uniq/1 on the result since that breaks the functions contract.

• Fix Unicode.Emoji.emoji/0.

• Fix documentation in Unicode.WordBreak.

Enhancements

• Add indic_conjunc_break as a property, it is new in Unicode 15.1.

• Fix performance regression in Unicode.replace_invalid/2 from the original UniRecover library and confirm the code memory usage remains a constant 128 bytes for all benchmark scenarios. Thanks to @Moosieus for the fabulous PR. Closes #10.

• Unicode.replace_invalid(string, :utf8, replacement) delegates to String.replace_invalid/2 where available (which will be from Elixir 1.16 onwards).

• Confirm that the README installation version matches the code version. Thanks to @Moosieus for the PR.

Unicode version 1.18.0

Enhancements

• Adds Unicode.validate_utf8/3 to force-validate a binary as a UTF-8 string. Any invalid codepoints or incomplete sequences are replaced with a replacement string. Many thanks to @Moosieus for the contribution.

Unicode version 1.17.0

Enhancements

• Updates to Unicode 15.1 data.

• Improve the security of the mix unicode.download task.

Unicode version 1.16.2

Enhancements

• Change the parsing of "SpecialCasing.text" specifically to support casing in unicode_string/.

Unicode version 1.16.1

Big Fixes

• Fix spelling of Unicode.script_dominance/1.

Unicode version 1.16.0

Enhancements

• Add Unicode.script_statistic/1 that returns the first index and grapheme count of the scripts in a string. This is useful to help derive the likely locale of a string. Determining the locale is outside the scope of this library but is required in ex_cldr_person_names.

• Add Unicode.script_dominance/1 to sort the results of Unicode.script_statistic/1 in descending dominance order.

Unicode version 1.15.0

Deprecations

• Fix deprecation warnings for Elixir 1.14. Now requires Elixir 1.11 as a minimum release.

Enhancements

• Updates to Unicode 15.

Bug Fixes

• Fix code fences in docs to be Elixir

Unicode version 1.13.1

Bug Fixes

• When looking up scripts, general categories and properties we indirect through an alias table. But not all entries have alias so in the case alias lookup fails we still need to lookup using the original key.

Unicode version 1.13.0

Enhancements

• Change the application name to :unicode (in collaboration with @Qqwy). The old name ex_unicode will be retired.

Elixir Unicode version 1.12.0

Enhancements

• Update to use Unicode 14 release data.