Skip to content

Tokenizer 1.30.1
Compare
Choose a tag to compare
@guillaumekln guillaumekln released this 25 Jan 15:59
· 50 commits to master since this release
v1.30.1
4c66c81

Fixes and improvements

  • Fix deprecated languages codes in ICU that are incorrectly considered as invalid (e.g. "tl" for Tagalog)
Assets 2
Loading