PyThaiNLP v5.1.0-beta2

Schedule

• First Beta release: 27 December 2024
• Production release: WIP

PyThaiNLP 5.1 Change Log #900

Docs: https://pythainlp.org/dev-docs/

What's Changed

• Add pythainlp.llm by @wannaphong in #1043
• Add How to cut a new release doc by @bact in #1051
• Update pandas requirement from ==1.4.* to ==2.2.* by @dependabot in #1041
• Bump sentence-transformers from 2.2.2 to 2.7.0 by @dependabot in #1038
• Bump pyicu from 2.8 to 2.14 by @dependabot in #1052
• Add pythainlp.lm.calculate_ngram_counts by @wannaphong in #1054
• Fixed #1055 bug: Tone detector + syllable sound bug by @wannaphong in #1056
• Fix inconsistency in newmm-safe engine by copilot by @wannaphong in #1063
• Fix bug in Longest Matching tokenizer to preprocess spaces consistently by @wannaphong in #1062
• [Ready] Reduce reload word tokenizer engine in word_tokenize by @new5558 in #1064
• Add display cell tokenizer by @wannaphong in #1058
• Add longest common subsequence algorithm by @wannaphong in #1059
• Bump transformers from 4.47.1 to 4.48.0 by @dependabot in #1068
• Bump protobuf from 5.29.2 to 5.29.3 by @dependabot in #1067
• Fix custom dict error for unsupported tokenization engines by @wannaphong in #1066
• Add pythainlp.util.spelling by @wannaphong in #1060
• Add misspell command to CLI by @wannaphong in #1057
• Add codemeta.json file to root directory by @wannaphong in #1069
• Bump epitran from 1.25.1 to 1.26.0 by @dependabot in #1072
• Bump transformers from 4.48.0 to 4.48.1 by @dependabot in #1071
• Bump transformers from 4.48.1 to 4.48.2 by @dependabot in #1074

Full Changelog: v5.1.0-beta1...v5.1.0-beta2