v0.1.13

Highlight

This version enhances the compatibility of XGrammar on various platforms. It also provides full support for regex. Now most features are supported. It also enhances the efficiency of the token bitmask application kernel.

What's Changed

• [Fix] Fix popcount for windows by @Ubospica in #167
• [Fix] Rollback safely when token acceptance fails by @benchislett in #164
• fix(fsm): fix error of dangling-reference in gcc-13 by @DarkSharpness in #171
• fix(test): fix the concurrency issue in #168 by @DarkSharpness in #170
• [Debug] Support cpptrace by @Ubospica in #176
• [Feature] Support Regex for GrammarCompiler by @Ubospica in #185
• [Docs] Add news section by @Ubospica in #191
• [Fix] Remove redundant grammar_functor.cc by @Ubospica in #195
• [Maintain] Add toml formatter by @Ubospica in #196
• [Maintain] Add no-sort to toml fmt by @Ubospica in #198
• [Maintain] Update toml formatter by @Ubospica in #199
• [Feature] Support Optimized CUDA Token Bitmask Kernel by @syuoni in #186
• [Maintain] Support Python 3.13 for Manylinux by @Ubospica in #200

New Contributors

• @syuoni made their first contribution in #186

Full Changelog: v0.1.11...v0.1.12

v0.1.11

Highlight

In this PR we supported the structural tag. This is a new feature that can support strict function calling (and many more flexible patterns). Read the [brief doc] to learn more. We will introduce it in details soon.

What's Changed

• [Feature] Structural tag by @Ubospica in #162
• [Fix] Fix #162 by @Ubospica in #163
• [Fix] Fix broken rollback char count after accepting stop token by @benchislett in #161
• [Feature] Optional Token Bitmask by @Ubospica in #165

Full Changelog: v0.1.10...v0.1.11

v0.1.10

Highlight

In this version we enhanced the ability of json schema, ebnf, and provided APIs for grammar concat and union.

What's Changed

• [Feature] Support regex and repetition range by @Ubospica in #144
• [Refactor] Rename internal classes for better structure by @Ubospica in #145
• [FunctionCalling] Support TagDispatch by @Ubospica in #146
• [Fix] Fix doc dependencies by @Ubospica in #147
• [Fix] Fix doc dependencies by @Ubospica in #148
• [Feature] Grammar concat and union by @Ubospica in #149
• [Fix] Fix compilation error with virtual overloaded function by @Ubospica in #150
• [Refactor] Refactor GrammarMatcherBase by @Ubospica in #151
• [3rdparty] Avoid macro redefinition in picojson by @MasterJH5574 in #153

Full Changelog: v0.1.9...v0.1.10

Release v0.1.8

Features

• Enhance JSON Schema converter by @Ubospica in #134
• Enhance EBNF Parser by @observerw in #125
• Support sentencepiece tokenizer by @zanderjiang in #120
• Enhance ApplyMask kernels to provide better support in mix-structured-and-unstructured cases by @Ubospica in #128

Release v0.1.6

Features

• The ability of the JSON Schema converter is enhanced to support integer range and regex pattern. Thanks @joennlae

Bug Fixes

• Solves the problem of strict JSON format degrading the LLM output quality

Release v0.1.4

This is the stable release version of XGrammar. It provides efficient and portable API for LLM structured generation.