Constrained output with tokens added into the model

[denadai2]

Dear community,

let's say I add new tokens into the model vocabulary. E.g. [OUTLINES!]. What happens with conditions like this one

class Response(BaseModel):
    answer: constr(pattern='^\[OUTLINES!\](code_\d+){4}$')

Does the constraint take care about the existance of the additional tokens or does it constrain on the original model's vocabulary?

Thanks

[denadai2]

It outputs the special token correctly!

[rlouf]

This is very good news 😅