Add checks when pad/eos/bos tokens are decoded from token ids (#1336) #5360
| Job | Run time |
|---|---|
| 12m 58s | |
| 9m 52s | |
| 32m 58s | |
| 15m 39s | |
| 15m 42s | |
| 14m 38s | |
| 16m 6s | |
| 22m 0s | |
| 15m 0s | |
| 10m 19s | |
| 25m 53s | |
| 11m 34s | |
| 8m 59s | |
| 10m 59s | |
| 12m 30s | |
| 23m 42s | |
| 7m 14s | |
| 22m 12s | |
| 18m 18s | |
| 14m 9s | |
| 1s | |
| 5h 20m 43s |