-
Notifications
You must be signed in to change notification settings - Fork 200
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
To test Llama3 fix: openvinotoolkit/openvino_tokenizers#357
- Loading branch information
1 parent
3b2104a
commit 037328d
Showing
1 changed file
with
1 addition
and
1 deletion.
There are no files selected for viewing
Submodule openvino_tokenizers
updated
18 files
| +2 −2 | .github/workflows/linux.yml | |
| +4 −4 | .github/workflows/mac.yml | |
| +2 −2 | .github/workflows/windows.yml | |
| +11 −1 | README.md | |
| +6 −6 | js/package-lock.json | |
| +12 −4 | js/package.json | |
| +1 −1 | pyproject.toml | |
| +1 −1 | python/openvino_tokenizers/__init__.py | |
| +1 −1 | python/openvino_tokenizers/constants.py | |
| +49 −12 | python/openvino_tokenizers/hf_parser.py | |
| +22 −5 | python/openvino_tokenizers/tokenizer_pipeline.py | |
| +7 −2 | python/openvino_tokenizers/utils.py | |
| +3 −2 | tests/conftest.py | |
| +2 −0 | tests/layer_tests.py | |
| +1 −1 | tests/pass_rates.json | |
| +192 −0 | tests/stats.json | |
| +63 −11 | tests/tokenizers_test.py | |
| +11 −3 | tests/utils.py |