Skip to content

Commit

Permalink
Add tokenizers dependency to requirements.txt
Browse files Browse the repository at this point in the history
  • Loading branch information
@sdan
sdan committed Apr 11, 2024
1 parent 4695acc commit 0b7165b
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions requirements.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -8,3 +8,4 @@ llama-cpp-python
huggingface_hub
tiktoken
onnxruntime==1.17.1
tokenizers==0.15.2

0 comments on commit 0b7165b

Please sign in to comment.