Skip to content

Commit

Permalink
fix: README example
Browse files Browse the repository at this point in the history
  • Loading branch information
daulet committed Nov 7, 2024
1 parent e97da0c commit 5fa02af
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,8 +36,7 @@ Load a tokenizer from Huggingface:
```go
import "github.com/daulet/tokenizers"

tokenizerPath := "../huggingface-tokenizers/google-bert/bert-base-uncased"
tk, err := tokenizers.LoadTokenizerFromHuggingFace("google-bert/bert-base-uncased", &tokenizerPath, nil)
tk, err := tokenizers.FromPretrained("google-bert/bert-base-uncased")
if err != nil {
return err
}
Expand Down

0 comments on commit 5fa02af

Please sign in to comment.