Skip to content

Commit 7ba6512

Browse files
committed
Subtyping will autocoerce lifetimes by itself
1 parent 54b1b78 commit 7ba6512

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tokenizers/src/models/bpe/model.rs

+1-1
Original file line numberDiff line numberDiff line change
@@ -460,7 +460,7 @@ impl BPE {
460460
Ok(word)
461461
}
462462

463-
fn word_to_tokens<'a, 'b: 'a>(&'a self, word: &'b Word) -> impl Iterator<Item = Token> + 'a {
463+
fn word_to_tokens<'a>(&'a self, word: &'a Word) -> impl Iterator<Item = Token> + 'a {
464464
word.get_chars_iter()
465465
.zip(word.get_offsets_iter())
466466
.map(move |(id, offsets)| Token::new(id, self.vocab_r[&id].clone(), offsets))

0 commit comments

Comments
 (0)