Skip to content

Commit

Permalink
better error message when the tokenizer is not downloaded
Browse files Browse the repository at this point in the history
  • Loading branch information
jstjohn committed Nov 5, 2024
1 parent dd7e636 commit 16bef75
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -145,7 +145,7 @@ def main(
case {"tokenizer": tokenizer, "median_dict": median_dict}:
logging.info("*************** Preprocessing Finished ************")
case _:
logging.error("Preprocessing failed.")
logging.error("Failed to download the tokenizer for the NV geneformer model.")
assert False
with open(hf_token_dictionary_path, "rb") as geneformer_hf_token_file:
geneformer_hf_token_dict = pickle.load(geneformer_hf_token_file)
Expand Down

0 comments on commit 16bef75

Please sign in to comment.