Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
irexyc committed Nov 21, 2023
1 parent 4e82cdf commit 0f9c6f0
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions src/turbomind/triton_backend/llama/LlamaTritonModel.cc
Original file line number Diff line number Diff line change
Expand Up @@ -123,6 +123,10 @@ LlamaTritonModel<T>::LlamaTritonModel(size_t tensor_para_size,
TM_LOG_ERROR("[ERROR] config and model_dir are all set");
ft::FT_CHECK(false);
}
else if (config.empty() && model_dir.empty()) {
TM_LOG_ERROR("[ERROR] Neither config nor model_dir is set");
ft::FT_CHECK(false);
}

if (!config.empty()) {
std::FILE* tmpf = std::tmpfile();
Expand Down

0 comments on commit 0f9c6f0

Please sign in to comment.