Skip to content

Commit

Permalink
fix error
Browse files Browse the repository at this point in the history
  • Loading branch information
xufang-lisa committed Dec 26, 2024
1 parent 5d063db commit 9c441ec
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -238,7 +238,7 @@ ContinuousBatchingPipeline::SpeculativeDecodingImpl::generate(const std::vector<
bool get_first_token = false;
float first_token_time = 0;
int first_tokens_num = 0;
m_sd_metrics.reset();
m_sd_metrics.clean_up();
m_draft_pipeline->reset_infer_duration();
m_main_pipeline->reset_infer_duration();
while (has_non_finished_requests() && continue_generation) {
Expand Down

0 comments on commit 9c441ec

Please sign in to comment.