Skip to content

Commit

Permalink
fix: prompt_n in timings
Browse files Browse the repository at this point in the history
  • Loading branch information
jhen0409 committed Aug 11, 2023
1 parent f736614 commit db9da00
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion ios/RNLlamaContext.mm
Original file line number Diff line number Diff line change
Expand Up @@ -260,7 +260,7 @@ - (NSDictionary *)completion:(NSDictionary *)params
@"stopping_word": [NSString stringWithUTF8String:self->llama->stopping_word.c_str()],
@"tokens_cached": @(self->llama->n_past),
@"timings": @{
@"prompt_n": @(timings.n_eval),
@"prompt_n": @(timings.n_p_eval),
@"prompt_ms": @(timings.t_p_eval_ms),
@"prompt_per_token_ms": @(timings.t_p_eval_ms / timings.n_p_eval),
@"prompt_per_second": @(1e3 / timings.t_p_eval_ms * timings.n_p_eval),
Expand Down

0 comments on commit db9da00

Please sign in to comment.