Skip to content

Commit

Permalink
heading format
Browse files Browse the repository at this point in the history
  • Loading branch information
@oandreeva-nv
oandreeva-nv committed Oct 25, 2024
1 parent 0ec9015 commit fbc0466
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion Conceptual_Guide/Part_8-semantic_caching/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -329,7 +329,7 @@ Clearly, the latter 2 requests are semantically similar to the first one, which
resulted in a cache hit scenario, which reduced the latency of our model from
approx 1.1s to the average of 0.048s per request.

## Current limitations
## Current Limitations

* The current implementation of the Semantic Cache only considers the prompt
itself for cache hits, without accounting for additional request parameters
Expand Down

0 comments on commit fbc0466

Please sign in to comment.