Code

Litellm use lru cache#7698

Code

Open

ishaan-jaff wants to merge 11 commits intomainBerriAI/litellm:mainfrom litellm_use_lru_cacheBerriAI/litellm:litellm_use_lru_cacheCopy head branch name to clipboard

+42-4

Commits

Commits on Jan 11, 2025

• fix - use lru cache on hit functions

  ishaan-jaff

  committed
  af7ce76

  Copy full SHA for af7ce76

• ci/cd run again

  ishaan-jaff

  committed
  c7e3600

  Copy full SHA for c7e3600

• fix import on python 3.8

  ishaan-jaff

  committed
  1a658ff

  Copy full SHA for 1a658ff

• do nothing in _response_cost_calculator

  ishaan-jaff

  committed
  11818d2

  Copy full SHA for 11818d2

• Revert "do nothing in _response_cost_calculator"

  Show description for f4daaa3
  ishaan-jaff

  committed
  f4daaa3

  Copy full SHA for f4daaa3

• fix typed_lru_cache

  ishaan-jaff

  committed
  5d9322d

  Copy full SHA for 5d9322d

• fix internal lru cache linting

  ishaan-jaff

  committed
  ac4a8ee

  Copy full SHA for ac4a8ee

• fix lint check

  ishaan-jaff

  committed
  3e6d1f3

  Copy full SHA for 3e6d1f3

Commits on Jan 12, 2025

• fixes on lru cache

  ishaan-jaff

  committed
  29bc18b

  Copy full SHA for 29bc18b

• use lru cache on get llm provider

  ishaan-jaff

  committed
  e2225c9

  Copy full SHA for e2225c9

• fix get get_supported_openai_params

  ishaan-jaff

  committed
  76dae76

  Copy full SHA for 76dae76