Add support for LLMs #136

whoseoyster · 2023-08-23T07:37:45Z

No description provided.

…hell models, and direct to API models

…nd in conda env

…o modules, separation of concerns)

…t construction on the Python client

…Cohere]

… model runners

…sults on Jupyter notebook

gustavocidornelas and others added 24 commits July 21, 2023 14:54

Completes OPEN-4724 Add client support for LLM projects - datasets, s…

4a298af

…hell models, and direct to API models

OpenAIChatCompletion model runner

083e8a8

Add support for fine-tuning datasets for LLM projects

2acd0b2

Add model to LLM model config schema

3288d3a

Completes OPEN-4772 Jupyter notebook examples for LLM tasks

2e3eb19

Init model runners from config or kwargs. Support running in memory a…

f2b3637

…nd in conda env

Adds Cohere Generate LLM runner

02dc06f

Adds Anthropic LLM runner

03b371b

Refactor model runners (factory method design pattern, break down int…

41424e9

…o modules, separation of concerns)

Completes OPEN-4810 Replace prompt template with new method for promp…

a0816f4

…t construction on the Python client

Completes OPEN-4816 Fail early for invalid API key for LLMs [OpenAI, …

4b61477

…Cohere]

Completes OPEN-4817 Surface total cost of using LLMs after requests

570ebf0

Completes OPEN-4818 Handle partially successful requests

4ee44cc

Completes OPEN-4820 Add column with timestamp for each prediction for…

72e3436

… model runners

Completes OPEN-4821 Yield prediction progress for LLMs and display re…

7fb3860

…sults on Jupyter notebook

Use UTC datetime and rename 'timestamps' column to 'output_time_utc'

e6773c0

Rename 'predictions' column to 'output' for all model runners

aa1f6f3

Completes OPEN-4812 Create model runner for self hosted LLMs

67b2bd8

Pass on timestamps if they are also available in the dataset

26fca36

Completes OPEN-4812 Create model runner for self hosted LLMs

a92d558

Delete old LLM notebook examples

c1d0d10

Completes OPEN-4842 Create notebook example for LangChain

cbe83fe

Remove LLM task type short-circuit from Python client methods

f155af5

Bump version

b7d89f9

whoseoyster merged commit 2273010 into main Aug 23, 2023
1 of 2 checks passed

whoseoyster deleted the cid/llm-client branch August 23, 2023 07:41

Provide feedback