Merge upstream 0324 #4

ntauth · 2024-03-21T08:52:38Z

PR Checklist

Read the Contributing documentation.
Read the Code of conduct documentation.
Name your Pull Request title clearly, concisely, and prefixed with the name of the primarily affected package you changed according to Good commit messages (such as memory: add interfaces for X, Y or util: add whizzbang helpers).
Check that there isn't already a PR that solves the problem the same way to avoid creating a duplicate.
Provide a description in this PR that addresses what the PR is solving, or reference the issue that it solves (e.g. Fixes #123).
Describes the source of new concepts.
References existing implementations as appropriate.
Contains test coverage for new functions.
Passes all golangci-lint checks.

And invoke it in the new methods Re tmc#465

The chat llm client calls use the newer OpenAI API to implement the same functionality

Adding CallLLM as a general utility

…aces

Via `queryAttrs` you can specify fields to be returned with a similarity search. In Weaviate you can retrieve the id via the `_additional` field. With the current setup it is not possible to add additional fields (like the id) to the the `_additional` due to the manual mapping in 'createFields' function. This adds a new `WithAdditionalFields` optional to give the user control over which additional fields to return.

Add callback handler method for GenerateContent start and end

Finalize the majority of the model/LLM interface refactoring

all: clean up now unused types Generation and LLMResult

all: clean up and update comments

docs: add example to embeddings

1. add pgvector into test 2. add OPENAI_API_KEY and GENAI_API_KEY into test 3. deprecate pgvector table name Sanitize function 4. reset pgvector Search sql and make TestDeduplicater rerun 5. add test TestWithAllOptions for test all option 6. because of StuffDocuments.joinDocuments ignore document's metadata, update some tests Signed-off-by: Abirdcfly <[email protected]>

Signed-off-by: Abirdcfly <[email protected]>

It seems like a bunch of links were broken and docs.langchain.com now redirects to the python docs.

* Example about retriever A example about retriever, how use and why need use * feat: add anothers options for vectorstore * fix: update remove docs

* Example spliters example about use spliter * fix: update names

* tool: sql_database generate sql-query filter redundant text

…c LLM (tmc#671) * implement WithBaseUrl and WithHttpClient for anthropic model * fix build errors * URL not url * fix more errors

…it only works for me when marked as system (tmc#670)

feat(milvus): add WithMetricType

* feat: Bumping to latest chroma-go version Refs: https://github.com/amikos-tech/chroma-go/releases/tag/v0.1.2

tmc#675) vectorstores/milvus: fixed the bug that the collection was created incorrectly

* feat: add llamafile * feat: add llamafile embeddings

* documentloaders: added assemblyai document loader

* Add bedrock LLMs

* llms: Improve json response format coverage, add example

* fix: require the correct parameter for Azure OpenAI

* fix: ResponseFormat cause openai api response err - is not one of ['json_object', 'text'] - 'response_format.type'

* feat: change Executor to *Executor * docs: add deprecated comment to agents.Initialize * feat: change CreationOptions to Options in agents * feat: change CreationOption type to Option in agents

* httputil: Add httputil package to provide some common helpers * httputil: Address lint issues

examples: Fix up import

…c#706)

mdelapenya and others added 30 commits January 16, 2024 17:17

feat: add MySQL tests using testcontainers-go

766a89d

feat: add Postgres tests using testcontainers-go

a77e095

Add new callback for GenerateContent start and end

405efea

And invoke it in the new methods Re tmc#465

Merge branch 'main' into patch-1

6cc76ba

chore: include postgres module dependency

4097eea

Move openai chat client functionality to its LLM, remove separate Chat

97397f1

The chat llm client calls use the newer OpenAI API to implement the same functionality

openai: use CallLLM to implement Call

c9a7d61

Adding CallLLM as a general utility

ollama: merge chat into llm, implement Call with GenerateContent

da53f69

googleai: add Call in terms of GenerateContent

537d9ea

huggingface: add GenerateContent and implement Model

ab1fc1e

localllm: implement Model with GenerateContent

b31c6f4

vertexai: implement GenerateContent

9fee6b6

vertexai: remove chat implementation since we now have Model

e1a90e0

anthropic: implement GenerateContent and Model

dd74cc7

cohere: implement GenerateContent

2240607

ernie: implement GenerateContent

51af708

all: lint

06ed2fb

all: remove ChatLLM interface - it's now unused

7d10272

all: remove Generate method, as it's no longer used

d7633d6

Add alias and comments

9325c2c

chains: dummy implementation of GenerateContent because of new interf…

0e4d69e

…aces

docs: fix link to CODE_OF_CONDUCT.md

45ac6b0

all: clean up now unused types Generation and LLMResult

8b30d4b

llms: clean up comments

75ee210

Merge pull request tmc#514 from tmc/cb

bf1b8da

Add callback handler method for GenerateContent start and end

Merge pull request tmc#521 from tmc/gccall

ea49eaa

Finalize the majority of the model/LLM interface refactoring

Merge pull request tmc#523 from tmc/clean5

690d1bd

all: clean up now unused types Generation and LLMResult

Merge pull request tmc#524 from tmc/clean6

c1aea7b

all: clean up and update comments

Merge pull request tmc#518 from haochunchang/add_example_to_embeddings

1526a5f

docs: add example to embeddings

Abirdcfly and others added 29 commits March 7, 2024 17:57

googleai: return err not log.Fatal when stream get error (tmc#663)

24cb833

Signed-off-by: Abirdcfly <[email protected]>

docs: fixup a bunch of links (tmc#659)

255f6a9

It seems like a bunch of links were broken and docs.langchain.com now redirects to the python docs.

docs: Add example about retriever (tmc#651)

04e2df3

* Example about retriever A example about retriever, how use and why need use * feat: add anothers options for vectorstore * fix: update remove docs

Create FUNDING.yml (tmc#669)

b82fbbf

docs: Add documentation for splitters (tmc#649)

b4e6529

* Example spliters example about use spliter * fix: update names

tool: sql_database generate sql-query filter redundant text (tmc#612)

ca2969c

* tool: sql_database generate sql-query filter redundant text

llms/anthropic: Implement WithBaseURL and WithHTTPClient for Anthropi…

6eaa82c

…c LLM (tmc#671) * implement WithBaseUrl and WithHttpClient for anthropic model * fix build errors * URL not url * fix more errors

This example hangs if the JSON data is either marked as human or AI, …

eecf58c

…it only works for me when marked as system (tmc#670)

vectorstores/milvus: add WithMetricType (tmc#674)

768bc00

feat(milvus): add WithMetricType

chore: Chroma dependency update (tmc#676)

e9fbf3c

* feat: Bumping to latest chroma-go version Refs: https://github.com/amikos-tech/chroma-go/releases/tag/v0.1.2

vectorstores/milvus: fixed the bug that the collection was created in… (

101dbf0

tmc#675) vectorstores/milvus: fixed the bug that the collection was created incorrectly

Implementation proposal for using llamafile (tmc#677)

ebb5d1a

* feat: add llamafile * feat: add llamafile embeddings

documentloaders: add AssemblyAI document loader (tmc#668)

0218733

* documentloaders: added assemblyai document loader

LLMs: Add AWS Bedrock LLMs (tmc#666)

259311e

* Add bedrock LLMs

docs: Fix docs build (tmc#686)

e108163

examples: Point to v0.1.6-alpha.1 (tmc#687)

325d534

llms: Improve json mode support (tmc#683)

6045596

* llms: Improve json response format coverage, add example

examples: Update examples to v0.1.6 (tmc#688)

014070c

llms/openai: Azure: add check for model parameter (tmc#691)

4065971

* fix: require the correct parameter for Azure OpenAI

llms/openai: Optionally supply ResponseFormat (tmc#690)

8b54683

* fix: ResponseFormat cause openai api response err - is not one of ['json_object', 'text'] - 'response_format.type'

examples: Update to v0.1.7 (tmc#694)

dc3e6f6

Improvements on agents package API (tmc#551)

4746a5d

* feat: change Executor to *Executor * docs: add deprecated comment to agents.Initialize * feat: change CreationOptions to Options in agents * feat: change CreationOption type to Option in agents

llms: add caching functionality for Models (tmc#564)

5635461

httputil: Add httputil package to provide some common helpers (tmc#702)

491288f

* httputil: Add httputil package to provide some common helpers * httputil: Address lint issues

examples: Use new debugging helper in example (tmc#703)

be54dc1

examples: Fix up import in openai debugging example (tmc#704)

3da52d3

examples: Fix up import

tests: Perform env-var checking skips sooner as to speed up tests (tm…

60fa95d

…c#706)

Merge remote-tracking branch 'upstream/main' into merge-upstream-0324

a1fdad3

ntauth merged commit 0e35361 into main Mar 21, 2024
2 of 3 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Merge upstream 0324 #4

Merge upstream 0324 #4

ntauth commented Mar 21, 2024 •

edited

Loading

Merge upstream 0324 #4

Merge upstream 0324 #4

Conversation

ntauth commented Mar 21, 2024 • edited Loading

PR Checklist

ntauth commented Mar 21, 2024 •

edited

Loading