LangChain / LlamaIndex VectorStore as destination

[HectorBst]

Feature description

LangChain and LlamaIndex are frameworks widely used in the construction of RAG solutions. In particular, they each define an abstract Vector Store interface, implemented for different technologies by themselves or partners.

Add a LangChain and a LlamaIndex destinations, based on the abstract interfaces.

Are you a dlt user?

Yes, I'm already a dlt user.

Use case

• I want to easily load data into an as-yet unsupported Vector Store, using an existing LangChain / LlamaIndex implementation.
• I want to reuse existing LangChain / LlamaIndex code.
• I want to use my own LangChain / LlamaIndex connector instead of the existing dlt destination.
• I want to be able to switch easily from one Vector Store to another (e.g. for local testing or future architecture changes).

Proposed solution

A LangChainVectorStore destination and a LlamaIndexVectorStore destination, based on the abstract interfaces and taking a developer-supplied implementation.

Related issues

No response