Why use both LanceDB and Parquet? #787
Unanswered
nileshtrivedi
asked this question in
Q&A
Replies: 1 comment
-
Parquet is used for general storage, lancedb is used for vector search, so only the embeddings are loaded there. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I just noticed that graphrag creates a directory
lancedb
outside ofragtest
. LanceDB is a columnar data format for ML and pitches itself as an alternative to Parquet.Is there a reason why GraphRAG needs both of these?
Beta Was this translation helpful? Give feedback.
All reactions