v0.2.1

arcadia-v0.2.1

Welcome to this new release!

Images built for this release:

• kubeagi/arcadia:v0.2.1
• kubeagi/data-processing:v0.2.1

Breaking Changes:

None

Feature summary 🚀 🚀 🚀

1. Able to use pdf(chuks),chunkd csv to build knwwledgebase.
2. Build knowledgebase for each conversation and use this knowledgebase for conversation chat.
3. Simplify kubeagi deployment and make it more reliable.
4. Introduce Rerank and MultiQueryRetriever to optimize RAG chat

Changelog

New Features

• 9a57c54: feat(knowledgebase): able to configure time cost of file processing (@bjwswang)
• a0d35cb: feat: add multiQueryRetriever (@Abirdcfly)
• 052bbfc: feat: build knowledgebase for conversation (@bjwswang)
• 21c524c: feat: complete the fields of the CR Model (@dayuy)
• 88fa96e: feat: conversation knowledgebase (@Abirdcfly)
• f55cdfa: feat: get data from modelscope and huggingface (@0xff-dev)
• 6bce308: feat: list cluster nodes with labels (@bjwswang)
• adb2d84: feat: set apiserver proxy (@0xff-dev)
• 5fb4aa3: feat: show pdf info in reference (@Abirdcfly)
• faaf5f2: feat: support chunk.csv has no q a col (@Abirdcfly)
• b7d3f1c: feat: sync app config web ui for gql (@Abirdcfly)
• fc03782: feat:add document chunk (@wangxinbiao)
• 4c37231: feat:the time consumed for data processing. (@wangxinbiao)

Bug Fixes

• 7db85f5: fix: add batchsize in embedding options (@bjwswang)
• 39ca07d: fix: apiserver cors error (@0xff-dev)
• 4d4dd63: fix: chat use header namespace (@Abirdcfly)
• 29b5ec4: fix: check nil pointer (@0xff-dev)
• 7adef69: fix: delete conversation with documents (@Abirdcfly)
• 72f3eb5: fix: list all files even no file status yet in knowledgebase (@0xff-dev)
• f150da5: fix: odd number of arguments passed as key-value pairs for logging (@bjwswang)
• 4036fcb: fix: pdf summerize and and it to test (@Abirdcfly)
• 32d82ce: fix: refine ray logic and support extraAgrs in worker (@nkwangleiGIT)
• 4afa402: fix: set/deploy a default embedder for kubeagi (@bjwswang)
• 9a38eac: fix: should do nil check before set when create/update model (@bjwswang)
• 368e868: fix: support getting all data (@0xff-dev)
• aedee1e: fix: use datasource as the default source in knowledgebase (@bjwswang)
• f735dde: fix: when edit csv file, temporary file cannot be created (@0xff-dev)
• fe9a465: fix: when knowledgebase has only chunk cant generate PromptStarter (@Abirdcfly)
• 026a3d2: fix: zhipu embedding error with empty string (@Abirdcfly)
• 41730a6: fix:A string literal cannot contain NULL (0x00) characters (@wangxinbiao)
• fe7d3b6: fix:If QA deduplication is not selected, an error will be prompted. (@wangxinbiao)
• 184fe51: fix:the service cannot be started. (@wangxinbiao)

Others

• 49d6316: Enable --enforce-eager by default fix NUMBER_GPUS issue (@nkwangleiGIT)
• 0eb824f: Fix conversation chat with doc for 1st time and update ray to 2.9.3(vllm 0.3.3) (@nkwangleiGIT)
• 15a61da: Merge remote-tracking branch 'upstream/main' (@nkwangleiGIT)
• 39c3736: chore: add modelsource field and update graphql definition (@0xff-dev)
• d867df0: chore: get the model files based on the modelsource field (@0xff-dev)
• 1dfc75b: chore: use 0.2 eval image in RAG jobs (@Lanture1064)
• 2683c46: chore:store the details of the error log information in a database table. (@wangxinbiao)
• 8dc06f1: release v0.2.1 (@bjwswang)

Thanks to our Contributors!

Thank you to everyone who contributed to v0.2.1! ❤️

And thank you very much to everyone else not listed here who contributed in other ways like filing issues, giving feedback, testing fixes, helping users in slack, etc. 🙏