Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

appbuilder文件夹重命名为python #578

Closed
wants to merge 3 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 1 addition & 1 deletion .github/workflows/python-package.yml
Original file line number Diff line number Diff line change
Expand Up @@ -144,7 +144,7 @@ jobs:
echo "检测到Python或Shell文件被更改(根据环境变量APPBUILDER_PYTHON_TESTS),准备启动单元测试Test with unittest部分..."
cd cicd/app-builder
pwd
sh appbuilder/tests/run_python_test.sh
sh python/tests/run_python_test.sh
fi
Go-Test-CI:
runs-on: ubuntu-latest
Expand Down
4 changes: 2 additions & 2 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ To run all existing test cases together, run

```
pip install -e .[all]
sh appbuilder/tests/run_python_test.sh
sh python/tests/run_python_test.sh
```

If you only want to run specific test file, e.g.:
Expand All @@ -64,7 +64,7 @@ and add/update `.vscode/settings.json` file with the following content:
"python.testing.unittestArgs": [
"-v",
"-s",
"./appbuilder",
"./python",
"-p",
"test*.py"
],
Expand Down
34 changes: 17 additions & 17 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -51,23 +51,23 @@ AppBuilder-SDK不仅提供了百度智能云提供的基础能力组件,同时

| 阶段 |组件名称 | 组件类型 |组件链接 |
|--------|--------|--------|---|
| 文档解析 | 文档矫正增强 (DocCropEnhance) | 基础能力组件 | [链接](./appbuilder/core/components/doc_crop_enhance/README.md) |
| 文档解析 | 文档格式转换 (DocFormatConverter) | 基础能力组件 | [链接](./appbuilder/core/components/doc_format_converter/README.md)|
| 文档解析 | 文档解析(DocParser)| 基础能力组件 | [链接](./appbuilder/core/components/doc_parser/README.md) |
| 文档解析 | 表格抽取组件(ExtractTableFromDoc)| 基础能力组件 | [链接](./appbuilder/core/components/extract_table/README.md) |
| 文档解析 | 通用文字识别-高精度版(GeneralOCR)| 基础能力组件 | [链接](./appbuilder/core/components/general_ocr/README.md) |
| 文档切片 | 文档切分(DocSplitter)| 基础能力组件 | [链接](./appbuilder/core/components/doc_splitter/README.md) |
| 切片向量化 | 向量计算(Embedding) | 基础能力组件 | [链接](./appbuilder/core/components/embeddings/README.md) |
| 索引构建及切片召回 | 向量检索-VectorDB(BaiduVectorDBRetriever) | 基础能力组件 | [链接](./appbuilder/core/components/retriever/baidu_vdb/README.md) |
| 索引构建及切片召回 | 向量检索-BES(BaiduElasticSearchRetriever) | 基础能力组件 | [链接](./appbuilder/core/components/retriever/bes/README.md) |
| 文档切片及答案生成 | 问答对挖掘(QAPairMining)| 高级能力组件 | [链接](./appbuilder/core/components/llms/qa_pair_mining/README.md) |
| 文档切片及答案生成 | 相似问生成(SimilarQuestion)| 高级能力组件 | [链接](./appbuilder/core/components/llms/similar_question/README.md) |
| 答案生成| 标签抽取(TagExtraction)| 高级能力组件 | [链接](./appbuilder/core/components/llms/tag_extraction/README.md) |
| 答案生成 | 复杂Query判定(IsComplexQuery)| 高级能力组件 | [链接](./appbuilder/core/components/llms/is_complex_query/README.md) |
| 答案生成 | 复杂Query分解(QueryDecomposition)| 高级能力组件 | [链接](./appbuilder/core/components/llms/query_decomposition/README.md) |
| 答案生成 | 多轮改写 (QueryRewrite)| 高级能力组件 | [链接](./appbuilder/core/components/llms/query_rewrite/README.md) |
| 答案生成 | 阅读理解问答(MRC)| 高级能力组件 | [链接](./appbuilder/core/components/llms/mrc/README.md) |
| 答案生成 | 幻觉检测(Hallucination Detection)| 高级能力组件 | [链接](./appbuilder/core/components/llms/hallucination_detection/README.md) |
| 文档解析 | 文档矫正增强 (DocCropEnhance) | 基础能力组件 | [链接](./python/core/components/doc_crop_enhance/README.md) |
| 文档解析 | 文档格式转换 (DocFormatConverter) | 基础能力组件 | [链接](./python/core/components/doc_format_converter/README.md)|
| 文档解析 | 文档解析(DocParser)| 基础能力组件 | [链接](./python/core/components/doc_parser/README.md) |
| 文档解析 | 表格抽取组件(ExtractTableFromDoc)| 基础能力组件 | [链接](./python/core/components/extract_table/README.md) |
| 文档解析 | 通用文字识别-高精度版(GeneralOCR)| 基础能力组件 | [链接](./python/core/components/general_ocr/README.md) |
| 文档切片 | 文档切分(DocSplitter)| 基础能力组件 | [链接](./python/core/components/doc_splitter/README.md) |
| 切片向量化 | 向量计算(Embedding) | 基础能力组件 | [链接](./python/core/components/embeddings/README.md) |
| 索引构建及切片召回 | 向量检索-VectorDB(BaiduVectorDBRetriever) | 基础能力组件 | [链接](./python/core/components/retriever/baidu_vdb/README.md) |
| 索引构建及切片召回 | 向量检索-BES(BaiduElasticSearchRetriever) | 基础能力组件 | [链接](./python/core/components/retriever/bes/README.md) |
| 文档切片及答案生成 | 问答对挖掘(QAPairMining)| 高级能力组件 | [链接](./python/core/components/llms/qa_pair_mining/README.md) |
| 文档切片及答案生成 | 相似问生成(SimilarQuestion)| 高级能力组件 | [链接](./python/core/components/llms/similar_question/README.md) |
| 答案生成| 标签抽取(TagExtraction)| 高级能力组件 | [链接](./python/core/components/llms/tag_extraction/README.md) |
| 答案生成 | 复杂Query判定(IsComplexQuery)| 高级能力组件 | [链接](./python/core/components/llms/is_complex_query/README.md) |
| 答案生成 | 复杂Query分解(QueryDecomposition)| 高级能力组件 | [链接](./python/core/components/llms/query_decomposition/README.md) |
| 答案生成 | 多轮改写 (QueryRewrite)| 高级能力组件 | [链接](./python/core/components/llms/query_rewrite/README.md) |
| 答案生成 | 阅读理解问答(MRC)| 高级能力组件 | [链接](./python/core/components/llms/mrc/README.md) |
| 答案生成 | 幻觉检测(Hallucination Detection)| 高级能力组件 | [链接](./python/core/components/llms/hallucination_detection/README.md) |


> 功能预告:在AppBuiler-SDK 1.0.0版本中,AppBuilder-SDK可联动AppBuilder平台,自定义离线与在线处理的能力及Pipeline,构建更加灵活、可沉淀、可复用的产业级`RAG`应用,敬请期待
Expand Down
24 changes: 0 additions & 24 deletions appbuilder/utils/chainlit.md

This file was deleted.

File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,7 @@ python3 -m pip uninstall -y pydantic
python3 -m pip install pydantic==2.7.4
python3 -m pip install langchain==0.3.0
python3 -m pip install datamodel-code-generator==0.25.8
cd appbuilder/tests/
cd python/tests/


# 5、执行parallel_ut_run.py,运行python单元测试
Expand All @@ -66,7 +66,7 @@ python3 parallel_ut_run.py
run_result=$?

# 6、基于coverage 测试结果计算全量单测覆盖率
# coverage combine ./appbuilder/tests/
# coverage combine ./python/tests/
coverage combine
coverage xml -o coverage.xml
coverage html -d coverage_html
Expand All @@ -82,8 +82,8 @@ echo "--------------------------"
# 替换后 /Users/chengmo/workspace/baidu_code/app-builder/
# 首先获取appbuilder-sdk的python lib的安装目录
python_lib=$(python3 -m pip show appbuilder-sdk | grep Location | awk '{print $2}')
# 再获取git clone的目录, 当前目录为 app-builder/appbuilder/tests, 取 app-builder/目录
git_dir=$(pwd | sed 's/appbuilder\/tests//')
# 再获取git clone的目录, 当前目录为 app-builder/python/tests, 取 app-builder/目录
git_dir=$(pwd | sed 's/python\/tests//')
# 批量替换coverage.xml文件中的python_lib为git_dir,并将源文件备份一个orignal.xml后缀
python3 -u sed_str.py coverage.xml $python_lib $git_dir
# 最后进行增量代码覆盖率测试
Expand Down
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
Loading
Loading