-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
6 changed files
with
163 additions
and
2 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,27 @@ | ||
name: ci | ||
on: | ||
push: | ||
branches: | ||
- master | ||
- main | ||
permissions: | ||
contents: write | ||
jobs: | ||
deploy: | ||
runs-on: ubuntu-latest | ||
steps: | ||
- uses: actions/checkout@v3 | ||
- uses: actions/setup-python@v4 | ||
with: | ||
python-version: 3.x | ||
- uses: actions/cache@v3 | ||
with: | ||
key: mkdocs-material-${{ github.ref }} | ||
path: .cache | ||
restore-keys: | | ||
mkdocs-material- | ||
- run: pip install mkdocs-material | ||
- run: pip install mkdocs-jupyter | ||
- run: pip install jieba | ||
- run: pip install mkdocs-git-revision-date-localized-plugin | ||
- run: mkdocs gh-deploy --force |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,2 +1,16 @@ | ||
# llm-full-stack | ||
以开发LLM为例,从实验(设计 + 开发)到生产(部署 + 迭代) | ||
> 本项目在[Made-With-ML](https://github.com/GokuMohandas/Made-With-ML)上进行完善 | ||
将机器学习与软件工程相结合,设计、开发develop、部署deploy和迭代iterate生产级ML应用程序。 | ||
|
||
## 概述 | ||
|
||
从实验(设计 + 开发)逐步过渡到生产(部署 + 迭代)。通过逐步激发那些能够构建可靠生产系统的组件来完成这一过程。 | ||
|
||
💡 第一原则:在我们直接进入编码之前,我们会为每个机器学习概念建立第一原则的理解。 | ||
💻 最佳实践:在开发和部署机器学习模型时,我们会实施软件工程的最佳实践。 | ||
📈 扩展:在Python中轻松扩展机器学习工作负载(数据、训练、调整、提供服务),而无需学习全新的语言。 | ||
⚙️ MLOps:当我们构建端到端的机器学习系统时,连接MLOps组件(跟踪、测试、提供服务、编排等)。 | ||
🚀 从开发到生产:学习如何快速而可靠地从开发过渡到生产,而不需要对我们的代码或基础设施管理进行任何更改。 | ||
🐙 CI/CD:学习如何创建成熟的CI/CD工作流程,以模块化的方式持续训练和部署更好的模型,这与任何技术堆栈都可以集成。 | ||
|
||
> 虽然具体任务涉及为监督任务微调LLM,但都可以轻松扩展到所有应用(自然语言处理、计算机视觉、时间序列等)、模型(回归 → LLM)、数据模态(表格、文本等)、云平台(AWS、GCP)以及规模(本地 → 分布式集群)。 |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,14 @@ | ||
将机器学习与软件工程相结合,设计、开发develop、部署deploy和迭代iterate生产级ML应用程序。 | ||
|
||
## 概述 | ||
|
||
从实验(设计 + 开发)逐步过渡到生产(部署 + 迭代)。通过逐步激发那些能够构建可靠生产系统的组件来完成这一过程。 | ||
|
||
💡 第一原则:在我们直接进入编码之前,我们会为每个机器学习概念建立第一原则的理解。 | ||
💻 最佳实践:在开发和部署机器学习模型时,我们会实施软件工程的最佳实践。 | ||
📈 扩展:在Python中轻松扩展机器学习工作负载(数据、训练、调整、提供服务),而无需学习全新的语言。 | ||
⚙️ MLOps:当我们构建端到端的机器学习系统时,连接MLOps组件(跟踪、测试、提供服务、编排等)。 | ||
🚀 从开发到生产:学习如何快速而可靠地从开发过渡到生产,而不需要对我们的代码或基础设施管理进行任何更改。 | ||
🐙 CI/CD:学习如何创建成熟的CI/CD工作流程,以模块化的方式持续训练和部署更好的模型,这与任何技术堆栈都可以集成。 | ||
|
||
> 虽然具体任务涉及为监督任务微调LLM,但都可以轻松扩展到所有应用(自然语言处理、计算机视觉、时间序列等)、模型(回归 → LLM)、数据模态(表格、文本等)、云平台(AWS、GCP)以及规模(本地 → 分布式集群)。 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,106 @@ | ||
# 网站信息 | ||
site_name: llm-full-stack # | ||
site_url: https://eanyang7.github.io/llm-full-stack # mkdocs serve ——》 Browser connected: http://127.0.0.1:8000/xxx/ | ||
site_description: "llm-full-stack" # | ||
site_author: Ean Yang | ||
# 仓库 | ||
repo_url: https://github.com/EanYang7/llm-full-stack # | ||
repo_name: github仓库 | ||
|
||
theme: | ||
name: material | ||
language: zh | ||
# 网站logo | ||
logo: assets/logo.jpg # | ||
# 网站favicon | ||
favicon: assets/favicon.jpg # | ||
# 设置右上角图标 | ||
icon: | ||
repo: fontawesome/brands/github-alt | ||
edit: material/pencil | ||
view: material/eye | ||
palette: | ||
# 可选颜色见https://squidfunk.github.io/mkdocs-material/setup/changing-the-colors/#primary-color | ||
# 切换为暗黑模式 | ||
- media: "(prefers-color-scheme: light)" | ||
scheme: default | ||
primary: red # 主色调 | ||
accent: deep purple # 强调色调 | ||
toggle: | ||
icon: material/weather-sunny | ||
name: 切换为暗黑模式 | ||
|
||
# 切换为浅色模式 | ||
- media: "(prefers-color-scheme: dark)" | ||
scheme: slate | ||
primary: deep purple | ||
accent: red | ||
toggle: | ||
icon: material/weather-night | ||
name: 切换为浅色模式 | ||
# 导航设置 | ||
features: | ||
- navigation.instant | ||
- navigation.instant.progress | ||
- navigation.tracking | ||
# - navigation.tabs #选项卡 | ||
# - navigation.tabs.sticky #选项卡固定,滚动时还可见 | ||
# - navigation.sections #章节视图,可以和tabs搭配使用 | ||
# - navigation.expand #展开侧边栏 | ||
- navigation.prune | ||
# - navigation.indexes # 点击文件夹显示index.md的内容 | ||
- navigation.top # 回到顶部 | ||
- toc.follow # 目录跟随 | ||
- header.autohide # 滚动时隐藏顶部 | ||
- navigation.footer # 底部导航,上下页 | ||
- search.suggest # 搜索建议 | ||
- search.highlight # 搜索高亮 | ||
- search.share # 搜索分享 | ||
# 编辑和查看源码 | ||
- content.action.edit | ||
- content.action.view | ||
- content.code.copy | ||
# 编辑链接 | ||
edit_uri: "tree/main/docs/" | ||
extra: | ||
generator: false | ||
# 社交链接 | ||
social: | ||
- icon: fontawesome/brands/github | ||
link: https://github.com/YQisme | ||
name: github主页 | ||
- icon: fontawesome/brands/bilibili | ||
link: https://space.bilibili.com/244185393?spm_id_from=333.788.0.0 | ||
name: b站主页 | ||
- icon: fontawesome/solid/person | ||
link: https://eanyang7.com | ||
name: 个人主页 | ||
|
||
copyright: Copyright © 2023 Ean Yang | ||
|
||
plugins: | ||
- search: | ||
separator: '[\s\u200b\-]' | ||
- git-revision-date-localized: | ||
enable_creation_date: true | ||
- mkdocs-jupyter: | ||
include_source: True | ||
# ignore_h1_titles: True # 忽略一级标题(默认为False,会替换掉nav自定义的标题) | ||
|
||
markdown_extensions: | ||
- toc: | ||
permalink: ⚓︎ | ||
- pymdownx.tasklist: | ||
custom_checkbox: true | ||
- pymdownx.arithmatex: | ||
generic: true | ||
- admonition | ||
- pymdownx.highlight | ||
- pymdownx.superfences | ||
- pymdownx.details | ||
|
||
# nav: | ||
# - 主页: index.md | ||
# - 示例: | ||
# - 示例1: demo/demo1.md | ||
# - 示例2: demo/demo2.md |