Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update chapter01 Chinese translation #224

Closed
wants to merge 3 commits into from

Conversation

jackbai233
Copy link

  • Fix word spelling errors
  • Update some sentences that don’t read smoothly

Copy link

github-actions bot commented Dec 2, 2023

👋 Thanks for contributing @jackbai233! We will review the pull request and get back to you soon.

@jackbai233
Copy link
Author

@jackbai233 please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.

@microsoft-github-policy-service agree [company="{your company}"]

Options:

  • (default - no company specified) I have sole ownership of intellectual property rights to my Submissions and I am not making Submissions in the course of work for my employer.
@microsoft-github-policy-service agree
  • (when company given) I am making Submissions in the course of work for my employer (or my employer has intellectual property rights in my Submissions by contract or applicable law). I have permission from my employer to make Submissions and enter into this Agreement on behalf of my employer. By signing below, the defined term “You” includes me and my employer.
@microsoft-github-policy-service agree company="Microsoft"

Contributor License Agreement

@microsoft-github-policy-service agree

Copy link

This PR has not seen any action for a while! Closing for now, but it can be reopened at a later date.

Copy link

github-actions bot commented Mar 3, 2024

Check Broken Paths

We have automatically detected the following broken relative paths in your lessons. Review and fix the paths to resolve this issue.

Check the file paths and associated broken paths inside them. For more details, check our Contributing Guide.

File Full Path Issues
./01-introduction-to-genai/translations/cn/README.md ['../../../13-continued-learning/translations/cn/README.md']

Copy link

github-actions bot commented Mar 3, 2024

Check Missing Tracking from Paths

We have automatically detected missing tracking id from the following relative paths in your lessons. Review and add tracking to paths to resolve this issue.

Check the file paths and associated paths inside them. For more details, check our Contributing Guide.

File Full Path Issues
./18-fine-tuning/SETUP.md ['./img/codespaces-secrets.png']
./16-open-source-models/README.md ['./images/model-price.png', './images/choose-model.png', './images/model-quality.png']
./05-advanced-prompts/README.md ['./python/aoai-solution.py']

Copy link

github-actions bot commented Mar 3, 2024

Check Missing Tracking from URLs

We have automatically detected missing tracking id from the following URLs in your lessons. Review and add tracking to URLs to resolve this issue.

Check the file paths and associated URLs inside them. For more details, check our Contributing Guide.

File Full Path Issues
./18-fine-tuning/README.md ['https://github.com/microsoft/generative-ai-for-beginners/issues']
./18-fine-tuning/SETUP.md ['https://docs.github.com/codespaces/managing-your-codespaces/managing-your-account-specific-secrets-for-github-codespaces', 'https://github.com/settings/codespaces']

Copy link

github-actions bot commented Mar 3, 2024

Check Country Locale in URLs

We have automatically detected added country locale to URLs in your lessons. Review and remove country specific locale from URLs to resolve this issue.

Check the file paths and associated URLs inside them. For more details, check our Contributing Guide.

File Full Path Issues
./README.md ['https://azure.microsoft.com/en-us/products/ai-services/openai-service?WT.mc_id=academic-105485-koreyst', 'https://learn.microsoft.com/en-us/training/paths/python-language/?WT.mc_id=academic-105485-koreyst', 'https://learn.microsoft.com/en-us/training/paths/build-javascript-applications-typescript/?WT.mc_id=academic-105485-koreyst']
./01-introduction-to-genai/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=36c6795a-e63c-46dd-8d69-df8bbe6e7bc9?WT.mc_id=academic-105485-koreyst']
./01-introduction-to-genai/translations/ja-jp/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=36c6795a-e63c-46dd-8d69-df8bbe6e7bc9?WT.mc_id=academic-105485-yoterada']
./01-introduction-to-genai/translations/cn/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=36c6795a-e63c-46dd-8d69-df8bbe6e7bc9?WT.mc_id=academic-105485-koreyst']
./01-introduction-to-genai/translations/pt-br/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=36c6795a-e63c-46dd-8d69-df8bbe6e7bc9?WT.mc_id=academic-105485-koreyst']
./01-introduction-to-genai/translations/es-mx/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=36c6795a-e63c-46dd-8d69-df8bbe6e7bc9?WT.mc_id=academic-105485-koreyst']
./18-fine-tuning/README.md ['https://learn.microsoft.com/en-us/azure/ai-services/openai/tutorials/fine-tune?tabs=python-new%2Ccommand-line?WT.mc_id=academic-105485-koreyst']
./18-fine-tuning/RESOURCES.md ['https://learn.microsoft.com/en-us/training/modules/finetune-foundation-model-with-azure-machine-learning/?WT.mc_id=academic-105485-koreyst', 'https://learn.microsoft.com/en-us/training/paths/work-with-generative-models-azure-machine-learning/?WT.mc_id=academic-105485-koreyst', 'https://www.microsoft.com/en-us/research/blog/phi-2-the-surprising-power-of-small-language-models/?WT.mc_id=academic-105485-koreyst']
./18-fine-tuning/assignments/python/aoai-assignment.ipynb ['https://learn.microsoft.com/en-us/azure/ai-services/openai/tutorials/fine-tune?tabs=python-new%2Ccommand-line?WT.mc_id=academic-105485-koreyst']
./04-prompt-engineering-fundamentals/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=d54c0c69-b183-4a6c-80ed-8b1a8f299cff?WT.mc_id=academic-105485-koreyst']
./04-prompt-engineering-fundamentals/translations/ja-jp/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=d54c0c69-b183-4a6c-80ed-8b1a8f299cff?WT.mc_id=academic-105485-yoterada']
./04-prompt-engineering-fundamentals/translations/cn/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=d54c0c69-b183-4a6c-80ed-8b1a8f299cff?WT.mc_id=academic-105485-koreyst']
./04-prompt-engineering-fundamentals/translations/pt-br/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=d54c0c69-b183-4a6c-80ed-8b1a8f299cff?WT.mc_id=academic-105485-koreyst']
./07-building-chat-applications/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=57a31949-67c5-4020-8c85-91e4995589f3?WT.mc_id=academic-105485-koreyst']
./07-building-chat-applications/translations/ja-jp/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=57a31949-67c5-4020-8c85-91e4995589f3?WT.mc_id=academic-105485-yoterada']
./07-building-chat-applications/translations/cn/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=57a31949-67c5-4020-8c85-91e4995589f3?WT.mc_id=academic-105485-koreyst']
./07-building-chat-applications/translations/pt-br/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=57a31949-67c5-4020-8c85-91e4995589f3?WT.mc_id=academic-105485-koreyst']
./10-building-low-code-ai-applications/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=170c6cb7-3c96-40f2-a354-b6f0ec523de7?WT.mc_id=academic-105485-koreyst']
./10-building-low-code-ai-applications/translations/ja-jp/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=170c6cb7-3c96-40f2-a354-b6f0ec523de7?WT.mc_id=academic-105485-yoterada']
./10-building-low-code-ai-applications/translations/cn/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=170c6cb7-3c96-40f2-a354-b6f0ec523de7?WT.mc_id=academic-105485-koreyst']
./10-building-low-code-ai-applications/translations/pt-br/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=170c6cb7-3c96-40f2-a354-b6f0ec523de7?WT.mc_id=academic-105485-koreyst']
./02-exploring-and-comparing-different-llms/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=39aa0f98-826a-4f71-a24d-e888a8e80246?WT.mc_id=academic-105485-koreyst']
./02-exploring-and-comparing-different-llms/translations/ja-jp/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=36c6795a-e63c-46dd-8d69-df8bbe6e7bc9?WT.mc_id=academic-105485-yoterada']
./02-exploring-and-comparing-different-llms/translations/cn/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=39aa0f98-826a-4f71-a24d-e888a8e80246?WT.mc_id=academic-105485-koreyst']
./02-exploring-and-comparing-different-llms/translations/pt-br/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=36c6795a-e63c-46dd-8d69-df8bbe6e7bc9?WT.mc_id=academic-105485-koreyst']
./05-advanced-prompts/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=f3615e46-dbca-477c-832d-21eef95cd9f3?WT.mc_id=academic-105485-koreyst']
./05-advanced-prompts/translations/ja-jp/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=f3615e46-dbca-477c-832d-21eef95cd9f3?WT.mc_id=academic-105485-yoterada']
./05-advanced-prompts/translations/cn/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=f3615e46-dbca-477c-832d-21eef95cd9f3?WT.mc_id=academic-105485-koreyst']
./05-advanced-prompts/translations/pt-br/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=f3615e46-dbca-477c-832d-21eef95cd9f3?WT.mc_id=academic-105485-koreyst']
./06-text-generation-apps/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=bf3f3528-9871-4628-8616-b4b03cb23dcd?WT.mc_id=academic-105485-koreyst']
./06-text-generation-apps/translations/ja-jp/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=bf3f3528-9871-4628-8616-b4b03cb23dcdt?WT.mc_id=academic-105485-yoterada']
./06-text-generation-apps/translations/cn/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=bf3f3528-9871-4628-8616-b4b03cb23dcd?WT.mc_id=academic-105485-koreyst']
./06-text-generation-apps/translations/pt-br/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=bf3f3528-9871-4628-8616-b4b03cb23dcd?WT.mc_id=academic-105485-koreyst']
./12-designing-ux-for-ai-applications/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=1464ef7a-d974-4a04-9ce3-1bc5b3087b4b?WT.mc_id=academic-105485-koreyst']
./12-designing-ux-for-ai-applications/translations/ja-jp/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=1464ef7a-d974-4a04-9ce3-1bc5b3087b4b?WT.mc_id=academic-105485-yoterada']
./12-designing-ux-for-ai-applications/translations/cn/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=1464ef7a-d974-4a04-9ce3-1bc5b3087b4b?WT.mc_id=academic-105485-koreyst']
./12-designing-ux-for-ai-applications/translations/pt-br/README.md ['https://learn.microsoft.com/_themes/docs.theme/master/en-us/_themes/global/video-embed.html?id=1464ef7a-d974-4a04-9ce3-1bc5b3087b4b?WT.mc_id=academic-105485-koreyst']
./13-securing-ai-applications/README.md ['https://www.microsoft.com/en-us/security/blog/2023/08/07/microsoft-ai-red-team-building-future-of-safer-ai/?WT.mc_id=academic-105485-koreyst', 'https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/role-based-access-control?WT.mc_id=academic-105485-koreyst', 'https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/red-teaming?WT.mc_id=academic-105485-koreyst', 'https://learn.microsoft.com/en-us/training/paths/purview-protect-govern-ai/?WT.mc_id=academic-105485-koreyst']


## LLMs 如何工作?

在下一章中,我们将探索不同类型的生成式 AI 模型,但现在让我们看看大型语言模型是如何工作的,重点是 OpenAI GPT(生成式预训练 Transformer)模型。

- **分词器,文本到数字**:大型语言模型接收文本作为输入并生成文本作为输出。 然而,作为统计模型,它们对数字的处理效果对比起文本序列的处理效果要好得多。 这就是为什么模型的每个输入在被核心模型使用之前都由分词器处理。 标记是一段文本——由可变数量的字符组成,因此标记器的主要任务是将输入分割成标记数组。 然后,每个令牌都映射有一个令牌索引,该索引是原始文本块的整数编码。
* **分词器,文本到数字**:大型语言模型接收文本作为输入并生成文本作为输出。 然而,作为统计模型,它们对数字的处理效果对比起文本序列的处理效果要好得多。 这就是为什么模型的每个输入在被核心模型使用之前都由分词器处理。 标记(token)是一段文本——由可变数量的字符组成,因此分词器的主要任务是将输入分割成标记数组。 然后,每个标记都映射有一个标记索引,该索引是原始文本块的整数编码。

![Example of tokenization](../../images/tokenizer-example.png?WT.mc_id=academic-105485-koreyst)

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.


@github-actions github-actions bot closed this Mar 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants