Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

指定 fine-tuned 模型 #298

Closed
profwu opened this issue Oct 15, 2023 · 10 comments
Closed

指定 fine-tuned 模型 #298

profwu opened this issue Oct 15, 2023 · 10 comments
Labels
bug Something isn't working

Comments

@profwu
Copy link

profwu commented Oct 15, 2023

請問如何指定gpt model為自己fine tune後的模型?
要在那一隻程式的哪一個地方修改呢?

@profwu profwu added the question Further information is requested label Oct 15, 2023
@memochou1993 memochou1993 changed the title 如何指定gpt model為自己fine tune後的模型? 如何指定 fine-tune 後的模型 Oct 16, 2023
@memochou1993
Copy link
Owner

@profwu

嗨。

我沒有試過,你可以試試看。

你是用 OpenAI 還是 Azure?

你的 fine-tune 完的模型,是否有得到 API 端點?

不確定是不是修改 OPENAI_BASE_URL 就好。

相關連結:

@profwu
Copy link
Author

profwu commented Oct 16, 2023

Hi,

我用的是openai的fine tune。我在Environment variable設定OPENAI_COMPLETION_MODEL=我的model名稱
然後在line中會出現這樣錯誤

POST https://api.openai.com/v1/completions
Request failed with status code 404
This is a chat model and not supported in the v1/completions endpoint. Did you mean to use v1/chat/completions?

@memochou1993
Copy link
Owner

@profwu

你的 fine-tune 完的模型,是否有得到 API 端點?

@tonylmm
Copy link

tonylmm commented Dec 7, 2023

想請教一下,在openai中的fine tuning後,並非得到api的端點,而只有得到一個模型的新名稱,像這樣ft:gpt-3.5-turbo-0613:personal::8ArgcXXX和job id像這樣ftjob-7ZZQFjR3ENWpyTo5c0JWuXXX。不知道該如何在您建構的這個LineBot中作使用???

@memochou1993
Copy link
Owner

@tonylmm

修改 Vercel 的環境變數:

OPENAI_COMPLETION_MODEL=ft:gpt-3.5-turbo:my-org:custom_suffix:id

@tonylmm
Copy link

tonylmm commented Dec 7, 2023

@tonylmm

修改 Vercel 的環境變數:

OPENAI_COMPLETION_MODEL=ft:gpt-3.5-turbo:my-org:custom_suffix:id

非常感謝您的回覆,在下受益良多。
但嘗試在Vercel的環境變數中,加入了自己的model id後,也是得到像上面朋友的結果,
POST https://api.openai.com/v1/completions
Request failed with status code 404
This is a chat model and not supported in the v1/completions endpoint. Did you mean to use v1/chat/completions?
不知道問題出在那裏???

@memochou1993
Copy link
Owner

@tonylmm

感謝回報。

請拉 4.8.0 版,然後再試一次看看。

@memochou1993 memochou1993 reopened this Dec 7, 2023
@memochou1993 memochou1993 added bug Something isn't working and removed question Further information is requested labels Dec 7, 2023
@memochou1993 memochou1993 changed the title 如何指定 fine-tune 後的模型 指定 fine-tuned 模型 Dec 7, 2023
@tonylmm
Copy link

tonylmm commented Dec 7, 2023

太感謝您了,果然用4.8.0的版本就可以了呢,辛苦您了。

@profwu
Copy link
Author

profwu commented Dec 8, 2023 via email

@memochou1993
Copy link
Owner

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants