Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Local deepseek deepseek-r1:14b, working but took very long time #195

Open
harst21 opened this issue Jan 29, 2025 · 4 comments
Open

Local deepseek deepseek-r1:14b, working but took very long time #195

harst21 opened this issue Jan 29, 2025 · 4 comments

Comments

@harst21
Copy link

harst21 commented Jan 29, 2025

Hi there,

Im using ollama and local model of deepseek-r1:14b, it works for default prompt. But each step took very long time, more than 4 minutes each. Its finally get into first page of search result

But it took more than 30 minutes. Lol

Any idea why is this happening? is there any way to speed up the process?

Thanks in advance!

@vvincent1234
Copy link
Contributor

maybe your ollama does not use gpu. try this two methods to solve: 1. ollama run deepseek-r1:14b first to check whether it can run faster? 2. try this: #185

@harst21
Copy link
Author

harst21 commented Jan 29, 2025

maybe your ollama does not use gpu. try this two methods to solve: 1. ollama run deepseek-r1:14b first to check whether it can run faster? 2. try this: #185

It run fast enough with ollama run deepseek-r1:14b, have no issue prompting directly. Already try 2 option, but no luck. Its still super slow.. it works, doing step 1, but super slow until reach step 2 and so on

@techstartupexplorer
Copy link

deepseek-reasoner doesn;t work with 1.3

@warmshao
Copy link
Collaborator

deepseek-reasoner doesn;t work with 1.3

please donot use 1.3,the code is under development, keep up with the latest codes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants