Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Windows tabby.exe crashed #3540

Open
microSoftware opened this issue Dec 10, 2024 · 2 comments
Open

Windows tabby.exe crashed #3540

microSoftware opened this issue Dec 10, 2024 · 2 comments

Comments

@microSoftware
Copy link

microSoftware commented Dec 10, 2024

Version:

v0.21.2-rc.2
https://tabby_x86_64-windows-msvc-cuda117.zip/

Machine

PC with windows 11 and RTX 2070

I run this command:

.\tabby.exe serve --model StarCoder-1B --chat-model Qwen2-1.5B-Instruct --device cuda

First 2 or 3 models get downloaded and then a crash happen:

Failed to read directory: 0s {code: 3, kind: NotFound, message: "The system cannot find the path specified."}
Location: crates\llama-cpp-server\src\supervisor.rs:158

Backtrace omitted. Run with RUST_BACKTRACE=1 environment variable to display it.
Run with RUST_BACKTRACE=full to include source snippets.

GOAL:

What i want to do is create a tabby server on windows to be used in my visual studio code on mac.

@wsxiaoys
Copy link
Member

Could you please share the directory structure where you are running Tabby? Should there be a llama-server.exe file in the same directory?

@microSoftware
Copy link
Author

Could you please share the directory structure where you are running Tabby? Should there be a llama-server.exe file in the same directory?

The folder is in a folder Program File in my NTFS NAS where i store all my windows install.
Indeed there is llama-server.exe along with some dll files.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants