Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ValueError: Number of devices 1 must equal the product of mesh_shape (1, 8) #305

Open
CodeBotanist opened this issue Mar 31, 2024 · 9 comments

Comments

@CodeBotanist
Copy link

image
I dunno what is going on here. By the way, there's a very big error while I am using the Hugging Face client, but I don't think that will affect anything because all the files are in my folder, though they haven't reached 297GB

@progaem95
Copy link

I have the same problem, they solved the problem ?

@cassius425
Copy link

cassius425 commented Mar 31, 2024

From #292

See
grok-1/run.py
Line 60 in 7050ed2
local_mesh_config=(1, 8),
and change local_mesh_config=(1, 1)

@metatron1973
Copy link

I think hugging face needs grok upgrade image

@progaem95
Copy link

I'm currently having this problem, "PermissionError: [WinError 32] The process cannot access the file because the file is occupied by another process: 'D:\dev\shm\tmp6jihw2tq'"

@shaikhmubin02
Copy link

To upgrade Hugging Face, you can use the following command in your terminal or command prompt:
pip install --upgrade transformers
This command will upgrade the Hugging Face Transformers library to the latest version available on the Python Package Index **(PyPI).

@progaem95
Copy link

Чтобы обновить Hugging Face, вы можете использовать следующую команду в терминале или командной строке.:
pip install --upgrade трансформаторы
Эта команда обновит библиотеку Hugging Face Transformers до последней версии, доступной в индексе пакетов Python **(PyPI).

Didn't help, same error

@Luffy-Yao
Copy link

Run the code on the instance with 8 GPUs and make sure the jax[cuda12_pip] is installed in your environment.

@tomDeprez
Copy link

I'm currently having this problem, "PermissionError: [WinError 32] The process cannot access the file because the file is occupied by another process: 'D:\dev\shm\tmp6jihw2tq'"

Have you found a solution to your issue with "PermissionError: [WinError 32] The process cannot access the file because it is being used by another process: 'D:\dev\shm\tmp6jihw2tq'"?

@progaem95
Copy link

В настоящее время у меня возникла такая проблема: «Ошибка разрешения: [WinError 32] Процесс не может получить доступ к файлу, поскольку файл занят другим процессом: 'D:\dev\shm\tmp6jihw2tq'"

Нашли ли вы решение своей проблемы с «PermissionError: [WinError 32] Процесс не может получить доступ к файлу, поскольку он используется другим процессом: 'D:\dev\shm\tmp6jihw2tq'"?

No

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

8 participants
@cassius425 @tomDeprez @Luffy-Yao @metatron1973 @shaikhmubin02 @progaem95 @CodeBotanist and others