Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Pipeline is not initialized. #788

Closed
Korol-Kotov opened this issue Sep 3, 2023 · 7 comments
Closed

Pipeline is not initialized. #788

Korol-Kotov opened this issue Sep 3, 2023 · 7 comments

Comments

@Korol-Kotov
Copy link

Issue Type

Bug Report

vc client version number

MMVCServerSIO_win_onnxgpu-cuda_v.1.5.3.13.zip

OS

Windows 10

GPU

GeForce GTX 650 (1GB)

Clear setting

yes

Sample model

yes

Input chunk num

yes

Wait for a while

The GUI successfully launched.

read tutorial

yes

Extract files to a new folder.

yes

Voice Changer type

RVC

Model type

onnx

Situation

I press start and hear nothing.

application window capture

Screenshot_773

logs on terminal

C:\Users\User\Desktop\Voice>MMVCServerSIO.exe -p 18888 --https false --content_vec_500 pretrain/checkpoint_best_legacy_500.pt --content_vec_500_onnx pretrain/content_vec_500.onnx --content_vec_500_onnx_on true --hubert_base pretrain/hubert_base.pt --hubert_base_jp pretrain/rinna_hubert_base_jp.pt --hubert_soft pretrain/hubert/hubert-soft-0d54a1f4.pt --nsf_hifigan pretrain/nsf_hifigan/model --crepe_onnx_full pretrain/crepe_onnx_full.onnx --crepe_onnx_tiny pretrain/crepe_onnx_tiny.onnx --rmvpe pretrain/rmvpe.pt --model_dir model_dir --samples samples.json
Booting PHASE :main
PYTHON:3.10.11 (tags/v3.10.11:7d4cc5a, Apr 5 2023, 00:38:17) [MSC v.1929 64 bit (AMD64)]
Activating the Voice Changer.
[Voice Changer] download sample catalog. samples_0003_t2.json
[Voice Changer] download sample catalog. samples_0003_o2.json
[Voice Changer] download sample catalog. samples_0003_d2.json
[Voice Changer] model_dir is already exists. skip download samples.
Internal_Port:18888
protocol: HTTP
-- ---- --
Please open the following URL in your browser.
http://:/
In many cases, it will launch when you access any of the following URLs.
http://127.0.0.1:18888/

[VCClient] Access http://127.0.0.1:18888/
[VCClient] wait web server...0 http://127.0.0.1:18888/
Booting PHASE :main
Booting PHASE :MMVCServerSIO
[Voice Changer] VoiceChangerManager initializing...
torch\cuda_init_.py:152: UserWarning:
Found GPU0 GeForce GTX 650 which is of cuda capability 3.0.
PyTorch no longer supports this GPU because it is too old.
The minimum cuda capability supported by this library is 3.7.

warnings.warn(old_gpu_warn % (d, name, major, minor, min_arch // 10, min_arch % 10))
[Voice Changer] model slot is changed -1 -> 1
................RVC
[Voice Changer] [RVCr2] Creating instance
VoiceChangerV2 Initialized (GPU_NUM(cuda):1, mps_enabled:False, onnx_device:GPU)
[Voice Changer][RVC]: update_settings gpu:0
[Voice Changer][RVCr2] Initializing...
2023-09-04 00:55:45.8648985 [W:onnxruntime:, session_state.cc:1030 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2023-09-04 00:55:45.8797436 [W:onnxruntime:, session_state.cc:1032 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2023-09-04 00:55:46.6507782 [E:onnxruntime:, inference_session.cc:1500 onnxruntime::InferenceSession::Initialize::<lambda_d67cde18891e9d311739162a2b4aba6d>::operator ()] Exception during initialization: D:\a_work\1\s\onnxruntime\core\providers\cuda\cuda_call.cc:124 onnxruntime::CudaCall D:\a_work\1\s\onnxruntime\core\providers\cuda\cuda_call.cc:117 onnxruntime::CudaCall CUBLAS failure 3: CUBLAS_STATUS_ALLOC_FAILED ; GPU=0 ; hostname=KOROLOKOTOV ; expr=cublasCreate(&cublas_handle_);

[Voice Changer] exception! loading inferencer [ONNXRuntimeError] : 6 : RUNTIME_EXCEPTION : Exception during initialization: D:\a_work\1\s\onnxruntime\core\providers\cuda\cuda_call.cc:124 onnxruntime::CudaCall D:\a_work\1\s\onnxruntime\core\providers\cuda\cuda_call.cc:117 onnxruntime::CudaCall CUBLAS failure 3: CUBLAS_STATUS_ALLOC_FAILED ; GPU=0 ; hostname=KOROLOKOTOV ; expr=cublasCreate(&cublas_handle_);

Traceback (most recent call last):
File "voice_changer\RVC\pipeline\PipelineGenerator.py", line 22, in createPipeline
File "voice_changer\RVC\inferencer\InferencerManager.py", line 24, in getInferencer
File "voice_changer\RVC\inferencer\InferencerManager.py", line 53, in loadInferencer
File "voice_changer\RVC\inferencer\OnnxRVCInferencer.py", line 17, in loadModel
File "onnxruntime\capi\onnxruntime_inference_collection.py", line 347, in init
File "onnxruntime\capi\onnxruntime_inference_collection.py", line 395, in create_inference_session
onnxruntime.capi.onnxruntime_pybind11_state.RuntimeException: [ONNXRuntimeError] : 6 : RUNTIME_EXCEPTION : Exception during initialization: D:\a_work\1\s\onnxruntime\core\providers\cuda\cuda_call.cc:124 onnxruntime::CudaCall D:\a_work\1\s\onnxruntime\core\providers\cuda\cuda_call.cc:117 onnxruntime::CudaCall CUBLAS failure 3: CUBLAS_STATUS_ALLOC_FAILED ; GPU=0 ; hostname=KOROLOKOTOV ; expr=cublasCreate(&cublas_handle);

[Voice Changer] pipeline create failed. check your model is valid.
[Voice Changer][RVC]: update_settings extraConvertSize:8192
[Voice Changer][RVC]: update_settings serverReadChunkSize:128
[Voice Changer][RVC]: update_settings silentThreshold:0.00001
[Voice Changer][RVC]: update_settings modelSlotIndex:1693770798001
[Voice Changer] VoiceChangerManager initializing... done.
[Voice Changer] MMVC_Rest initializing...
[Voice Changer] MMVC_Rest initializing... done.
[Voice Changer] MMVC_SocketIOApp initializing...
[Voice Changer] MMVC_SocketIOApp initializing... done.
[VCClient] wait web server... done 200
[2023-09-04 00:55:51] connet sid : ZQXEg5RAhtGAT6GuAAAB
[2023-09-04 00:55:51] connet sid : YddskVFE3hshmY8MAAAD
Generated Strengths: for prev:(4096,), for cur:(4096,)
[Voice Changer] Pipeline is not initialized.
[Voice Changer] Waiting generate pipeline...
[Voice Changer] Pipeline is not initialized.
[Voice Changer] Waiting generate pipeline...
[Voice Changer] Pipeline is not initialized.
[Voice Changer] Waiting generate pipeline...
[Voice Changer] Pipeline is not initialized.
[Voice Changer] Waiting generate pipeline...
[Voice Changer] Pipeline is not initialized.
[Voice Changer] Waiting generate pipeline...
[Voice Changer] Pipeline is not initialized.
[Voice Changer] Waiting generate pipeline...
[Voice Changer] Pipeline is not initialized.
[Voice Changer] Waiting generate pipeline...
[Voice Changer] Pipeline is not initialized.
[Voice Changer] Waiting generate pipeline...
[Voice Changer] Pipeline is not initialized.
[Voice Changer] Waiting generate pipeline...
[Voice Changer] Pipeline is not initialized.
[Voice Changer] Waiting generate pipeline...
[Voice Changer] update configuration: modelSlotIndex 1693770975000
[Voice Changer] model slot is changed 1 -> 0
................RVC
[Voice Changer] [RVCr2] Creating instance
VoiceChangerV2 Initialized (GPU_NUM(cuda):1, mps_enabled:False, onnx_device:GPU)
[Voice Changer][RVC]: update_settings gpu:0
[Voice Changer][RVCr2] Initializing...
2023-09-04 00:56:15.9906042 [W:onnxruntime:, session_state.cc:1030 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2023-09-04 00:56:16.0032094 [W:onnxruntime:, session_state.cc:1032 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
2023-09-04 00:56:16.0612171 [E:onnxruntime:, inference_session.cc:1500 onnxruntime::InferenceSession::Initialize::<lambda_d67cde18891e9d311739162a2b4aba6d>::operator ()] Exception during initialization: D:\a_work\1\s\onnxruntime\core\providers\cuda\cuda_call.cc:124 onnxruntime::CudaCall D:\a_work\1\s\onnxruntime\core\providers\cuda\cuda_call.cc:117 onnxruntime::CudaCall CUBLAS failure 3: CUBLAS_STATUS_ALLOC_FAILED ; GPU=0 ; hostname=KOROLOKOTOV ; expr=cublasCreate(&cublas_handle_);

[Voice Changer] exception! loading inferencer [ONNXRuntimeError] : 6 : RUNTIME_EXCEPTION : Exception during initialization: D:\a_work\1\s\onnxruntime\core\providers\cuda\cuda_call.cc:124 onnxruntime::CudaCall D:\a_work\1\s\onnxruntime\core\providers\cuda\cuda_call.cc:117 onnxruntime::CudaCall CUBLAS failure 3: CUBLAS_STATUS_ALLOC_FAILED ; GPU=0 ; hostname=KOROLOKOTOV ; expr=cublasCreate(&cublas_handle_);

Traceback (most recent call last):
File "voice_changer\RVC\pipeline\PipelineGenerator.py", line 22, in createPipeline
File "voice_changer\RVC\inferencer\InferencerManager.py", line 24, in getInferencer
File "voice_changer\RVC\inferencer\InferencerManager.py", line 53, in loadInferencer
File "voice_changer\RVC\inferencer\OnnxRVCInferencer.py", line 17, in loadModel
File "onnxruntime\capi\onnxruntime_inference_collection.py", line 347, in init
File "onnxruntime\capi\onnxruntime_inference_collection.py", line 395, in create_inference_session
onnxruntime.capi.onnxruntime_pybind11_state.RuntimeException: [ONNXRuntimeError] : 6 : RUNTIME_EXCEPTION : Exception during initialization: D:\a_work\1\s\onnxruntime\core\providers\cuda\cuda_call.cc:124 onnxruntime::CudaCall D:\a_work\1\s\onnxruntime\core\providers\cuda\cuda_call.cc:117 onnxruntime::CudaCall CUBLAS failure 3: CUBLAS_STATUS_ALLOC_FAILED ; GPU=0 ; hostname=KOROLOKOTOV ; expr=cublasCreate(&cublas_handle);

[Voice Changer] pipeline create failed. check your model is valid.
[Voice Changer][RVC]: update_settings extraConvertSize:8192
[Voice Changer][RVC]: update_settings serverReadChunkSize:128
[Voice Changer][RVC]: update_settings silentThreshold:0.00001
[Voice Changer][RVC]: update_settings modelSlotIndex:1693770975000
Generated Strengths: for prev:(4096,), for cur:(4096,)
[Voice Changer] Pipeline is not initialized.
[Voice Changer] Waiting generate pipeline...
[Voice Changer] Pipeline is not initialized.
[Voice Changer] Waiting generate pipeline...
[Voice Changer] Pipeline is not initialized.
[Voice Changer] Waiting generate pipeline...
[Voice Changer] Pipeline is not initialized.
[Voice Changer] Waiting generate pipeline...
[Voice Changer] Pipeline is not initialized.
[Voice Changer] Waiting generate pipeline...
@Korol-Kotov Korol-Kotov reopened this Sep 4, 2023
@HorizonBlink
Copy link

same happened to me

@FireynSS
Copy link

FireynSS commented Sep 4, 2023

same thing

@peja22
Copy link

peja22 commented Sep 4, 2023

The same issue when using colab, even with colab pro: After launch got this message

[voice changer] waiting generate pipline ..
[voice changer] pipeline is not initialized...
[voice changer] waiting generate pipline ..
[voice changer] pipeline is not initialized...
[voice changer] waiting generate pipline ..
[voice changer] pipeline is not initialized...

@w-okada
Copy link
Owner

w-okada commented Sep 5, 2023

same
#382

@w-okada w-okada closed this as completed Sep 5, 2023
@Glebertyt
Copy link

брат ты разобрался уже с этим?

@SerguYT
Copy link

SerguYT commented Oct 4, 2023

Как решить такую же проблему на MMVCServerSIO_win_onnxgpu-cuda_v.1.5.3.14?

@FamryAmri
Copy link

i was find out, is this means GTX 650 are not longer work?

Found GPU0 GeForce GTX 650 which is of cuda capability 3.0.
PyTorch no longer supports this GPU because it is too old.
The minimum cuda capability supported by this library is 3.7.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
8 participants
@w-okada @FamryAmri @Korol-Kotov @SerguYT @FireynSS @HorizonBlink @peja22 @Glebertyt