Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rvc models have trouble speaking #932

Closed
5 of 6 tasks
simteraplications opened this issue Oct 8, 2023 · 3 comments
Closed
5 of 6 tasks

rvc models have trouble speaking #932

simteraplications opened this issue Oct 8, 2023 · 3 comments

Comments

@simteraplications
Copy link

Voice Changer Version

1.5.3.14

Operational System

windows10pro

GPU

nvidia quadro p4000

Read carefully and check the options

  • I've tried to Clear Settings
  • Sample/Default Models are working
  • I've tried to change the Chunk Size
  • GUI was successfully launched
  • I've read the tutorial
  • I've tried to extract to another folder (or re-extract) the .zip file

Model Type

rvc

Issue Description

I have here a set of rvc models that i have trained. When i use the rvc webui to for example make them say or sing something it works perfectly fine. How ever when i use them in the voice changer the models have a lot of speaking errors, they are really hard to understand, fail to pronounce certain letters that they don't have any problems pronouncing in the rvc webui. It only works when i talk really really slow which is contraproductive.

Application Screenshot

grafik

Logs on console

Booting PHASE :__main__
PYTHON:3.10.11 (tags/v3.10.11:7d4cc5a, Apr  5 2023, 00:38:17) [MSC v.1929 64 bit (AMD64)]
Activating the Voice Changer.

[Voice Changer] download sample catalog. samples_0003_t2.json
[Voice Changer] download sample catalog. samples_0003_o2.json
[Voice Changer] download sample catalog. samples_0003_d2.json
[Voice Changer] model_dir is already exists. skip download samples.
Internal_Port:18888
protocol: HTTP
-- ---- --
Please open the following URL in your browser.
http://:/
In many cases, it will launch when you access any of the following URLs.
http://127.0.0.1:18888/
Booting PHASE :main
Booting PHASE :MMVCServerSIO
[Voice Changer] VoiceChangerManager initializing...
[Voice Changer] model slot is changed -1 -> 2
................RVC
[Voice Changer] [RVCr2] Creating instance
VoiceChangerV2 Initialized (GPU_NUM(cuda):1, mps_enabled:False, onnx_device:GPU)
[Voice Changer][RVC]: update_settings gpu:0
[Voice Changer][RVCr2] Initializing...
2 0 2 3 - 1 0 - 0 8 1 6 : 4 7 : 1 8 . 0 9 7 9 0 1 6 [ W : o n n x r u n t i m e : , s e s s i o n _ s t a t e . c c : 1 0 3 0 o n n x r u n t i m e : : V e r i f y E a c h N o d e I s A s s i g n e d T o A n E p ] S o m e n o d e s w e r e n o t a s s i g n e d t o t h e p r e f e r r e d e x e c u t i o n p r o v i d e r s w h i c h m a y o r m a y n o t h a v e a n n e g a t i v e i m p a c t o n p e r f o r m a n c e . e . g . O R T e x p l i c i t l y a s s i g n s s h a p e r e l a t e d o p s t o C P U t o i m p r o v e p e r f .
2 0 2 3 - 1 0 - 0 8 1 6 : 4 7 : 1 8 . 0 9 8 7 8 2 3 [ W : o n n x r u n t i m e : , s e s s i o n _ s t a t e . c c : 1 0 3 2 o n n x r u n t i m e : : V e r i f y E a c h N o d e I s A s s i g n e d T o A n E p ] R e r u n n i n g w i t h v e r b o s e o u t p u t o n a n o n - m i n i m a l b u i l d w i l l s h o w n o d e a s s i g n m e n t s .
GENERATE INFERENCER<voice_changer.RVC.inferencer.RVCInferencerv2.RVCInferencerv2 object at 0x000001ABB1283BB0>
GENERATE EMBEDDER<voice_changer.RVC.embedder.OnnxContentvec.OnnxContentvec object at 0x000001AC2F950310>
GENERATE PITCH EXTRACTOR<voice_changer.RVC.pitchExtractor.RMVPEOnnxPitchExtractor.RMVPEOnnxPitchExtractor object at 0x000001AC2F950340>
[Voice Changer] [RVC] Initializing... done
[Voice Changer][RVC]: update_settings modelSlotIndex:1696776062002
[Voice Changer] VoiceChangerManager initializing... done.
[Voice Changer] MMVC_Rest initializing...
[Voice Changer] MMVC_Rest initializing... done.
[Voice Changer] MMVC_SocketIOApp initializing...
[Voice Changer] MMVC_SocketIOApp initializing... done.
[Voice Changer] model slot is changed 2 -> 2
................RVC
[Voice Changer] [RVCr2] Creating instance
VoiceChangerV2 Initialized (GPU_NUM(cuda):1, mps_enabled:False, onnx_device:GPU)
[Voice Changer][RVC]: update_settings gpu:0
[Voice Changer][RVCr2] Initializing...
2 0 2 3 - 1 0 - 0 8 1 6 : 4 7 : 3 3 . 0 4 0 7 9 3 2 [ W : o n n x r u n t i m e : , s e s s i o n _ s t a t e . c c : 1 0 3 0 o n n x r u n t i m e : : V e r i f y E a c h N o d e I s A s s i g n e d T o A n E p ] S o m e n o d e s w e r e n o t a s s i g n e d t o t h e p r e f e r r e d e x e c u t i o n p r o v i d e r s w h i c h m a y o r m a y n o t h a v e a n n e g a t i v e i m p a c t o n p e r f o r m a n c e . e . g . O R T e x p l i c i t l y a s s i g n s s h a p e r e l a t e d o p s t o C P U t o i m p r o v e p e r f .
2 0 2 3 - 1 0 - 0 8 1 6 : 4 7 : 3 3 . 0 4 1 8 8 3 1 [ W : o n n x r u n t i m e : , s e s s i o n _ s t a t e . c c : 1 0 3 2 o n n x r u n t i m e : : V e r i f y E a c h N o d e I s A s s i g n e d T o A n E p ] R e r u n n i n g w i t h v e r b o s e o u t p u t o n a n o n - m i n i m a l b u i l d w i l l s h o w n o d e a s s i g n m e n t s .
GENERATE INFERENCER<voice_changer.RVC.inferencer.RVCInferencerv2.RVCInferencerv2 object at 0x000001ABF8ECCC40>
GENERATE EMBEDDER<voice_changer.RVC.embedder.OnnxContentvec.OnnxContentvec object at 0x000001AC2F9501C0>
GENERATE PITCH EXTRACTOR<voice_changer.RVC.pitchExtractor.RMVPEOnnxPitchExtractor.RMVPEOnnxPitchExtractor object at 0x000001AC2F950310>
[Voice Changer] [RVC] Initializing... done
[Voice Changer][RVC]: update_settings modelSlotIndex:1696776451002
[Voice Changer][RVC]: update_settings tran:-1
[Voice Changer][RVC]: update_settings tran:-2
[Voice Changer][RVC]: update_settings tran:-3
[Voice Changer][RVC]: update_settings tran:-4
[Voice Changer][RVC]: update_settings tran:-5
[Voice Changer][RVC]: update_settings tran:-6
[Voice Changer][RVC]: update_settings tran:-7
[Voice Changer][RVC]: update_settings tran:-8
[Voice Changer][RVC]: update_settings tran:-9
[Voice Changer][RVC]: update_settings tran:-10
[Voice Changer][RVC]: update_settings tran:-11
[Voice Changer][RVC]: update_settings tran:-12
[Voice Changer][RVC]: update_settings tran:-13
Generated Strengths: for prev:(4096,), for cur:(4096,)
[Voice Changer] warming up... generating sola buffer.
client closed.

@simteraplications
Copy link
Author

Btw the high buffering is related to my grafics card beeing really busy at the moment that i made the screenshot, normally the conversion is almost realtime but the issue with the voices speaking unclearly is also there without the high buffer.

@w-okada
Copy link
Owner

w-okada commented Oct 9, 2023

increase chunk, use dio,

@w-okada
Copy link
Owner

w-okada commented Oct 13, 2023

no res close

@w-okada w-okada closed this as completed Oct 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants