You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have thoroughly reviewed the project documentation (installation, training, inference) but couldn't find any relevant information that meets my needs. English中文日本語Portuguese (Brazil)
I have searched for existing issues search for existing issues, including closed ones.
I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
[FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
Please do not modify this template :) and fill in all the required fields.
1. Is this request related to a challenge you're experiencing? Tell us your story.
I love the model and your work overall, but there is an issue for the Russian language (I guess because of the lack of data model was trained). It's not an issue with the model itself, but some Russian language related problem.
There is a thing as a stress for the vowel. It can change the word in different ways if stress is on one vowel or another.
2. What is your suggested solution?
I would suggest to maybe train a model in some way with a special character before the vowel to add stress for it. In the long run someone can create a vocabulary and add words to it and have model read the vocabulary before the initialization and pronounce added words as they are in the vocabulary.
I know that this is just for one language and maybe it's too much work to be done, but maybe you can guide someone with more knowledge then me, to write the code for finetuning the LLAMA model to add that special character.
I can propose to look at some other model that was trained based on GPT-Sovits for Russian with addition of that stress symbol.
Here is a link to the repo: vosk-tts. Here is the model from HF. You put the model into the folder vosk-tts/gpt-sovitst/pretrained_models. You can also find mentioned dictionary on HF in the dictionary it contains the vocabulary with stress described in the 1 if stress is applied to a vowel and 0 if vowel should be read as is.
Hope that makes sense.
3. Additional context or comments
Maybe there is a way to add stress to vowels that I don't know. What I have tried so far to apply at least some stress to vowels in words that model interprets incorrectly:
Add another vowel (eg. if it letter o then add another o).
Add a grave accent symbol before a vowel (eg. `o)
Add a special char that we use in Russian literature when learning the language and how to read words it is called acute accent (eg. o´)
Use the capital letter if I need a stress for a vowel (eg. sOme wOrd)
Add a duplicate of letter and add a hyphen (eg. so-ome wo-ord)
4. Can you help us with this feature?
I am interested in contributing to this feature.
The text was updated successfully, but these errors were encountered:
Self Checks
1. Is this request related to a challenge you're experiencing? Tell us your story.
I love the model and your work overall, but there is an issue for the Russian language (I guess because of the lack of data model was trained). It's not an issue with the model itself, but some Russian language related problem.
There is a thing as a stress for the vowel. It can change the word in different ways if stress is on one vowel or another.
2. What is your suggested solution?
I would suggest to maybe train a model in some way with a special character before the vowel to add stress for it. In the long run someone can create a vocabulary and add words to it and have model read the vocabulary before the initialization and pronounce added words as they are in the vocabulary.
I know that this is just for one language and maybe it's too much work to be done, but maybe you can guide someone with more knowledge then me, to write the code for finetuning the LLAMA model to add that special character.
I can propose to look at some other model that was trained based on GPT-Sovits for Russian with addition of that stress symbol.
Here is a link to the repo: vosk-tts. Here is the model from HF. You put the model into the folder
vosk-tts/gpt-sovitst/pretrained_models
. You can also find mentioned dictionary on HF in thedictionary
it contains the vocabulary with stress described in the1
if stress is applied to a vowel and0
if vowel should be read as is.Hope that makes sense.
3. Additional context or comments
Maybe there is a way to add stress to vowels that I don't know. What I have tried so far to apply at least some stress to vowels in words that model interprets incorrectly:
4. Can you help us with this feature?
The text was updated successfully, but these errors were encountered: