Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Speech2Text support #4

Open
dk-dsr opened this issue Sep 8, 2020 · 4 comments
Open

Add Speech2Text support #4

dk-dsr opened this issue Sep 8, 2020 · 4 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@dk-dsr
Copy link
Contributor

dk-dsr commented Sep 8, 2020

Add Speech2Text support so there's minimal typing required. We initially had done an implementation using Mozilla's DeepSpeech pre-trained model but it didn't work well for different types of accents.
We are thinking of using Chrome's built in Web Speech API and Firefox Voice addon and populate our query box with the text response. User can edit/fix the text and submit the query to get code. Another option which isn't explored yet, is to finetune DeepSpeech on a custom dataset, more suited for understanding dataframe, variable & column names.

Any contributions are welcome.

Following solutions can be explored:

  1. Chrome's built in Web Speech API
  2. Firefox Voice
  3. Silero Models
  4. Mozilla's DeepSpeech pre-trained models
@dk-dsr dk-dsr added the enhancement New feature or request label Sep 8, 2020
@dk-dsr
Copy link
Contributor Author

dk-dsr commented Sep 8, 2020

Using Firefox voice is fine for short term/poc but it won't be useful for long term as it will no longer be supported by Mozilla due to their realigned priorities. For details please visit: https://github.com/mozilla-extensions/firefox-voice#status

@dk-dsr dk-dsr added the help wanted Extra attention is needed label Sep 9, 2020
@ppsha3
Copy link

ppsha3 commented Sep 16, 2020

Hey,

I wanted to help with this. I am a first-timer so please vear with me. Will let you know of my progress soon. Where should I reach out?

@dk-dsr
Copy link
Contributor Author

dk-dsr commented Sep 16, 2020

Please send a PR once the changes are done. We will review and merge.

@RavenousJim
Copy link

I have had varying results with different algorithms in sagemaker. It would be nice to use the Google API but there are at least a hundered different AI's, some free, some not.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

3 participants