mimiuchi v0.3.4
Download the desktop app to interface with applications like VRChat. Currently, you can only use speech-to-text on the web version, so the desktop app is just a middle application. You can technically use other apps to accomplish this (by using the webhook on the website).
Instructions for VRChat
English: How to use Speech-to-text with VRChat
- Turn on OSC in VRChat (you might need to restart VRChat for it to take affect)
- install and open the desktop app (mimiuchi_0.3.4.exe)
- go to mimiuchi.com
- toggle the mic button on the website (make sure to grant permission)
- toggle the broadcast button on the website (this will toggle it on the desktop app too)
![osc](https://private-user-images.githubusercontent.com/9059594/244174669-7f595258-19aa-454c-bdd9-52f22bb4fe31.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzOTYwOTAsIm5iZiI6MTczOTM5NTc5MCwicGF0aCI6Ii85MDU5NTk0LzI0NDE3NDY2OS03ZjU5NTI1OC0xOWFhLTQ1NGMtYmRkOS01MmYyMmJiNGZlMzEuZ2lmP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI1MDIxMiUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNTAyMTJUMjEyOTUwWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9OTdiZmY2YmRkN2VhYzUzNGNiM2ExOWIzNzE0NDFkZDgxMzVhMjdjZWNiZDk1N2ZlN2QzY2Q4YWY3YTFhOTQ5MSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.1bcgxYGec1mmn6SekhsIM87wAfFRRXeJUnXqrTbSdaI)
![toggle](https://private-user-images.githubusercontent.com/9059594/244173142-69224683-b027-4e51-9524-97e1d78fffc4.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzOTYwOTAsIm5iZiI6MTczOTM5NTc5MCwicGF0aCI6Ii85MDU5NTk0LzI0NDE3MzE0Mi02OTIyNDY4My1iMDI3LTRlNTEtOTUyNC05N2UxZDc4ZmZmYzQucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI1MDIxMiUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNTAyMTJUMjEyOTUwWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MjEwMDA5ZDJlNDA2NDIwYTE5OGU0YmRiOTdiNmE0ZGVhZmIzNWU0NWIzMDI0NWY5ZDdhZDc3ZmMwNjRhYzJjNCZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.0mIt1sUD5k0FvfCPOwSqUohA_zkt_yK55rCdz66NIbM)
you can go thru the settings to adjust the experience. note that speech-to-text will not work with Firefox or Opera.
日本語: VRChatでSpeech-to-textを使う方法
- VRChatでOSCをオンにします(有効にするためにVRChatを再起動する必要がある場合があります)
- デスクトップアプリをインストールして、開きます (mimiuchi_0.3.4.exe)
- mimiuchi.comにアクセスします
- ウェブサイトでマイクボタンをトグルします (許可する必要があります)
- ウェブサイトでブロードキャストボタンをトグルします
![osc](https://private-user-images.githubusercontent.com/9059594/244174669-7f595258-19aa-454c-bdd9-52f22bb4fe31.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzOTYwOTAsIm5iZiI6MTczOTM5NTc5MCwicGF0aCI6Ii85MDU5NTk0LzI0NDE3NDY2OS03ZjU5NTI1OC0xOWFhLTQ1NGMtYmRkOS01MmYyMmJiNGZlMzEuZ2lmP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI1MDIxMiUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNTAyMTJUMjEyOTUwWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9OTdiZmY2YmRkN2VhYzUzNGNiM2ExOWIzNzE0NDFkZDgxMzVhMjdjZWNiZDk1N2ZlN2QzY2Q4YWY3YTFhOTQ5MSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.1bcgxYGec1mmn6SekhsIM87wAfFRRXeJUnXqrTbSdaI)
![toggle](https://private-user-images.githubusercontent.com/9059594/244173142-69224683-b027-4e51-9524-97e1d78fffc4.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzOTYwOTAsIm5iZiI6MTczOTM5NTc5MCwicGF0aCI6Ii85MDU5NTk0LzI0NDE3MzE0Mi02OTIyNDY4My1iMDI3LTRlNTEtOTUyNC05N2UxZDc4ZmZmYzQucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI1MDIxMiUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNTAyMTJUMjEyOTUwWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MjEwMDA5ZDJlNDA2NDIwYTE5OGU0YmRiOTdiNmE0ZGVhZmIzNWU0NWIzMDI0NWY5ZDdhZDc3ZmMwNjRhYzJjNCZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.0mIt1sUD5k0FvfCPOwSqUohA_zkt_yK55rCdz66NIbM)
![language](https://private-user-images.githubusercontent.com/9059594/244184428-5da94856-fa4e-4e2b-9d57-9bd075b468cb.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzOTYwOTAsIm5iZiI6MTczOTM5NTc5MCwicGF0aCI6Ii85MDU5NTk0LzI0NDE4NDQyOC01ZGE5NDg1Ni1mYTRlLTRlMmItOWQ1Ny05YmQwNzViNDY4Y2IucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI1MDIxMiUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNTAyMTJUMjEyOTUwWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MjUzNGMyYmQ2NjAwNzk4YTllZjI3ZjFlYzZlODljNGZkMzg4YzE3NjIzMzZiZTVhMWVmNTVmM2UwZTY0N2E4YiZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.rNeH_YukvP14jeUiYzyIvoDn4DobuSODA1K25sZO77k)
Changes
Planned
- Whisper inference (eventually)
- DeepL option
let me know if you have any suggestions or issues !!