-
Notifications
You must be signed in to change notification settings - Fork 2.1k
feat: add voice input mode via /speak #602
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
All contributors have signed the CLA ✍️ ✅ |
I have read the CLA Document and I hereby sign the CLA |
223d37b
to
86b2426
Compare
86b2426
to
a87c617
Compare
I addressed all feedback from the previous review and added tests for both the I also added config settings to customize the transcription model and language through the existing config system. Details for these options are available in the OpenAI docs. Functionally, everything is working as intended. Let me know if there's anything else needed to complete this PR. |
Example of the # existing config options
model: 4o-mini
approvalMode: suggest
# ...
# new transcription options (these are the defaults found in src/utils/transcriber.ts)
transcription:
input_audio_transcription:
model: gpt-4o-transcribe
prompt: ""
language: "en"
turn_detection:
type: server_vad
threshold: 0.6
prefix_padding_ms: 400
silence_duration_ms: 500
input_audio_noise_reduction:
type: near_field |
Resolves #418
Adds a
/speak
command in the CLUI which triggers a transcription based input to the text boxUses the OpenAI Realtime API for transcription of voice input
When
/speak
is invoked:●
recording indicator appears at the front of the input boxThe default language is 'en' and the default model is 'gpt-4o-mini-transcribe'
I was originally going to add language config to the command itself but it might be better suited for the ~/.codex/ config file so I am looking for feedback on the best place to add config for model + language.
Tested and working Macbook Air M4 with built in microphone