Sonus-AV is a Python library designed to enhance Large Language Models (LLMs) by adding support for voice and image inputs. Add a feature to convert the final translated text back to speech in the output language This library simplifies the process of converting speech to text and analyzing images before feeding the information to LLMs.
- Audio Processing: Convert audio input to text using
AudioProcessor
, which supports multiple languages and can handle real-time translation. - Image Processing: Use
ImageProcessor
to extract text from images or generate descriptions of images using advanced machine learning models.
Install the library using pip:
pip install sonus-av
Here is how you can use the AudioProcessor
to convert speech to text:
from sonus_av import AudioProcessor
# Initialize the processor
audio_processor = AudioProcessor()
# Capture and translate audio to text
recognized_text = audio_processor.capture('path_to_your_audio_file.wav')
print(recognized_text)
This project is licensed under the MIT License - see the LICENSE.md file for details.