Skip to content

Sonus-AV is a Python library designed to enhance Large Language Models (LLMs) by adding support for voice and image inputs. This library simplifies the process of converting speech to text and analyzing images before feeding the information to LLMs.

License

Notifications You must be signed in to change notification settings

maxmos001/sonus-av

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

19 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Sonus-AV

Description

Sonus-AV is a Python library designed to enhance Large Language Models (LLMs) by adding support for voice and image inputs. Add a feature to convert the final translated text back to speech in the output language This library simplifies the process of converting speech to text and analyzing images before feeding the information to LLMs.

Features

  • Audio Processing: Convert audio input to text using AudioProcessor, which supports multiple languages and can handle real-time translation.
  • Image Processing: Use ImageProcessor to extract text from images or generate descriptions of images using advanced machine learning models.

Installation

Install the library using pip:

pip install sonus-av

Usage

Audio Processing

Here is how you can use the AudioProcessor to convert speech to text:

from sonus_av import AudioProcessor

# Initialize the processor
audio_processor = AudioProcessor()

# Capture and translate audio to text
recognized_text = audio_processor.capture('path_to_your_audio_file.wav')
print(recognized_text)

License

This project is licensed under the MIT License - see the LICENSE.md file for details.

About

Sonus-AV is a Python library designed to enhance Large Language Models (LLMs) by adding support for voice and image inputs. This library simplifies the process of converting speech to text and analyzing images before feeding the information to LLMs.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages