Objective: This project is an attempt to help people with hearing disabilities and impairments utilizing the HoloLens that have the ability to auto-generate captions. It is especially helpful for situations where having an interpreter is difficult or is unavailable.
Install the necessary dependencies:
server/
cd server
pip install openai-whisper ffmpeg
npm install express cors body-parser ws crypto
nextapp/
cd nextapp
npm i --force
Note: Force is required since ricky0123/vad conflicts with Next.JS for some eason.
.
Here is to build the client onto the server.
chmod +x ./build_both.sh
./build_both.sh
And to start the server, go into server/ and run npm start.
