AR App for Patient Education and Awareness Prior to MRI Scan
There are two ways to deploy this project on Unity:
- Download the project zip
- Navigate to the top of the page and click on
code
- Copy the url in
Clone with HTTPS
- Open your terminal and go to the location where you wish to clone the repository
- Type
git clone https://github.com/UCLComputerScience/COMP0016_2020_21_Team21.git
- Press
Enter
to create your local clone
Open the project in Unity and you will be able to use the repository. For more details, please visit https://docs.github.com/en/github/creating-cloning-and-archiving-repositories/cloning-a-repository .
- Download the APK file from the master branch > AR MRI final.apk
- Install the app on your device.
- You will need an IBM Cloud account.
- The Watson Credentials will only be provided to our clients, NTT Data and UCL.
- The IBM SDK Core (Assets > IBMSDKCore) and Watson (Assets > Watson) file must be used together in order to use the Watson Services.
- For questions related to the Watson Configuration, please visit https://github.com/watson-developer-cloud/unity-sdk to find out more.
- Change the build settings in Unity (File > Build Settings) to any platform except for web player/Web GL. The IBM Watson SDK for Unity does not support Unity Web Player.
- If using Unity 2018.2 or later you'll need to set Scripting Runtime Version and Api Compatibility Level in Build Settings to .NET 4.x equivalent. We need to access security options to enable TLS 1.2.
- To set up the credentials for Watson, simply enter the API key and URLs as below
This script is used for the authentication of the Watson API for the voice chatbot. The main logic behind the voice chatbot is
- Convert Speech To Text
- Get the response from Watson Assistant
- Convert the reponse from text to speech
This script is used for the text chatbot. The code is similar to the voice chatbot with just a slight modification.
The authentication is performed using this script. The results such as "Login Successful" and "Invalid email or password" will be shown to the users.
This generation of questions and scores are performed using this script
This is used to configure the sequence of the MRI demonstration. Only admins are allowed to configure the demonstration sequence
The animations for the movement of the MRI machine are performed using this script.
The setup of the MRI room, machine and Practitioner are performed when the users tap on a their screen and plane detection is successful.