ARKit Application for T-Mobile's Hacktober 2019
Winner of 2nd Place Prize of $2,000
by Khalid Hossain, Supratik Pochampally, Cady Baltz, Christina Abraham
Check it out the demo here: https://devpost.com/software/dollar
Check out our featured news article!
When approaching the theme of the hackathon, we discussed the possibility of developing a virtual store such as a virtual reality phone store or an augmented reality application that would allow the user to purchase a phone simply by hovering over it with a camera. However, we later decided that a consumer solution would be something both practical and effective in the buying process. We wanted to create an application that consumers would be interested in using, possibly a consumer solution that answered a common real-life problem. Thus, we developed dollAR!
E-Commerce in the telecommunications industry has become increasingly more efficient through technology. With the ability to view the entire markup of the product you would like to purchase before actually purchasing, online shopping has become increasingly more of a replacement than a supplement of in-store shopping. However, e-commerce is still not fool-proof, with over 30% off online purchases sent back for returns as opposed to the 9% return rate of in-store purchases. Furthermore, regardless of the plethora of information found online about the product, more than a fifth of all online returns resulting from parities in how the product seems online as opposed to the consumer’s in-person experience with the product. To solve this, dollAR serves to allow the user to visualize their cell phone in their hands before completing the purchase online, thereby simulating the in-store experience of holding your phone in the comfort of your own home.
-
Communicated with retail employees to discern issues that directly affect both the customers and Metro by T-Mobile as a whole
-
Brainstormed a practical and productive xR solution for consumer experience in the T-Mobile store
-
Produced a proof of concept using a 3D model of a phone and displaying it on a dollar bill (the marker) in augmented reality
-
Figured out how to map the 3D model to have the correct scale compared to the dollar bill, ensuring that the user would see an accurate depiction of the phone’s dimensions at all angles and distances.
-
Mapped multiple phones and cases of different colors.
-
Drew out the pages of the user interface using Sketch, including functionalities such as the viewing home page, browsing through different phones, and viewing different phone colors and case colors through augmented reality.
-
Connected the front-end and back-end in Swift by using the drawn pages of the user interface and applying them to the Main.storyboard file
-
Incompatible AR SDKs
-
Learning how to use AR with Swift
-
Collaborating over Windows & Mac platforms
One of our major accomplishments was being able to build a proof of concept very early on through the process, as we were able to know for sure that we weren’t pursuing an unrealistic goal. By doing so, we had more time to focus on the implementation of the concept into a completely user-friendly experience.
We learned we should make the bare-bones of an app before refining it. We spent time creating many models of phones, but ran out of time to actually implement these models into our app. Had we instead only created a few models and then began working on the UI, we would have had the time to create a more refined UI.
Using this technology, we aim to create an augmented reality experience for the entire T-Mobile store. For example, we aim to model smartwatches to see how they fit on your wrist, and how smart hubs can fit in your house. Because our application is ultimately used to save both the consumer and retailer time and money, we also aim to provide the user warnings if the specifications from a product they are attempting to buy vastly differs from their current product specifications (i.e memory, camera resolution, display size, etc.). For instance, if the consumer is attempting to buy a smartphone with 32GB of storage and his/her current phone has a greater storage capacity, the application will notify the user prior to making the purchase.