AI Calculator |||| Computer Vision

A fascinating AI based calculator

Table of contents

• Project overview
  • What is this AI Calculator
  • How to use it
  • Benefits
  • Screen shots
• Project stracture
  • Tools/technologies used
• Author

---

Project overview

What is this AI Calculator

This computer vision project is an AI based Calculator which assists the user to use their hand signs to do arithmetic calculations through a webcam. Advances in deep learning, particularly image processing, has enabled me to create this project so as to utilize American Sign Language (ASL) to make computer do our desired calculations. It also has a pretty good UI
Bellow are hand signs for numbers from 0 to 9:
0: 1: 2: 3: 4: 5: 6: 7: 8: 9:

How to use it

First it detects your hand via the webcam, then it tries to check your hands' sign. If the hand sign is representing a number, it will display the number and the digit sign on screen (bottom left). Next, if it detects that your hand is in 'get number' mode (only thumb is up), it will check the cursor (wether the number belongs to operand1 or operand2) and inputs the detected number to the proper operand. When you are in 'select' mode (thumb and finger are up), you can use your finger to choose an operator from the screen (upper right), or select equal'=' to see the result. To reset, after getting the result, you can try to enter any number, then it will reset. Pressing 'q' or 'Esc' closes the app.

Benefits

• Entertainment: you can just play arround with it, and use it a friendly hobby.
• It is useful when you don't have access to a keyboard, or the keyboard is broken.
• Playing with mathematics is super impressive to foster the development of children's brain and logic. So long as this is a funny and entertaining calculator, it can be used as a tool to keep children busy with math operations which is good for their brain development.

Screen shots

Scr shot-1:

Scr shot-2:

Scr shot-3:

Project stracture

Tools/technologies used

• Python: a general purpose programming language.
• OpenCV | cv2: OpenCV or cv2 is a Python library which deal with computer vision.
• Mediapipe: Mediapipe is a framework developed by Google offering cross-platform, customizable ML solutions for live and streaming media.
• Numpy: Numpy (Numeric Python) is also a Python library which deals with math calculations.

Author

• LinkedIn - @hikmatullah-mohammadi
• Github - hikmatullah-mohammadi
• Website - Hikmatullah Mohammadi