This project was done as part of Opencv AI Competition 2021 (https://opencv.org/opencv-ai-competition-2021/)
OAK—D is a spatial AI powerhouse, capable of simultaneously running advanced neural networks while providing depth from two stereo cameras and color information from a single 4K camera in the center.
To buy visit page - https://store.opencv.ai/products/oak-d
Book2Braille is a solution that is built to aid people with visual impairments in the field of science. The aim of the solution is to convert equations and texts from scientific books into Braille thereby making it accessible for visually impaired people.
Follow the below link for in-depth details of the implementation and our motivation behind the project
Capture image ➡️ Filter backgroud ➡️ Split pages ➡️ Uncurve the page ➡️ Adaptive threshold
Step3: Feed each image to custom trained yoloV3 model to locate mathematical expressions and text blocks
Step4: Extract content from text blocks and mathematical expressions using tesseract-OCR and MathPix respectively
Convert text to braille as per Universal English Braille standard and latex to braille using Latex2Nemeth software
cd Book2Braille
python main.py- opencv
- depthai
- pytesseract
- scipy
- skimage
- speech_recognition
- pyttsx3
- Custom trained yoloV3 model
- Tesseract
- Mathpix
- Latex2Nemeth
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent