Scale Invariant Braille Translator Student: Yaniv Tocker Final - PowerPoint PPT Presentation

Scale Invariant Braille Translator Student: Yaniv Tocker Final Project in 'Introduction to Computational & Biological Vision' Course

2 Scale Invariant Braille Translator Braille Background Methods Conclusions Translator Motivation  Optical Character Recognition (OCR):  Automatic translating of letters/digits in images to a form that a computer can manipulate (Strings, ASCII codes)

3 Scale Invariant Braille Translator Braille Background Methods Conclusions Translator Why is this important?  Replacing data entry clerks  Reading car plates  Making electronic copies of books researchable

4 Scale Invariant Braille Translator Braille Background Methods Conclusions Translator Braille OCR  A less investigated field of OCR  Can assist the vision-impaired

5 Scale Invariant Braille Translator Braille Background Methods Conclusions Translator Braille Translator  Goal: being able to translate braille language from an image to English letters  The system is required to be robust to scale changes, since circle can appear in different sizes

6 Scale Invariant Braille Translator Braille Background Methods Conclusions Translator Methods Circle Histogram Histogram Circle Create Create Create Create Find areas Find areas Detection of Radius of Radius Detection Dictionary Dictionary Patch Patch Letter Letter Braille Braille Decision Decision Circles filtered by common radius size & amount of neighbors Dynamic mask using common radius Braille meaningful circles mask with centers Braille meaningful circles mask Original Image Detected Circles Points that are local maxima & convolution result above a threshold Circles filtered by common radius size Radius Histogram Braille meaningful – creating patches Masks convolution results Braille meaningful circles Dictionary Creation Circles Mask First Patch Interpretation Original image Result Braille patches Dictionary

7 Scale Invariant Braille Translator Braille Background Methods Conclusions Translator GUI  A user friendly GUI was created to easily operate the software

8 Scale Invariant Braille Translator Braille Background Methods Conclusions Translator Conclusions & Future Work  A scale invariant Braille translator has been proposed  The main key is to find the common radius in the image & build the dictionary according to it  Future addition could be to detect if braille writing is in an image in order to assist the vision impaired

9 Scale Invariant Braille Translator Braille Background Methods Conclusions Translator References 1. OCR: http://en.wikipedia.org/wiki/Optical_character_recognition 2. Braille OCR http://en.wikipedia.org/wiki/Optical_braille_recognition 3. Braille OCR example http://www.ni.com/white-paper/6470/en/ 4. Braille code generator http://braille.compelo.com/generate/ 5. X. fernanadez et al, “A braille O.C.R for the blind” http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.141.7727&rep=rep1&type= pdf 6. J.Mennans et al,”Optical recognition of braillle writing using standard equipment”. http://bauhaus.ece.curtin.edu.au/~iain/PhD%20BU/A_Phd%20docs/To%20read/Ac cessibility%20info/Research/Braille_Articles/OCR%20of%20Braille.pdf 7. O. ben-shahar – lecture notes from ICBV 2014 – - object classification - hough transform

10 Scale Invariant Braille Translator Braille Background Methods Conclusions Translator