Development smart eyeglasses for visually impaired people based on you only look once

Hassan Salam Abdul-Ameer, Hassan Jaleel Hassan, Salma Hameedi Abdullah

Abstract


Visually impaired people are facing many problems in their life. One of these problems is how they can find the objects in their indoor environment. This research was presented to assists visually impaired people in finding the objects in office. Object detection is a method used to detect the objects in images and videos. Many algorithms used for object detection such as convolutional neural network (CNN) and you only look once (YOLO). The proposed method was YOLO which outperforms the other algorithms such as CNN. In CNN the algorithm splits the image into regions. These regions sequentially enters the neural network for object detection and recognition so CNN does not deal with all the regions at the same time but YOLO looks the entire image then it produces the bounding boxes with convolutional network and the probabilities of these boxes, this makes YOLO faster than other algorithms. Open source computer vision (OpenCV) used to capture frames by using camera. Then YOLO used to detect and recognize the objects in each frame. Finally, the sound in Arabic language was generated to tell the visually impaired people about the objects. The proposed system can detect 6 objects and achieve an accuracy of 99%.

Keywords


computer vision; convolutional neural network; object detection; OpenCV; YOLO;

Full Text:

PDF


DOI: http://doi.org/10.12928/telkomnika.v20i1.22457

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

TELKOMNIKA Telecommunication, Computing, Electronics and Control
ISSN: 1693-6930, e-ISSN: 2302-9293
Universitas Ahmad Dahlan, 4th Campus
Jl. Ringroad Selatan, Kragilan, Tamanan, Banguntapan, Bantul, Yogyakarta, Indonesia 55191
Phone: +62 (274) 563515, 511830, 379418, 371120
Fax: +62 274 564604

View TELKOMNIKA Stats