Improving Outdoor Sound Distance Navigation for Visually Impaired People Using BLSTM and CRF

Abstract

Background and Aims: This study aims to develop a prototype that utilizes sound-based systems to localize individuals with visual impairments. In this study, the wireless ultrasound network is proposed and used to facilitate autonomous navigation and maneuvering for individuals with visual impairments. Methods: In the proposed method, we designed robust algorithms for ultrasonic systems with sound waves of high frequency to detect obstacles in the surrounding environment. The algorithms were developed using voice recognition method, bi-directional long short-term memory (BLSTM), and conditional random fields (CRFs). The proposed system was implemented with the help of assisting hardware instruments, such as an ultrasonic sensor network and a global positioning system (GPS). To analyze different outdoor settings, the Raspberry pi4 was used to locate and store the coordinates (points of interactive latitude and longitude) of four different outdoor places. These including home, mosque, laundry, and supermarket. Results: According to our results, the proposed approach was capable of accurately navigating the specific site with an accuracy of 98.5%. Conclusions: The proposed method was able to obtain a robust outdoor localization for VIP.

References

1. 1.Paiva S, Gupta N. Technologies and systems to improve mobility of visually impaired people: A state of the art. Technological Trends in Improved Mobility of the Visually Impaired. 2020:105-23.
2. 2.Tapu R, Mocanu B, Zaharia T. Wearable assistive devices for visually impaired: A state of the art survey. Pattern Recognition Letters. 2020 Sep 1;137:37-52.
3. 3.Plikynas D, Žvironas A, Budrionis A, Gudauskis M. Indoor navigation systems for visually impaired persons: Mapping the features of existing tech66 Journal of the Acoustical Society of America. 2022 Jul 1;152(1):107-51.
4. 4.Yassin A, Nasser Y, Awad M, Al-Dubai A, Liu R, Yuen C, Raulefs R, Aboutanios E. Recent advances in indoor localization: A survey on theoretical approaches and applications. IEEE Communications Surveys & Tutorials. 2016 Nov 29;19(2):1327-46.
5. 5.Zhang D, Han J, Cheng G, Yang MH. Weakly supervised object localization and detection: A survey. IEEE transactions on pattern analysis and machine intelligence. 2021 Apr 20;44(9):5866-85.
6. 6.Nagarajan B, Shanmugam V, Anantha- Improving Outdoor Sound Distance Navigation for Visually Impaired People Using BLSTM and CRF Majmaah Journal of Health Sciences ,Vol. 12, Issue 2 , April - 2024, Shawwal - 1445 narayanan V, Bagavathi Sivakumar P. terials Science and Engineering 2020 Localization and indoor navigation for Mar 1 (Vol. 745, No. 1, p. 012103). visually impaired using bluetooth low IOP Publishing. energy. InSmart Systems and IoT: In- 15. Mai C, Xie D, Zeng L, Li Z, Li Z, novations in Computing: Proceeding Qiao Z, Qu Y, Liu G, Li L. Laser Sensof SSIC 2020 (pp. 249-259). Springer Singapore.
7. 7.Tang Y, Chen M, Wang C, Luo L, Li J, ing and Vision Sensing Smart Blind Cane: A Review. Sensors. 2023 Jan 12;23(2):869. Lian G, Zou X. Recognition and local- 16. Messaoudi MD, Menelas BA, Mcheization methods for vision-based fruit ick H. Review of Navigation Assistive picking robots: A review. Frontiers in Plant Science. 2020 May 19;11:510.
8. 8.Desai D, Mehendale N. A review on Tools and Technologies for the Visually Impaired. Sensors. 2022 Oct 17;22(20):7888. sound source localization systems. Ar- 17. Khan S, Nazir S, Khan HU. Analysis chives of Computational Methods in of navigation assistants for blind and Engineering. 2022 Nov;29(7):4631-42. visually impaired people: A system-
9. 9.Ashiq F, Asif M, Ahmad MB, Zafar atic review. IEEE access. 2021 Jan S, Masood K, Mahmood T, Mahmood 18;9:26712-34. MT, Lee IH. CNN-based object recog- 18. Simões WC, Machado GS, Sales AM, nition and tracking system to assist visde Lucena MM, Jazdi N, de Lucena Jr ually impaired people. IEEE Access. 2022 Jan 31;10:14819-34.
10. 10.Tan TH, Lin YT, Chang YL, Alkhaleefah M. Sound source localization using VF. A review of technologies and techniques for indoor navigation systems for the visually impaired. Sensors. 2020 Jul 15;20(14):3935. a convolutional neural network and 19. Bakouri M, Alsehaimi M, Ismail HF, regression model. Sensors. 2021 Dec Alshareef K, Ganoun A, Alqahtani A, 1;21(23):8031. Alharbi Y. Steering a robotic wheel-
11. 11.Al-kafaji RD, Gharghan SK, Mahdi chair based on voice recognition system SQ. Localization techniques for blind using convolutional neural networks. people in outdoor/indoor environ- Electronics. 2022 Jan 5;11(1):168. ments. InIOP Conference Series: Ma- 20. Chakladar DD, Dey S, Roy PP, Dogra Improving Outdoor Sound Distance Navigation for Visually Impaired People Using BLSTM and CRF 67 Majmaah Journal of Health Sciences ,Vol. 12, Issue 2 , April - 2024, Shawwal - 1445 DP. EEG-based mental workload estimation using deep BLSTM-LSTM network and evolutionary algorithm. Biomedical Signal Processing and Control. 2020 Jul 1;60:101989.
12. 12.Wang M, Cheng JC. A unified convolutional neural network integrated with conditional random field for pipe defect segmentation. Computer-Aided Civil and Infrastructure Engineering. 2020 Feb;35(2):162-77. 68 Improving Outdoor Sound Distance Navigation for Visually Impaired People Using BLSTM and CRF