Jyoti M. Katagi; Pandurangarao N. Kulkarni

Sound Source Localization Ability in Hearing Aids: A Survey

Full Text (PDF, 385KB), PP.30-44

Views: 0 Downloads: 0

Author(s)

Jyoti M. Katagi ^1,* Pandurangarao N. Kulkarni ²

1. Biluru Gurubasava Mahaswamiji Institute of Technology/Electronics & Communication Engineering, Mudhol-587313, Karnataka, India

2. Basaveshwar Engineering College (Autonomous)/Electronics & Communication Engineering, Bagalkot-587102, Karnataka, India

* Corresponding author.

DOI: https://doi.org/10.5815/ijigsp.2021.06.04

Received: 14 Aug. 2021 / Revised: 1 Sep. 2021 / Accepted: 19 Sep. 2021 / Published: 8 Dec. 2021

Index Terms

Sound source localization, Head related transfer function, Hearing aids, Inter-aural Level Difference, Inter-aural Time Difference.

Abstract

Ability to locate sound source in human acoustic system is a prime factor. The source of sound has various spectral, temporal and strength characteristics depending on where it is located. To identify the sound location, the listeners analyze these characteristics arising from various directions on the horizontal and the vertical surfaces. In noisy background, it is very difficult to understand the speech for individuals with sensorineural hearing loss. In order to reliably distinguish various sound sources and increase speech intelligibility in noisy conditions, binaural hearing is adopted. Diffraction induced by the pinnae, head, shoulders and torso changes the pressure waveform when sound waves travel from the audio source to the listener's eardrum. Two transfer functions that specify the relation between the sound pressures at the listener's right and left ear drums will catch these propagation effects. These spectral changes are recorded by Head Related Transfer Functions (HRTFs). Different hearing aid algorithms are to be studied to measure their effectiveness in improving speech perception through series of subjective evaluations involving subjects with sensorineural hearing loss with different types of loss characteristics under different listening conditions. We investigated the various proposed approaches, weighed in on their benefits and drawbacks and most importantly, examined whether and how the resulting HRTFs perceptual validity is evaluated. This paper brings out current research efforts on sound source localization ability in hearing aids, which includes use of Head Related Transfer Functions (HRTFs) for generating spatial sounds in elevation and azimuth plane, evaluating the effect of monaural and binaural hearing aid algorithms on source localization under different listening conditions on subjects with different hearing losses and also to assess the effectiveness of localization with type of hearing aids.

Cite This Paper

Jyoti M. Katagi, Pandurangarao N. Kulkarni, " Sound Source Localization Ability in Hearing Aids: A Survey", International Journal of Image, Graphics and Signal Processing(IJIGSP), Vol.13, No.6, pp. 30-44, 2021. DOI: 10.5815/ijigsp.2021.06.04

Reference

[1]Kuk F, Korhonen P. “Localization 101: Hearing aid factors in localization”, Hearing Review, vol.21, no.9, pp.26-33, 2014.

[2]Chantai Laroche, “Review of the literature on sound source Localization and applications to noisy Workplaces”, Canadian Acoustics, vol.22, no.4, pp.13-18, 1994.

[3]M. Usman, K. Kamal, R. Qayyum, S. Akram, S. Mathavan, “3D Sound Generation Using Kinect and HRTF”, IEEE 2nd International Conference on Signal and Image Processing, Singapore, pp. 307-310, Aug. 2017.

[4]Corentin Guezenoc & Renaud Seguier, “HRTF Individualization: A Survey”, Audio Engineering Society Convention 145, Audio Engineering Society, Oct 2018, New York, United States.

[5]Song Xu, Zhizhong Li & Gaviriel Salvendy, “Individualization of Head-Related Transfer Function for Three-Dimensional Virtual Auditory Display: A Review”, International conference on virtual reality, pp. 397-407, July 2007.

[6]Jan-Gerrit Richter &Janina Fels, “On the Influence of Continuous Subject Rotation During High- Resolution Head-Related Transfer Function Measurements”, IEEE/ACM Transactions on audio, speech & language processing, Vol. 27, No. 4, April 2019.

[7]Michele Geronazzo, Simone Spagnol & Federico Avanzini, “Do We Need Individual Head-Related Transfer Functions for Vertical Localization? The Case Study of a Spectral Notch Distance Metric”, IEEE /ACM Transactions on audio, speech and language processing, Vol.26, No.7, July 2018.

[8]Michael Buerger, Stefan Meier, Christian Hofmann, Walter Kellermann, Eghart Fischer & Henning Puder, “Retrieval of Individualized Head-Related Transfer Functions for Hearing Aid Applications”, 25th European Signal Processing Conference (EUSIPCO), 2017.

[9]Hannes Gamper, David lohnston & Ivan J. Tashev, “Interaural time delay personalization using incomplete head scans”, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP),2017.

[10]Holzl, J., “A Global Model for HRTF Individualization by Adjustment of Principal Component Weights”, Master Thesis, Graz University of Technology, 2014.

[11]Denk, F., Heeren, J., Ewert, S. D., Kollmeier, B., & Ernst, S. M., “Controlling the Head Position during individual HRTF Measurements and its Effect on Accuracy”, in DAGA, Kiel, 2017.

[12]Wen-Chih Wu, Cheng-Hsun Hsieh ; Hsin-Chieh Huang ; Oscal T. -C. Chen ; Yu-Jen Fang, “Hearing aid system with 3D sound localization”, IEEE Region 10 Conference, pp.1- 4, Taipei, 2007.

[13]M. Raspaud, H. Viste, G. Evangelista, "Binaural Source Localization by Joint Estimation of ILD and ITD", IEEE Transactions on Audio, Speech, and Language Processing, vol.18, Issue 1, pp.68-77, Jan 2010.

[14]W. A. Yost,L. Loiselle, M. Dorman and J. Burns, “Sound source localization of filtered noises by listeners with normal hearing: A statistical analysis”, Journal of the Acoustical Society of America, vol.133, no.5, pp. 2876– 2882, May 2013.

[15]Danfeng Li, S.E.Levinson, “A Bayes-rule based hierarchical system for binaural sound source localization”, Proc.IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , vol.5, pp v521-v524, April 2003.

[16]Nguyen Duy Hai, Nitesh Kumar Chaudhary, Santi Peksi, Rishabh Ranjan, Jianjun He & Woon-Seng Gan, “Fast HRTF Measurement System with Unconstrained Head Movements for 3D Audio in Virtual and Augmented Reality Applications”, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP),2017.

[17]V. Willert , J. Eggert , J. Adamy , R. Stahl and E. Korner, "A probabilistic model for binaural sound localization", IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 36, no. 5, pp. 982-994, 2006.

[18]Ivo Merks, Gerald Enzner, Tao Zhang “Sound source localization with binaural hearing aids using adaptive blind channel identification”, Proc. IEEE International Conference on Acoustics, Speech and Signal Processing, pp.438-442, 2013.

[19]T. May, S. van de Par, and A. Kohlrausch, “A probabilistic model for robust localization based on a binaural auditory front-end”, IEEE Transactions on Audio, Speech, and Language Processing, vol.19, no.1, pp.1–13, 2011.

[20]Mojtaba Farmani, Michael Syskind Pedersen ; Zheng-Hua Tan ; Jesper Jensen, “Maximum likelihood approach to “informed” Sound Source Localization for Hearing Aid applications”, Proc.IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp 16- 20, South Brisbane, QLD, April 2015.

[21]M.Omologo and P. Svaizer, "Acoustic event localization using a crosspower-spectrum phase based technique", Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. II/273-II/276, Apr 1994.

[22]P. N. Kulkarni, P. C. Pandey, and D. S. Jangamashetti, “Multi-band frequency compression for sensorineural hearing impairment”, Proc.16th IEEE International Conference on Digital Signal Processing (DSP 2009), pp. 322-327, Santorini, Greece, 2009.

[23]Ravi Kumar Kandagatla, P V Subbaiah, “Performance Analysis of Statistical Approaches and NMF Approaches for Speech Enhancement”, International Journal of Image, Graphics and Signal Processing, Vol.11, No.7, pp. 9-38, 2019.

[24]P.Sunitha, K.Satya Prasad, “Speech Enhancement based on Wavelet Thresholding the Multitaper Spectrum Combined with Noise Estimation Algorithm”, International Journal of Image, Graphics and Signal Processing, Vol.11, No.9, pp. 44-55, 2019.

[25]https://www.sciencedirect.com/topics/engineering/interaural- time-difference.

[26]Daniel J. Tollin, Kanthaiah Koka, Jeffrey J. Tsai, “Interaural Level Difference Discrimination Thresholds for Single Neurons in the Lateral Superior Olive”, The Journal of Neuroscience, vol. 28, no.19, pp.4848 – 4860, May 7, 2008.

[27]Xiang Wu, Dumidu S. Talagala, Wen Zhang and Thushara D. Abhayapala, “Binaural localization of speech sources in 3-D using a composite feature vector of the HRTF”, IEEE International Conference on Acoustics, Speech and Signal Processing(ICASSP), Brisbane, Australia, April 2015.

[28]Mojtaba Farmani, Richard Heusdens, Michael Syskind Pedersen, Zheng-Hua Tan, and Jesper Jensen, “Concurrent Localization of Sound Sources and Dual-Microphone Sub- Arrays Using TOFs”, 19th International Conference on Information Fusion, pp.1931-1936, July 2016, Germany.

[29]Mojtaba Farmani, Michael Syskind Pedersen, Zheng-Hua Tan, Jesper Jensen, “On the influence of microphone array geometry on HRTF-based sound source localization”, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.439-443, 2015.

[30]Mojtaba Farmani, Michael Syskind Pedersen, Zheng-Hua Tan and Jesper Jensen, “Informed TDoA-based Direction of Arrival Estimation for Hearing Aid Applications”, IEEE Global Conference on Signal and Information Processing (GlobalSIP), pp.953-957, 2015.

[31]Anshuman Ganguly, Chandan Reddy, Yiya Hao, Issa Panahi, “Improving Sound Localization for Hearing Aid Devices Using Smartphone Assisted Technology”, IEEE International Workshop on Signal Processing Systems (SiPS), pp.165-170, Dec-2016.

[32]Ibrahim I, Parsa V, Macpherson E, Cheesman M, “Evaluation of speech intelligibility and sound localization abilities with hearing aids using binaural wireless technology”, Audiology Research, Volume 3, no.1, 2013.

[33]Rajani S. Pujar, Pandurangarao N. Kulkarni, "Wiener Filter Based Noise Reduction Algorithm with Perceptual Post Filtering for Hearing Aids", International Journal of Image, Graphics and Signal Processing, Vol.11, No.7, pp. 69-81, 2019.

[34]Denis Byrne & William Noble, “Optimizing Sound Localization with Hearing Aids”, Trends in Amplification, Vol. 3, No. 2,pp.51-73, 1998.

[35]Dumidu S. Talagala, Xiang Wu, Wen Zhang and Thushara D. Abhayapala, “Binaural Localization of Speech Sources in the median plane using Cepstral HRTF Extraction”, 2014 22nd European Signal Processing Conference (EUSIPCO), Lisbon, Portugal, Sept.2014.

[36]Marc M. Van Wanrooij and A. John Van Opstal, “Contribution of Head Shadow and Pinna Cues to Chronic Monaural Sound Localization”,The Journal of Neuroscience, vol. 24, no.17, pp. 4163– 4171, April 2004.

[37]J. A. Macdonald, "A localization algorithm based on head- related transfer functions", The Journal of the Acoustical Society of America, vol. 123, no. 6, pp. 4290-4296, 2008.

[38]Shin, K. H. and Park, Y., “Enhanced vertical perception through head-related impulse response customization based on pinna response tuning in the median plane”, IEICE Transactions on Fundamentals of Electronics, Communications & Computer Sciences, pp.345–356, 2008.

[39]Rajani S. Pujar, Pandurangarao N. Kulkarni, "Cascaded Structure of Noise Reduction and Multiband Frequency Compression of speech signal to Improve Speech Perception for monaural Hearing Aids”, 16th IEEE India Council International Conference (INDICON 2019), Gujarat, 13th – 15th December 2019.

[40]Andrew D. Brown, Brianne T. Beemer, Nathaniel T. Greene, Theodore Argo, G.Douglas Meegan & Daniel J. Tollin, “Effects of Active and Passive Hearing Protection Devices on Sound Source Localization, Speech Recognition & Tone Detection”, https://doi.org/10.1371/journal.pone.0136568, 27th August 2015.

[41]Jianjun He, Woon-Seng Gan & Ee-Leng Tan, “On the preprocessing & postprocessing of HRTF individualization based on sparse representation of anthropometric features”, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), South Brisbane, QLD, Australia, 19-24 April 2015.

[42]Arjun Das H, Lisha Gopalakrishnan Pillai & Muruganantham C, “Human Voice Localization in Noisy Environment by SRP-PHAT and MFCC”, International Research Journal of Advanced Engineering and Science, Volume 1, Issue 3, pp. 33-37, 2016.

[43]Dongwen Ying, Ruohua Zhou, Junfeng Li & Yonghong Yan, “Window-Dominant Signal Subspace Methods for Multiple Short-Term Speech Source Localization”, IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 25, no. 4, April 2017.

[44]T. Van den Bogaert, E. Carette & J. Wouters, “Sound localization with and without hearing aids”, Belgium, January 2009.

[45]Ngai-Man Cheung Steven Trautmann & Andrew Homer, “Head-Related transfer function modeling in 3-D sound systems with genetic algorithms”, IEEE, pp.3529-3532, 1998.

[46]Douglas S. Brungart, Brian D. Simpson, “Auditory Localization of nearby sources in a Virtual Audio Display”, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat.No.01TH8575), New Platz, NY, USA, Oct.2001.

[47]Frantisek Rund, Filip Saturka, “Alternatives to HRTF Measurement”, 2012 35th International Conference on Telecommunications and Signal Processing (TSP), Prague, Czech Republic, July 2012.

[48]Martin Rothbucher, Tim Habigt, Johannes Feldmaier and Klaus Diepold, “Integrating a HRTF-based Sound Synthesis System into Mumble”, 2010 IEEE International Workshop on Multimedia Signal Processing, Saint Malo, France, pp. 24-28, Oct. 2010.

[49]Xiaohai Tian, Zhonghua Fu and Lei Xie, “An Experimental Comparison on KEMAR and BHead210 Dummy Heads for HRTF-based Virtual Auditory on Chinese Subjects”, IET 3rd International Conference on Wireless, Mobile and Multimedia Networks (ICWMNN 2010), Beijing, China, Sept. 2010.

[50]Ruixing Wu1, Guangzheng Yu, “Improvements in HRTF dataset of 3D Game Audio Application”, 2016 International Conference on Audio, Language and Image Processing (ICALIP), Shanghai, China, July 2016.

[51]Silzle A., “Selection and Tuning of HRTFs”, AES 112th Convention, Munich, Germany, May 10-13, pp.1–14, 2002.

[52]Mo Zhu, Muhammad Shahnawaz, Stefano Tubaro, Augusto Sarti, “HRTF Personalization based On Weighted Sparse Representation of Anthropometric Features”, 2017 International Conference on 3D Immersion (IC3D), Brussels, Belgium, Dec. 2017.

[53]H. Hu, L. Zhou, H. Ma, and Z. Wu, “HRTF personalization based on artificial neural network in individual virtual auditory space”, Applied Acoustics, vol. 69, no.2, pp. 163– 172, 2008.

[54]L. Li and Q. Huang, “HRTF personalization modeling based on RBF neural network”, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.3707–3710, 2013.

[55]V. R. Algazi, R. O. Duda, D. M. Thompson and C. Avendano, "Then CIPIC HRTF database", Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics, New Platz, NY, pp. 99– 102, 2001.

[56]“CIPIC database,” http://interface.cipic.ucdavis.edu.

[57]Kazuhiro Iida, Hikaru Shimazaki & Masato Oota, ”Generation of the Individual Head-Related Transfer Functions in the Upper Median Plane Based on the Anthropometry of the Listener's Pinnae”, IEEE 7th Global conference on consumer electronics(GCCE),2018.

[58]William Noble, S. Sinclair, Denis Byrne, “Improvement in Aided Sound localization with Open Ear molds: Observations in People with High-Frequency Hearing Loss”, Journal of the American Academy of Audiology,vol.9, no.1, pp. 25-34, Feb 1998.

[59]Kuk F, Baeksgaard L, “Considerations in fitting hearing aids with extended bandwidth”, Hearing Review, vol.16, no.11, pp.32-38, 2009.

[60]Tim Van den Bogaert, T. J. Klasen, M. Moonen, Lieselot Van Deun, Jan Wouters, “Horizontal localization with bilateral hearing aids: Without is better than with”, Acoustical Society of America, pp.515–526, 2005.

[61]Iman Elsabah Ibrahim, “Effects of Coordinated Bilaterial Hearing Aids and Auditory Training on Sound Localization”, PhD Thesis, University of Western Ontario, April 2013.

[62]Kuk F, Crose B, Kyhn T, Morkebjerg M, Rank M, Norgaard M, Foh H, “Digital wireless hearing aids part-3:audiological benefits”, Hearing Review, vol.18, no.8, pp.48-56, 2011.

[63]Korhonen P, Lau C, Kuk F, Deenan D, Schumacher J. “Effects of coordinated dynamic range compression and pinna compensation algorithm on horizontal localization performance in hearing-aid users”, Journal of the American Academy of Audiology,vol.26, no.1, pp 80-92, Jan 2015.

[64]Keidser G, O’Brien A, Hain J, McLelland M, Yeend I, “The effect of frequency-dependent microphone directionality on horizontal localization performance in hearing-aid users”, International Journal of Audiology,vol.48, no. 11, pp. 789- 803, 2009.

International Journal of Image, Graphics and Signal Processing (IJIGSP)