{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T06:46:57Z","timestamp":1776754017252,"version":"3.51.2"},"reference-count":36,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2021,9,30]],"date-time":"2021-09-30T00:00:00Z","timestamp":1632960000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"WS Audiology and the Deutsche Forschungsgemeinschaft 467 (DFG, German Research Foundation) \u2013 Project ID 390895286 \u2013 EXC 2177\/1.","award":["390895286 \u2013 EXC 2177\/1"],"award-info":[{"award-number":["390895286 \u2013 EXC 2177\/1"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Recent advances have shown that it is possible to identify the target speaker which a listener is attending to using single-trial EEG-based auditory attention decoding (AAD). Most AAD methods have been investigated for an open-loop scenario, where AAD is performed in an offline fashion without presenting online feedback to the listener. In this work, we aim at developing a closed-loop AAD system that allows to enhance a target speaker, suppress an interfering speaker and switch attention between both speakers. To this end, we propose a cognitive-driven adaptive gain controller (AGC) based on real-time AAD. Using the EEG responses of the listener and the speech signals of both speakers, the real-time AAD generates probabilistic attention measures, based on which the attended and the unattended speaker are identified. The AGC then amplifies the identified attended speaker and attenuates the identified unattended speaker, which are presented to the listener via loudspeakers. We investigate the performance of the proposed system in terms of the decoding performance and the signal-to-interference ratio (SIR) improvement. The experimental results show that, although there is a significant delay to detect attention switches, the proposed system is able to improve the SIR between the attended and the unattended speaker. In addition, no significant difference in decoding performance is observed between closed-loop AAD and open-loop AAD. The subjective evaluation results show that the proposed closed-loop cognitive-driven system demands a similar level of cognitive effort to follow the attended speaker, to ignore the unattended speaker and to switch attention between both speakers compared to using open-loop AAD. Closed-loop AAD in an online fashion is feasible and enables the listener to interact with the AGC.<\/jats:p>","DOI":"10.3390\/a14100287","type":"journal-article","created":{"date-parts":[[2021,9,30]],"date-time":"2021-09-30T10:22:42Z","timestamp":1632997362000},"page":"287","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Closed-Loop Cognitive-Driven Gain Control of Competing Sounds Using Auditory Attention Decoding"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5770-0858","authenticated-orcid":false,"given":"Ali","family":"Aroudi","sequence":"first","affiliation":[{"name":"WS Audiology, 91058 Erlangen, Germany"},{"name":"Department of Medical Physics and Acoustics and Cluster of Excellence Hearing4all, University of Oldenburg, 26122 Oldenburg, Germany"}]},{"given":"Eghart","family":"Fischer","sequence":"additional","affiliation":[{"name":"WS Audiology, 91058 Erlangen, Germany"}]},{"given":"Maja","family":"Serman","sequence":"additional","affiliation":[{"name":"WS Audiology, 91058 Erlangen, Germany"}]},{"given":"Henning","family":"Puder","sequence":"additional","affiliation":[{"name":"WS Audiology, 91058 Erlangen, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3392-2381","authenticated-orcid":false,"given":"Simon","family":"Doclo","sequence":"additional","affiliation":[{"name":"Department of Medical Physics and Acoustics and Cluster of Excellence Hearing4all, University of Oldenburg, 26122 Oldenburg, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2021,9,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MSP.2014.2366780","article-title":"Multichannel signal enhancement algorithms for assisted listening devices","volume":"32","author":"Doclo","year":"2015","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"692","DOI":"10.1109\/TASLP.2016.2647702","article-title":"A Consolidated Perspective on Multimicrophone Speech Enhancement and Source Separation","volume":"25","author":"Gannot","year":"2017","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_3","first-page":"1697","article-title":"Attentional selection in a cocktail party environment can be decoded from single-trial EEG","volume":"25","author":"Power","year":"2014","journal-title":"Cereb. Cortex"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"46007","DOI":"10.1088\/1741-2560\/12\/4\/046007","article-title":"Decoding the attended speech stream with multi-channel EEG: Implications for online, daily-life applications","volume":"12","author":"Mirkovic","year":"2015","journal-title":"J. Neural Eng."},{"key":"ref_5","unstructured":"Zink, R., Baptist, A., Bertrand, A., Van Huffel, S., and De Vos, M. (2016, January 1\u20133). Online detection of auditory attention in a neurofeedback application. Proceedings of the 8th International Workshop on Biosignal Interpretation, Osaka, Japan."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1016\/j.neuroimage.2017.04.026","article-title":"Noise-robust cortical tracking of attended speech in real-world acoustic scenes","volume":"156","author":"Fuglsang","year":"2017","journal-title":"NeuroImage"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"531","DOI":"10.3389\/fnins.2018.00531","article-title":"A Comparison of Regularization Methods in Forward and Backward Models for Auditory Attention Decoding","volume":"12","author":"Wong","year":"2018","journal-title":"Front. Neurosci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1016\/j.neuroimage.2018.01.033","article-title":"Decoding the auditory brain with canonical component analysis","volume":"172","author":"Wong","year":"2018","journal-title":"NeuroImage"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"262","DOI":"10.3389\/fnins.2018.00262","article-title":"Real-Time Tracking of Selective Auditory Attention From M\/EEG: A Bayesian Filtering Approach","volume":"12","author":"Miran","year":"2018","journal-title":"Front. Neurosci."},{"key":"ref_10","first-page":"1","article-title":"Testing the Limits of the Stimulus Reconstruction Approach: Auditory Attention Decoding in a Four-Speaker Free Field Environment","volume":"22","author":"Hannemann","year":"2018","journal-title":"Trends Hear."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"66017","DOI":"10.1088\/1741-2552\/aae0a6","article-title":"EEG-based auditory attention detection: Boundary conditions for background noise and speaker positions","volume":"15","author":"Das","year":"2018","journal-title":"J. Neural Eng."},{"key":"ref_12","first-page":"1234","article-title":"Machine learning for decoding listeners\u2019 attention from electroencephalography evoked by continuous speech","volume":"51","author":"Kollmeier","year":"2018","journal-title":"Eur. J. Neurosci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"153","DOI":"10.3389\/fnins.2019.00153","article-title":"A Tutorial on Auditory Attention Identification Methods","volume":"13","author":"Alickovic","year":"2019","journal-title":"Front. Neurosci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1109\/TNSRE.2019.2903404","article-title":"Impact of Different Acoustic Components on EEG-based Auditory Attention Decoding in Noisy and Reverberant Conditions","volume":"27","author":"Aroudi","year":"2019","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_15","first-page":"1","article-title":"Comparison of Two-Talker Attention Decoding from EEG with Nonlinear Neural Networks and Linear Methods","volume":"9","author":"Ciccarelli","year":"2019","journal-title":"Sci. Rep. Nat."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"036017","DOI":"10.1088\/1741-2552\/ab0cf1","article-title":"EEG decoding of the target speaker in a cocktail party scenario: Considerations regarding dynamic switching of talker location","volume":"16","author":"Teoh","year":"2019","journal-title":"J. Neural Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"036013","DOI":"10.1088\/1741-2552\/ab92b2","article-title":"Auditory attention tracking states in a cocktail party environment can be decoded by deep convolutional neural networks","volume":"17","author":"Tian","year":"2020","journal-title":"J. Neural Eng."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Aroudi, A., de Taillez, T., and Doclo, S. (2020, January 4\u20138). Improving Auditory Attention Decoding Performance of Linear and Non-Linear Methods using State-Space Model. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Barcelona, Spain.","DOI":"10.1109\/ICASSP40776.2020.9053149"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1109\/MSP.2021.3075932","article-title":"Electroencephalography-Based Auditory Attention Decoding: Toward Neurosteered Hearing Devices","volume":"38","author":"Geirnaert","year":"2021","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.1109\/TBME.2016.2587382","article-title":"EEG-informed attended speaker extraction from recorded speech mixtures with application in neuro-steered hearing prostheses","volume":"64","author":"Francart","year":"2017","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1744","DOI":"10.1121\/1.5035691","article-title":"Towards cognitive control of hearing instruments using EEG measures of selective attention","volume":"143","author":"Dau","year":"2018","journal-title":"J. Acoust. Soc. Am."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"eaav6134","DOI":"10.1126\/sciadv.aav6134","article-title":"Speaker-independent auditory attention decoding without access to clean speech sources","volume":"5","author":"Han","year":"2019","journal-title":"Sci. Adv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Pu, W., Xiao, J., Zhang, T., and Luo, Z. (2019, January 12\u201317). A Joint Auditory Attention Decoding and Adaptive Binaural Beamforming Algorithm for Hearing Devices. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Brighton, UK.","DOI":"10.1109\/ICASSP.2019.8682514"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"862","DOI":"10.1109\/TASLP.2020.2969779","article-title":"Cognitive-driven binaural beamforming using EEG-based auditory attention decoding","volume":"28","author":"Aroudi","year":"2020","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1097\/01.HJ.0000582432.27323.bd","article-title":"Brain-Controlled Hearing Aids for Better Speech Perception in Noisy Settings","volume":"72","author":"Mesgarani","year":"2019","journal-title":"Hear. J."},{"key":"ref_26","unstructured":"Hering, E. (2012). Kostbarkeiten aus dem Deutschen M\u00e4rchenschatz. Audiopool H\u00f6rbuchverlag MP3 CD, BUCHFUNK Verlag."},{"key":"ref_27","first-page":"2015","article-title":"Ohrka.de-Kostenlose H\u00f6rabenteuer f\u00fcr Kinderohren","volume":"30","author":"Ohrka","year":"2012","journal-title":"Accessed Apr"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"349","DOI":"10.3389\/fnins.2016.00349","article-title":"Target Speaker Detection with Concealed EEG Around the Ear","volume":"10","author":"Mirkovic","year":"2016","journal-title":"Front. Neurosci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1109\/TNSRE.2016.2571900","article-title":"Auditory-Inspired Speech Envelope Extraction Methods for Improved EEG-Based Auditory Attention Detection in a Cocktail Party Scenario","volume":"25","author":"Biesmans","year":"2017","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1896","DOI":"10.1109\/TBME.2016.2628884","article-title":"Dynamic Estimation of the Auditory Temporal Response Function from MEG in Competing-Speaker Environments","volume":"64","author":"Akram","year":"2017","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Collett, D. (2002). Modeling Binary Data, Chapman and Hall.","DOI":"10.1201\/b16654"},{"key":"ref_32","first-page":"370","article-title":"Generalized Linear Models","volume":"135","author":"Nelder","year":"1972","journal-title":"J. R. Stat. Soc."},{"key":"ref_33","unstructured":"Train, K.E. (2009). Discrete Choice Methods with Simulation, Cambridge University Press."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Hochberg, Y., and Tamhane, A.C. (1987). Multiple Comparison Procedures, John Wiley and Sons.","DOI":"10.1002\/9780470316672"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"102966","DOI":"10.1016\/j.bspc.2021.102966","article-title":"Auditory attention decoding from electroencephalography based on long short-term memory networks","volume":"70","author":"Lu","year":"2021","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1557","DOI":"10.1109\/TBME.2020.3033446","article-title":"Fast EEG-Based Decoding Of The Directional Focus Of Auditory Attention Using Common Spatial Patterns","volume":"68","author":"Geirnaert","year":"2021","journal-title":"IEEE Trans. Biomed. Eng."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/14\/10\/287\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:07:55Z","timestamp":1760166475000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/14\/10\/287"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,30]]},"references-count":36,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,10]]}},"alternative-id":["a14100287"],"URL":"https:\/\/doi.org\/10.3390\/a14100287","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,30]]}}}