{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T15:21:15Z","timestamp":1777735275939,"version":"3.51.4"},"reference-count":42,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T00:00:00Z","timestamp":1695859200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["62001523"],"award-info":[{"award-number":["62001523"]}]},{"name":"National Natural Science Foundation of China","award":["JCYJ20180307151430655"],"award-info":[{"award-number":["JCYJ20180307151430655"]}]},{"name":"National Natural Science Foundation of China","award":["KQTD20190929172704911"],"award-info":[{"award-number":["KQTD20190929172704911"]}]},{"name":"Shenzhen Fundamental Research Program","award":["62001523"],"award-info":[{"award-number":["62001523"]}]},{"name":"Shenzhen Fundamental Research Program","award":["JCYJ20180307151430655"],"award-info":[{"award-number":["JCYJ20180307151430655"]}]},{"name":"Shenzhen Fundamental Research Program","award":["KQTD20190929172704911"],"award-info":[{"award-number":["KQTD20190929172704911"]}]},{"name":"Shenzhen Science and Technology Program","award":["62001523"],"award-info":[{"award-number":["62001523"]}]},{"name":"Shenzhen Science and Technology Program","award":["JCYJ20180307151430655"],"award-info":[{"award-number":["JCYJ20180307151430655"]}]},{"name":"Shenzhen Science and Technology Program","award":["KQTD20190929172704911"],"award-info":[{"award-number":["KQTD20190929172704911"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Due to the outstanding penetrating detection performance of low-frequency electromagnetic waves, through-wall radar (TWR) has gained widespread applications in various fields, including public safety, counterterrorism operations, and disaster rescue. TWR is required to accomplish various tasks, such as people detection, people counting, and positioning in practical applications. However, most current research primarily focuses on one or two tasks. In this paper, we propose a multitask network that can simultaneously realize people counting, action recognition, and localization. We take the range\u2013time\u2013Doppler (RTD) spectra obtained from one-dimensional (1D) radar signals as datasets and convert the information related to the number, motion, and location of people into confidence matrices as labels. The convolutional layers and novel attention modules automatically extract deep features from the data and output the number, motion category, and localization results of people. We define the total loss function as the sum of individual task loss functions. Through the loss function, we transform the positioning problem into a multilabel classification problem, where a certain position in the distance confidence matrix represents a certain label. On the test set consisting of 10,032 samples from through-wall scenarios with a 24 cm thick brick wall, the accuracy of people counting can reach 96.94%, and the accuracy of motion recognition is 96.03%, with an average distance error of 0.12 m.<\/jats:p>","DOI":"10.3390\/s23198147","type":"journal-article","created":{"date-parts":[[2023,9,29]],"date-time":"2023-09-29T07:42:08Z","timestamp":1695973328000},"page":"8147","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["A Multitask Network for People Counting, Motion Recognition, and Localization Using Through-Wall Radar"],"prefix":"10.3390","volume":"23","author":[{"given":"Junyu","family":"Lin","sequence":"first","affiliation":[{"name":"School of Electronics and Communication Engineering, Sun Yat-sen University, Shenzhen 518107, China"}]},{"given":"Jun","family":"Hu","sequence":"additional","affiliation":[{"name":"School of Electronics and Communication Engineering, Sun Yat-sen University, Shenzhen 518107, China"}]},{"given":"Zhiyuan","family":"Xie","sequence":"additional","affiliation":[{"name":"School of Electronics and Communication Engineering, Sun Yat-sen University, Shenzhen 518107, China"}]},{"given":"Yulan","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Electronics and Communication Engineering, Sun Yat-sen University, Shenzhen 518107, China"}]},{"given":"Guangjia","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Electronics and Communication Engineering, Sun Yat-sen University, Shenzhen 518107, China"}]},{"given":"Zengping","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Electronics and Communication Engineering, Sun Yat-sen University, Shenzhen 518107, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1145\/3131897","article-title":"Covertband: Activity information leakage using music","volume":"1","author":"Nandakumar","year":"2017","journal-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."},{"key":"ref_2","first-page":"342","article-title":"Advances on penetrating imaging of building layout technique using low frequency radio waves","volume":"10","author":"Tian","year":"2020","journal-title":"J. Radars"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2093","DOI":"10.1039\/C4AN01987C","article-title":"Wavelength-dependent penetration depth of near infrared radiation into cartilage","volume":"140","author":"Padalkar","year":"2015","journal-title":"Analyst"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"10032","DOI":"10.1109\/JSEN.2020.2991741","article-title":"mm-Pose: Real-time human skeletal posture estimation using mmWave radars and CNNs","volume":"20","author":"Sengupta","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"802","DOI":"10.1109\/LAWP.2009.2021586","article-title":"Through-wall imaging of moving targets using UWB random noise radar","volume":"8","author":"Wang","year":"2009","journal-title":"IEEE Antennas Wirel. Propag. Lett."},{"key":"ref_6","unstructured":"Dubroca, R., Fortino, N., Dauvignac, J.Y., Bellomo, L., Pioch, S., Saillard, M., Lepetit, T., De Rosny, J., Prada, C., and Millot, P. (2011, January 12\u201314). Time reversal-based processing for human targets detection in realistic through-the-wall scenarios. Proceedings of the 2011 8th European Radar Conference, Manchester, UK."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"75","DOI":"10.2528\/PIER10052408","article-title":"Through-the-wall target localization with time reversal music method","volume":"106","author":"Zhang","year":"2010","journal-title":"Prog. Electromagn. Res."},{"key":"ref_8","unstructured":"Hayashi, T., and Kidera, S. (2018, January 23\u201326). In corporation of Super-resolution Doppler Analysis and Compressed Sensing Filter for UWB Human Body Imaging Radar. Proceedings of the 2018 International Symposium on Antennas and Propagation (ISAP), Busan, Republic of Korea."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ram, S.S., and Majumdar, A. (2016, January 2\u20136). Through-wall propagation effects on Doppler-enhanced frontal radar images of humans. Proceedings of the 2016 IEEE Radar Conference (RadarConf), Philadelphia, PA, USA.","DOI":"10.1109\/RADAR.2016.7485326"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1109\/LGRS.2016.2628909","article-title":"Three-dimensional imaging method incorporating range points migration and Doppler velocity estimation for UWB millimeter-wave radar","volume":"14","author":"Sasaki","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"205","DOI":"10.2528\/PIERB11042207","article-title":"Two-dimensional diffraction tomographic algorithm for through-the-wall radar imaging","volume":"31","author":"Zhang","year":"2011","journal-title":"Prog. Electromagn. Res. B"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"4155","DOI":"10.1109\/TGRS.2012.2227059","article-title":"Three-dimensional real-time through-the-wall radar imaging with diffraction tomographic algorithm","volume":"51","author":"Zhang","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2816795.2818072","article-title":"Capturing the human figure through a wall","volume":"34","author":"Adib","year":"2015","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_14","unstructured":"Camero (2023, September 15). XAVER\u2122 1000 High Performance 3D Portable through Wall Imaging System. Available online: https:\/\/camero-tech.com\/wp-content\/uploads\/2022\/06\/Camero-Xave-1000.pdf."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhao, M., Tian, Y., Zhao, H., Alsheikh, M.A., Li, T., Hristov, R., Kabelac, Z., Katabi, D., and Torralba, A. (2018, January 20\u201325). RF-based 3D skeletons. Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication, Budapest, Hungary.","DOI":"10.1145\/3230543.3230579"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Song, Y., Jin, T., Dai, Y., Song, Y., and Zhou, X. (2021). Through-wall human pose reconstruction via UWB MIMO radar and 3D CNN. Remote Sens., 13.","DOI":"10.3390\/rs13020241"},{"key":"ref_17","first-page":"3505205","article-title":"Human posture reconstruction for through-the-wall radar imaging using convolutional neural networks","volume":"19","author":"Zheng","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"5112015","DOI":"10.1109\/TGRS.2022.3162333","article-title":"Recovering human pose and shape from through-the-wall radar images","volume":"60","author":"Zheng","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","first-page":"240","article-title":"Micro-Doppler effect of micromotion dynamics: A review","volume":"5102","author":"Chen","year":"2003","journal-title":"Indep. Compon. Anal. Wavel. Neural Netw."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1109\/TAES.2006.1603402","article-title":"Micro-Doppler effect in radar: Phenomenon, model, and simulation study","volume":"42","author":"Chen","year":"2006","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"5717","DOI":"10.1109\/JSEN.2017.2723766","article-title":"People counting based on an IR-UWB radar sensor","volume":"17","author":"Choi","year":"2017","journal-title":"IEEE Sens. J."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"13704","DOI":"10.1109\/JSEN.2021.3071941","article-title":"CNN-based regional people counting algorithm exploiting multi-scale range-time maps with an IR-UWB radar","volume":"21","author":"Bao","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Choi, J.H., Kim, J.E., Jeong, N.H., Kim, K.T., and Jin, S.H. (2020, January 21\u201325). Accurate people counting based on radar: Deep learning approach. Proceedings of the 2020 IEEE Radar Conference (RadarConf20), Florence, Italy.","DOI":"10.1109\/RadarConf2043947.2020.9266496"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"7715","DOI":"10.1109\/JIOT.2021.3113671","article-title":"Deep learning approach for radar-based people counting","volume":"9","author":"Choi","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"5806","DOI":"10.1109\/JIOT.2020.3032710","article-title":"People counting using IR-UWB radar sensor in a wide area","volume":"8","author":"Choi","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_26","first-page":"7541814","article-title":"Through-wall radar classification of human posture using convolutional neural networks","volume":"2019","author":"Arslan","year":"2019","journal-title":"Int. J. Antennas Propag."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"12244","DOI":"10.1109\/JSEN.2019.2938997","article-title":"Using an end-to-end convolutional network on radar signal for human activity classification","volume":"19","author":"Ye","year":"2019","journal-title":"IEEE Sens. J."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1178","DOI":"10.1109\/LGRS.2019.2942097","article-title":"Classification of human activity based on radar signal using 1-D convolutional neural network","volume":"17","author":"Chen","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"He, Y., Li, X., and Jing, X. (2019). A multiscale residual attention network for multitask learning of human activity using radar micro-Doppler signatures. Remote Sens., 11.","DOI":"10.3390\/rs11212584"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Wang, M., Cui, G., Huang, H., Gao, X., Chen, P., Li, H., Yang, H., and Kong, L. (2019, January 22\u201326). Through-wall human motion representation via autoencoder-self organized mapping network. Proceedings of the 2019 IEEE Radar Conference (RadarConf), Boston, MA, USA.","DOI":"10.1109\/RADAR.2019.8835845"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"186879","DOI":"10.1109\/ACCESS.2020.3029247","article-title":"Human motion serialization recognition with through-the-wall radar","volume":"8","author":"Yang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Wang, X., Chen, P., Xie, H., and Cui, G. (2021, January 8\u201314). Through-wall human activity classification using complex-valued convolutional neural network. Proceedings of the 2021 IEEE Radar Conference (RadarConf21), Atlanta, GA, USA.","DOI":"10.1109\/RadarConf2147009.2021.9455169"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"5062","DOI":"10.1109\/JSEN.2019.2901923","article-title":"A multi-target detection algorithm using high-order differential equation","volume":"19","author":"Lin","year":"2019","journal-title":"IEEE Sens. J."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1109\/LMWC.2021.3057867","article-title":"Detection and localization of multiple humans based on curve length of I\/Q signal trajectory using MIMO FMCW radar","volume":"31","author":"Han","year":"2021","journal-title":"IEEE Microw. Wirel. Compon. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Lee, J., Park, K., and Kim, Y. (2022). Deep learning-based device-free localization scheme for simultaneous estimation of indoor location and posture using FMCW radars. Sensors, 22.","DOI":"10.3390\/s22124447"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zhu, D., Wang, C., Han, C., Guo, J., and Sun, L. (2022, January 4\u20138). TWLBR: Multi-Human Through-Wall Localization and Behavior Recognition Based on MIMO Radar. Proceedings of the GLOBECOM 2022\u20142022 IEEE Global Communications Conference, Rio de Janeiro, Brazil.","DOI":"10.1109\/GLOBECOM48099.2022.10001129"},{"key":"ref_37","first-page":"3274207","article-title":"Real-time Through-Wall Multi-Human Localization and Behavior Recognition Based on MIMO Radar","volume":"61","author":"Wang","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"3059","DOI":"10.1109\/JSEN.2022.3227025","article-title":"Single 24-GHz FMCW Radar-Based Indoor Device-Free Human Localization and Posture Sensing With CNN","volume":"23","author":"Yang","year":"2022","journal-title":"IEEE Sens. J."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., and Lu, H. (2019, January 15\u201320). Dual attention network for scene segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00326"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1819","DOI":"10.1109\/TKDE.2013.39","article-title":"A review on multi-label learning algorithms","volume":"26","author":"Zhang","year":"2013","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1034","DOI":"10.1109\/LGRS.2020.2990742","article-title":"ResNet-based counting algorithm for moving targets in through-the-wall radar","volume":"18","author":"Jia","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/19\/8147\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:01:13Z","timestamp":1760130073000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/19\/8147"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,28]]},"references-count":42,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["s23198147"],"URL":"https:\/\/doi.org\/10.3390\/s23198147","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,28]]}}}