{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T18:52:40Z","timestamp":1775069560632,"version":"3.50.1"},"reference-count":36,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2016,3,26]],"date-time":"2016-03-26T00:00:00Z","timestamp":1458950400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Science Foundation of China","doi-asserted-by":"publisher","award":["#51328801"],"award-info":[{"award-number":["#51328801"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Science Foundation of China","doi-asserted-by":"publisher","award":["#51278021"],"award-info":[{"award-number":["#51278021"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Driven by the prominent thermal signature of humans and following the growing availability of unmanned aerial vehicles (UAVs), more and more research efforts have been focusing on the detection and tracking of pedestrians using thermal infrared images recorded from UAVs. However, pedestrian detection and tracking from the thermal images obtained from UAVs pose many challenges due to the low-resolution of imagery, platform motion, image instability and the relatively small size of the objects. This research tackles these challenges by proposing a pedestrian detection and tracking system. A two-stage blob-based approach is first developed for pedestrian detection. This approach first extracts pedestrian blobs using the regional gradient feature and geometric constraints filtering and then classifies the detected blobs by using a linear Support Vector Machine (SVM) with a hybrid descriptor, which sophisticatedly combines Histogram of Oriented Gradient (HOG) and Discrete Cosine Transform (DCT) features in order to achieve accurate detection. This research further proposes an approach for pedestrian tracking. This approach employs the feature tracker with the update of detected pedestrian location to track pedestrian objects from the registered videos and extracts the motion trajectory data. The proposed detection and tracking approaches have been evaluated by multiple different datasets, and the results illustrate the effectiveness of the proposed methods. This research is expected to significantly benefit many transportation applications, such as the multimodal traffic performance measure, pedestrian behavior study and pedestrian-vehicle crash analysis. Future work will focus on using fused thermal and visual images to further improve the detection efficiency and effectiveness.<\/jats:p>","DOI":"10.3390\/s16040446","type":"journal-article","created":{"date-parts":[[2016,3,29]],"date-time":"2016-03-29T16:00:28Z","timestamp":1459267228000},"page":"446","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":82,"title":["Pedestrian Detection and Tracking from Low-Resolution Unmanned Aerial Vehicle Thermal Imagery"],"prefix":"10.3390","volume":"16","author":[{"given":"Yalong","family":"Ma","sequence":"first","affiliation":[{"name":"Beijing Key Laboratory for Cooperative Vehicle Infrastructure Systems and Safety Control, School of Transportation Science and Engineering, Beihang University, Beijing 100191, China"},{"name":"Jiangsu Province Collaborative Innovation Center of Modern Urban Traffic Technologies, SiPaiLou #2, Nanjing 210096, China"}]},{"given":"Xinkai","family":"Wu","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory for Cooperative Vehicle Infrastructure Systems and Safety Control, School of Transportation Science and Engineering, Beihang University, Beijing 100191, China"},{"name":"Jiangsu Province Collaborative Innovation Center of Modern Urban Traffic Technologies, SiPaiLou #2, Nanjing 210096, China"}]},{"given":"Guizhen","family":"Yu","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory for Cooperative Vehicle Infrastructure Systems and Safety Control, School of Transportation Science and Engineering, Beihang University, Beijing 100191, China"},{"name":"Jiangsu Province Collaborative Innovation Center of Modern Urban Traffic Technologies, SiPaiLou #2, Nanjing 210096, China"}]},{"given":"Yongzheng","family":"Xu","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory for Cooperative Vehicle Infrastructure Systems and Safety Control, School of Transportation Science and Engineering, Beihang University, Beijing 100191, China"},{"name":"Jiangsu Province Collaborative Innovation Center of Modern Urban Traffic Technologies, SiPaiLou #2, Nanjing 210096, China"}]},{"given":"Yunpeng","family":"Wang","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory for Cooperative Vehicle Infrastructure Systems and Safety Control, School of Transportation Science and Engineering, Beihang University, Beijing 100191, China"},{"name":"Jiangsu Province Collaborative Innovation Center of Modern Urban Traffic Technologies, SiPaiLou #2, Nanjing 210096, China"}]}],"member":"1968","published-online":{"date-parts":[[2016,3,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1239","DOI":"10.1109\/TPAMI.2009.122","article-title":"Survey of Pedestrian Detection for Advanced Driver Assistance Systems","volume":"32","author":"Geronimo","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Oreifej, O., Mehran, R., and Shah, M. (2010, January 13\u201318). Human identity recognition in aerial images. Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5540147"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Gaszczak, A., Breckon, T.P., and Han, J. (2011, January 24). Real-time people and vehicle detection from UAV imagery. Proceedings of the Intelligent Robots and Computer Vision XXVIII: Algorithms and Techniques, San Francisco, CA, USA.","DOI":"10.1117\/12.876663"},{"key":"ref_4","unstructured":"Portmann, J., Lynen, S., Chli, M., and Siegwart, R. (June, January 31). People detection and tracking from aerial thermal views. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-Vector Networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_6","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201326). Histograms of oriented gradients for human detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, CA, USA."},{"key":"ref_7","unstructured":"Bouguet, J. Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the Algorithm. Available online: http:\/\/robots.stanford.edu\/cs223b04\/algo_tracking.pdf."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2179","DOI":"10.1109\/TPAMI.2008.260","article-title":"Monocular Pedestrian Detection: Survey and Experiments","volume":"31","author":"Enzweiler","year":"2009","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1109\/TPAMI.2011.155","article-title":"Pedestrian Detection: An Evaluation of the State of the Art","volume":"34","author":"Dollar","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Davis, J.W., and Keck, M.A. (2005, January 5\u20137). A Two-Stage Template Approach to Person Detection in Thermal Imagery. Proceedings of the Seventh IEEE Workshops on Application of Computer Vision, Breckenridge, CO, USA.","DOI":"10.1109\/ACVMOT.2005.14"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1016\/j.cviu.2006.08.009","article-title":"Pedestrian detection and tracking in infrared imagery using shape and appearance","volume":"106","author":"Dai","year":"2007","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1007\/s00138-008-0176-5","article-title":"Pedestrian tracking by fusion of thermal-visible surveillance videos","volume":"21","author":"Leykin","year":"2008","journal-title":"Mach. Vis. Appl."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Miezianko, R., and Pokrajac, D. (2008, January 23\u201328). People detection in low resolution infrared videos. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Anchorage, AK, USA.","DOI":"10.1109\/CVPRW.2008.4563056"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"6763","DOI":"10.3390\/s150306763","article-title":"Human Detection Based on the Generation of a Background Image by Using a Far-Infrared Light Camera","volume":"15","author":"Jeon","year":"2015","journal-title":"Sensors"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"10580","DOI":"10.3390\/s150510580","article-title":"Robust Pedestrian Detection by Combining Visible and Thermal Infrared Cameras","volume":"15","author":"Lee","year":"2015","journal-title":"Sensors"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1947","DOI":"10.1016\/j.patcog.2014.12.013","article-title":"Robust pedestrian detection in thermal infrared imagery using a shape distribution histogram feature and modified sparse representation classification","volume":"48","author":"Zhao","year":"2015","journal-title":"Pattern Recognit."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1109\/TITS.2004.838222","article-title":"Pedestrian detection and tracking with night vision","volume":"6","author":"Xu","year":"2005","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1109\/TITS.2009.2018961","article-title":"Real-Time Pedestrian Detection and Tracking at Nighttime for Driver-Assistance Systems","volume":"10","author":"Ge","year":"2009","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Qi, B., John, V., Liu, Z., and Mita, S. (2014, January 23\u201328). Use of Sparse Representation for Pedestrian Detection in Thermal Images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.49"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Teutsch, M., Mueller, T., Huber, M., and Beyerer, J. (2014, January 23\u201328). Low Resolution Person Detection with a Moving Thermal Infrared Camera by Hot Spot Classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.40"},{"key":"ref_21","unstructured":"Sidla, O., Braendle, N., Benesova, W., Rosner, M., and Lypetskyy, Y. (October, January 27). Towards complex visual surveillance algorithms on smart cameras. Proceedings of the IEEE 12th International Conference on Computer Vision Workshops (ICCV Workshops), Kyoto, Japan."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Benfold, B., and Reid, I. (2011, January 20\u201325). Stable multi-target tracking in real-time surveillance video. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA.","DOI":"10.1109\/CVPR.2011.5995667"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Stiefelhagen, R., Bowers, R., and Fiscus, J. (2008). Multimodal Technologies for Perception of Humans, Springer.","DOI":"10.1007\/978-3-540-68585-2"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Hammoud, R., Fan, G., McMillan, R.W., and Ikeuchi, K. (2011). Machine Vision Beyond Visible Spectrum, Springer.","DOI":"10.1007\/978-3-642-11568-4"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Stiefelhagen, R., Bowers, R., and Fiscus, J. (2008). Multimodal Technologies for Perception of Humans, Springer.","DOI":"10.1007\/978-3-540-68585-2"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"6666","DOI":"10.3390\/s140406666","article-title":"Thermal-Infrared Pedestrian ROI Extraction through Thermal and Motion Information Fusion","volume":"14","author":"Lopez","year":"2014","journal-title":"Sensors"},{"key":"ref_27","unstructured":"Viola, P., and Jones, M. (2001, January 8\u201314). Rapid object detection using a boosted cascade of simple features. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"(1979). A Threshold Selection Method from Gray-Level Histograms. IEEE Trans. Syst. Man Cybern., 9, 62\u201366.","DOI":"10.1109\/TSMC.1979.4310076"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1023\/A:1011183429707","article-title":"Face Recognition Using the Discrete Cosine Transform","volume":"43","author":"Hafed","year":"2001","journal-title":"Int. J. Comput. Vis."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Vaidehi, V., Babu, N.T.N., Avinash, H., Vimal, M.D., Sumitra, A., Balmuralidhar, P., and Chandra, G. (2010, January 7\u201310). Face recognition using discrete cosine transform and fisher linear discriminant. Proceedings of the 11th International Conference on Control Automation Robotics & Vision (ICARCV), Singapore.","DOI":"10.1109\/ICARCV.2010.5707946"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1109\/TITS.2005.858621","article-title":"Airborne video registration and traffic-flow parameter estimation","volume":"6","author":"Shastry","year":"2005","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_32","unstructured":"Shi, J., and Tomasi, C. (1994, January 21\u201323). Good Features To Track. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA."},{"key":"ref_33","first-page":"9795","article-title":"Detection and Tracking of Point Features","volume":"9","author":"Tomasi","year":"1991","journal-title":"Tech. Rep."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Bernardin, K., and Stiefelhagen, R. (2008). Evaluating multiple object tracking performance: The CLEAR MOT metrics. J. Image Video Process., 2008.","DOI":"10.1155\/2008\/246309"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.trc.2015.03.011","article-title":"A continuous-flow-intersection-lite design and traffic control for oversaturated bottleneck intersections","volume":"56","author":"Sun","year":"2015","journal-title":"Transp. Res. Part C Emerg. Technol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.trc.2013.07.010","article-title":"Mining smart card data for transit riders\u2019 travel patterns","volume":"36","author":"Ma","year":"2013","journal-title":"Transp. Res. Part C Emerg. Technol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/4\/446\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:21:21Z","timestamp":1760210481000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/4\/446"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,3,26]]},"references-count":36,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2016,4]]}},"alternative-id":["s16040446"],"URL":"https:\/\/doi.org\/10.3390\/s16040446","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,3,26]]}}}