{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:46:58Z","timestamp":1760237218065,"version":"build-2065373602"},"reference-count":41,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2020,3,26]],"date-time":"2020-03-26T00:00:00Z","timestamp":1585180800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100005908","name":"Bundesministerium f\u00fcr Ern\u00e4hrung und Landwirtschaft","doi-asserted-by":"publisher","award":["FKZ: 22WB410602"],"award-info":[{"award-number":["FKZ: 22WB410602"]}],"id":[{"id":"10.13039\/501100005908","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100013549","name":"Bundesministerium f\u00fcr Umwelt, Naturschutz und nukleare Sicherheit","doi-asserted-by":"publisher","award":["FKZ: 22WB410602"],"award-info":[{"award-number":["FKZ: 22WB410602"]}],"id":[{"id":"10.13039\/501100013549","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Semi-Global Matching (SGM) approximates a 2D Markov Random Field (MRF) via multiple 1D scanline optimizations, which serves as a good trade-off between accuracy and efficiency in dense matching. Nevertheless, the performance is limited due to the simple summation of the aggregated costs from all 1D scanline optimizations for the final disparity estimation. SGM-Forest improves the performance of SGM by training a random forest to predict the best scanline according to each scanline\u2019s disparity proposal. The disparity estimated by the best scanline acts as reference to adaptively adopt close proposals for further post-processing. However, in many cases more than one scanline is capable of providing a good prediction. Training the random forest with only one scanline labeled may limit or even confuse the learning procedure when other scanlines can offer similar contributions. In this paper, we propose a multi-label classification strategy to further improve SGM-Forest. Each training sample is allowed to be described by multiple labels (or zero label) if more than one (or none) scanline gives a proper prediction. We test the proposed method on stereo matching datasets, from Middlebury, ETH3D, EuroSDR image matching benchmark, and the 2019 IEEE GRSS data fusion contest. The result indicates that under the framework of SGM-Forest, the multi-label strategy outperforms the single-label scheme consistently.<\/jats:p>","DOI":"10.3390\/rs12071069","type":"journal-article","created":{"date-parts":[[2020,4,1]],"date-time":"2020-04-01T03:44:13Z","timestamp":1585712653000},"page":"1069","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Multi-Label Learning based Semi-Global Matching Forest"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2049-2180","authenticated-orcid":false,"given":"Yuanxin","family":"Xia","sequence":"first","affiliation":[{"name":"Department of Photogrammetry and Image Analysis, Remote Sensing Technology Institute, German Aerospace Center (DLR), 82234 Wessling, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8541-3856","authenticated-orcid":false,"given":"Pablo","family":"d\u2019Angelo","sequence":"additional","affiliation":[{"name":"Department of Photogrammetry and Image Analysis, Remote Sensing Technology Institute, German Aerospace Center (DLR), 82234 Wessling, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8407-5098","authenticated-orcid":false,"given":"Jiaojiao","family":"Tian","sequence":"additional","affiliation":[{"name":"Department of Photogrammetry and Image Analysis, Remote Sensing Technology Institute, German Aerospace Center (DLR), 82234 Wessling, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5805-8892","authenticated-orcid":false,"given":"Friedrich","family":"Fraundorfer","sequence":"additional","affiliation":[{"name":"Department of Photogrammetry and Image Analysis, Remote Sensing Technology Institute, German Aerospace Center (DLR), 82234 Wessling, Germany"},{"name":"Institute of Computer Graphics and Vision, Graz University of Technology (TU Graz), 8010 Graz, Austria"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8122-1475","authenticated-orcid":false,"given":"Peter","family":"Reinartz","sequence":"additional","affiliation":[{"name":"Department of Photogrammetry and Image Analysis, Remote Sensing Technology Institute, German Aerospace Center (DLR), 82234 Wessling, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Farinella, G.M., Battiato, S., and Cipolla, R. (2013). Stereo matching\u2014State-of-the-art and research challenges. Advanced Topics in Computer Vision, Springer.","DOI":"10.1007\/978-1-4471-5520-1"},{"key":"ref_2","unstructured":"Hirschmuller, H. (2005, January 20\u201325). Accurate and efficient stereo processing by semi-global matching and mutual information. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, CA, USA."},{"key":"ref_3","first-page":"79","article-title":"Semiglobal matching results on the ISPRS stereo matching benchmark","volume":"XXXVIII-4\/W19","author":"Reinartz","year":"2011","journal-title":"ISPRS\u2014Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"299","DOI":"10.5194\/isprs-archives-XLI-B1-299-2016","article-title":"Improving semi-global matching: Cost aggregation and confidence measure","volume":"XLI-B1","year":"2016","journal-title":"ISPRS\u2014Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1109\/TPAMI.2007.1166","article-title":"Stereo processing by semiglobal matching and mutual information","volume":"30","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1023\/A:1014573219977","article-title":"A taxonomy and evaluation of dense two-frame stereo correspondence algorithms","volume":"47","author":"Scharstein","year":"2002","journal-title":"Int. J. Comput. Vis."},{"key":"ref_7","first-page":"173","article-title":"Semi-global matching-motivation, developments and applications","volume":"Volume 11","year":"2011","journal-title":"Photogrammetric Week"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"195","DOI":"10.5194\/isprsarchives-XL-1-195-2014","article-title":"DSM accuracy evaluation for the ISPRS commission I image matching benchmark","volume":"XL-1","author":"Kuschk","year":"2014","journal-title":"ISPRS\u2014Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2125","DOI":"10.1109\/JSTARS.2015.2424275","article-title":"Object-based 3-D building change detection on multitemporal stereo images","volume":"8","author":"Qin","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_10","unstructured":"Ferrari, V., Hebert, M., Sminchisescu, C., and Weiss, Y. (2018). Learning to fuse proposals from multiple scanline optimizations in semi-global matching. Computer Vision\u2014ECCV 2018, Springer International Publishing."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Menze, M., and Geiger, A. (2015, January 7\u201312). Object scene flow for autonomous vehicles. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298925"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Sch\u00f6ps, T., Sch\u00f6nberger, J.L., Galliani, S., Sattler, T., Schindler, K., Pollefeys, M., and Geiger, A. (2017, January 21\u201326). A multi-view stereo benchmark with high-resolution images and multi-camera videos. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.272"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Scharstein, D., and Pal, C. (2007, January 17\u201322). Learning conditional random fields for stereo. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383191"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Hirschm\u00fcller, H., and Scharstein, D. (2007, January 17\u201322). Evaluation of cost functions for stereo matching. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383248"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Scharstein, D., Hirschm\u00fcller, H., Kitajima, Y., Krathwohl, G., Ne\u0161i\u0107, N., Wang, X., and Westling, P. (2014). High-resolution stereo datasets with subpixel-accurate ground truth. German Conference on Pattern Recognition (GCPR 2014), Springer.","DOI":"10.1007\/978-3-319-11752-2_3"},{"key":"ref_16","first-page":"115","article-title":"Dense image matching final report","volume":"64","author":"Haala","year":"2014","journal-title":"EuroSDR Publ. Ser. Off. Publ."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Bosch, M., Foster, K., Christie, G.A., Wang, S., Hager, G.D., and Brown, M.Z. (2019, January 7\u201311). Semantic Stereo for Incidental Satellite Images. Proceedings of the 2019 IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa Village, HI, USA.","DOI":"10.1109\/WACV.2019.00167"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1109\/MGRS.2019.2893783","article-title":"2019 IEEE GRSS Data Fusion Contest: Semantic 3D Reconstruction [Technical Committees]","volume":"7","author":"Yokoya","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_19","unstructured":"Birchfield, S., and Tomasi, C. (1998, January 4\u20137). Depth discontinuities by pixel-to-pixel stereo. Proceedings of the Sixth International Conference on Computer Vision (ICCV), Bombay, India."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"61735","DOI":"10.1109\/ACCESS.2018.2876420","article-title":"Second-Order Semi-Global Stereo Matching Algorithm Based on Slanted Plane Iterative Optimization","volume":"6","author":"Ni","year":"2018","journal-title":"IEEE Access"},{"key":"ref_21","first-page":"1","article-title":"Stereo matching by training a convolutional neural network to compare image patches","volume":"17","author":"Zbontar","year":"2016","journal-title":"J. Mach. Learn. Res."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Luo, W., Schwing, A.G., and Urtasun, R. (2016, January 27\u201330). Efficient Deep Learning for Stereo Matching. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.614"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Seki, A., and Pollefeys, M. (2017, January 21\u201326). Sgm-nets: Semi-global matching with neural networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.703"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Scharstein, D., Taniai, T., and Sinha, S.N. (2017, January 10\u201312). Semi-global stereo matching with surface orientation priors. Proceedings of the 2017 International Conference on 3D Vision (3DV), Qingdao, China.","DOI":"10.1109\/3DV.2017.00033"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Michael, M., Salmen, J., Stallkamp, J., and Schlipsing, M. (2013, January 23\u201326). Real-time stereo vision: Optimizing semi-global matching. Proceedings of the 2013 IEEE Intelligent Vehicles Symposium (IV), Gold Coast, QLD, Australia.","DOI":"10.1109\/IVS.2013.6629629"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Poggi, M., and Mattoccia, S. (2016, January 25\u201328). Learning a general-purpose confidence measure based on O(1) features and a smarter aggregation strategy for semi global matching. Proceedings of the 2016 Fourth International Conference on 3D Vision (3DV), Stanford, CA, USA.","DOI":"10.1109\/3DV.2016.61"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Zhang, F., Prisacariu, V., Yang, R., and Torr, P.H. (2019, January 15\u201321). GA-Net: Guided Aggregation Net for End-to-end Stereo Matching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00027"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Bromley, J., Bentz, J., Bottou, L., Guyon, I., LeCun, Y., Moore, C., Sackinger, E., and Shah, R. (1993). Signature Verification using a \u201cSiamese\u201d Time Delay Neural Network. Int. ]. Pattern Recognit. Artif. Intell., 7.","DOI":"10.1142\/9789812797926_0003"},{"key":"ref_29","unstructured":"Eklundh, J.O. (1994). Non-parametric local transforms for computing visual correspondence. Computer Vision\u2014ECCV\u201994, Springer."},{"key":"ref_30","unstructured":"Duda, R.O., Hart, P.E., and Stork, D.G. (2001). Pattern Classification, Wiley. [2th ed.]."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1757","DOI":"10.1016\/j.patcog.2004.03.009","article-title":"Learning multi-label scene classification","volume":"37","author":"Boutell","year":"2004","journal-title":"Pattern Recognit."},{"key":"ref_32","unstructured":"McCallum, A. (1999). Multi-label text classification with a mixture model trained by EM. AAAI Workshop Text Learn., 1\u20137."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1023\/A:1007649029923","article-title":"BoosTexter: A boosting-based system for text categorization","volume":"39","author":"Schapire","year":"2000","journal-title":"Mach. Learn."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"De Raedt, L., and Siebes, A. (2001). Knowledge discovery in multi-label phenotype data. Principles of Data Mining and Knowledge Discovery, Springer.","DOI":"10.1007\/3-540-44794-6"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4018\/jdwm.2007070101","article-title":"Multi-label classification: An overview","volume":"3","author":"Tsoumakas","year":"2007","journal-title":"Int. J. Data Warehous. Min. (IJDWM)"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Schumacher, F., and Greiner, T. (2014, January 8\u201311). Matching cost computation algorithm and high speed FPGA architecture for high quality real-time semi global matching stereo vision for road scenes. Proceedings of the 17th International IEEE Conference on Intelligent Transportation Systems (ITSC), Qingdao, China.","DOI":"10.1109\/ITSC.2014.6958182"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Gehrig, S.K., and Rabe, C. (2010, January 13\u201318). Real-time semi-global matching on the CPU. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition\u2014Workshops, San Francisco, CA, USA.","DOI":"10.1109\/CVPRW.2010.5543779"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Arndt, O.J., Becker, D., Banz, C., and Blume, H. (2013, January 15\u201318). Parallel implementation of real-time semi-global matching on embedded multi-core architectures. Proceedings of the 2013 International Conference on Embedded Computer Systems: Architectures, Modeling, and Simulation (SAMOS), Agios Konstantinos, Greece.","DOI":"10.1109\/SAMOS.2013.6621106"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Fritz, M., Schiele, B., and Piater, J.H. (2009). A real-time low-power stereo vision engine using semi-global matching. Computer Vision Systems, Springer.","DOI":"10.1007\/978-3-642-04667-4"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Banz, C., Hesselbarth, S., Flatt, H., Blume, H., and Pirsch, P. (2010, January 19\u201322). Real-time stereo vision system using semi-global matching disparity estimation: Architecture and FPGA-implementation. Proceedings of the 2010 International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation, Samos, Greece.","DOI":"10.1109\/ICSAMOS.2010.5642077"},{"key":"ref_41","unstructured":"(2019, November 26). 2019 IEEE GRSS Data Fusion Contest. Available online: http:\/\/www.grss-ieee.org\/community\/technical-committees\/data-fusion."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/7\/1069\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:11:50Z","timestamp":1760173910000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/7\/1069"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,26]]},"references-count":41,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2020,4]]}},"alternative-id":["rs12071069"],"URL":"https:\/\/doi.org\/10.3390\/rs12071069","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2020,3,26]]}}}