{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,27]],"date-time":"2025-11-27T06:36:41Z","timestamp":1764225401123,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2017,11,21]],"date-time":"2017-11-21T00:00:00Z","timestamp":1511222400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001711","name":"Schweizerischer Nationalfonds zur F\u00f6rderung der Wissenschaftlichen Forschung","doi-asserted-by":"publisher","award":["200021_162998"],"award-info":[{"award-number":["200021_162998"]}],"id":[{"id":"10.13039\/501100001711","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Hyperspectral sensors capture a portion of the visible and near-infrared spectrum with many narrow spectral bands. This makes it possible to better discriminate objects based on their reflectance spectra and to derive more detailed object properties. For technical reasons, the high spectral resolution comes at the cost of lower spatial resolution. To mitigate that problem, one may combine such images with conventional multispectral images of higher spatial, but lower spectral resolution. The process of fusing the two types of imagery into a product with both high spatial and spectral resolution is called hyperspectral super-resolution. We propose a method that performs hyperspectral super-resolution by jointly unmixing the two input images into pure reflectance spectra of the observed materials, along with the associated mixing coefficients. Joint super-resolution and unmixing is solved by a coupled matrix factorization, taking into account several useful physical constraints. The formulation also includes adaptive spatial regularization to exploit local geometric information from the multispectral image. Moreover, we estimate the relative spatial and spectral responses of the two sensors from the data. That information is required for the super-resolution, but often at most approximately known for real-world images. In experiments with five public datasets, we show that the proposed approach delivers up to 15% improved hyperspectral super-resolution.<\/jats:p>","DOI":"10.3390\/rs9111196","type":"journal-article","created":{"date-parts":[[2017,11,21]],"date-time":"2017-11-21T11:23:20Z","timestamp":1511263400000},"page":"1196","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":38,"title":["Hyperspectral Super-Resolution with Spectral Unmixing Constraints"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1189-9026","authenticated-orcid":false,"given":"Charis","family":"Lanaras","sequence":"first","affiliation":[{"name":"Photogrammetry and Remote Sensing, ETH Zurich, 8093 Zurich, Switzerland"}]},{"given":"Emmanuel","family":"Baltsavias","sequence":"additional","affiliation":[{"name":"Photogrammetry and Remote Sensing, ETH Zurich, 8093 Zurich, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3172-9246","authenticated-orcid":false,"given":"Konrad","family":"Schindler","sequence":"additional","affiliation":[{"name":"Photogrammetry and Remote Sensing, ETH Zurich, 8093 Zurich, Switzerland"}]}],"member":"1968","published-online":{"date-parts":[[2017,11,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Varshney, P.K., and Arora, M.K. (2004). Advanced Image Processing Techniques for Remotely Sensed Hyperspectral Data, Springer.","DOI":"10.1007\/978-3-662-05605-9"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1109\/MGRS.2016.2637824","article-title":"Hyperspectral and Multispectral Data Fusion: A comparative review of the recent literature","volume":"5","author":"Yokoya","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1109\/79.974727","article-title":"Spectral unmixing","volume":"19","author":"Keshava","year":"2002","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_4","first-page":"3924","article-title":"Improved methods for spectral calibration of on-orbit imaging spectrometers","volume":"48","author":"Wang","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Lanaras, C., Baltsavias, E., and Schindler, K. (2015, January 11\u201318). Hyperspectral Super-Resolution by Coupled Spectral Unmixing. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.409"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1391","DOI":"10.1109\/TGRS.2005.846874","article-title":"A comparative analysis of image fusion methods","volume":"43","author":"Wang","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1109\/MGRS.2015.2440094","article-title":"Hyperspectral Pansharpening: A Review","volume":"3","author":"Loncan","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kawakami, R., Wright, J., Tai, Y.W., Matsushita, Y., Ben-Ezra, M., and Ikeuchi, K. (2011, January 20\u201325). High-resolution hyperspectral imaging via matrix factorization. Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995457"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1693","DOI":"10.1109\/TGRS.2013.2253612","article-title":"Spatial and spectral image fusion using sparse matrix factorization","volume":"52","author":"Huang","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Akhtar, N., Shafait, F., and Mian, A. (2014, January 6\u201312). Sparse Spatio-spectral Representation for Hyperspectral Image Super-Resolution. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1109\/CVPR.2015.7298986"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3373","DOI":"10.1109\/TGRS.2014.2375320","article-title":"A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization","volume":"53","author":"Simoes","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1109\/TGRS.2011.2161320","article-title":"Coupled nonnegative matrix factorization unmixing for hyperspectral and multispectral data fusion","volume":"50","author":"Yokoya","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wycoff, E., Chan, T.H., Jia, K., Ma, W.K., and Ma, Y. (2013, January 26\u201331). A non-negative sparse promoting algorithm for high resolution hyperspectral imaging. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, BC, Canada.","DOI":"10.1109\/ICASSP.2013.6637883"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1109\/TIP.2015.2496263","article-title":"Hyperspectral super-resolution of locally low rank images from complementary multisource data","volume":"25","author":"Veganzones","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1174","DOI":"10.1109\/TIP.2004.829779","article-title":"MAP estimation for hyperspectral image resolution enhancement using an auxiliary sensor","volume":"13","author":"Hardie","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1117","DOI":"10.1109\/JSTSP.2015.2407855","article-title":"Bayesian fusion of multi-band images","volume":"9","author":"Wei","year":"2015","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"4109","DOI":"10.1109\/TIP.2015.2458572","article-title":"Fast fusion of multi-band images based on solving a Sylvester equation","volume":"24","author":"Wei","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1632","DOI":"10.1109\/LSP.2016.2608858","article-title":"R-FUSE: Robust Fast Fusion of Multiband Images Based on Solving a Sylvester Equation","volume":"23","author":"Wei","year":"2016","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1022","DOI":"10.1109\/LGRS.2017.2692958","article-title":"Hyperspectral Image Superresolution Based on Double Regularization Unmixing","volume":"14","author":"Zou","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"7236","DOI":"10.1109\/TGRS.2016.2598784","article-title":"Multiband Image Fusion Based on Spectral Unmixing","volume":"54","author":"Wei","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Akhtar, N., Shafait, F., and Mian, A. (2015, January 7\u201312). Bayesian Sparse Representation for Hyperspectral Image Super Resolution. Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298986"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1109\/JSTARS.2012.2208449","article-title":"Cross-Calibration for Data Fusion of EO-1\/Hyperion and Terra\/ASTER","volume":"6","author":"Yokoya","year":"2013","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1109\/JSTARS.2012.2194696","article-title":"Hyperspectral unmixing overview: Geometrical, statistical, and sparse regression-based approaches","volume":"5","author":"Plaza","year":"2012","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1007\/s10107-013-0701-9","article-title":"Proximal alternating linearized minimization for nonconvex and nonsmooth problems","volume":"146","author":"Bolte","year":"2014","journal-title":"Math. Programm."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1007\/s10107-015-0946-6","article-title":"Fast projection onto the simplex and the l1 ball","volume":"158","author":"Condat","year":"2016","journal-title":"Math. Programm."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Bioucas-Dias, J.M. (2009, January 26\u201328). A variable splitting augmented Lagrangian approach to linear spectral unmixing. Proceedings of the Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS), Grenoble, France.","DOI":"10.1109\/WHISPERS.2009.5289072"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2435","DOI":"10.1109\/TGRS.2008.918089","article-title":"Hyperspectral subspace identification","volume":"46","author":"Nascimento","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Boyd, S., and Vandenberghe, L. (2004). Convex Optimization, Cambridge University Press.","DOI":"10.1017\/CBO9780511804441"},{"key":"ref_29","unstructured":"Lanaras, C., Baltsavias, E., and Schindler, K. (2016, January 17\u201321). Estimating the relative spatial and spectral sensor response for hyperspectral and multispectral image fusion. Proceedings of the Asian Conference on Remote Sensing (ACRS), Colombo, Sri Lanka."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"10286","DOI":"10.3390\/rs61110286","article-title":"Landsat-8 operational land imager design, characterization and performance","volume":"6","author":"Knight","year":"2014","journal-title":"Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.rse.2014.11.014","article-title":"Advanced radiometry measurements and Earth science applications with the Airborne Prism Experiment (APEX)","volume":"158","author":"Schaepman","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_32","first-page":"451","article-title":"Advances in Hyperspectral and Multispectral Image Fusion and Spectral Unmixing","volume":"XL-3\/W3","author":"Lanaras","year":"2015","journal-title":"ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_33","unstructured":"Yasuma, F., Mitsunaga, T., Iso, D., and Nayar, S. (2008). Generalized Assorted Pixel Camera: Post-Capture Control of Resolution, Dynamic Range and Spectrum, Department of Computer Science, Columbia University. Technical Report."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Chakrabarti, A., and Zickler, T. (2011, January 20\u201325). Statistics of Real-World Hyperspectral Images. Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995660"},{"key":"ref_35","unstructured":"Wald, L. (2000, January 26\u201328). Quality of high resolution synthesised images: Is there a simple criterion?. Proceedings of the International Conference on Fusion of Earth Data, Sophia Antipolis, France."},{"key":"ref_36","unstructured":"Yuhas, R.H., Goetz, A.F., and Boardman, J.W. (1992, January 1\u20135). Discrimination among semi-arid landscape endmembers using the spectral angle mapper (SAM) algorithm. Proceedings of the Summaries of the Third Annual JPL Airborne Geoscience Workshop, Pasadena, CA, USA."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"662","DOI":"10.1109\/LGRS.2009.2022650","article-title":"Hypercomplex quality assessment of multi\/hyperspectral images","volume":"6","author":"Garzelli","year":"2009","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1109\/LGRS.2013.2247562","article-title":"Noise reduction in hyperspectral images through spectral unmixing","volume":"11","author":"Cerra","year":"2014","journal-title":"IEEE Geosci. Remote Sens. Lett."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/9\/11\/1196\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:50:39Z","timestamp":1760208639000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/9\/11\/1196"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,11,21]]},"references-count":38,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2017,11]]}},"alternative-id":["rs9111196"],"URL":"https:\/\/doi.org\/10.3390\/rs9111196","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2017,11,21]]}}}