{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T02:19:08Z","timestamp":1772417948560,"version":"3.50.1"},"reference-count":47,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2022,10,13]],"date-time":"2022-10-13T00:00:00Z","timestamp":1665619200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Natural Science Foundation of China","award":["34361303093"],"award-info":[{"award-number":["34361303093"]}]},{"name":"Natural Science Foundation of China","award":["61402278"],"award-info":[{"award-number":["61402278"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>A color transfer algorithm between images based on two-stage convolutional neural network (CNN) is proposed. The first stage network is based on VGG19 architecture as the backbone. The reference image-based color transfer (RICT) model was used to extract the features of the reference image and the target image, so as to realize the color transfer between them. The second stage is based on progressive convolutional neural network (PCNN) as its backbone. The palette-based emotional color enhancement (PECE) model is adopted to enhance the emotional coloring of the resulting image by comparing the palette, emotional value and the proportion of each color of the reference image. Through five sets of experiments, it is proved that the visual effect processed by our model is obviously better than several main colorization methods in both subjective evaluation and objective data. It can be applied to various complex scenes, and in the near future, it can also be better applied to the fields of digital restoration of old image archives, medical image coloring, art restoration, remote sensing image enhancement, infrared image enhancement and other fields.<\/jats:p>","DOI":"10.3390\/s22207779","type":"journal-article","created":{"date-parts":[[2022,10,14]],"date-time":"2022-10-14T01:44:13Z","timestamp":1665711853000},"page":"7779","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Color Transfer Algorithm between Images Based on a Two-Stage Convolutional Neural Network"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3876-6821","authenticated-orcid":false,"given":"Min","family":"Xu","sequence":"first","affiliation":[{"name":"Shanghai Film Academy, Shanghai University, Shanghai 200072, China"}]},{"given":"Youdong","family":"Ding","sequence":"additional","affiliation":[{"name":"Shanghai Film Academy, Shanghai University, Shanghai 200072, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/38.946629","article-title":"Color Transfer between Images","volume":"21","author":"Reinhard","year":"2001","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Li, C., and Wand, M. (2016, January 27\u201330). Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.272"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Gatys, L.A., Ecker, A.S., and Bethge, M. (2016, January 27\u201330). Image Style Transfer Using Convolutional Neural Networks. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.265"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1145\/2897824.2925974","article-title":"Let there be color!: Joint end-to-end learning of global and local image priors for automatic image colorization with simultaneous classification","volume":"35","author":"Iizuka","year":"2016","journal-title":"ACM Trans. Graph."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Larsson, G., Maire, M., and Shakhnarovich, G. (2016). Learning Representations for Automatic Colorization. Lecture Notes in Computer Science: European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46493-0_35"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Zhang, R., Isola, P., and Efros, A.A. (2016). Colorful Image Colorization. Lecture Notes in Computer Science: European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46487-9_40"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1145\/1015706.1015780","article-title":"Colorization using optimization","volume":"23","author":"Levin","year":"2004","journal-title":"ACM Trans. Graph."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1145\/3272127.3275090","article-title":"Two-stage sketch colorization","volume":"37","author":"Zhang","year":"2018","journal-title":"ACM Trans. Graph."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1145\/566654.566576","article-title":"Transferring color to greyscale images","volume":"21","author":"Welsh","year":"2002","journal-title":"ACM Trans. Graph."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1109\/TIP.2006.888347","article-title":"Example-Based Color Transformation of Image and Video Using Basic Color Categories","volume":"16","author":"Chang","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"ref_11","unstructured":"Gupta, R., Chia, A., Rajan, D., Ng, E., and Huang, Z. (November, January 29). Image colorization using similar images. Proceedings of the ACM Multimedia Conference, Nara, Japan."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Morimoto, Y., Taguchi, Y., and Naemura, T. (2009, January 3\u20137). Automatic colorization of grayscale images using multiple images on the web. Proceedings of the Siggraph: Talks, New Orleans, LA, USA.","DOI":"10.1145\/1597990.1598049"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2070781.2024190","article-title":"Semantic colorization with internet images","volume":"30","author":"Chia","year":"2011","journal-title":"ACM Trans. Graph."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"5188","DOI":"10.1109\/TIP.2017.2732239","article-title":"Example-Based Image Colorization Using Locality Consistent Sparse Representation","volume":"26","author":"Li","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Vondrick, C., Shrivastava, A., Fathi, A., Guadarrama, S., and Murphy, K. (2018, January 8\u201314). Tracking Emerges by Colorizing Videos. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01261-8_24"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1016\/j.neucom.2017.05.083","article-title":"Example-based Image Colorization via Automatic Feature Selection and Fusion","volume":"266","author":"Li","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1145\/3197517.3201365","article-title":"Deep exemplar-based colorization","volume":"37","author":"He","year":"2018","journal-title":"ACM Trans. Graph."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1111\/cgf.13659","article-title":"Example-Based Colourization Via Dense Encoding Pyramids","volume":"39","author":"Xiao","year":"2020","journal-title":"Comput. Graph. Forum"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2931","DOI":"10.1109\/TVCG.2019.2908363","article-title":"A Superpixel-based Variational Model for Image Colorization","volume":"26","author":"Fang","year":"2019","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4606","DOI":"10.1109\/TIP.2019.2912291","article-title":"Automatic Example-based Image Colourisation using Location-Aware Cross-Scale Matching","volume":"28","author":"Li","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1109\/TIP.2013.2288929","article-title":"Variational Exemplar-Based Image Colorization","volume":"23","author":"Bugeau","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_22","unstructured":"Johnson, J. (2022, August 17). Neural-Style. Available online: https:\/\/github.com\/jcjohnson\/neural-style."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2766978","article-title":"Palette-based Photo Recoloring","volume":"34","author":"Chang","year":"2015","journal-title":"ACM Trans. Graph."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Furusawa, C., Hiroshiba, K., Ogaki, K., and Odagiri, Y. (2017, January 27\u201330). Comicolorization: Semi-Automatic Manga Colorization. Proceedings of the SIGGRAPH Asia 2017 Technical Briefs, Bangkok, Thailand.","DOI":"10.1145\/3145749.3149430"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Chen, J., Shen, Y., Gao, J., Liu, J., and Liu, X. (2018, January 18\u201323). Language-based image editing with recurrent attentive models. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00909"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Bahng, H., Yoo, S., Cho, W., Keetae Park, D., Wu, Z., Ma, X., and Choo, J. (2018, January 8\u201314). Coloring with words: Guiding image colorization through text-based palette generation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01258-8_27"},{"key":"ref_27","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_28","unstructured":"Fu, H., Ma, H., and Wu, S. (2012, January 11\u201315). Night Removal by Color Estimation and Sparse Representation. Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), Tsukuba, Japan."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"You, Q., Luo, J., Jin, H., and Yang, J. (2015, January 25\u201330). Robust Image Sentiment Analysis Using Progressively Trained and Domain Transferred Deep Networks. Proceedings of the National Conference on Artificial Intelligence, Austin, TX, USA.","DOI":"10.1609\/aaai.v29i1.9179"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Machajdik, J., and Hanbury, A. (2010, January 25\u201329). Affective image classification using features inspired by psychology and art theory. Proceedings of the ACM Multimedia, Firenze, Italy.","DOI":"10.1145\/1873951.1873965"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Yang, J., Sun, M., and Sun, X. (2017, January 4\u20139). Learning Visual Sentiment Distributions via Augmented Conditional Probability Neural Network. Proceedings of the AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.10485"},{"key":"ref_32","first-page":"54","article-title":"An image retrieval algorithm based on HSV color segment histograms","volume":"26","year":"2009","journal-title":"Mech. Electr. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1465","DOI":"10.1109\/TIP.2011.2175739","article-title":"Rotation-Invariant Image and Video Description With Local Binary Pattern Features","volume":"21","author":"Zhao","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_34","first-page":"322","article-title":"Histogram of Oriented Gradients (HoG)","volume":"64","author":"Yamasaki","year":"2010","journal-title":"J. Inst. Image Inf. Telev. Eng."},{"key":"ref_35","first-page":"43","article-title":"An improved adaboost algorithm based on new Haar-like feature for face detection","volume":"2","year":"2014","journal-title":"J. Shandong Univ. (Eng. Sci.)"},{"key":"ref_36","unstructured":"Ebied, H.M. (2012, January 14\u201316). Feature extraction using PCA and Kernel-PCA for face recognition. Proceedings of the 2012 8th International Conference on Informatics and Systems (INFOS), Giza, Egypt."},{"key":"ref_37","unstructured":"(2008). Exhaustive Search. Encyclopedia of Genetics, Genomics, Proteomics and Informatics, Springer."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"465612","DOI":"10.1155\/2010\/465612","article-title":"Polarimetric SAR Image Classification Using Multifeatures Combination and Extremely Randomized Clustering Forests","volume":"2010","author":"Zou","year":"2010","journal-title":"EURASIP J. Adv. Signal Process."},{"key":"ref_39","unstructured":"Hussein, F., Kharma, N., and Ward, R. (2001, January 13). Genetic algorithms for feature selection and weighting, a review and study. Proceedings of the International Conference on Document Analysis & Recognition, Seattle, WA, USA."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1145\/1015706.1015720","article-title":"GrabCut: Interactive Foreground Extraction Using Iterated Graph Cuts","volume":"23","author":"Rother","year":"2004","journal-title":"ACM Trans. Graph."},{"key":"ref_41","first-page":"67","article-title":"Color Quantization Using Fast K-means Clustering","volume":"97","author":"Kasuga","year":"1998","journal-title":"ICE Tech. Rep. Image Eng."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Yendrikhovskij, S.N., Blommaert, F.J.J., and De Ridder, H. (1998, January 17\u201320). Optimizing color reproduction of natural images. Proceedings of the Color and Imaging Conference, Scottsdale, AZ, USA.","DOI":"10.2352\/CIC.1998.6.1.art00029"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"800","DOI":"10.1049\/el:20080522","article-title":"Scope of validity of PSNR in image\/video quality assessment","volume":"44","author":"Ghanbari","year":"2008","journal-title":"Electron. Lett."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image Quality Assessment: From Error Visibility to Structural Similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Zerman, E., Rana, A., and Smolic, A. (2019, January 22\u201325). ColorNet: Estimating Colorfulness in Natural Images. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.","DOI":"10.1109\/ICIP.2019.8803407"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"D\u2019Orazio, T., Mazzeo, P.L., and Spagnolo, P. (September, January 30). Color Brightness Transfer Function evaluation for non overlapping multi camera tracking. Proceedings of the 2009 Third ACM\/IEEE International Conference on Distributed Smart Cameras (ICDSC), Como, Italy.","DOI":"10.1109\/ICDSC.2009.5289365"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2129","DOI":"10.1007\/s00371-020-01921-6","article-title":"Deep Color Transfer using Histogram Analogy","volume":"36","author":"Lee","year":"2020","journal-title":"Vis. Comput."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/20\/7779\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:53:29Z","timestamp":1760144009000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/20\/7779"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,13]]},"references-count":47,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["s22207779"],"URL":"https:\/\/doi.org\/10.3390\/s22207779","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,13]]}}}