{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,12]],"date-time":"2026-04-12T19:48:46Z","timestamp":1776023326818,"version":"3.50.1"},"reference-count":56,"publisher":"Wiley","issue":"5","license":[{"start":{"date-parts":[[2025,1,12]],"date-time":"2025-01-12T00:00:00Z","timestamp":1736640000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Journal of Field Robotics"],"published-print":{"date-parts":[[2025,8]]},"abstract":"<jats:title>ABSTRACT<\/jats:title><jats:p>Downy mildew (<jats:italic>Plasmopara<\/jats:italic>), apple scab (<jats:italic>Venturia inaequalis<\/jats:italic>), and <jats:italic>Alternaria<\/jats:italic> leaf blight are endemic diseases that affect crops worldwide. The diseases can cause severe losses in grapes, apples and carrots when not detected and treated in an early stage. The European Union Horizon 2020 OPTIMA project aimed to improve disease detection in the open field with an automated detection system as part of an integrated pest management (IPM) system. In this research, we investigated the automated detection of downy mildew in grape, apple scab in apple and <jats:italic>Alternaria<\/jats:italic> leaf blight in carrot, using a deep convolutional neural network (CNN) on RGB color images. Detections from the CNN served as input to a Decision Support System (DSS), to precisely locate and quantify the disease, so that appropriate and timely application of plant protection products could be recommended. The focus of our study was on a smart camera implementation with integrated deep\u2010learning processing in real\u2010field conditions. The question was whether the deep learning model, when trained on images of disease symptoms recorded in conditioned circumstances, can also perform on images of disease symptoms recorded in field conditions. This type of evaluation is called open\u2010set evaluation, and so far it has received little attention in plant disease detection research. Therefore, the goal of our research was to evaluate the performance of a deep learning model in an open\u2010set evaluation scenario in commercial vineyards, orchards, and open fields. The model's performance in the open\u2010set scenario was compared to its performance in the closed\u2010set scenario, which involved evaluating the trained model on images similar to those used for model training. Our results showed that the model's performance in the closed\u2010set scenario with <jats:italic>F<\/jats:italic>1 scores of 66.3% (downy mildew), 45.1% (apple scab), and 42.1% (<jats:italic>Alternaria<\/jats:italic>) was notably better than in the open\u2010set scenario, with <jats:italic>F<\/jats:italic>1 scores of 34.8% (downy mildew), 5.5% (apple scab) and 4.2% (<jats:italic>Alternaria<\/jats:italic>). Uniform Manifold Approximation and Projection (UMAP) analysis proved the significant difference between the open\u2010set and closed\u2010set data sets. Our result should encourage other researchers to carry out similar open\u2010set evaluations to get realistic impressions of their model's performance under field conditions. A subset of our image data set has been made publicly available at <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/doi.org\/10.5281\/zenodo.6778647\">https:\/\/doi.org\/10.5281\/zenodo.6778647<\/jats:ext-link>.<\/jats:p>","DOI":"10.1002\/rob.22510","type":"journal-article","created":{"date-parts":[[2025,1,12]],"date-time":"2025-01-12T11:33:52Z","timestamp":1736681632000},"page":"2062-2075","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["A Smart Camera With Integrated Deep Learning Processing for Disease Detection in Open Field Crops of Grape, Apple, and Carrot"],"prefix":"10.1002","volume":"42","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4896-4776","authenticated-orcid":false,"given":"Gerrit","family":"Polder","sequence":"first","affiliation":[{"name":"Wageningen Plant Research Wageningen University &amp; Research Wageningen The Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9535-5354","authenticated-orcid":false,"given":"Pieter M.","family":"Blok","sequence":"additional","affiliation":[{"name":"Wageningen Plant Research Wageningen University &amp; Research Wageningen The Netherlands"}]},{"given":"Tim","family":"van Daalen","sequence":"additional","affiliation":[{"name":"Wageningen Plant Research Wageningen University &amp; Research Wageningen The Netherlands"}]},{"given":"Joseph","family":"Peller","sequence":"additional","affiliation":[{"name":"Wageningen Plant Research Wageningen University &amp; Research Wageningen The Netherlands"}]},{"given":"Nikos","family":"Mylonas","sequence":"additional","affiliation":[{"name":"Agricultural Engineering Agricultural University of Athens Athens Greece"}]}],"member":"311","published-online":{"date-parts":[[2025,1,12]]},"reference":[{"key":"e_1_2_10_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-13-2414-7_11"},{"key":"e_1_2_10_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.atech.2022.100083"},{"key":"e_1_2_10_4_1","first-page":"79","volume-title":"Datenbanksysteme \u00fcr Business, Technologie und Web (BTW 2017)\u2014Workshopband","author":"Amara J.","year":"2017"},{"key":"e_1_2_10_5_1","doi-asserted-by":"publisher","DOI":"10.17660\/ActaHortic.2020.1279.33"},{"key":"e_1_2_10_6_1","doi-asserted-by":"crossref","unstructured":"Ash G.2000. \u201cDowny Mildew of Grape.\u201dPlant Health Instructor.https:\/\/doi.org\/10.1094\/PHI-I-2000-1112-01.","DOI":"10.1094\/PHI-I-2000-1112-01"},{"key":"e_1_2_10_7_1","doi-asserted-by":"publisher","DOI":"10.3390\/app11146422"},{"key":"e_1_2_10_8_1","first-page":"42","volume-title":"Conference Proceedings 12th EFITA\u2010HAICTA\u2010WCCA Congress","author":"Balafoutis A.","year":"2019"},{"key":"e_1_2_10_9_1","doi-asserted-by":"publisher","DOI":"10.3390\/agriculture11070617"},{"key":"e_1_2_10_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compag.2022.106917"},{"key":"e_1_2_10_11_1","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2010.0390"},{"key":"e_1_2_10_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11119-022-09941-z"},{"issue":"5","key":"e_1_2_10_13_1","first-page":"4230","article-title":"Automated Diagnosis and Cataloguing of Foliar Disease in Apple Trees Using Ensemble of Deep Neural Networks","volume":"7","author":"Darshan S. V.","year":"2020","journal-title":"International Research Journal of Engineering and Technology"},{"key":"e_1_2_10_14_1","doi-asserted-by":"publisher","DOI":"10.3390\/s21144749"},{"key":"e_1_2_10_15_1","unstructured":"FiftyOne.2023.Using Image Embeddings.https:\/\/docs.voxel51.com\/tutorials\/image_embeddings.html."},{"key":"e_1_2_10_16_1","doi-asserted-by":"crossref","unstructured":"Garcia J. andA.Barbedo.2013.Digital Image Processing Techniques for Detecting Quantifying and Classifying Plant Diseases Vol 2.http:\/\/www.springerplus.com\/content\/2\/1\/660.","DOI":"10.1186\/2193-1801-2-660"},{"key":"e_1_2_10_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cropro.2022.105921"},{"key":"e_1_2_10_18_1","unstructured":"Hughes D. P. andM.Salathe.2015.An Open Access Repository of Images on Plant Health to Enable the Development of Mobile Disease Diagnostics."},{"key":"e_1_2_10_19_1","unstructured":"Jocher G.2020.https:\/\/github.com\/ultralytics\/yolov5."},{"key":"e_1_2_10_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compag.2018.02.016"},{"key":"e_1_2_10_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-020-09244-3"},{"key":"e_1_2_10_22_1","doi-asserted-by":"publisher","DOI":"10.15159\/AR.21.045"},{"key":"e_1_2_10_23_1","doi-asserted-by":"crossref","unstructured":"Kole D. K. A.Ghosh andS.Mitra.2014. \u201cDetection of Downy Mildew Disease Present in the Grape Leaves Based on Fuzzy Set Theory.\u201d In Smart Innovation Systems and Technologies.https:\/\/doi.org\/10.1007\/978-3-319-07353-8_44.","DOI":"10.1007\/978-3-319-07353-8_44"},{"key":"e_1_2_10_24_1","doi-asserted-by":"publisher","DOI":"10.1094\/PDIS-05-15-0574-FE"},{"key":"e_1_2_10_25_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature14539"},{"key":"e_1_2_10_26_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpls.2022.820146"},{"key":"e_1_2_10_27_1","doi-asserted-by":"crossref","unstructured":"Lin T.\u2010Y. M.Maire S. J.Belongie et al.2014.Microsoft COCO: Common Objects in Context. arXiv:1405.0312.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"e_1_2_10_28_1","doi-asserted-by":"publisher","DOI":"10.1094\/Phyto-73-520"},{"key":"e_1_2_10_29_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpls.2020.01082"},{"key":"e_1_2_10_30_1","doi-asserted-by":"publisher","DOI":"10.3390\/sym10010011"},{"key":"e_1_2_10_31_1","doi-asserted-by":"publisher","DOI":"10.1146\/phyto.2018.56.issue-1"},{"key":"e_1_2_10_32_1","unstructured":"McInnes L. J.Healy andJ.Melville.2020.Umap: Uniform Manifold Approximation and Projection for Dimension Reduction."},{"key":"e_1_2_10_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s43154-020-00004-7"},{"key":"e_1_2_10_34_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpls.2016.01419"},{"key":"e_1_2_10_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.envpol.2018.10.113"},{"key":"e_1_2_10_36_1","unstructured":"Noyan M. A.2022.Uncovering Bias in the Plantvillage Dataset.https:\/\/doi.org\/10.48550\/arXiv.2206.04374."},{"key":"e_1_2_10_37_1","volume-title":"Crop Production and Crop Protection","author":"Oerke E.\u2010C.","year":"1994"},{"key":"e_1_2_10_38_1","unstructured":"Oren B.\u2010K. E.Clark andd. N.Ingy.2021.https:\/\/yaml.org."},{"key":"e_1_2_10_39_1","unstructured":"Peller J. A. G.Polder P. M.Blok andI.Malounas.2021. \u201cDetecting Spectral Signals in Imaging for Disease Detection in Apple and Grape.\u201d InProceedings of the European Conference on Agricultural Engineering AgEng 2021 edited byJ. C.Barbosa L. L.Silva P.Louren\u00e7o A.Sousa J. R.Silva V. F.Cruz andF.Baptista European Conference on Agricultural Engineering AgEng 2021 EurAgEng Cranfield 63\u201369."},{"key":"e_1_2_10_40_1","unstructured":"Polder G. P. M.Blok J. T.vanDaalen J. A.Peller andN.Mylonas.2021. \u201cEarly Disease Detection in Apple and Grape Using Deep Learning on a Smart\u2010Camera.\u201d InProceedings of the European Conference on Agricultural Engineering AgEng 2021 edited byJ. C.Barbosa L. L.Silva P.Louren\u00e7o A.Sousa J. R.Silva V. F.Cruz andF.Baptista European Conference on Agricultural Engineering AgEng 2021 EurAgEng Cranfield 51\u201356."},{"key":"e_1_2_10_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/s41348-022-00660-1"},{"key":"e_1_2_10_42_1","doi-asserted-by":"crossref","unstructured":"Redmon J. S. K.Divvala R. B.Girshick andA.Farhadi.2015. \u201cYou Only Look Once: Unified Real\u2010Time Object Detection.\u201dCoRR abs\/1506.02640.arXiv:1506.02640.","DOI":"10.1109\/CVPR.2016.91"},{"key":"e_1_2_10_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSP.2016.7878133"},{"key":"e_1_2_10_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tplants.2015.10.015"},{"key":"e_1_2_10_45_1","doi-asserted-by":"publisher","DOI":"10.32604\/cmc.2022.021875"},{"key":"e_1_2_10_46_1","article-title":"A Comparative Analysis on Plant Pathology Classification Using Deep Learning Architecture \u2010 Resnet and vgg19","author":"Subetha T.","year":"2021","journal-title":"Materials Today: Proceedings"},{"key":"e_1_2_10_47_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364918770733"},{"key":"e_1_2_10_48_1","doi-asserted-by":"publisher","DOI":"10.1002\/aps3.v8.9"},{"key":"e_1_2_10_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compag.2018.03.032"},{"key":"e_1_2_10_50_1","unstructured":"Tzutalin D.2020.https:\/\/github.com\/tzutalin\/labelImg."},{"key":"e_1_2_10_51_1","unstructured":"United Nations.2015.Population 2030 Demographic Challenges and Opportunities for Sustainable Development Planning.https:\/\/www.un.org\/en\/development\/desa\/population\/publications\/pdf\/trends\/Population2030.pdf."},{"key":"e_1_2_10_52_1","doi-asserted-by":"publisher","DOI":"10.1094\/PHI-I-2000-1005-01"},{"key":"e_1_2_10_53_1","doi-asserted-by":"crossref","unstructured":"Waghmare H. R.Kokare andY.Dandawate.2016. \u201cDetection and Classification of Diseases of Grape Plant Using Opposite Colour Local Binary Pattern Feature and Machine Learning for Automated Decision Support System.\u201d In3rd International Conference on Signal Processing and Integrated Networks. SPIN.https:\/\/doi.org\/10.1109\/SPIN.2016.7566749.","DOI":"10.1109\/SPIN.2016.7566749"},{"key":"e_1_2_10_54_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11356-012-1114-7"},{"key":"e_1_2_10_55_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20123535"},{"key":"e_1_2_10_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-018-7092-0"},{"key":"e_1_2_10_57_1","doi-asserted-by":"publisher","DOI":"10.1002\/ps.6792"}],"container-title":["Journal of Field Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/rob.22510","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,23]],"date-time":"2025-07-23T06:50:38Z","timestamp":1753253438000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/rob.22510"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,12]]},"references-count":56,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,8]]}},"alternative-id":["10.1002\/rob.22510"],"URL":"https:\/\/doi.org\/10.1002\/rob.22510","archive":["Portico"],"relation":{},"ISSN":["1556-4959","1556-4967"],"issn-type":[{"value":"1556-4959","type":"print"},{"value":"1556-4967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,12]]},"assertion":[{"value":"2022-08-30","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-12-12","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-01-12","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}