{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T16:45:24Z","timestamp":1776357924557,"version":"3.51.2"},"reference-count":31,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2020,12,3]],"date-time":"2020-12-03T00:00:00Z","timestamp":1606953600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100005825","name":"National Institute of Food and Agriculture","doi-asserted-by":"publisher","award":["2020-67021-32461"],"award-info":[{"award-number":["2020-67021-32461"]}],"id":[{"id":"10.13039\/100005825","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The use of deep neural networks (DNNs) in plant phenotyping has recently received considerable attention. By using DNNs, valuable insights into plant traits can be readily achieved. While these networks have made considerable advances in plant phenotyping, the results are processed too slowly to allow for real-time decision-making. Therefore, being able to perform plant phenotyping computations in real-time has become a critical part of precision agriculture and agricultural informatics. In this work, we utilize state-of-the-art object detection networks to accurately detect, count, and localize plant leaves in real-time. Our work includes the creation of an annotated dataset of Arabidopsis plants captured using Cannon Rebel XS camera. These images and annotations have been complied and made publicly available. This dataset is then fed into a Tiny-YOLOv3 network for training. The Tiny-YOLOv3 network is then able to converge and accurately perform real-time localization and counting of the leaves. We also create a simple robotics platform based on an Android phone and iRobot create2 to demonstrate the real-time capabilities of the network in the greenhouse. Additionally, a performance comparison is conducted between Tiny-YOLOv3 and Faster R-CNN. Unlike Tiny-YOLOv3, which is a single network that does localization and identification in a single pass, the Faster R-CNN network requires two steps to do localization and identification. While with Tiny-YOLOv3, inference time, F1 Score, and false positive rate (FPR) are improved compared to Faster R-CNN, other measures such as difference in count (DiC) and AP are worsened. Specifically, for our implementation of Tiny-YOLOv3, the inference time is under 0.01 s, the F1 Score is over 0.94, and the FPR is around 24%. Last, transfer learning using Tiny-YOLOv3 to detect larger leaves on a model trained only on smaller leaves is implemented. The main contributions of the paper are in creating dataset (shared with the research community), as well as the trained Tiny-YOLOv3 network for leaf localization and counting.<\/jats:p>","DOI":"10.3390\/s20236896","type":"journal-article","created":{"date-parts":[[2020,12,3]],"date-time":"2020-12-03T11:15:43Z","timestamp":1606994143000},"page":"6896","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":73,"title":["Real-Time Plant Leaf Counting Using Deep Object Detection Networks"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3853-1152","authenticated-orcid":false,"given":"Michael","family":"Buzzy","sequence":"first","affiliation":[{"name":"School of Electrical &amp; Computer Engineering, University of Georgia, Athens, GA 30602, USA"}]},{"given":"Vaishnavi","family":"Thesma","sequence":"additional","affiliation":[{"name":"School of Electrical &amp; Computer Engineering, University of Georgia, Athens, GA 30602, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0403-9722","authenticated-orcid":false,"given":"Mohammadreza","family":"Davoodi","sequence":"additional","affiliation":[{"name":"School of Electrical &amp; Computer Engineering, University of Georgia, Athens, GA 30602, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8546-221X","authenticated-orcid":false,"given":"Javad","family":"Mohammadpour Velni","sequence":"additional","affiliation":[{"name":"School of Electrical &amp; Computer Engineering, University of Georgia, Athens, GA 30602, USA"}]}],"member":"1968","published-online":{"date-parts":[[2020,12,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1498","DOI":"10.1109\/TRO.2016.2603528","article-title":"Sensor planning for a symbiotic UAV and UGV system for precision agriculture","volume":"32","author":"Tokekar","year":"2016","journal-title":"IEEE Trans. Rob."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"S4","DOI":"10.1115\/1.2018-JUN-4","article-title":"Coverage control with multiple ground robots for precision agriculture","volume":"140","author":"Davoodi","year":"2018","journal-title":"Mech. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.pbi.2015.02.006","article-title":"Lights, camera, action: High-throughput plant phenotyping is ready for a close-up","volume":"24","author":"Fahlgren","year":"2015","journal-title":"Curr. Opin. Plant Biol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1169","DOI":"10.1093\/jxb\/50.336.1169","article-title":"The modular character of growth in Nicotiana tabacum plants under steady-state nutrition","volume":"50","author":"Walter","year":"1999","journal-title":"J. Exp. Bot."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1111\/j.1399-3054.1995.tb00836.x","article-title":"The effect of daylength on the transition to flowering in phytochrome-deficient, late-flowering and double mutants of Arabidopsis thaliana","volume":"95","author":"Koornneef","year":"1995","journal-title":"Physiol. Plant."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1109\/MSP.2015.2405111","article-title":"Image Analysis: The New Bottleneck in Plant Phenotyping","volume":"32","author":"Minervini","year":"2015","journal-title":"IEEE Signal Process Mag."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Dobrescu, A., Valerio Giuffrida, M., and Tsaftaris, S.A. (2017, January 22\u201329). Leveraging multiple datasets for deep leaf counting. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1101\/185173"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Giuffrida, M.V., Minervini, M., and Tsaftaris, S.A. (2015, January 7\u201310). Learning to count leaves in rosette plants. Proceedings of the Computer Vision Problems in Plant Phenotyping (CVPPP) Workshop, Swansea, UK.","DOI":"10.5244\/C.29.CVPPP.1"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1007\/s00138-015-0737-3","article-title":"Leaf segmentation in plant phenotyping: A collation study","volume":"27","author":"Scharr","year":"2016","journal-title":"Mach. Vis. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1190","DOI":"10.3389\/fpls.2017.01190","article-title":"Deep plant phenomics: A deep learning platform for complex plant phenotyping tasks","volume":"8","author":"Ubbens","year":"2017","journal-title":"Front. Plant Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"880","DOI":"10.1111\/tpj.14064","article-title":"Pheno-Deep Counter: A unified and versatile deep learning architecture for leaf counting","volume":"96","author":"Giuffrida","year":"2018","journal-title":"Plant J."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_14","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015). Faster R-CNN: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems, The MIT Press."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ren, M., and Zemel, R.S. (2016). End-to-End Instance Segmentation and Counting with Recurrent Attention. arXiv.","DOI":"10.1109\/CVPR.2017.39"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.patrec.2015.10.013","article-title":"Finely-grained annotated datasets for image-based plant phenotyping","volume":"81","author":"Minervini","year":"2016","journal-title":"Pattern Recognit. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Xu, L., Li, Y., Sun, Y., Song, L., and Jin, S. (2018, January 5\u20138). Leaf Instance Segmentation and Counting Based on Deep Object Detection and Segmentation Networks. Proceedings of the 2018 Joint 10th International Conference on Soft Computing and Intelligent Systems (SCIS) and 19th International Symposium on Advanced Intelligent Systems (ISIS), Toyama, Japan.","DOI":"10.1109\/SCIS-ISIS.2018.00038"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kuznichov, D., Zvirin, A., Honen, Y., and Kimmel, R. (2019, January 16\u201320). Data Augmentation for Leaf Segmentation and Counting Tasks in Rosette Plants. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA.","DOI":"10.1109\/CVPRW.2019.00314"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"611","DOI":"10.3389\/fpls.2019.00611","article-title":"Single-shot convolution neural networks for real-time fruit detection within the tree","volume":"10","author":"Bresilla","year":"2019","journal-title":"Front. Plant Sci."},{"key":"ref_20","unstructured":"Vishal, M.K., Tamboli, D., Patil, A., Saluja, R., Banerjee, B., Sethi, A., Raju, D., Kumar, S., Sahoo, R., and Chinnusamy, V. (2020). Image-based phenotyping of diverse Rice (Oryza Sativa L.) Genotypes. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13007-020-00570-z","article-title":"Deep convolutional neural networks for image-based Convolvulus sepium detection in sugar beet fields","volume":"16","author":"Gao","year":"2020","journal-title":"Plant Methods"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1107","DOI":"10.1007\/s11119-019-09642-0","article-title":"Deep learning for real-time fruit detection and orchard fruit load estimation: Benchmarking of MangoYOLO","volume":"20","author":"Koirala","year":"2019","journal-title":"Precis. Agric."},{"key":"ref_23","unstructured":"Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.ijleo.2019.02.038","article-title":"An improved tiny-yolov3 pedestrian detection algorithm","volume":"183","author":"Yi","year":"2019","journal-title":"Optik"},{"key":"ref_25","unstructured":"Redmon, J. (2019, December 01). Darknet: Open Source Neural Networks in C. Available online: http:\/\/pjreddie.com\/darknet\/."},{"key":"ref_26","unstructured":"(2019, December 01). iRobot Create2. Available online: https:\/\/www.irobot.com\/."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1926","DOI":"10.1126\/science.8316832","article-title":"Arabidopsis thaliana DNA methylation mutants","volume":"260","author":"Vongs","year":"1993","journal-title":"Science"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Valerio Giuffrida, M., Dobrescu, A., Doerner, P., and Tsaftaris, S.A. (2019, January 16\u201320). Leaf Counting Without Annotations Using Adversarial Unsupervised Domain Adaptation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA.","DOI":"10.1109\/CVPRW.2019.00315"},{"key":"ref_29","unstructured":"Sattar, A., and Kang, B.H. (2006). Beyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation. AI 2006: Advances in Artificial Intelligence, Springer."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/23\/6896\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:40:49Z","timestamp":1760179249000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/23\/6896"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,3]]},"references-count":31,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["s20236896"],"URL":"https:\/\/doi.org\/10.3390\/s20236896","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,3]]}}}