Herbal Plant Leaves Classification Using Convolutional Neural Network Models: A Literature Review

Alfharizky Fauzi, Emy Haryatmi, Tri Agus Riyadi, Murniyati Murniyati

Abstract


Plants are essential to human beings because plants are considered most as foods. Plants can be used for food ingredients, medical purposes, and industrial applications. People inspect plants using traditional methods, such as using the naked eye, which can be time-consuming and expensive. Therefore, the effectiveness and high quality of automated crop identification classification systems are needed for adequate crop protection. This study aims to identify and classify nine plant species using different datasets, focusing on transfer learning from models trained on plant leaf datasets. Most research has shown that increasing the dataset size would significantly improve classification accuracy. The accuracy of the first test using the modified N1 classification model was 99.45%. In the second experiment, the accuracy of the N2 model was 99.65%. The accuracy of the N3 model, despite being slightly less accurate than AlexNet, was 99.55%, and it performed better, while the accuracy of AlexNet was 99.73%. Compared to the AlexNet model, the proposed model performed better and required less training time. The N1 model reduced the training time by 34.58%, the N2 model by 18.25%, and the N3 model by 20.23%. The N1 and N3 resulted in the same size, namely 14.8MB, and the compactness was 92.67%. The size of the N2 model was 29.7MB, and the compactness was 85.29% compactness. The proposed models provide more accuracy and efficiency in classifying plant leaves and can be used as a standalone mobile application that benefits farmers.


Keywords


Plant Leaves, Classification, Detection, Transfer Learning, Convolutional Neural Network

Full Text:

PDF

References


Z.-Y. Gao, H.-X. Xie, J.-F. Li, and S.-L. Liu, "Spatial-Structure Siamese Network for Plant Identification," Intern J Pattern Recognit Artif Intell, vol. 32, no. 11, p. 1850035, Nov. 2018, doi: 10.1142/S0218001418500350.

S. Kaur, S. Pandey, and S. Goel, "Plants Disease Identification and Classification Through Leaf Images: A Survey," Archives of Computational Methods in Engineering, vol. 26, no. 2, pp. 507–530, Apr. 2019, doi: 10.1007/s11831-018-9255-6.

A. Rehman, S. Naz, M. I. Razzak, F. Akram, and M. Imran, "A Deep Learning-Based Framework for Automatic Brain Tumors Classification Using Transfer Learning," Circuits Syst Signal Process, vol. 39, no. 2, pp. 757–775, Feb. 2020, doi: 10.1007/s00034-019-01246-3.

S. G. Wu, F. S. Bao, E. Y. Xu, Y.-X. Wang, Y.-F. Chang, and Q.-L. Xiang, "A Leaf Recognition Algorithm for Plant Classification Using Probabilistic Neural Network," in 2019 IEEE International Symposium on Signal Processing and Information Technology, Giza, Egypt: IEEE, Dec. 2019, pp. 11–16. doi: 10.1109/ISSPIT.2007.4458016.

S. Tiwari, "A Comparative Study of Deep Learning Models With Handcraft Features and Non-Handcraft Features for Automatic Plant Species Identification," International Journal of Agricultural and Environmental Information Systems, vol. 11, no. 2, pp. 44–57, Apr. 2020, doi: 10.4018/IJAEIS.2020040104.

K. Yang, W. Zhong, and F. Li, "Leaf Segmentation and Classification with a Complicated Background Using Deep Learning," Agronomy, vol. 10, no. 11, p. 1721, Nov. 2020, doi: 10.3390/agronomy10111721.

C. A. Priya, T. Balasaravanan, and A. S. Thanamani, "An efficient leaf recognition algorithm for plant classification using support vector machine," in International Conference on Pattern Recognition, Informatics and Medical Engineering (PRIME-2012), Salem, Tamilnadu, India: IEEE, Mar. 2012, pp. 428–432. doi: 10.1109/ICPRIME.2012.6208384.

J. Du, C.-M. Zhai, and Q.-P. Wang, "Recognition of plant leaf image based on fractal dimension features," Neurocomputing, vol. 116, pp. 150–156, Sep. 2019, doi: 10.1016/j.neucom.2012.03.028.

V. Bodhwani, D. P. Acharjya, and U. Bodhwani, “Deep Residual Networks for Plant Identification,” Procedia Comput Sci, vol. 152, pp. 186–194, 2019, doi: 10.1016/j.procs.2019.05.042.

S. H. Lee, C. S. Chan, S. J. Mayo, and P. Remagnino, "How deep learning extracts and learns leaf features for plant classification," Pattern Recognit, vol. 71, pp. 1–13, Nov. 2017, doi: 10.1016/j.patcog.2017.05.015.

N. Kumar et al., "Leafsnap: A Computer Vision System for Automatic Plant Species Identification," in Computer Vision – ECCV 2018, vol. 7573, A. Fitzgibbon, S. Lazebnik, P. Perona, Y. Sato, and C. Schmid, Eds., Berlin, Heidelberg: Springer Berlin Heidelberg, 2018, pp. 502–516. doi: 10.1007/978-3-642-33709-3_36.

N. Duong-Trung, L.-D. Quach, and C.-N. Nguyen, "Learning Deep Transferability for Several Agricultural Classification Problems," International Journal of Advanced Computer Science and Applications, vol. 10, no. 1, 2019, doi: 10.14569/IJACSA.2019.0100107.

A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," Commun ACM, vol. 60, no. 6, pp. 84–90, May 2017, doi: 10.1145/3065386.

J. A. Villaruz, "Deep Convolutional Neural Network Feature Extraction for Berry Trees Classification," Journal of Advances in Information Technology, vol. 12, no. 3, 2021, doi: 10.12720/jait.12.3.226-233.

A. Voulodimos, N. Doulamis, A. Doulamis, and E. Protopapadakis, "Deep Learning for Computer Vision: A Brief Review," Comput Intell Neurosci, vol. 2018, pp. 1–13, 2018, doi: 10.1155/2018/7068349.

G. Wang, Y. Sun, and J. Wang, "Automatic Image-Based Plant Disease Severity Estimation Using Deep Learning," Comput Intell Neurosci, vol. 2017, pp. 1–8, 2017, doi: 10.1155/2017/2917536.

Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proceedings of the IEEE, vol. 86, no. 11, pp. 2278–2324, Nov. 2020, doi: 10.1109/5.726791.

C. Szegedy et al., "Going deeper with convolutions," in 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA: IEEE, Jun. 2018, pp. 1–9. doi: 10.1109/CVPR.2015.7298594.

K. He, X. Zhang, S. Ren, and J. Sun, "Deep Residual Learning for Image Recognition," in 2019 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA: IEEE, Jun. 2019, pp. 770–778. doi: 10.1109/CVPR.2016.90.

K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition," 2018, doi: 10.48550/ARXIV.1409.1556.

G. Huang, Z. Liu, L. van der Maaten, and K. Q. Weinberger, "Densely Connected Convolutional Networks," 2019, doi: 10.48550/ARXIV.1608.06993.

F. N. Iandola, S. Han, M. W. Moskewicz, K. Ashraf, W. J. Dally, and K. Keutzer, "SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size," 2019, doi: 10.48550/ARXIV.1602.07360.

S. P. Mohanty, D. P. Hughes, and M. Salathé, "Using Deep Learning for Image-Based Plant Disease Detection," Front Plant Sci, vol. 7, p. 1419, Sep. 2019, doi: 10.3389/fpls.2016.01419.

M. Dyrmann, H. Karstoft, and H. S. Midtiby, "Plant species classification using deep convolutional neural network," Biosyst Eng, vol. 151, pp. 72–80, Nov. 2018, doi: 10.1016/j.biosystemseng.2016.08.024.

P. Barré, B. C. Stöver, K. F. Müller, and V. Steinhage, "LeafNet: A computer vision system for automatic plant species identification," Ecol Inform, vol. 40, pp. 50–56, Jul. 2017, doi: 10.1016/j.ecoinf.2017.05.005.

F. Haque and S. Haque, "PLANT RECOGNITION SYSTEM USING LEAF SHAPE FEATURES AND MINIMUM EUCLIDEAN DISTANCE," ICTACT Journal on Image and Video Processing, vol. 9, no. 2, pp. 1919–1925, Nov. 2018, doi: 10.21917/ijivp.2018.0272.

Y. Zhu et al., "TA-CNN: Two-way attention models in deep convolutional neural network for plant recognition," Neurocomputing, vol. 365, pp. 191–200, Nov. 2019, doi: 10.1016/j.neucom.2019.07.016.

M. R. Dileep and P. N. Pournami, "AyurLeaf: A Deep Learning Approach for Classification of Medicinal Plants," in TENCON 2019 - 2019 IEEE Region 10 Conference (TENCON), Kochi, India: IEEE, Oct. 2019, pp. 321–325. doi: 10.1109/TENCON.2019.8929394.

J. Liu, S. Yang, Y. Cheng, and Z. Song, "Plant Leaf Classification Based on Deep Learning," in 2018 Chinese Automation Congress (CAC), Xi'an, China: IEEE, Nov. 2018, pp. 3165–3169. doi: 10.1109/CAC.2018.8623427.

P. F. B. Silva, A. R. S. Marçal, and R. M. A. da Silva, “Evaluation of Features for Leaf Discrimination,” 2018, pp. 197–204. doi: 10.1007/978-3-642-39094-4_23.

M. Brahimi, K. Boukhalfa, and A. Moussaoui, "Deep Learning for Tomato Diseases: Classification and Symptoms Visualization," Applied Artificial Intelligence, vol. 31, no. 4, pp. 299–315, Apr. 2017, doi: 10.1080/08839514.2017.1315516.

P. Bharali, C. Bhuyan, and A. Boruah, "Plant Disease Detection by Leaf Image Classification Using Convolutional Neural Network," in Information, Communication and Computing Technology, vol. 1025, A. Bin Gani, P. K. Das, L. Kharb, and D. Chahal, Eds., Singapore: Springer Singapore, 2019, pp. 194–205. doi: 10.1007/978-981-15-1384-8_16.

I. Ahmad, M. Hamid, S. Yousaf, S. T. Shah, and M. O. Ahmad, "Optimizing Pretrained Convolutional Neural Networks for Tomato Leaf Disease Detection," Complexity, vol. 2020, pp. 1–6, Sep. 2020, doi: 10.1155/2020/8812019.

A. T and J. S. M. Murugaiyan, "Identification of Tomato Leaf Disease Detection using Pretrained Deep Convolutional Neural Network Models," Scalable Computing: Practice and Experience, vol. 21, no. 4, pp. 625–635, Dec. 2020, doi: 10.12694/scpe.v21i4.1780.

A. Almadhor, H. T. Rauf, M. I. U. Lali, R. Damaševi?ius, B. Alouffi, and A. Alharbi, "AI-Driven Framework for Recognition of Guava Plant Diseases through Machine Learning from DSLR Camera Sensor Based High Resolution Imagery," Sensors, vol. 21, no. 11, p. 3830, Jun. 2021, doi: 10.3390/s21113830.

D. O. Oyewola, E. G. Dada, S. Misra, and R. Damaševi?ius, "Detecting cassava mosaic disease using a deep residual convolutional neural network with distinct block processing," PeerJ Comput Sci, vol. 7, p. e352, Mar. 2021, doi: 10.7717/peerj-cs.352.

O. O. Abayomi?Alli, R. Damaševi?ius, S. Misra, and R. Maskeli?nas, "Cassava disease recognition from low?quality images using enhanced data augmentation model and deep learning," Expert Syst, vol. 38, no. 7, Nov. 2021, doi: 10.1111/exsy.12746.

N. Kundu et al., "IoT and Interpretable Machine Learning Based Framework for Disease Prediction in Pearl Millet," Sensors, vol. 21, no. 16, p. 5386, Aug. 2021, doi: 10.3390/s21165386.

C. Shorten and T. M. Khoshgoftaar, "A survey on Image Data Augmentation for Deep Learning," J Big Data, vol. 6, no. 1, p. 60, Dec. 2019, doi: 10.1186/s40537-019-0197-0.

S. Cygert and A. Czyzewski, "Toward Robust Pedestrian Detection With Data Augmentation," IEEE Access, vol. 8, pp. 136674–136683, 2020, doi: 10.1109/ACCESS.2020.3011356.

M. Längkvist, J. Jendeberg, P. Thunberg, A. Loutfi, and M. Lidén, "Computer aided detection of ureteral stones in thin slice computed tomography volumes using Convolutional Neural Networks," Comput Biol Med, vol. 97, pp. 153–160, Jun. 2018, doi: 10.1016/j.compbiomed.2018.04.021.

S. Jaiswal and G. C. Nandi, "Robust real-time emotion detection system using CNN architecture," Neural Comput Appl, vol. 32, no. 15, pp. 11253–11262, Aug. 2020, doi: 10.1007/s00521-019-04564-4.

H. F. Nweke, Y. W. Teh, M. A. Al-garadi, and U. R. Alo, "Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges," Expert Syst Appl, vol. 105, pp. 233–261, Sep. 2019, doi: 10.1016/j.eswa.2018.03.056.

R. Moradi, R. Berangi, and B. Minaei, "A survey of regularization strategies for deep models," Artif Intell Rev, vol. 53, no. 6, pp. 3947–3986, Aug. 2020, doi: 10.1007/s10462-019-09784-7.

Srivastava, N. and Hinton, G. and Krizhevsky, A. and Sutskever, I. and Salakhutdinov, and Ruslan, "a simple way to prevent neural networks from overfitting," vol. 15, pp. 1929–1958, 2019, [Online]. Available: JMLR.

W.-S. Jeon and S.-Y. Rhee, "Plant Leaf Recognition Using a Convolution Neural Network," The International Journal of Fuzzy Logic and Intelligent Systems, vol. 17, no. 1, pp. 26–34, Mar. 2017, doi: 10.5391/IJFIS.2017.17.1.26.

A. Kaya, A. S. Keceli, C. Catal, H. Y. Yalic, H. Temucin, and B. Tekinerdogan, "Analysis of transfer learning for deep neural network based plant classification models," Comput Electron Agric, vol. 158, pp. 20–29, Mar. 2019, doi: 10.1016/j.compag.2019.01.041.

B. Wang and D. Wang, "Plant Leaves Classification: A Few-Shot Learning Method Based on Siamese Network," IEEE Access, vol. 7, pp. 151754–151763, 2019, doi: 10.1109/ACCESS.2019.2947510.

S. Anubha Pearline, V. Sathiesh Kumar, and S. Harini, "A study on plant recognition using conventional image processing and deep learning approaches," Journal of Intelligent & Fuzzy Systems, vol. 36, no. 3, pp. 1997–2004, Mar. 2019, doi: 10.3233/JIFS-169911.

A. N. Fountsop, J. L. Ebongue Kedieng Fendji, and M. Atemkeng, "Deep Learning Models Compression for Agricultural Plants," Applied Sciences, vol. 10, no. 19, p. 6866, Sep. 2020, doi: 10.3390/app10196866.

A. Fuentes, S. Yoon, S. Kim, and D. Park, "A Robust Deep-Learning-Based Detector for Real-Time Tomato Plant Diseases and Pests Recognition," Sensors, vol. 17, no. 9, p. 2022, Sep. 2017, doi: 10.3390/s17092022.

A. F. Fuentes, S. Yoon, J. Lee, and D. S. Park, "High-Performance Deep Neural Network-Based Tomato Plant Diseases and Pests Diagnosis System With Refinement Filter Bank," Front Plant Sci, vol. 9, p. 1162, Aug. 2018, doi: 10.3389/fpls.2018.01162.

B. De Agustina, E. Rubio, and M. Sebastián, "Surface Roughness Model Based on Force Sensors for the Prediction of the Tool Wear," Sensors, vol. 14, no. 4, pp. 6393–6408, Apr. 2018, doi: 10.3390/s140406393.




DOI: https://doi.org/10.52088/ijesty.v5i1.723

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


Copyright (c) 2025 Alfharizky Fauzi, Emy Haryatmi, Tri Agus Riyadi, Murniyati Murniyati

International Journal of Engineering, Science and Information Technology (IJESTY) eISSN 2775-2674