Abstract
This paper presents an automatic inspection approach for Printed Circuit Boards (PCBs) with accurate determination of the fault location and identification of the fault type. This approach depends on several digital image processing techniques including registration, filtering, foreground segmentation, mathematical morphological operations, subtraction, feature extraction, and component matching. The Speeded Up Robust Feature extraction (SURF) technique is used for two purposes: registration of the PCB to be checked to a reference PCB and detection of feature points of each missing component on the PCB that is localized from the subtraction process from the reference PCB. Operation is performed on the hue component of the color PCB images. A dictionary is first built for all possible components on the available PCBs with SURF feature descriptors, and hence if a missing item is detected on a PCB during the inspection process, the SURF feature descriptors for features extracted from the difference between the tested and reference PCBs at the position of the lost component are matched with those in the built dictionary or database. A distance metric is used in the matching process. The importance of the proposed approach lies in its ability to build a dictionary of feature descriptors for all possible components in a diversity of PCBs and its ability to localize and identify the missing components regardless of the PCB position, rotation, or type. All operations are formulated in a Graphical User Interface (GUI) using MATLAB environment.
























Similar content being viewed by others
References
Alam F, Rahman SU, Ullah S, Gulati K (2018) Medical image registration in image guided surgery: issues, challenges and research opportunities. Biocybernetics and Biomedical Engineering 38:71–89
Al-Obaidy F, Yazdani F, Mohammadi FA (2017) Fault detection using thermal image based on soft computing methods: comparative study. Microelectron Reliab 71:56–64
Bay H, Ess A, Tuytelaars T, Gool LV (2011) Speeded-up robust features (SURF). Comput Vis Image Underst 110:346–359
Chauhan V, Surgenor B (2015) A comparative study of machine vision based methods for fault detection in an automated assembly machine. Procedia Manufacturing 1:416–428
Gonzalez RC, Woods RE (2002) Digital image processing, 2nd edn. Prentice Hall, Upper Saddle River
Harris C, Stephens M (1988) A combined corner and edge detector. In: Proceedings of the Alvey Vision Conference, p 147–151
Hu H, Liu Y, Liu M, Nie L (2016) Surface defect classification in large-scale strip steel image collection via hybrid chromosome genetic algorithm. Neurocomputing 181:86–95
Huang W, Wei P (2018) A PCB dataset for defects detection and classification. Journal of Latex Class files 14
Kumar Y, Sharan SN (2017) Automatic misalignment defects detection & correction in PCB using SURF (Speed up Robust Features) technique. International Journal of Engineering Research & Technology (IJERT), ISSN: 2278–0181 IJERTV6IS010166 Vol. 6
Liu M, Zhang L, Liu Y, Hu H, Fang W (2017) Recognizing semantic correlation in image-text weibo via feature space mapping. Comput Vis Image Underst 163:58–66
Maitre H (2008) Image processing. Wiley, London
Malik F, Baharudin B (2013) Analysis of distance metrics in content based image retrieval using statistical quantized histogram texture features in the DCT domain. Journal of King Saud University- Computer and Information Sciences 25:207–218
Muthugnanambika M, Padmavathi S (2017) Feature detection for color images using SURF. International Conference on Advanced Computing and Communication Systems, IEEE
Nayak JPR. et al (2017) Identification of PCB faults using image processing. International Conference on Electric, Electronic, Communication, Computer and Optimization technique, IEEE, p 742–745
Nerakae P, Uangpairoj P, Chamniprasart K (2016) Using machine vision for flexible automatic assembly system. Procedia Computer Science 96:428–435
Pedersen JT (2011) Study group SURF: feature detection and description. Department of Computer Science, Aarhus University, Q4
Putera SH, Ibrahim Z (2010) Printed Circuit Board Defect Detection Using Mathematical Morphology and MAT LAB Image Processing Tools. 2nd International Conference on Education Technology and Computer (ICETC), IEEE, p 359–363
Putera SH, Dzafaruddin SF, Mohamad M (2012) MATLAB Based Defect Detection and Classification of Printed Circuit Board. Universiti Teknoogi MARA, Shah Alam, Malaysia, IEEE, p 115–119
Raj R, Joseph N (2016) Keypoint extraction using SURF algorithm for CMFD. Procedia Computer Science 93:375–381
Soliman RF, El Banby Gh M., Algarni A D, Elsheikh M, Soliman NF, Amin M, Abd El-Samie FE (2018) Double random phase encoding for cancelable face and iris recognition. Appl Opt 57
Zhang F, Qiao N, Li J (2017) A PCB photoelectric image edge information detection method. Optik 144:642–646
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Hassanin, AA.I.M., Abd El-Samie, F.E. & El Banby, G.M. A real-time approach for automatic defect detection from PCBs based on SURF features and morphological operations. Multimed Tools Appl 78, 34437–34457 (2019). https://doi.org/10.1007/s11042-019-08097-9
Received:
Revised:
Accepted:
Published:
Version of record:
Issue date:
DOI: https://doi.org/10.1007/s11042-019-08097-9

