Journal of Textile Research ›› 2025, Vol. 46 ›› Issue (05): 243-251.doi: 10.13475/j.fzxb.20240404501

• Machinery & Equipment • Previous Articles     Next Articles

Design of machine vision-based system for detecting appearance defects in glass fiber yarn clusters

LI Jiguo1, JING Junfeng1(), CHENG Wei2, WANG Yongbo3, LIU Wei1   

  1. 1. School of Electronics and Information, Xi'an Polytechnic University, Xi'an, Shaanxi 710048, China
    2. Xi'an Huode Image Technology Co., Ltd., Xi'an, Shaanxi 710048, China
    3. School of Textile Science and Engineering, Xi'an Polytechnic University, Xi'an, Shaanxi 710048, China
  • Received:2024-04-07 Revised:2024-08-05 Online:2025-05-15 Published:2025-06-18
  • Contact: JING Junfeng E-mail:413066458@qq.com

Abstract:

Objective Glass fiber is widely used in transportation, shipbuilding, aerospace, construction, wind power, national defense equipment, leisure sports and other fields, and is stored in the form of glass fiber yarn clusters in the production and transportation process, so the quality monitoring of glass fiber yarn clusters is particularly important. However, conventional manual detection has disadvantages such as low efficiency, high missing detection, and long lag time. Therefore, a machine vision-based appearance defect detection system for glass fiber yarn was proposed and designed to meet the demand of the production line.
Method Based on the combination of conventional image algorithm and deep learning algorithm, firstly, the conventional method is adopted to preprocess the image, and the RGB and HSV color space channels are adopted to identify the model label of the glass fiber yarn clusters, and secondly, the suspected defective glass fiber yarn clusters image is transmitted to the improved MobileNetV2 deep learning model for defect judgment. Finally, a complete set of software and hardware system for the detection of appearance defects of glass fiber yarn clusters was designed, and the system used Siemens S7-200 PLC as the hardware controller to complete the automatic transmission and sorting of glass fiber yarn clusters in the process of detection.
Results The image data collected in the industrial field is used as a dataset sample, and the resolution of the upper end face image is 1 942 pixel×1 942 pixel, and the bottom end image resolution is 3 500 pixel×3 500 pixel. 3 000 normal samples, 25 847 defective samples, 1 000 images of red, yellow and blue varieties were selected for verification by the variety classification algorithm. In order to ensure that no detections are missed in the preclassification task, the parameter threshold is set as low as possible during the algorithm design, so that all images of suspected defects continue to be input to the subsequent deep learning model for further review. In the variety classification task, the recognition accuracy of each species reached 99%. In the follow-up defect review task, ResNet, AlexNet, VGG16 and MobileNetV2 models were experimented, respectively, and the overall classification accuracy reached about 95%, of which the classification accuracy of ResNet50 reached 96.12%, which was 0.62% higher than that of MobileNetV2, but its training time and model parameters were much larger than those of MobileNetV2. MobileNetV2 achieves a classification accuracy of 97.37%, which is 1.87% higher than the original model, proving the effectiveness of the improvement. On the whole, the proposed detection algorithm meets the requirements of the appearance defect detection system of glass fiber yarn clusters.
Conclusion A software and hardware system for the detection of appearance defects of glass fiber yarn clusters based on machine vision is proposed and designed. The conveyor mechanism controlled by the Siemens S7-200 PLC can be freely and conveniently embedded in the actual production line, and the multi-angle camera is adopted to collect the appearance image of the glass fiber yarn clusters during the conveying process. According to the requirements of production inspection, effective pretreatment, variety classification and defect detection algorithms were designed. The influence of the reflection effect of the plastic packaging on the surface of the glass fiber yarn clusters on the image feature extraction is solved, the image preprocessing method is designed to effectively reduce the computation amount of the system, and the proposed SA-MobileNetV2 lightweight deep learning model can meet the needs of the actual production line to detect and sort one glass fiber yarn clusters per 5 s on average. The system is simple to operate and has complete data, which helps enterprises to improve production processes and monitor product quality, and has broad engineering application value.

Key words: machine vision, glass fiber yarn, defect detection, image processing, elastic algorithm service framework

CLC Number: 

  • TP23

Fig.1

Glass fiber yarn clusters appearance defect detection system"

Fig.2

Images of glass fiber yarn clusters and main defects. (a) Image of glass fiber yarn clusters; (b) Misalignment defects; (c) Foreign matter defects; (d) Stain defects"

Fig.3

Surface image (a) and weighted average gray level (b) of glass fiber yarn clusters"

Fig.4

Histogram modification. (a) Original image; (b) Histogram equalization; (c) Multiplication processing"

Fig.5

Images of glass fiber yarn coil. (a) Upper plane; (b) Bottom plane"

Fig.6

Block diagram of regional positioning and segmentation process"

Fig.7

Color recognition and classification of label paper plates"

Fig.8

Process flow of initial detection method"

Fig.9

Network structure. (a) Bottleneck layer structure; (b) SA-MobileNetV2 structure; (c) Each Cardinal structure"

Fig.10

Layout of home screen"

Tab.1

Statistics of experimental datasets 张"

正常数量 异常类别数量 不同品种数量
错丝 异物 污渍
3 000 3 893 3 303 18 651 1 000 1 000 1 000

Fig.11

Confusion matrix between defect pre-detection and variety classification algorithm. (a) Traditional method of pre-detection; (b) Assortment"

Tab.2

Comparison between SA-MobileNetV2 and mainstream classification networks"

对比模型 错丝Top1 异物Top1 污渍Top1 平均准确率/% 参数量×103 FP32模型大小/MB 分辨率/(帧·s-1)
ResNet-18[16] 95.83 91.52 98.04 95.12 11.7 44.6 484
ResNet-50[16] 96.85 93.55 97.98 96.12 25.6 97.8 298
AlexNet[17] 93.59 88.45 98.17 93.38 61.0 223.0 472
VGG16[18] 94.71 91.53 97.01 94.41 138.0 528.0 230
MobileNetV2[14] 95.05 92.91 98.56 95.50 3.4 13.6 579
SA-MobileNetV2 97.43 95.87 98.74 97.37 4.8 19.2 496
[1] 蔡洁, 王亮, 傅宏俊, 等. 玻璃纤维/碳纤维织物基复合材料的电磁屏蔽性能[J]. 纺织学报, 2023, 44(2): 111-117.
CAI Jie, WANG Liang, FU Hongjun, et al. Electromagnetic shielding properties of glass fiber/carbon fiber fabric matrix composites[J]. Journal of Textile Research, 2023, 44(2): 111-117.
[2] 吴雄, 蔡炜, 李健, 等. 电力纤维增强复合材料应用进展[J]. 复合材料科学与工程, 2021(11): 116-128.
doi: 10.19936/j.cnki.2096-8000.20211128.018
WU Xiong, CAI Wei, LI Jian, et al. Application progress of power fiber reinforced composites[J]. Composites Science and Engineering, 2021(11): 116-128.
doi: 10.19936/j.cnki.2096-8000.20211128.018
[3] 朱耀麟, 穆婉婉, 王进美, 等. 基于改进B-CNN模型的羊绒与羊毛纤维识别[J]. 西安工程大学学报, 2021, 35(6): 46-53.
ZHU Yaolin, MU Wanwan, WANG Jinmei, et al. Identification of cashmere and wool fibers based on improved B-CNN model[J]. Journal of Xi'an Polytechnic University, 2021, 35(6): 46-53.
[4] 纪越, 潘东, 马杰东, 等. 基于机器视觉的弦振动纱线张力非接触检测系统[J]. 纺织学报, 2023, 44(5): 198-204.
JI Yue, PAN Dong, MA Jiedong, et al. Non-contact testing system for string vibration yarn tension based on machine vision[J]. Journal of Textile Research, 2023, 44(5): 198-204.
[5] 李新荣, 韩鹏辉, 李瑞芬, 等. 数字孪生在纺纱领域应用的关键技术解析[J]. 纺织学报, 2023, 44(10): 214-222.
doi: 10.13475/j.fzxb.20220509002
LI Xinrong, HAN Penghui, LI Ruifen, et al. Analysis of key technologies for the application of digital twin in the field of spinning[J]. Journal of Textile Research, 2023, 44(10): 214-222.
doi: 10.13475/j.fzxb.20220509002
[6] 蔡兆信, 李瑞新, 戴逸丹, 等. 基于Faster RCNN的布匹瑕疵识别系统[J]. 计算机系统应用, 2021, 30(2): 83-88.
CAI Zhaoxin, LI Ruixin, DAI Yidan, et al. Fabric defect recognition system based on Faster RCNN[J]. Applications of Computer Systems, 2021, 30(2): 83-88.
[7] 王斌, 李敏, 雷承霖, 等. 基于深度学习的织物疵点检测研究进展[J]. 纺织学报, 2023, 44(1): 219-227.
WANG Bin, LI Min, LEI Chenglin, et al. Research progress on fabric defect detection based on deep learning[J]. Journal of Textile Research, 2023, 44(1): 219-227.
[8] 黄汉林, 景军锋, 张缓缓, 等. 基于MF-SSD网络的织物疵点检测[J]. 棉纺织技术, 2020, 48(12): 11-16.
HUANG Hanlin, JING Junfeng, ZHANG Huanhuan, et al. Fabric defect detection based on MF-SSD network[J]. Cotton Textile Technology, 2020, 48(12): 11-16.
[9] 高敏, 邹阳林, 曹新旺. 基于改进YOLOv5模型的织物疵点检测[J]. 现代纺织技术, 2023, 31(4): 155-163.
GAO Min, ZOU Yanglin, CAO Xinwang. Fabric defect detection based on improved YOLOv5 model[J]. Advanced Textile Technology, 2023, 31(4): 155-163.
[10] 陈金广, 李雪, 邵景峰, 等. 改进YOLOv5网络的轻量级服装目标检测方法[J]. 纺织学报, 2022, 43(10): 155-160.
doi: 10.13475/j.fzxb.20210809306
CHEN Jinguang, LI Xue, SHAO Jingfeng, et al. Improved lightweight clothing object detection method for YOLOv5 network[J]. Journal of Textile Research, 2022, 43(10): 155-160.
doi: 10.13475/j.fzxb.20210809306
[11] FUJINOKI K, ASHIZAWA K. Directional lifting wavelet transform for image edge analysis[J]. Signal Processing, 2024. DOI: 10.1016/j.sigpro.2023.109188.
[12] MURSHED M G S, MURPHY C, HOU D, et al. Machine learning at the network edge: a survey[J]. ACM Computing Surveys (CSUR), 2021, 54(8): 1-37.
[13] HUANG M, LIU Y, YANG Y. Edge detection of ore and rock on the surface of explosion pile based on improved Canny operator[J]. Alexandria Engineering Journal, 2022, 61(12): 10769-10777.
[14] KARADAL C H, KAYA M C, TUNCER T, et al. Automated classification of remote sensing images using multileveled MobileNetV2 and DWT techniques[J]. Expert Systems with Applications, 2021. DOI:10.1016/j.eswa.2021.115659.
[15] ZHANG H, WU C, ZHANG Z, et al. Resnest: split-attention networks[C]// Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. New orleans: IEEE. 2022: 2736-2746.
[16] HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]// Proceedings of the IEEE conference on computer vision and pattern recognition. las vegas: IEEE. 2016: 770-778.
[17] KRIZHEVSKY A, SUSTKEVER I, HINTON G E. ImageNet classification with deep convolutional neural networks[J]. Communications of the ACM, 2017, 60(6): 84-90.
[18] SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recogn-ition[J]. ArXiv. 2014. DOI: 10.48550/arXiv:1409.1556,2014.
[1] GU Mengshang, ZHANG Ning, PAN Ruru, GAO Weidong. Object detection of weaving fabric defects using frequency-domain convolution modules [J]. Journal of Textile Research, 2025, 46(05): 159-168.
[2] MA Yunjiao, WANG Lei, PAN Ruru. Three-dimensional simulation of yarn core based on two planer mirrors [J]. Journal of Textile Research, 2025, 46(02): 86-91.
[3] REN Ke, ZHOU Hengshu, WEI Jinyu, YAN Wenjun, ZUO Yanwen. Dynamic aesthetic evaluation of pleated skirts based on machine vision technology [J]. Journal of Textile Research, 2024, 45(12): 189-198.
[4] LIU Yanping, GUO Peiyao, WU Ying. Research progress in deep learning technology for fabric defect detection [J]. Journal of Textile Research, 2024, 45(12): 234-242.
[5] REN Jiawei, ZHOU Qihong, CHEN Chang, HONG Wei, CEN Junhao. Detection method of position and posture of cheese yarn based on machine vision [J]. Journal of Textile Research, 2024, 45(11): 207-214.
[6] LI Yang, ZHANG Yongchao, PENG Laihu, HU Xudong, YUAN Yanhong. Fabric defect detection based on improved cross-scene Beetle global search algorithm [J]. Journal of Textile Research, 2024, 45(10): 89-94.
[7] JIANG Jing, PENG Laihu, SHI Weimin, YUAN Haowei. Non-contact yarn tension measurement based on singular value decomposition algorithm [J]. Journal of Textile Research, 2024, 45(09): 204-211.
[8] ZHOU Qihong, CHEN Chang, REN Jiawei, HONG Wei, CEN Junhao. Tie-positioning method based on improved convex hull defect algorithm [J]. Journal of Textile Research, 2024, 45(09): 212-219.
[9] CHEN Yufan, ZHENG Xiaohu, XU Xiuliang, LIU Bing. Machine vision-based defect detection method for sewing stitch traces [J]. Journal of Textile Research, 2024, 45(07): 173-180.
[10] ZHU Lingyun, WANG Chenyu, ZHAO Yueying. Detection of fabric surface defects based on multi-metric-multi-model image voting [J]. Journal of Textile Research, 2024, 45(06): 89-97.
[11] WEN Jiaqi, LI Xinrong, FENG Wenqian, LI Hansen. Rapid extraction of edge contours of printed fabrics [J]. Journal of Textile Research, 2024, 45(05): 165-173.
[12] TUO Wu, DU Cong, CHEN Qian, WU Chao, WEI Xinqiao, ZHANG Xinru, LIU Siyu. Clothing pattern contour extraction based on computer vision and Canny algorithm [J]. Journal of Textile Research, 2024, 45(05): 174-182.
[13] YANG Jinpeng, JING Junfeng, LI Jiguo, WANG Yuanbo. Design of defect detection system for glass fiber plied yarn based on machine vision [J]. Journal of Textile Research, 2024, 45(05): 193-201.
[14] WANG Zhenhua, ZHANG Zhouqiang, ZAN Jie, LIU Jianghao. Fabric defects detection algorithm based on multi-scale Laws texture energy and low-rank decomposition [J]. Journal of Textile Research, 2024, 45(04): 96-104.
[15] BAI Enlong, ZHANG Zhouqiang, GUO Zhongchao, ZAN Jie. Cotton color detection method based on machine vision [J]. Journal of Textile Research, 2024, 45(03): 36-43.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!