纺织学报 ›› 2023, Vol. 44 ›› Issue (07): 86-94.doi: 10.13475/j.fzxb.20220406301

• 纺织工程 • 上一篇    下一篇

基于非线性扩散和多特征融合的提花针织物疵点检测

史伟民1, 简强1, 李建强2(), 汝欣1, 彭来湖1,2   

  1. 1.浙江理工大学 浙江省现代纺织装备技术重点实验室, 浙江 杭州 310018
    2.浙江理工大学龙港研究院有限公司, 浙江 温州 325802
  • 收稿日期:2022-04-19 修回日期:2022-10-21 出版日期:2023-07-15 发布日期:2023-08-10
  • 通讯作者: 李建强(1990—),男,博士。主要研究方向为机器视觉、机电一体化技术。E-mail:wzcnljq@126.com
  • 作者简介:史伟民(1965—),男,教授,博士。主要研究方向为纺织机械自动控制。
  • 基金资助:
    国家重点研发计划重点专项课题(2017YFB1304005);浙江省公益技术研究计划项目(LGG21E050024);浙江理工大学科研启动基金项目(18022224-Y);浙江省博士后科研项目特别资助项目(ZJ2020004)

Defect detection of jacquard knitted fabrics based on nonlinear diffusion and multi-feature fusion

SHI Weimin1, JIAN Qiang1, LI Jianqiang2(), RU Xin1, PENG Laihu1,2   

  1. 1. Key Laboratory of Modern Textile Machinery & Technology of Zhejiang Province, Zhejiang Sci-Tech University, Hangzhou, Zhejiang 310018, China
    2. Research Institute of Zhejiang Sci-Tech University in Longgang,Wenzhou, Zhejiang 325802, China
  • Received:2022-04-19 Revised:2022-10-21 Published:2023-07-15 Online:2023-08-10

摘要:

为解决提花针织物的复杂纹理在疵点检测过程中易造成检测干扰和疵点误判的问题,提出一种基于非线性扩散和多特征融合的疵点检测方法。采用改进PM模型对提花针织物的花纹和强纹理边缘进行抑制,首先利用梯度差异将疵点图像分为纹理区域及疵点区域,然后结合各区域特点选择对应的扩散方程,依据梯度矩阵计算概率子集、相关准则来确定梯度阈值,实现分区域扩散。根据提花针织物的纹理分布特性,提取改进局部二值算法(LBP)、局部熵、局部相关性等表征参数,然后进行去邻域归一化和多特征融合进一步突出疵点区域,最后利用区域生长法定位分割出疵点形态。实验验证了本文预处理方法及疵点检测方法的有效性,通过与其它预处理算法和疵点检测算法进行对比,结果表明本文算法的检测效果最好,对正常织物图像的误检率为3.3%,对含疵点织物图像检测的准确率为98.6%。

关键词: 提花针织物, PM模型, 扩散方程, 梯度阈值, 改进局部二值算法, 去邻域归一化, 多特征融合

Abstract:

Objective Supervision and inspection are important parts in quality control of the knitted fabric production process. The defect detection by automation and machine vision technology can effectively improve the detection efficiency. Jacquard knitted fabrics have prominent yarn edges, obvious loop characteristics and patterns, which have a strong interference to the defect detection process. Therefore, it is necessary to design an effective and accurate pretreatment and defect detection method for the complex texture of jacquard knitted fabrics.

Method Improved PM (perona-malik)model was adopted to suppress the strong texture edge of jacquard knitted fabric. Firstly, the image was divided into texture and defect region by gradient difference before selecting the corresponding diffusion equation. The gradient threshold was determined according to the probability subset calculated by the gradient matrix and the relevant criteria to achieve regional diffusion. According to the texture distribution characteristics, the improved local binary pattern(LBP), entropy and correlation were extracted, and then the defect regions were further highlighted by neighborhood normalization and multi-feature fusion. Finally, the defect morphology was located and segmented by region growth method.

Results The effectiveness of the preprocessing method and the defect detection method for texture suppression was experimental investigated and analyzed, and defect information extraction of jacquard knitted fabric was demonstrated exhaustively. In addition, several different preprocessing algorithms and defect detection algorithms were compared and demonstrated. Comparison of defect image before and after preprocessing showed that the gray fluctuation amplitude of the image after preprocessing was smaller and the texture distribution was more concentrated. It was seen from the pretreatment experimental images and from the comparison effect with other preprocessing algorithms that the abrupt change of the texture edge area was still obvious, and the yarn spacing area of the fabric was still obvious in the visual effect. However, the proposed preprocessing algorithm effectively suppressed the strong texture edges and yarn spacing of patterns, and the intensity of texture edge filtering was greater. At the same time, in order to prove the robustness of the preprocessing effect more intuitively, the background suppression factor BSF, structure similarity SSIM and signal-to-noise ratio gain ISNR were used for index evaluation (Tab. 1). From characteristic reconstruction diagrams and normalized characteristic diagrams, the texture features selected in this paper effectively described the gray difference and gray distribution difference between defects and textures. In addition, the normalization of the row mean value without neighborhood effectively weakened the eigenvalue of the texture region and increased the difference between the texture and the defect. The effect of different defect detection algorithms on the defect image of jacquard knitted fabric was showed that, the algorithm in docoment [3] may misjudge the fabrics with single pattern or similar patterns, while the fabrics with multiple patterns may be interfered by complex patterns, resulting in false detection. The algorithm adopted in docoment[4] was not able to rule out that the interference of yarn coil spacing, which lead to missed inspection and false inspection. The algorithm in this paper achieved the localization of the defect area and extracts a relatively complete defect shape contour. The comparison results of the detection accuracy of each detection algorithm for 100 experimental images were obtained (Tab. 2). The false detection rate of the algorithm was 3.3% for normal fabric images and 98.6% for defective fabric images, further illustrating the effectiveness of the algorithm.

Conclusion Aiming at the complex texture of jacquard knitted fabric, this paper proposed a defect detection algorithm based on nonlinear diffusion and multi-feature fusion. The improved nonlinear diffusion model was used as the pretreatment means, and the single diffusion mode of the conventional PM model was improved to the regional diffusion by selecting the best diffusion equation and gradient threshold. At the same time, multi-feature extraction and fusion were used as detection means to further highlight the defect area by using without neighborhood normalization and weighted fusion methods, and finally the defect shape was segmented by using region growth method. The experimental results show that the improved PM model effectively weakens the complex texture of jacquard knitted fabric and eliminates the interference caused by texture. Feature extraction method and normalization method increase the difference between texture and defect, and further highlight the defect. Compared with other detection methods, the detection accuracy of this paper is higher for jacquard knitted fabric defect image, and the defect region segmentation is more perfect and accurate.

Key words: jacquard knitted fabric, PM model, diffusion equation, gradient threshold, improved local binary pattern, removed neighborhood normalization, multi-feature fusion

中图分类号: 

  • TS181.9

图1

织物疵点检测流程"

图2

预处理前后疵点图像对比"

图3

归一化前的特征图"

图4

特征重构图和归一化后特征图"

图5

疵点定位分割示意图"

表1

3种算法实验评判指标"

算法 第①组疵点图像 第②组疵点图像 第③组疵点图像 第④组疵点图像
BSF SSIM ISNR BSF SSIM ISNR BSF SSIM ISNR BSF SSIM ISNR
文献[19] 1.41 0.49 1.13 1.62 0.59 1.27 1.56 0.46 1.37 1.80 0.26 2.79
文献20] 1.85 0.41 1.25 1.81 0.32 1.29 2.48 0.36 1.26 2.03 0.52 2.69
本文算法 2.23 0.19 1.40 1.98 0.28 1.55 3.00 0.16 1.48 2.15 0.21 2.97

图6

预处理实验效果图"

图7

疵点检测实验效果图"

表2

各算法对实验图像的检测准确性比较"

检测
方法
含疵点图像 不含疵点图像 综合
准确率/
%
正确
数目
错误
数目
准确
率/%
正确
数目
错误
数目
误检
率/%
文献[3] 32 38 45.7 16 14 46.7 48
文献[4] 36 34 51.4 25 5 16.7 61
文献[19]预处理+本文后续算法 53 17 75.7 12 18 60.0 65
文献[20]预处理+本文后续算法 51 19 72.9 10 20 66.7 61
本文算法 69 1 98.6 29 1 3.3 98
[1] SELVI S S T, NASIRA G M. An effective automatic fabric defect detection system using digital image processing[J]. J Environ Nanotechnol, 2017, 6(1): 79-85.
doi: 10.13074/jent
[2] NILESH T D, TANUJA K S. Fabric defect detection adopting combined GLCM, Gabor wavelet features and random decision forest[J]. 3D Research, 2019, 10(1): 1-13.
doi: 10.1007/s13319-018-0210-y
[3] CAO J J, ZHANG J, WEN Z, et al. Fabric defect inspection using prior knowledge guided least squares regression[J]. Multimedia Tools & Applications, 2017, 76(3): 4141-4157.
[4] TAJERIPOUR F, KABIR E, SHEIKHI A. Defect detection in patterned fabrics using modified local binary patterns[C]// International Conference on Conference on Computational Intelligence & Multimedia Applications. Sivakasi: IEEE, 2008: 261-267.
[5] BODNAROVA A, BENNAMOUN M, LATHAM S. Optimal Gabor filters for textile flaw detection[J]. Pattern Recognition, 2002(35): 2973-2991.
[6] 尉苗苗, 李岳阳, 蒋高明, 等. 应用最优Gabor滤波器的经编织物疵点检测[J]. 纺织学报, 2016, 37(11):48-54.
YU Miaomiao, LI Yueyang, JIANG Gaoming, et al. Warp knit fabric defect detection method based on optimal Gabor filter[J]. Journal of Textile Research, 2016, 37(11):48-54.
[7] JING Junfeng, ZHANG Huanhuan, WANG Jing, et al. Fabric defect detection using Gabor filters and defect classification based on LBP and Tamura method[J]. Journal of The Textile Institute, 2013, 104(1): 18-27.
doi: 10.1080/00405000.2012.692940
[8] 赵志勇. 基于深度学习的布匹缺陷识别与检测研究[D]. 武汉: 华中科技大学, 2019: 69.
ZHAO Zhiyong. Research on recognition and detection of textile defects based on deep learning[D]. Wuhan: Huazhong University of Science & Technology, 2019: 69.
[9] 王理顺, 钟勇. 基于深度学习的织物缺陷在线检测算法[J]. 计算机应用, 2019, 39(7): 2125-2128.
doi: 10.11772/j.issn.1001-9081.2019010110
WANG Lishun, ZHONG Yong. On-line fabric defect recognition algorithm based on deep learning[J]. Journal of Computer Applications, 2019, 39(7): 2125-2128.
doi: 10.11772/j.issn.1001-9081.2019010110
[10] HU Guanghua, HUANG Junfeng, WANG Qinghui, et al. Unsupervised fabric defect detection based on a deep convolutional generative adversarial network[J]. Textile Research Journal, 2019, 90(3/4): 247-270.
doi: 10.1177/0040517519862880
[11] PERONA P, MALIK J. Scale-space and edge detection using anisotropic diffusion[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1990, 12(7): 29-39.
[12] 宋新, 杨明琴, 张莉. 基于PM模型扩散系数改进的加速算法[J]. 网络安全技术与应用, 2016(4): 52-54.
SONG Xin, YANG Mingqin, ZHANG Li. Improved acceleration algorithm based on diffusion coefficient of PM model[J]. Network Security Technology & Application, 2016(4): 52-54.
[13] 蒋成龙, 赵曜, 张柘. 基于相关准则的稀疏微波成像方位向采样优化方法[J]. 电子与信息学报, 2015, 37(3): 580-586.
JIANG Chenglong, ZHAO Zhuo, ZHANG Tuo. Azimuth sampling optimization method for sparse microwave imaging based on correlation criterion[J]. Journal of Electronics & Information Technology, 2015, 37(3): 580-586.
[14] OJALA T, PIETIKAINEN M, MAENPAA T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(7): 971-987.
doi: 10.1109/TPAMI.2002.1017623
[15] OJALA T, PIETIKAINEN M, HARWOOD D. A comparative study of texture measures with classification based on featured distributions[J]. Pattern Recognition, 1996, 29(1): 51-59.
doi: 10.1016/0031-3203(95)00067-4
[16] 吴哲, 刘孝星, 郑力新, 等. 基于灰度共生矩阵特征图像的织物疵点检测方法[J]. 网络安全与数据治理, 2015, 34(21): 47-50.
WU Zhe, LIU Xiaoxing, ZHENG Lixin, et al. A fabric defect detection method based on gray level co-ocurrence matrix feature image[J]. Cyber security and Data Governance, 2015, 34 (21): 47-50.
[17] 李凡. 复杂背景抑制及弱小目标检测算法研究[D]. 西安: 西安电子科技大学, 2010: 26-28.
LI Fan. A study of algorithms for complex background suppression and small target detection[D]. Xi'an: Xidian University, 2010: 26-28.
[18] 史小雨. 基于结构相似度的遥感图像质量评价[D]. 西安: 西安科技大学, 2017: 21-25.
SHI Xiaoyu. Quality assessment of remote sensing image based on structural similarity[D]. Xi'an: Xi'an University of Science and Technology, 2017: 21-25.
[19] FENG Xiangfei, GUO Xiaoyu, HUANG Qinghua. Systematic evaluation on speckle suppression methods in examination of ultrasound breast images[J]. Applied Sciences, 2017.DOI:10.3390/app7010037.
doi: 10.3390/app7010037
[20] MATHIYALAGAN P, SUVITHA N. Image fusion using convolutional neural network with bilateral filtering[C]// International Conference on Computing, Communication and Networking Technologies. Bengaluru: IEEE, 2018: 1-11.
[1] 邢文宇, 邓娜, 辛斌杰, 于晨. 基于多特征融合图像分析技术的羊毛与羊绒鉴别[J]. 纺织学报, 2019, 40(03): 146-152.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!