Journal of Textile Research ›› 2023, Vol. 44 ›› Issue (08): 63-72.doi: 10.13475/j.fzxb.20220107001

• Textile Engineering • Previous Articles     Next Articles

Online detection of yarn breakage based on visual feature enhancement and extraction

CHEN Taifang1, ZHOU Yaqin1(), WANG Junliang2, XU Chuqiao3, LI Dongwu1   

  1. 1. College of Mechanical Engineering, Donghua University, Shanghai 201620, China
    2. Institute of Artificial Intelligence,Donghua University, Shanghai 201620, China
    3. School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200030, China
  • Received:2022-01-28 Revised:2022-04-30 Online:2023-08-15 Published:2023-09-21

Abstract:

Objective The yarn breakage in ring spinning directly affects the production efficiency and product quality of the yarns. At present, the commonly used automatic yarn break detection mainly employs a single spindle detection method with photoelectricity or magnetoelectricity as the core, both requiring costly modification of the spinning machine and is difficult to implement. Therefore, this paper proposes a break detection method based on machine vision, which provides a new direction for achieving low-cost and high-precision break detection.

Method An online detection method for yarn breaks based on visual feature reinforcement extraction was proposed. For the problem of difficult yarn feature extraction due to yarn trailing, a neighborhood gradient reinforcement operator was designed for yarn clustering to achieve yarn feature reinforcement. To deal with the problem that yarn targets are small and easily disturbed by environment, an Otsu small target segmentation threshold search method inspired by valley bottom was designed to achieve the segmentation of yarn and background, to extract adaptively yarn features from the yarn image after feature reinforcement, and to enable broken end detection by Euler distance discriminant method.

Results Inspection devices were installed at a textile factory in Wuxi to collect data, with 1 000 captured images selected for analyze. The factory mainly produces pure cotton high count yarns, with 400 spindles per vehicle. To verify the superiority of the weak feature enhancement proposed in this research, the proposed algorithm was compared with Retinex, homomorphic filtering, and histogram averaging for enhancement experiments. The algorithm developed in this research enhanced the yarn features and effectively suppressed the background areas based on the gradient step characteristics of the yarn (Fig. 8 (e)). Choices of different weights for neighborhood gradient reinforcement operators had different effects on the separation of yarn features and background features. In order to select the optimal weight value, this research adopts the method of controlling variables and conducts experimental comparison on the center weight value between 2 and 3. It was found that the optimal selection range of weight values was between 2.4 and 2.7. Distinct image and dim image enhancement renderings under different weight show clear and blurred images, respectively.

To verify the effectiveness of the algorithm in extracting yarn features, Otsu, Otsu with added pixel proportion weight, and Otsu threshold segmentation method inspired by valley points were applied to the images. Using this algorithm, it was demonstrated that the proposed algorithm effectively extracted yarn features and a small number of background features at the same pixel level. It was also be demonstrated that the proposed algorithm was able to search effectively for valley thresholds and achieve yarn feature extraction.

To verify the effectiveness of the feature extraction algorithm, the processing effects and detection results of the Hough transform line extraction method, LSD line detection algorithm, Sobel, Robert and Otsu combined algorithm, Linknet algorithm, and this algorithm were compared(Fig. 13). The results obtained by this algorithm were best fitted to the original image (Fig. 13 (g)).

The experimental results showed that the detection rate of this method reached 97.3% and the processing efficiency reached 59.76 ms per frame, which was carried out by collecting 1 000 spinning pictures of a spinning factory. It was evident that this method was able to effectively detect yarn breakage in real-time.

Conclusion The algorithm reported in this paper decomposes the acquisition of yarn features into two parts: reinforcement and extraction, solving the problems of yarn feature dispersion, low proportion of yarn features, and susceptibility to background noise interference in visual ring spinning breakage detection in dynamic environments. Experiments have shown that the algorithm proposed in this article can meet the real-time and accuracy requirements for factory inspection.

The algorithm currently has difficulty to identify linear noise and yarn features, as the linear filter only considers its morphological features and does not combine its color and morphology. Neural networks can solve problem effectively. In the future, the standard of industrial real-time performance can be achieved by streamlining network models and improving hardware configuration. It is necessary to study how to combine the characteristics of break detection with deep learning to achieve high-precision, robust, and efficient yard breakage detection methods.

Key words: ring spinning, yarn breakage detection, machine vision, morphological operation, threshold segmentation, spun yarn

CLC Number: 

  • TS111.8

Fig. 1

Broken yarn patrol detection car"

Fig. 2

Flow chart of broken yarn detection"

Fig. 3

Yarn image analysis diagram. (a) Yarn and background interference image; (b) Yarn image gradient diagram"

Fig. 4

Schematic diagram of neighborhood gradient enhancement algorithm"

Fig. 5

Feature category contained by the pixel changes"

Fig. 6

Yarn feature extraction image"

Fig. 7

Identification method of broken yarn based on Euler distance"

Fig. 8

Comparison of feature enhancement methods. (a) Original image; (b) Retinex; (c) Homomorphic filtering; (d) Histogram averaging; (e) Our algorithm"

Fig. 9

Distinct image(a) and dim image(b) enhancement renderings under different weight"

Fig. 10

Histograms of distinct image(a) and dim image(b) under different weight"

Fig. 11

Extraction effect of different threshold segmentation methods. (a)Original image; (b) Otsu threshold segmentation; (c) Added pixel proportion weight OTSU; (d) Our algorithm"

Fig. 12

Threshold of different threshold segmentation methods. (a) Otsu threshold segmentation; (b) Added pixel proportion weight Otsu; (c) Our algorithm"

Fig. 13

Comparison of experimental results of each algorithm. (a) Original image; (b) Optimized Hough transform; (c) LSD line detection; (d) Robert-Otsu; (e) Sobel-Otsu; (f) Linknet algorithm; (g) Our algorithm"

Tab. 1

Detection result of broken head of each algorithm"

方法 AACU/% TTP/% 时间/ms
Robert+Otsu 55.3 86.4 47.98
应用霍夫变换 78.4 5.1 41.96
Sobel+Otsu 54.3 79.4 57.98
LSD直线检测 37.6 63.4 3.53
Linknet 99.1 97.1 478.43
本文强化提取算法 97.3 96.1 59.76
[1] 陈根才, 章友鹤. 国内外环锭纺纱技术的发展与创新[J]. 现代纺织技术, 2011, 19(1):29-34.
CHEN Gencai, ZHANG Youhe. Development and in-novation of ring spinning technology at home and abroad[J]. Advanced Textile Technology, 2011, 19(1): 29-34.
[2] 汪军. 环锭纺纱线质量检测技术发展现状及趋势[J]. 纺织学报, 2013, 34(6):131-136.
WANG Jun. Current status and development trend of quality inspection technique of ring spun yarns[J]. Journal of Textile Research, 2013, 34(6): 131-136.
[3] 吕汉明, 吴擎擎, 吕鑫, 等. 基于数据库的环锭纺细纱机细纱断头检测与信息显示[J]. 纺织学报, 2018, 39(4):123-129.
LÜ Hanming, WU Qingqing, LÜ Xin, et al. Broken yarn monitoring and data display for ring spinning frame based on database[J]. Journal of Textile Research, 2018, 39(4): 123-129.
[4] ELDAR M. Line laser-based break sensor that detects light spots on yarns[J]. Optics & Lasers in Engineering, 2009, 47(7/8): 741-746.
[5] 王清. 一种基于线激光的实时非接触纱线断头检测方法:中国, 201611143551.9[P]. 2016-12-13.
WANG Qing. A real-time non-contact yarn breakage detection method based on line laser: China, 201611143551.9[P]. 2016-12-13.
[6] 史鹏飞, 白瑞林, 杨文浩, 等. 基于机器视觉的整经机断头检测系统[J]. 东华大学学报(自然科学版), 2011, 37(6):750-754,760.
SHI Pengfei, BAI Ruilin, YANG Wenhao, et al. Broken Yarn detection system on warping machine based on machine vision[J]. Journal of Donghua Univer-sity(Natural Science), 2011, 37(6): 750-754,760.
[7] 姚俊红. 赛络纺纱巡回式断头检测装置的设计[J]. 上海纺织科技, 2015, 43(10):88-89,93.
YAO Junhong. Design of sirospun touring beheaded detection device[J]. Shanghai Textile Science& Technology, 2015, 43(10): 88-89,93.
[8] 王雯雯, 刘基宏. 应用优化霍夫变换的细纱断头检测[J]. 纺织学报, 2018, 39(4):36-41.
WANG Wenwen, LIU Jihong. Spinning breakage detection based on optimized Hough transform[J]. Journal of Textile Research, 2018, 39(4): 36-41.
[9] 孟立凡, 高文学. 一种应用FPGA的灰度投影法断头检测平台设计[J]. 现代电子技术, 2020, 43(4):4-7.
MENG Lifan, GAO Wenxue. Design of FPGA-based broken yarn detection platform using gray projection algorithm[J]. Modern Electronic Technology, 2020, 43(4): 4-7.
[10] 吴旭东, 吕汉明. 基于深度学习的细纱断头检测模型[J]. 天津纺织科技, 2020(2):42-47.
WU Xudong, LÜ Hanming. Broken yarn detection model of spinning frame based on deep learning[J]. Tianjin Textile Science & Technology, 2020(2): 42-47.
[11] 陈泰芳. 机器视觉驱动的环锭纺断纱巡游检测方法研究[D]. 上海: 东华大学, 2022:33-34.
CHEN Taifang. Research on detection method of ring spining broken yarn cauise driven by machine vision[D]. Shanghai: Donghua University, 2022:33-34.
[12] XU Li. Image smoothing via L0 gradient minimiza-tion[J]. ACM Transactions on Graphics (TOG), 2011, 30(6): 1-12.
[13] OTSU N. A threshold selection method from gray-level histograms[J]. IEEE Transactions on Systems Man & Cybernetics, 2007, 9(1):62-66.
[14] VON GIOI R G, JAKUBOWICZ J, MOREL J M. LSD: a line segment detector[J]. Image Processing On Line, 2012, 2: 35-55.
doi: 10.5201/ipol
[15] 孟向臻, 姜春英, 丁美杰, 等. 基于改进Otsu-Sobel的分体式炮弹缝宽视觉测量方法研究[J/OL]. 火炮发射与控制学报:1-6[2022-03-18]. http://kns.cnki.net/kcms/detail/61.1280.TJ.20211129.1913.006.html
MENG Xiangzhen, JIANG Chunying, DING Meijie, et al. Visual measurement method of gap width of split type ammunition based on improved Ostu-Sobel[J/OL]. Journal of Gun Launch & Control:1-6[2022-03-18]. http://kns.cnki.net/kcms/detail/61.1280.TJ.20211129.1913.006.html.
[16] CHAURASIA A, CULURCIELLO E. Linknet: exploiting encoder representations for efficient semantic segmentation[C]// 2017 IEEE Visual Communications and Image Processing (VCIP). New York: IEEE, 2017: 1-4.
[1] MIAO Lulu, DONG Zhengmei, ZHU Fanqiang, RONG Hui, HE Linwei, ZHENG Guoquan, ZOU Zhuanyong. Influence of core filament type and delivery speed on performance of air-jet vortex spun core-spun yarns [J]. Journal of Textile Research, 2023, 44(12): 50-57.
[2] SHI Weimin, HAN Sijie, TU Jiajia, LU Weijian, DUAN Yutang. Empty yarn bobbin positioning method based on machine vision [J]. Journal of Textile Research, 2023, 44(11): 105-112.
[3] FAN Mengjing, WU Lingya, ZHOU Xinru, HONG Jianhan, HAN Xiao, WANG Jian. Construction of capacitive sensor based on silver coated polyamide 6/polyamide 6 nanofiber core-spun yarn [J]. Journal of Textile Research, 2023, 44(11): 67-73.
[4] JIA Liping, LI Ming, LI Weilong, RAN Jianhua, BI Shuguang, LI Shiwei. Strain-sensing and electrothermal difunctional core-spun yarn based on long silver nanowires [J]. Journal of Textile Research, 2023, 44(10): 113-119.
[5] SUN Xianqiang, XUE Yuan, LIU Yuexing, ZHANG Guoqing, LIU Lixia. Full color phase mixing model constructed by blending of six primary colored fibers and colored yarn production [J]. Journal of Textile Research, 2023, 44(09): 60-67.
[6] CHEN Gang, JIN Guiyang, WU Jing, LUO Qian. Research and development of key technologies and whole-set equipment for intelligent sewing [J]. Journal of Textile Research, 2023, 44(08): 197-204.
[7] WANG Kai, WANG Jin, NIU Li, CHEN Chaoyu, MA Pibo. Preparation and conductive stability of knitted circuit using cotton/stainless steel wire core-spun yarn [J]. Journal of Textile Research, 2023, 44(07): 64-71.
[8] ZHOU Xinru, FAN Mengjing, HU Chengye, HONG Jianhan, LIU Yongkun, HAN Xiao, ZHAO Xiaoman. Effect of spinneret rate on structure and properties of nanofiber core-spun yarns prepared by continuous water bath electrospinning [J]. Journal of Textile Research, 2023, 44(06): 50-56.
[9] FU Chiyu, XU Ao, QI Shuo, WANG Kai, MIAO Ying, SHANG Lulu, XIA Zhigang. Shape memory alloy composite yarn and its fabric actuation performance [J]. Journal of Textile Research, 2023, 44(06): 91-97.
[10] YANG Hongmai, ZHANG Xiaodong, YAN Ning, ZHU Linlin, LI Na'na. Robustness algorithm for online yarn breakage detection in warp knitting machines [J]. Journal of Textile Research, 2023, 44(05): 139-146.
[11] JI Yue, PAN Dong, MA Jiedong, SONG Limei, DONG Jiuzhi. Yarn tension non-contacts detection system on string vibration based on machine vision [J]. Journal of Textile Research, 2023, 44(05): 198-204.
[12] LIU Shuai, GUO Chenyu, CHEN Hewen, YANG Ruihua. Model analysis on structure of ring spun Sirofil wrapped yarn and its property optimization [J]. Journal of Textile Research, 2023, 44(04): 63-69.
[13] TAO Jing, WANG Junliang, XU Chuqiao, ZHANG Jie. Feature extraction method for ring-spun-yarn evenness online detection based on visual calibration [J]. Journal of Textile Research, 2023, 44(04): 70-77.
[14] SHI Jingjing, YANG Enlong. Analysis of structure and properties of cotton/wool siro segment colored yarns [J]. Journal of Textile Research, 2023, 44(03): 55-59.
[15] WU Junxiong, WEI Xia, LUO Jingxian, YAN Jiaoru, WU Lei. Preparation and UV stability of flame-retardant acrylic/aramid core-spun yarns [J]. Journal of Textile Research, 2023, 44(03): 60-66.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!