Journal of Textile Research ›› 2025, Vol. 46 ›› Issue (06): 231-239.doi: 10.13475/j.fzxb.20240504701

• Machinery & Equipment • Previous Articles     Next Articles

Broken yarn detection on warp beam zone of sizing machine based on machine vision

XU Lunyou, ZOU Kun(), WU Haonan   

  1. College of Mechanical Engineering, Donghua University, Shanghai 201620, China
  • Received:2024-05-21 Revised:2025-03-27 Online:2025-06-15 Published:2025-07-02
  • Contact: ZOU Kun E-mail:kouz@dhu.edu.cn

Abstract:

Objective Sizing is one of the key processes before weaving in the textile industry, and it requires the use of a sizing machine. During the process of sizing, the yarn on the warp beam of the sizing machine often breaks, leading to yarn accumulation and wastage. Currently, inspections for broken yarn on the warp beam zone of sizing machines predominantly rely on manual patrols, which suffer from poor timeliness and low efficiency. To address this issue, an algorithm was proposed in this research for detecting broken yarn faults in the warp beam zone of sizing machines based on machine vision.

Method By analyzing the image features captured by the cameras, an algorithm for determining the parameters of image recognition was investigated based on the theory of vanishing points, comprising an automatic vanishing point extraction algorithm, a warp roller axis calibration algorithm, and an automatic region of interest (ROI) selection algorithm. With the determined parameters of image recognition, the original images captured by the cameras was preprocessed, followed by edge detection and ellipse fitting. Subsequently, by assessing the positional relationship between the fitted ellipse and the top and bottom edges of the yarn roller, the recognition of broken yarn faults in the warp beam region was achieved.

Results The results demonstrated the significant effectiveness of the image recognition algorithm based on the theory of the vanishing point. Firstly, the automatic vanishing point extraction algorithm, using exhaustive search, successfully and consistently identified the vanishing point within a coordinate variation range of 5 pixels, ensuring the accuracy of subsequent analysis. Secondly, the vanishing point-centerline calibration method improved the accuracy of the axle-centerline identification by addressing the deviation issue of the dual-ellipse centerline method, providing a crucial geometric reference for broken yarn detection. Additionally, by utilizing the vanishing point information, the automatic selection algorithm for the ROI could accurately partition the ROI region that varies with the roller even in cases of smaller roller radius and increased background interference, enhancing the robustness of the algorithm. Based on the comprehensive algorithm mentioned above, the broken yarn detection algorithm performed edge detection on the preprocessed image and used ellipse fitting to fit the contour of the formed protruding circular white yarn loop. The relationship between the fitted ellipse and the roller edge lines was used to determine broken yarn faults, and the algorithm accurately identified the intersection points between the fitted ellipse and the upper and lower roller edge lines, showing good performance in detecting broken yarn faults in the middle and end sections. The detection algorithm took approximately 700 to 800 ms to process a single image. By concurrently processing images from multiple cameras, the time required to handle multiple images was significantly reduced. Experimental results indicated a 0.91 accuracy of the detection algorithm.

Conclusion Practical application shows that under most normal conditions in the sizing production process, the broken yarn fault identification algorithm for the warp beam zone can accurately and promptly detect broken yarn issues and trigger the corresponding alarms, meeting the needs of the project and actual industrial production. This detection system has been applied in relevant textile enterprises, confirming its feasibility.

Key words: warp beam zone of sizing machine, broken yarn detection, machine vision, image vanishing point, ellipse fitting

CLC Number: 

  • TP391.7

Fig.1

Diagram of GA310 sizing machine"

Fig.2

Characteristics of broken yarn faults in warp beam zone. (a) Center fault; (b) End fault"

Fig.3

Sketch map of parallel cylinders similarity with same vanishing point illustration"

Fig.4

Vanishing point extraction results of warp beam zone"

Fig.5

Extracted vanishing point coordinates from multiple image sets"

Fig.6

Fitting interfering ellipses to metal discs at end of warp beam"

Fig.7

Vanishing point-centerline method"

Fig.8

Automatic region flow chart of interest selection algorithm"

Fig.9

Result of automatic region of interest selection algorithm. (a) Start time; (b) 10 min later; (c) 15 min later"

Fig.10

Contours after Canny edge detection"

Fig.11

Handling mid-section yarn breakdown faults"

Fig.12

Handling end-section yarn breakdown faults"

Tab.1

Processing time of algorithm ms"

采集
图像
图像
预处理
前置参数
确定
感兴趣
区域选取
故障判别
算法
150 10 350 180 50

Fig.13

Overall process of detection system algorithm"

Tab.2

Evaluation result of algorithm by confusion matrix"

设备状态 预测为故障 预测为正常
实际为故障 71 10
实际为正常 8 111
[1] 陈传亮, 王成群, 吕文涛, 等. 纱线张力传感器的研究进展[J]. 现代纺织技术, 2022, 30(4):32-41.
CHEN Chuanliang, WANG Chengqun, LV Wentao, et al. Advances in yarn tension sensor research[J]. Advanced Textile Technology, 2022, 30(4): 32-41.
doi: 10.19398/j.att.202111050
[2] CARVALHO V, JOSÉ G P, MONTEIRO J L, et al. Yarn parameterization based on mass analysis[J]. Sensors & Actuators A: Physical, 2004, 115(2/3):540-548.
[3] CHEN G F, SUN H C, ZHAI L L, et al. A capacitance based circuit design for yarn breaking detection[J]. Advanced Materials Research, 2012, 562: 1840-1843.
[4] ELDAR M. Line-laser-based yarn shadow sensing break sensor[J]. Optics & Lasers in Engineering, 2011, 49(3): 313-317.
[5] 宋晓亮, 刘建立, 徐阳, 等. 光电式环锭断纱在线检测系统[J]. 纺织学报, 2014, 35(8):94-98,103.
SONG Xiaoliang, LIU Jianli, XU Yang, et al. Online detection system for ring spinning yarn break based on photoelectric sensing[J]. Journal of Textile Research, 2014, 35(8): 94-98,103.
[6] 张建新, 李琦. 基于机器视觉的筒子纱密度在线检测系统[J]. 纺织学报, 2020, 41(6):141-146.
ZHANG Jianxin, LI Qi. On-line detection system for bobbin yarn density based on machine vision[J]. Journal of Textile Research, 2020, 41(6): 141-146.
[7] SCHNEIDER D, GLOY Y S, MERHOF D. Vision-based on-loom measurement of yarn densities in woven fabrics[J]. IEEE Transactions on Instrumentation and Measurement, 2014, 64(4): 1063-1074.
[8] 史鹏飞, 白瑞林, 杨文浩, 等. 基于机器视觉的整经机断纱检测系统[J]. 东华大学学报(自然科学版), 2011, 37(6):750-754,760.
SHI Pengfei, BAI Ruilin, YANG Wenhao, et al. Broken yarn detection system for warp assembly machine based on machine vision[J]. Journal of Donghua University (Natural Science), 2011, 37(6): 750-754,760.
[9] 周其洪, 彭轶, 岑均豪, 等. 基于机器视觉的细纱接头机器人纱线断头定位方法[J]. 纺织学报, 2022, 43(5):163-169.
ZHOU Qihong, PENG Yi, CEN Junhao, et al. Yarn break localization method for fine yarn splicing robot based on machine vision[J]. Journal of Textile Research, 2022, 43(5): 163-169.
[10] PEREIRA F, CARVALHO V, SOARES F, et al. Computer vision techniques for detecting yarn defects[M]// Applications of Computer Vision in Fashion and Textiles. Cambridge: Woodhead Publishing, 2018: 123-145.
[11] CHAN J P, PALMER G S. Machine vision-applications in industry[C]// IEE Colloquium on Application of Machine Vision. London: IEE, 1995: 1-6.
[12] HARTLEY R, ZISSERMAN A. Multiple view geometry in computer vision[M]. Cambridge: Cambridge University Press, 2003: 213-218.
[13] ROTHER C. A new approach to vanishing point detection in architectural environments[J]. Image and Vision Computing, 2002, 20(9): 647-655.
[14] BAZIN J C, POLLEFEYS M. 3-line RANSAC for orthogonal vanishing point detection[C]// 2012 IEEE/rsj International Conference on Intelligent Robots and Systems. [S.l.]:IEEE, 2012: 4282-4287.
[15] ZITZLER E, DEB K, THIELE L. Comparison of multiobjective evolutionary algorithms: empirical results[J]. Evolutionary Computation, 2000, 8(2): 173-195.
doi: 10.1162/106365600568202 pmid: 10843520
[1] LI Jiguo, JING Junfeng, CHENG Wei, WANG Yongbo, LIU Wei. Design of machine vision-based system for detecting appearance defects in glass fiber yarn clusters [J]. Journal of Textile Research, 2025, 46(05): 243-251.
[2] REN Ke, ZHOU Hengshu, WEI Jinyu, YAN Wenjun, ZUO Yanwen. Dynamic aesthetic evaluation of pleated skirts based on machine vision technology [J]. Journal of Textile Research, 2024, 45(12): 189-198.
[3] REN Jiawei, ZHOU Qihong, CHEN Chang, HONG Wei, CEN Junhao. Detection method of position and posture of cheese yarn based on machine vision [J]. Journal of Textile Research, 2024, 45(11): 207-214.
[4] CHEN Yufan, ZHENG Xiaohu, XU Xiuliang, LIU Bing. Machine vision-based defect detection method for sewing stitch traces [J]. Journal of Textile Research, 2024, 45(07): 173-180.
[5] WEN Jiaqi, LI Xinrong, FENG Wenqian, LI Hansen. Rapid extraction of edge contours of printed fabrics [J]. Journal of Textile Research, 2024, 45(05): 165-173.
[6] YANG Jinpeng, JING Junfeng, LI Jiguo, WANG Yuanbo. Design of defect detection system for glass fiber plied yarn based on machine vision [J]. Journal of Textile Research, 2024, 45(05): 193-201.
[7] BAI Enlong, ZHANG Zhouqiang, GUO Zhongchao, ZAN Jie. Cotton color detection method based on machine vision [J]. Journal of Textile Research, 2024, 45(03): 36-43.
[8] GE Sumin, LIN Ruibing, XU Pinghua, WU Siyi, LUO Qianqian. Personalized customization of curved surface pillows based on machine vision [J]. Journal of Textile Research, 2024, 45(02): 214-220.
[9] SHI Weimin, HAN Sijie, TU Jiajia, LU Weijian, DUAN Yutang. Empty yarn bobbin positioning method based on machine vision [J]. Journal of Textile Research, 2023, 44(11): 105-112.
[10] CHEN Gang, JIN Guiyang, WU Jing, LUO Qian. Research and development of key technologies and whole-set equipment for intelligent sewing [J]. Journal of Textile Research, 2023, 44(08): 197-204.
[11] CHEN Taifang, ZHOU Yaqin, WANG Junliang, XU Chuqiao, LI Dongwu. Online detection of yarn breakage based on visual feature enhancement and extraction [J]. Journal of Textile Research, 2023, 44(08): 63-72.
[12] JI Yue, PAN Dong, MA Jiedong, SONG Limei, DONG Jiuzhi. Yarn tension non-contacts detection system on string vibration based on machine vision [J]. Journal of Textile Research, 2023, 44(05): 198-204.
[13] TAO Jing, WANG Junliang, XU Chuqiao, ZHANG Jie. Feature extraction method for ring-spun-yarn evenness online detection based on visual calibration [J]. Journal of Textile Research, 2023, 44(04): 70-77.
[14] WANG Bin, LI Min, LEI Chenglin, HE Ruhan. Research progress in fabric defect detection based on deep learning [J]. Journal of Textile Research, 2023, 44(01): 219-227.
[15] JIN Shoufeng, HOU Yize, JIAO Hang, ZHNAG Peng, LI Yutao. An improved AlexNet model for fleece fabric quality inspection [J]. Journal of Textile Research, 2022, 43(06): 133-139.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!