基于机器视觉的细纱接头机器人纱线断头定位方法

doi:10.13475/j.fzxb.20210504407

纺织学报 ›› 2022, Vol. 43 ›› Issue (05): 163-169.doi: 10.13475/j.fzxb.20210504407

基于机器视觉的细纱接头机器人纱线断头定位方法

周其洪¹^,²(), 彭轶¹^,², 岑均豪³, 周申华¹, 李姝佳¹

1.东华大学机械工程学院, 上海 201620
2.东华大学数字化纺织服装技术教育部工程研究中心, 上海 201620
3.广州盛原成自动化科技有限公司, 广东广州 511400

收稿日期:2021-05-18 修回日期:2021-11-20 出版日期:2022-05-15 发布日期:2022-05-30
作者简介:周其洪(1976—),男,教授,博士。主要研究方向为高端纺织装备机电一体化、自动化和智能化以及机器人技术。E-mail: zhouqihong@dhu.edu.cn。
基金资助:
国家重点研发计划项目(2017YFB1304000)

Yarn breakage location for yarn joining robot based on machine vision

ZHOU Qihong¹^,²(), PENG Yi¹^,², CEN Junhao³, ZHOU Shenhua¹, LI Shujia¹

1. College of Mechanical Engineering, Donghua University, Shanghai 201620, China
2. Engineering Research Center of Digitalized Textile and Fashion Technology, Ministry of Education, Donghua University, Shanghai 201620, China
3. Guangzhou Seyounth Automation Technology Co., Ltd., Guangzhou, Guangdong 511400, China

Received:2021-05-18 Revised:2021-11-20 Published:2022-05-15 Online:2022-05-30

摘要/Abstract

摘要：

为实现通过机器视觉方式对细纱接头机器人的纱线断头进行定位,并简化机械结构,根据断头纱线图像特点,提出针对纱线特征的识别与定位算法。利用工业相机采集纱线被吸入吸嘴的图像,通过改进灰度增强方法增大纱线特征与背景对比度,利用Canny算子进行边缘检测,最后通过划分上下感兴趣区域以及优化的霍夫直线检测获取纱线的图像特征并利用定位算法提取所需的位置信息。结果表明:本文算法提取的位置信息精度较高,坐标点误差为1.42像素,角度误差为0.60°;相较于传统检测算法,程序运行时间得到了缩短,识别时间在10^-1 s数量级上,实时性好;研究成果可应用于细纱接头机器人产品开发中。

关键词: 细纱接头, 机器视觉, 纱线断头定位, 图像处理, 霍夫变换

Abstract:

In order to identify and locate the yarn breakage in the spinning process for the yarn joining robot through visual method and to simplify the mechanical structure, a recognition and positioning algorithm for yarn characteristics is proposed according to the image characteristics. An industrial camera was used to collect the image of the yarn being sucked into the suction nozzle, and the contrast between yarn features and background was enhanced through an improved gray enhancement method, using Canny operator for yarn edge detection. The image features of the yarn were obtained by dividing the interest regions and optimized using Hough line detection method, and the positioning algorithm was used to extract the required location information. The experimental results show that the position information extracted by the proposed algorithm has high accuracy, the error of coordinate points is 1.42 pixels, and the error of angle α is 0.60°. Compared with the use of the traditional location detecting algorithm, the running time of the program is reduced, and the average recognition time is in the order of 10^-1 s, with good real-time performance. The research results can be applied to the development of yarn joining robot products.

Key words: yarn joining, machine vision, yarn breakage location, image processing, Hough transform

中图分类号:

TS103.2

周其洪, 彭轶, 岑均豪, 周申华, 李姝佳. 基于机器视觉的细纱接头机器人纱线断头定位方法[J]. 纺织学报, 2022, 43(05): 163-169.

ZHOU Qihong, PENG Yi, CEN Junhao, ZHOU Shenhua, LI Shujia. Yarn breakage location for yarn joining robot based on machine vision[J]. Journal of Textile Research, 2022, 43(05): 163-169.

图/表 12

图1

图2

图3

图4

图5

图6

图7

图8

表1

图9

表2

表3

参考文献 13

[1]	章友鹤, 赵连英. 环锭细纱机的技术进步与创新[J]. 纺织导报, 2015(1): 52-57.
	ZHANG Youhe, ZHAO Lianying. Technological advancement and innovation of ring-spinning machine[J]. China Textile Leader, 2015(1): 52-57.
[2]	韩晨晨, 傅佳佳, 高卫东. 环锭细纱机的发展现状及技术进步[J]. 棉纺织技术, 2019, 47(2): 1-5.
	HAN Chenchen, FU Jiajia, GAO Weidong. Development status and technology improvement of ring spinning frame[J]. Cotton Textile Technology, 2019, 47(2): 1-5.
[3]	唐新军, 宋均燕, 何小东. 国内外环锭纺自动接头装置的技术进展[J]. 棉纺织技术, 2019, 47(1): 78-84.
	TANG Xinjun, SONG Junyan, HE Xiaodong. Technology progress of ring spinning automatic piecing device at home and abroad[J]. Cotton Textile Technology, 2019, 47(1): 78-84.
[4]	陈佳. 立达集团:自动化、紧密纺以及数字化领域创新突破[J]. 纺织导报, 2019 (7): 15.
	CHEN Jia. Rieter group: innovative breakthroughs in automation, compact spinning and digitization[J]. China Textile Leader, 2019(7): 15.
[5]	唐火红, 周琼, 冯宝林, 等. 环锭纺接头机器人结构研究与动力学分析[J]. 机械设计与制造, 2016(1): 47-49,53.
	TANG Huohong, ZHOU Qiong, FENG Baolin, et al. Structure research and dynamics analysis of yarn piecing robot for ring spinning[J]. Machinery Design & Manufacture, 2016(1): 47-49,53.
[6]	XIAO R, XU Y, HOU Z, et al. An adaptive feature extraction algorithm for multiple typical seam tracking based on vision sensor in robotic arc welding[J]. Sensors and Actuators A: Physical, 2019, 297:111533. doi: 10.1016/j.sna.2019.111533
[7]	YANG H, CHEN L, MA Z, et al. Computer vision-based high-quality tea automatic plucking robot using Delta parallel manipulator[J]. Computers and Electronics in Agriculture, 2021, 181:105946. doi: 10.1016/j.compag.2020.105946
[8]	张文昌, 单忠德, 卢影. 基于机器视觉的纱笼纱杆快速定位方法[J]. 纺织学报, 2020, 41(12): 137-143.
	ZHANG Wenchang, SHAN Zhongde, LU Ying. Fast location of yarn-bars on yarn-cage based on machine vision[J]. Journal of Textile Research, 2020, 41(12): 137-143.
[9]	张建新, 李琦. 基于机器视觉的筒子纱密度在线检测系统[J]. 纺织学报, 2020, 41(6): 141-146.
	ZHANG Jianxin, LI Qi. Online cheese package yarn density detection system based on machine vision[J]. Journal of Textile Research, 2020, 41(6): 141-146.
[10]	王雯雯, 刘基宏. 应用优化霍夫变换的细纱断头检测[J]. 纺织学报, 2018, 39(4): 36-41.
	WANG Wenwen, LIU Jihong. Spinning breakage detection based on optimized Hough transform[J]. Journal of Textile Research, 2018, 39(4): 36-41.
[11]	孙博文, 朱志明, 郭吉昌, 等. 基于组合激光结构光的视觉传感器检测算法及图像处理流程优化[J]. 清华大学学报(自然科学版), 2019, 59(6): 445-452.
	SUN Bowen, ZHU Zhiming, GUO Jichang, et al. Detection algorithms and optimization of image processing for visual sensors using combined laser structured light[J]. Journal of Tsinghua Univer-sity(Science and Technology), 2019, 59(6): 445-452.
[12]	王文帝, 辛斌杰, 邓娜, 等. 单一视角下自适应阈值法的纱线毛羽识别及其应用[J]. 纺织学报, 2019, 40(5): 150-156.
	WANG Wendi, XIN Binjie, DENG Na, et al. Identification and application of yarn hairiness using adaptive threshold method under single vision[J]. Journal of Textile Research, 2019, 40(5): 150-156.
[13]	HAJJOUJI I, MARS S, ASRIH Z, et al. A novel FPGA implementation of Hough transform for straight lane detection[J]. Engineering Science and Technology, an International Journal, 2020, 23(2): 274-280. doi: 10.1016/j.jestch.2019.05.008

相关文章 15

[1]	张荣根, 冯培, 刘大双, 张俊平, 杨崇倡. 涤纶工业长丝毛丝在线检测系统的研究[J]. 纺织学报, 2022, 43(04): 153-159.
[2]	熊晶晶, 杨雪, 苏静, 王鸿博. 基于图像技术的织物导湿性能测试方法[J]. 纺织学报, 2021, 42(12): 70-75.
[3]	吕文涛, 林琪琪, 钟佳莹, 王成群, 徐伟强. 面向织物疵点检测的图像处理技术研究进展[J]. 纺织学报, 2021, 42(11): 197-206.
[4]	夏旭文, 孟朔, 潘如如, 高卫东. 基于改进帧间差分法的经纱撞筘拥纱在线检测[J]. 纺织学报, 2021, 42(06): 91-96.
[5]	江燕婷, 严庆帅, 辛斌杰, 高琮, 施楣梧. 纺织品单向导水性能测试方法分析[J]. 纺织学报, 2021, 42(05): 51-58.
[6]	吴柳波, 李新荣, 杜金丽. 基于轮廓提取的缝纫机器人运动轨迹规划研究进展[J]. 纺织学报, 2021, 42(04): 191-200.
[7]	李东洁, 郭帅, 杨柳. 基于改进图像阈值分割算法的纱线疵点检测[J]. 纺织学报, 2021, 42(03): 82-88.
[8]	唐千惠, 王蕾, 高卫东. 基于图像处理的织物保形性检测[J]. 纺织学报, 2021, 42(03): 89-94.
[9]	田宇航, 王绍宗, 张文昌, 张倩. 基于机器视觉的单组分染液浓度快速检测方法[J]. 纺织学报, 2021, 42(03): 115-121.
[10]	冯文倩, 李新荣, 杨帅. 人体轮廓机器视觉检测算法的研究进展[J]. 纺织学报, 2021, 42(03): 190-196.
[11]	孟朔, 夏旭文, 潘如如, 周建, 王蕾, 高卫东. 基于卷积神经网络的机织物密度均匀性检测[J]. 纺织学报, 2021, 42(02): 101-106.
[12]	朱世根, 杨宏贤, 白云峰, 丁浩, 朱巧莲. 长条状细薄带钩零件变形自动检测系统[J]. 纺织学报, 2020, 41(10): 158-163.
[13]	张建新, 李琦. 基于机器视觉的筒子纱密度在线检测系统[J]. 纺织学报, 2020, 41(06): 141-146.
[14]	路浩, 陈原. 基于机器视觉的碳纤维预浸料表面缺陷检测方法[J]. 纺织学报, 2020, 41(04): 51-57.
[15]	王文胜, 李天剑, 冉宇辰, 卢影, 黄民. 筒子纱纱笼纱杆的定位检测方法[J]. 纺织学报, 2020, 41(03): 160-167.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

图像	上ROI区域		下ROI区域
图像	r	θ/(°)	r	θ/(°)
图像1	210.6	50	579	100
图像2	234.6	58	540.6	106
图像3	251.4	60	550.2	112
图像4	282.6	66	395.4	128
图像5	310.2	74	309	135.9
图像6	333	86	303.3	137.9
图像7	448	92	279	139.9

图像	程序输出坐标/像素	手动标注坐标/像素	V轴绝对误差/像素	程序输出α/(°)	手动标注α/(°)	α值绝对误差/(°)
图像1	(140,606)	(140,609.5)	3.5	15.01	15.82	0.81
图像2	(140,393)	(140,392)	1	174.99	175.24	0.25
图像3	(140,530)	(140,531.5)	1.5	5.01	5.24	0.23
图像4	(140,479)	(140,478.5)	0.5	1.99	2.86	0.87
图像5	(140,459)	(140,460)	1	178.99	177.61	1.38
图像6	(140,139)	(140,140)	1	164.99	165.07	0.08
平均误差	—	—	1.42	—	—	0.60

图像	本文算法	OHT	直线拟合
图像1	53.9	21.9	433.7
图像2	59.1	17.9	460.8
图像3	63.9	24	513.7
图像4	61.9	16	511.7
图像5	79.9	23.9	453.7
图像6	60	34	497.7
平均耗时	63.1	23	478.6

基于机器视觉的细纱接头机器人纱线断头定位方法

Yarn breakage location for yarn joining robot based on machine vision

RichHTML

PDF (PC)

摘要/Abstract

引用本文

使用本文

图/表 12

参考文献 13

相关文章 15

Metrics

本文评价

推荐阅读 0