Journal of Textile Research ›› 2020, Vol. 41 ›› Issue (07): 40-46.doi: 10.13475/j.fzxb.20191102407

• Textile Engineering • Previous Articles     Next Articles

Fiber detection and recognition technology in cotton fiber carding process based on image processing and deep learning

SHAO Jinxin1, ZHANG Baochang1,2(), CAO Jipeng3   

  1. 1. School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China
    2. Shenzhen Academy of Aerospace Technology, Shenzhen, Guangdong 518057, China
    3. Liaoning Key Laboratory of Functional Textile Materials, Eastern Liaoning University, Dandong, Liaoning 118003, China
  • Received:2019-11-07 Revised:2020-04-09 Online:2020-07-15 Published:2020-07-23
  • Contact: ZHANG Baochang E-mail:bczhang@buaa.edu.cn

Abstract:

Aiming at the problem that the images obtained by the high-speed camera on the surface of the cylinder during the cotton fiber carding process cannot be recognized by the human eye, algorithms that combine image processing and deep learning were employed to assist human identification through a series of detection processes. The image data was derived from the high-speed video camera data of the carding process of the cylinder surface under the moving cover of the card. The specific implementation process was to first extract the denoising residuals from the image through a multi-level wavelet convolutional neural network, then use the deep convolutional networks for super-resolution reconstruction, and finally use a multi-scale edge detection and enhancement algorithm under strong noise to sketch the fibers. Through the processing of these three steps in the algorithm, a clear fiber image recognizable by the human eyes was obtained. Feature-enhanced image samples were used to train the cycle-consistent adversarial network to obtain more continuous and clear fiber extraction results. The results from the research demonstrate that the proposed processing procedure improves the detection and recognition effect of fibers during carding, and provides a new idea for the research in the field of carding.

Key words: cotton fiber carding, fiber image, fiber recognition, multi-level wavelet convolutional neural network, multi-scale edge detection

CLC Number: 

  • TS113.1

Fig.1

Sample image of dataset. (a) Sample 1; (b) Sample 2"

Fig.2

Detection process"

Fig.3

Network structure of MWCNN"

Fig.4

Effect of preliminary feature extraction of sample 1 (a) and sample 2 (b)"

Fig.5

Network structure of image super-resolution using deep convolutional networks"

Fig.6

Effect of fiber detection after super-resolution reconstruction of sample 1 (a) and sample 2 (b)"

Fig.7

Sketched result sample 1 (a) and sample 2 (b)"

Fig.8

CycleGAN's model structure"

Fig.9

Test output of CycleGAN model. (a) Test data 1; (b) Test data 2; (3)Output of test data 1; (4) Output of test data 2"

[1] 于学智, 邵英海, 曹继鹏. 刺辊速度对梳理后纤维长度指标的影响[J]. 棉纺织技术, 2016,44(3):26-29.
YU Xuezhi, SHAO Yinghai, CAO Jipeng. Influence of licker-in speed on fiber length index after carding[J]. Cotton Textile Technology, 2016,44(3):26-29.
[2] 何晓峰, 徐守东, 刘从九. 棉纤维细度检测技术综述[J]. 中国纤检, 2018(10):88-93.
HE Xiaofeng, XU Shoudong, LIU Congjiu. Summary of cotton fiber fineness detection technology[J]. China Fiber Inspection, 2018 (10):88-93.
[3] 刘天骄, 孙润军, 王红红. 利用激光细度仪快速检测棉纤维细度的探究[J]. 棉纺织技术, 2018,46(3):77-80.
LIU Tianjiao, SUN Runjun, WANG Honghong. Study on rapid detection of cotton fiber linear density with the laserscan[J]. Cotton Textile Technology, 2018,46(3):77-80.
[4] LIU K, TAN J, SU B. An adaptive image denoising model based on Tikhonov and TV regularizations[J]. Advances in Multimedia, 2014,2014:1-10.
[5] LIU P, ZHANG H, ZHANG K, et al. Multi-level wavelet-CNN for image restoration[C] //Proceedings of the IEEE conference on computer vision and pattern recognition workshops. Salt Lake: Computer Vision Foundation, 2018: 773-782.
[6] 刘亚梅. 基于梯度边缘最大值的图像清晰度评价[J]. 图学学报, 2016,37(2):97-102.
LIU Yamei. Sharpness assessment for remote sensing image based on maximum gradient[J]. Journal of Graphics, 2016,37(2):97-102.
[7] 孙旭, 李晓光, 李嘉锋, 等. 基于深度学习的图像超分辨率复原研究进展[J]. 自动化学报, 2017,43(5):697-709.
SUN Xu, LI Xiaoguang, LI Jiafeng, et al. Review on deep learning based image super-resolution restoration algorithms[J]. Acta Automatica Sinica, 2017,43(5):697-709.
[8] DONG C, LOY C C, HE K, et al. Image super-resolution using deep convolutional networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015,38(2):295-307.
doi: 10.1109/TPAMI.2015.2439281 pmid: 26761735
[9] YANG J, WRIGHT J, HUANG T S, et al. Image super-resolution via sparse representation[J]. IEEE Transactions on Image Processing, 2010,19(11):2861-2873.
pmid: 20483687
[10] VIJAYARANI S, VINUPRIYA M. Performance analysis of canny and sobel edge detection algorithms in image mining[J]. International Journal of Innovative Research in Computer and Communication Engineering, 2013,1(8):1760-1767.
[11] GALUN M, BASRI R, BRANDT A. Multiscale edge detection and fiber enhancement using differences of oriented means[C] //2007 IEEE 11th International Conference on Computer Vision. Rio de Janeiro:IEEE, 2007: 1-8.
[12] 颜贝, 张建林. 基于生成对抗网络的图像翻译现状研究[J]. 国外电子测量技术, 2019,38(6):130-134.
YAN Bei, ZHANG Jianlin. Research the status of image translation based on generative adversarial networks[J]. Foreign Electronic Measurement Technology, 2019,38(6):130-134.
[13] CRESWELL A, WHITE T, DUMOULLIN V, et al. Generative adversarial networks: an overview[J]. IEEE Signal Processing Magazine, 2018,35(1):53-65.
[14] SALIMANS T, GOODFELLOW I, ZAREMBA W, et al. Improved techniques for training GANs[C] //Advances in Neural Information Processing Systems. Barcelona: Curran Associates, 2016: 2234-2242.
[15] ZHU J Y, PARK T, ISOLA P, et al. Unpaired image-to-image translation using cycle-consistent adversarial networks[C] //Proceedings of the IEEE International Conference on Computer Vision. Venice: Computer Vision Foundation, 2017: 2223-2232.
[1] . Concave points matching and segmentation algorithm for overlapped fiber image [J]. JOURNAL OF TEXTILE RESEARCH, 2017, 38(11): 143-149.
[2] . Level set of central axis method of cashmere and wool diameter [J]. JOURNAL OF TEXTILE RESEARCH, 2017, 38(09): 14-18.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!