Journal of Textile Research ›› 2023, Vol. 44 ›› Issue (01): 179-187.doi: 10.13475/j.fzxb.20210911809

• Machinery & Accessories • Previous Articles     Next Articles

Cotton impurity image detection based on improved RFB-MobileNetV3

XU Jian1(), HU Daojie1, LIU Xiuping1, HAN Lin1, YAN Huanying2   

  1. 1. School of Electronics and Information, Xi'an Polytechnic University, Xi'an, Shaanxi 710048, China
    2. Shenzhen Municipal Robotel Robot Technology Co., Ltd., Shenzhen, Guangdong 518109, China
  • Received:2021-09-29 Revised:2022-06-13 Online:2023-01-15 Published:2023-02-16

Abstract:

Objective The complexity of deep convolutional neural network models makes it difficult for embedded devices to meet real-time online detection, and this research works on an improved RFB-MobileNetV3(RFB-MNV3) method for cotton impurity detection.
Method Firstly, the MNV3 redundant network structure was reduced according to the construction of high-precision lightweight network model and the premise of ensuring high detection accuracy. Secondly, the 3×3 convolutional layer replaced the 5×5 convolutional layer and the 1×3+3×1 convolutional layer was folded to replace the 3×3 convolutional layer as the improved RFB module deployed to the pooling layer of the improved MNV3 to enhance the online detection speed and accuracy of cotton hash. Finally, the algorithm before and after the improvement and other detection algorithms were compared.
Results The influence of training times, different lighting changes and different camera shift poses on the model was investigated using the test set. The improved RFB-MNV3 network model was iteratively trained to improve the average accuracy of cotton impurity classification. The specific classification detection effect under the improved RFB-MNV3 model showed that the detection accuracy was 83%-96% as suggested by the average AP values of the detection results for each category, among which the best effect was achieved in identifying cotton seeds with 96% accuracy (Fig.11). The value of the improved RFB-MNV3 algorithm reached 88.15%, indicating that the accuracy and score (the score of impurity detection under the optimized algorithm) have reasonably high stability, i.e. the model can better classify cotton impurity detection and can basically meet the actual industrial production needs. The detection results were compared with those of the MNV3, YOLOv3, VGG16 and ResNet34 network models (Tab.2). The detection time of the improved RFB-MNV3 model reached 0.02 s, and the online detection accuracy of the improved RFB-MNV3 model reached 89.05%, which is 6.83% higher than MNV3 and 8.48%-17.32% higher than other network models. The average accuracy mean combined with the accuracy and recall rates can be utilized to evaluate the comprehensive performance of image classification. It can be seen that the improved RFB-MNV3 model has a mean accuracy value that is 6.31% higher than MNV3 and 8.76%-17.72% higher than other networks.
Conclusion The new network is improved on the basis of the MNV3 detection network, while the improved RFB-MNV3 module is combined to achieve the purpose of reducing the model parameters without basically losing the model accuracy, solving the problem that the complexity of the deep convolutional neural network model makes it difficult for the embedded device to meet the real-time online detection. The model proposed can effectively achieve the detection of lint images, while the model detection efficiency is high and the storage occupied is small, which can provide the necessary technical support for the development of embedded devices for lint image detection.

Key words: RFB-MobileNetV3, cotton impurity, online detection, network structure, lightweight model, image detection

CLC Number: 

  • TP391.41

Fig.1

MNV3 block structure"

Fig.2

Detection process flow"

Tab.1

Improved structure of MNV3"

网络结构 输入分辨率/像素 输出通道数 网络层数
Conv3×3 640 ×480 16 1
Bottleneck3×3 320×240 24 2
Bottleneck5×5 160×80 40 2
Bottleneck5×5 80×80 80 2
Conv1×1、Pooling 40×40 120 1
Conv1×1 1×1 240 1
Conv1×1 1×1 6 1

Fig.3

Improved RFB module structure"

Fig.4

Cotton impurity labeling chart"

Fig.5

Visualization feature map"

Fig.6

Single cotton impurity test results by model before (a) and after (b) improvement"

Fig.7

Multiple cotton impurity test results by model before (a) and after (b) improvement"

Fig.8

Detection results for different camera positions. (a) Rotation by 0°;(b) Rotation by 90°;(c) Rotation by 180°"

Fig.9

Detection results under different lighting conditions. (a)Strong light;(b)Normal light;(c)Weak light"

Fig.10

Average accuracy of cotton impurity classification"

Fig.11

Results of improved RFB-MNV3 classification detection"

Tab.2

Detection effect by different networks models"

模型 参数量/
106
检测时间/
s
平均准
确率/%
召回率/
%
平均准确率
均值/%
MNV3 1.41 262 82.22 81.47 81.84
RFB-MNV3 0.09 87 89.05 87.25 88.15
YOLOv3 2.63 291 80.57 78.21 79.39
VGG16 17.38 289 73.28 71.63 72.45
ResNet34 19.37 320 71.73 70.87 70.43

Fig.12

Comparison of detection results between algorithms"

[1] 程文. 棉花种植技术和病虫害防治措施[J]. 河南农业, 2022(8):8-9.
CHENG Wen. Cotton planting technology and pest control measures[J]. Henan Agriculture, 2022(8):8-9.
[2] 田景山, 王文敏, 王聪, 等. 机械采收方式对新疆棉品质的影响[J]. 纺织学报, 2016, 37(7):13-17.
TIAN Jingshan, WANG Wenmin, WANG Cong, et al. Effect of mechanical harvesting methods on the quality of Xinjiang cotton[J]. Journal of Textile Research, 2016, 37(7): 13-17.
[3] 周建, 潘如如, 高卫东. 机器视觉在纺织中的应用现状与发展趋势[J]. 棉纺织技术, 2019, 47(2):15-17.
ZHOU Jian, PAN Rugru, GAO Weidong. Application status and development trend of machine vision in textile[J]. Cotton Textile Technology, 2019, 47(2): 15-17.
[4] 景军锋, 郭根. 基于机器视觉的丝饼毛羽检测[J]. 纺织学报, 2019, 40(1):147-152.
JING Junfeng, GUO Gen. Machine vision-based lint detection of silk cake[J]. Journal of Textile Research, 2019, 40(1):147-152.
doi: 10.1177/004051757004000208
[5] 杜玉红, 王加富, 蒋秀明, 等. 应用聚类统计分析的棉花异纤图形检测算法[J]. 纺织学报, 2015, 36(3):135-139.
DU Yuhong, WANG Jiafu, JIANG Xiuming, et al. A graphical detection algorithm for cotton heterofibers applying cluster statistical analysis[J]. Journal of Textile Research, 2015, 36(3): 135-139.
[6] 齐英兰. 基于高低阈值迭代优化的原棉图像杂质检测[J]. 现代纺织技术, 2019, 27(5):50-53.
QI Yinglan. Image impurity detection of raw cotton based on high and low threshold iterative optimi-zation[J]. Advanced Textile Technology, 2019, 27(5): 50-53.
[7] 李龙. 基于改进Mobile-Net-V2的原棉杂质分类方法[J]. 毛纺科技, 2021, 49(2):83-88.
LI Long. Impurity Classification method of raw cotton based on improved Mobile-Net-V2[J]. Wool Textile Journal, 2021, 49(2): 83-88.
[8] HOWARD A, SANDLER M, CHU G, et al. Searching for MobileNetV3[C]// Proceedings of the IEEE/CVF International Conference on Computer Vision.Seoul:ICCV, 2019:1314-1324.
[9] LANGER Sophie. Approximating smooth functions by deep neural networks with sigmoid activation function[J]. Journal of Multivariate Analysis, 2021, 182(10): 96-104.
[10] LIU S, HUANG D. Receptive field block net for accurate and fast object detection[C]// Proceedings of the European Conference on Computer Vision (ECCV).Munich:ECCV, 2018: 385-400.
[11] 董超群, 杜玉红, 任维佳, 等. 应用光学成像技术检测棉花中异性纤维的研究进展[J]. 纺织学报, 2020, 41(6):183-189.
DONG Chaoqun, DU Yuhong, REN Weijia, et al. Research progress on the application of optical imaging technology for the detection of anisotropic fibers in cotton[J]. Journal of Textile Research, 2020, 41(6): 183-189.
[12] 陈晓妮, 汪军, 陈庆东. 棉花检测能力认证活动中统计模型的应用[J]. 纺织学报, 2012, 33(10):33-36.
CHEN Xiaoni, WANG Jun, CHEN Qingdong. Application of statistical models in cotton testing capability certification activities[J]. Journal of Textile Research, 2012, 33(10): 33-36.
[13] 高伟, 王志衡, 赵训坡, 等. 基于HSI颜色空间的棉花杂质高速实时检测方法[J]. 自动化学报, 2008, 34(7): 729-735.
GAO Wei, WANG Zhiheng, ZHAO Xunpo, et al. High-speed real-time detection method of cotton impurities based on HSI colour space[J]. Journal of Automation, 2008, 34(7): 729-735.
[14] YANG Wenzhu, LI Daoliang, WANG Sile, et al. Saliency-based color image segmentation in foreign fiber detection[J]. Mathematical and Computer Modelling, 2013, 58(3/4): 852-858.
doi: 10.1016/j.mcm.2012.12.016
[15] 徐健, 陆珍, 刘秀平, 等. 注意力机制优化RetinaNet的密集工件检测方法研究[J]. 电子测量与仪器学报, 2022, 36(1):227-235.
XU Jian, LU Zhen, LIU Xiuping, et al. Research on dense artifact detection method with attention mechanism optimized RetinaNet[J]. Journal of Electronic Measurement and Instrumentation, 2022, 36(1):227-235.
[1] LU Haojie, LI Manli, JIN Enqi, ZHANG Hongwei, ZHOU Jiu. Online measurement of moisture regains of sized yarns based on arc capacitance sensor [J]. Journal of Textile Research, 2023, 44(01): 201-208.
[2] GUO Min, WANG Jing'an, GUO Mingrui, GAO Weidong. Evaluation of anti-pilling performance of sized yarns based on hairiness image detection [J]. Journal of Textile Research, 2022, 43(03): 78-82.
[3] JI Yong, JIANG Gaoming. Expression and realization of human body model based on learning model [J]. Journal of Textile Research, 2021, 42(10): 146-149.
[4] ZHANG Wenchang, SHAN Zhongde, LU Ying. Fast location of yarn-bars on yarn-cage based on machine vision [J]. Journal of Textile Research, 2020, 41(12): 137-143.
[5] LIU Airong, CHEN Yanmin, GE Fengyan, CAI Zaisheng, WANG Juan. Progress on fiber-based surface-enhanced Raman scattering substrates [J]. Journal of Textile Research, 2020, 41(05): 176-183.
[6] . Preparation and properties of self-weaving composites of bacterial cellulose/polyester [J]. JOURNAL OF TEXTILE RESEARCH, 2018, 39(02): 126-131.
[7] . Online detection of roving strand broken in siro-spinning [J]. JOURNAL OF TEXTILE RESEARCH, 2016, 37(10): 120-0124.
[8] MA Chongqi;PAN Qingyun. Design of communication protocol in sample textile CAD&CAM system based on RS 485 [J]. JOURNAL OF TEXTILE RESEARCH, 2008, 29(7): 108-111.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] . [J]. JOURNAL OF TEXTILE RESEARCH, 2003, 24(06): 109 -620 .
[2] ZHANG Jin-qiu;ZHANG Hua;HAO Xin-min;JIANG Feng-qin. Relationship between high temperature scouring time and degumming quality of hemp fiber[J]. JOURNAL OF TEXTILE RESEARCH, 2006, 27(2): 81 -83 .
[3] ZHENG Tian-yong;CUI Shi-zhong. Study on constructing the 3D yarn model by B-spline surface (part Ⅱ):inserting 3D bumping texture on the surface of the yarn[J]. JOURNAL OF TEXTILE RESEARCH, 2006, 27(3): 24 -26 .
[4] . [J]. JOURNAL OF TEXTILE RESEARCH, 2004, 25(03): 14 -15 .
[5] LUO You-xin;LI Xiao-feng . Uncertainty system model USM-1 in testing moisture regain of the ramie fiber[J]. JOURNAL OF TEXTILE RESEARCH, 2005, 26(1): 42 -43 .
[6] . [J]. JOURNAL OF TEXTILE RESEARCH, 2003, 24(06): 87 -88 .
[7] . [J]. JOURNAL OF TEXTILE RESEARCH, 2004, 25(04): 60 -61 .
[8] CHEN Weiguo;DAI Jinjin;WANG Junsu;JIA Chengtong;WANG Zhiyong;MENG Zhaocheng. Thermosol dyeing of polyester fabrics with high light fastness vat dyes[J]. JOURNAL OF TEXTILE RESEARCH, 2008, 29(9): 82 -86 .
[9] LI Zhong . Biarc application in the garment pattern design[J]. JOURNAL OF TEXTILE RESEARCH, 2005, 26(5): 101 -102 .
[10] CUI Yi-hua. Primary properties of basalt continuous filament[J]. JOURNAL OF TEXTILE RESEARCH, 2005, 26(5): 120 -121 .