纺织学报 ›› 2024, Vol. 45 ›› Issue (12): 50-57.doi: 10.13475/j.fzxb.20231002501

• 纺织工程 • 上一篇    下一篇

基于焦点像素的纤维成分检测多焦面融合成像

杨宁1,2, 杨志军1, 王沛森1, 周全1, 孙晗1,2()   

  1. 1.广东工业大学 精密电子制造技术与装备国家重点实验室, 广东 广州 510006
    2.华道超精科技有限公司, 广东 佛山 528225
  • 收稿日期:2023-10-09 修回日期:2024-08-29 出版日期:2024-12-15 发布日期:2024-12-31
  • 通讯作者: 孙晗(1982—),男,讲师,博士。主要研究方向为微纳智能制造。E-mail:sunhan@gdut.edu.cn
  • 作者简介:杨宁(2000—),男,硕士生。主要研究方向为数字图像处理。
  • 基金资助:
    国家重点研发计划项目(2022YFB4701001);教育部产学研教改项目(220904084262251)

Multi-focal plane fusion imaging of fiber component detection based on focal pixels

YANG Ning1,2, YANG Zhijun1, WANG Peisen1, ZHOU Quan1, SUN Han1,2()   

  1. 1. State Key Laboratory of Precision Electronic Manufacturing Technology and Equipment, Guangdong University of Technology, Guangzhou, Guangdong 510006, China
    2. Hua Dao Super Precision Technology Company Limited, Foshan, Guangdong 528225,China
  • Received:2023-10-09 Revised:2024-08-29 Published:2024-12-15 Online:2024-12-31

摘要:

针对纤维成分显微检测中,单幅成像时视野中重叠纤维失焦模糊的问题,建立基于焦点像素的纤维多焦面融合算法。通过显微检测平台采集Z轴不同聚焦平面处的重叠纤维序列图像,并确定2幅局部最清晰源图像,之后对源图像使用多尺度修正拉普拉斯算子计算得到焦点像素,生成初始决策图;通过切片计算生成中间决策图;使用引导滤波器得到最终决策图,再采用近邻距离滤波器分解源图像得到高通和低通图像,最终加权得到融合图像;最后与多模态融合算法、3层分解稀疏融合去噪算法和非下采样连续变换算法进行主客观评估标准相比。结果表明:该融合算法得到的全局纤维边缘信息保留度更好,图像互信息较高且峰值信噪比大。该融合算法处理后的纤维图像达到全局纹理清晰聚焦的效果,能够有效改善局部纤维模糊问题。

关键词: 近邻距离滤波器, 决策图学习, 多焦面融合算法, 纤维图像, 纤维成分显微检测

Abstract:

Objective Currently, textile testing technology requires high-quality fiber images as a fundamental condition to observe the fineness and maturity of textiles. However, obtaining high quality fiber images is challenging due to the out-of-focus blurring of overlapping fibers in the visual field during single image imaging. Therefore, achieving the effect of global texture sharpness focusing by multi-focal plane fusion, based on obtaining only the locally clearest source image of overlapping fibers, holds great theoretical significance and application value.

Method To address the problem of defocus blur of overlapping fibers in the visual field during single image imaging, this research proposed a multi-focal plane fusion algorithm based for fibers on focal pixels. Firstly, two locally clearest source images were determined from the overlapping fiber images. Focal pixels were then obtained by multi-scale modified Laplacian algorithm to generate the initial decision map. The intermediate decision map was generated by slice calculation, and the guide filter was used to get the final decision map. Subsequently, the source image was processed with high-pass and low-pass respectively by the nearest neighbor distance filter. Finally, the fusion image was weighted.

Results The fiber multi-focal plane fusion algorithm based on focal pixels was proved suitable for different fiber samples. In the experiment, four types of fiber samples were listed, named as sample 1 (wool), sample 2 (down hair), sample 3 (cotton) and sample 4 (rabbit hair). By comparing the locally out-of-focus fuzzy original images of different samples with the fused images, it was seen that the texture details and edge structures of different samples were very clear after processing by the proposed multi-focal plane algorithm. Overlapping wool fiber samples in the same region were selected to compare the differences among the multi-focal plane fusion algorithm based on focus pixels and multi-mode fusion algorithm, three-layer decomposition sparse fusion denoising algorithm and non-down sampled continuous transformation algorithm. In order to better compare the four algorithms, Subjective evaluations were employed as auxiliary evaluation, and objective evaluation index was established as the evaluation benchmark. Three objective evaluation indexes of image mutual information, peak signal-to-noise ratio and edge information result retention were used to evaluate the algorithms. From the evaluation data, it was found that the evaluation values of each index of the multi-focal plane fusion algorithm were 3.543, 0.624 6 and 29.425 3, respectively. Compared with the other three algorithms, the evaluation value of each index of the proposed algorithm was the largest, and the larger the evaluation value, the better the image fusion. Thus, the superiority of the multi-focal plane fusion algorithm proposed in this paper was verified.

Conclusion The study provided data support and characterization to verify the effectiveness of the fiber multi-focal plane fusion algorithm based on focus pixels to solve the out-of-focus fuzzy problem of overlapping fibers. The factors leading to local blurring of overlapping fibers were analyzed from the perspective of high-power microscopic imaging. The multi-focal plane fusion algorithm was designed according to the characteristics of microscopic imaging to achieve globally clear imaging of overlapping fibers. It has been proven that the algorithm is suitable for different fiber types and has high adaptability. Compared with other multi-focal plane fusion algorithms, the fiber image processed by this fusion algorithm can best achieve the effect of globally sharp texture and focus.

Key words: neighbor distance filter, decision map learning, multi-focal plane fusion algorithm, fiber image, microscopic detection of fiber component

中图分类号: 

  • TP311.1

图1

多焦面融合算法流程图"

图2

图像采集过程示意图"

图3

纤维多焦面清晰度评价曲线"

图4

纤维多焦面融合过程"

图5

重叠羊毛不同算法融合效果图"

图6

其它3种样品的原图及融合效果图"

表1

融合图像质量客观评估表"

算法类型 MI QAB/F PSNR
多模态融合算法 2.352 0.502 1 25.361 5
3层分解稀疏融合去躁算法 2.634 0.531 4 26.527 3
非下采样连续变换算法 1.872 0.497 5 20.471 4
本文算法 3.543 0.624 6 29.425 3
[1] LI Huafeng, HE Xiaoge, TAO Dapeng, et al. Joint medical image fusion, denoising and enhancement via discriminative low-rank sparse dictionaries learning[J]. Pattern Recognition, 2018,79: 130-146.
[2] YANG Yong, YANG Mei, HUANG Shuying, et al. Robust sparse representation combined with adaptive PCNN for multifocus image fusion[J]. IEEE Access, 2018, 6: 20138-20151.
[3] MA Jiayi, MA Yong, LI Chang. Infrared and visible image fusion methods and applications: a survey[J]. Information Fusion, 2019,45:153-178.
[4] LI Shutao. Multisensor remote sensing image fusion using stationary wavelet transform: effects of basis and decomposition level[J]. International Journal of Wavelets, Multiresolution and Information Processing, 2008, 6(1):37-50.
[5] LI H, MANJUNATH B S, MITRA S K. Multisensor image fusion using the wavelet transform[J]. Graphical Models and Image Processing, 1995, 57(3):235-245.
[6] SELESNICK I W, BARANIUK R G, KINGSBURY N C. The dual-tree complex wavelet transform[J]. IEEE Signal Process magazine, 2005, 22(6): 123-151.
[7] DO M N, VETTERLI M. The contourlet transform: An efficient directional multiresolution image representa-tion[J]. IEEE Transactions on Image Processing, 2005, 14(12): 2091-2106.
[8] DA CUNHA A L, ZHOU J, DO M N. The nonsubsampled contourlet transform: theory, design, and applications[J]. IEEE Transaction on Image Process, 2006, 15(10):3089-3101.
[9] LI S T, YANG B, HU J W. Performance comparison of different multiresolution transforms for image fusion[J]. Information Fusion, 2011, 12(2): 74-84.
[10] ZHANG Q, GUO B. Multi-focus image fusion using the nonsubsampled contourlet transform[J]. Signal Process, 2009, 89(7): 1334-1346.
[11] MITIANOUDIS N, STATHAKI T. Pixel-based and region-based image fusion schemes using ICA bases[J]. Information Fusion, 2007, 8(2): 131-142.
[12] REDONDO R, ŠROUBEK F, FISCHER S, et al. Multifocus image fusion using the log-Gabor transform and a multisize windows technique[J]. Information Fusion, 2009, 10(2): 163-171.
[13] YANG Y, TONG S, HUANG S Y, et al. Multifocus image fusion based on NSCT and focused area detec-tion[J]. IEEE Sensors Journal, 2014, 15(5): 2824-2838.
[14] LI H F, QIU H M, YU Z T, et al, Infrared and visible image fusion scheme based on NSCT and low-level visual features[J]. Infrared Physical & Technology, 2016, 76: 174-184.
[15] LIU Y, CHEN X, PENG H, et al. Multi-focus image fusion with a deep convolutional neural network[J]. Information Fusion, 2017, 36: 191-207.
[16] HUANG W, JING Z. Multi-focus image fusion using pulse coupled neural network[J]. Pattern Recognition Letters, 2007, 28(9): 1123-1132.
[17] 毕天华, 杜文华. 一种改进的Brenner清晰度评价函数[J]. 电子测量技术, 2019, 42(9):80-84.
BI Tianhua, DU Wenhua. An improved Brenner articulation evaluation function[J]. Electronic Measurement Technology, 2019, 42(9):80-84.
[18] LI X S, ZHOU F Q, TAN H S, et al. Multimodal medical image fusion based on joint bilateral filter and local gradient energy[J]. Information Sciences, 2021, 569: 302-325.
[19] LI X S, ZHOU F Q, TAN H S. Joint image fusion and denoising via three-layer decomposition and sparse representation[J]. Knowledge-Based Systems, 2021. DOI:10.1016/j.knosys.2021.107087.
[20] LI X S, ZHOU F Q, TAN H S, et al. Multi-focus image fusion based on nonsubsampled contourlet transform and residual information removal[J]. Signal Processing, 2021. DOI:10.1016/j.sigpro.2021.108062.
[1] 邵金鑫, 张宝昌, 曹继鹏. 基于图像处理与深度学习方法的棉纤维梳理过程纤维检测识别技术[J]. 纺织学报, 2020, 41(07): 40-46.
[2] 张铮烨, 辛斌杰, 邓娜, 陈阳, 邢文宇. 基于边界跟踪测量麻纤维横截面参数的算法研究与应用[J]. 纺织学报, 2020, 41(02): 39-43.
[3] 朱俊平 路凯 柴新玉 钟跃崎 . 羊绒与羊毛直径的水平集中轴线法测量[J]. 纺织学报, 2017, 38(09): 14-18.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!