基于融合多层卷积特征的显著性区域提取

针对目前卷积神经网络提取图像特征不充分导致的显著性提取效果不明显的问题,提出了一种多层卷积特征融合的自编码显著性区域提取算法.在使用卷积网络提取图像特征时,其浅层卷积特征一般提取的是图像的细节特征如颜色、纹理和位置特征,深层次卷积特征一般是图像的语义特征,在编码层将浅层卷积特征经过下采样融合到深层次的卷积特征中,并将深层次卷积特征进行上采样融合到浅层卷积特征中,实验表明这样可以大大提高编码质量;在解码中将编码时的卷积特征也进行融合,可以获取到解码丢失的信息进而得到更优的解码图像.此外还设计了逐层监督的方式来指导解码层的训练,即用标准的区域提取图进行下采样作为每一层解码层的标准图进行监督训练.实验结果表明,该方法可以在PAGRN的基础上将F度量平均提升0.071,平均绝对误差MEA平均降低0.031.

Extraction of saliency region based on fusion of multilayer convolutional features

This paper proposed a self-encoding salient region extraction algorithm based on multi-layer convolutional to solve the problem that the existing convolutional neural network wasn''t sufficient in extracting image features, which led to the poor effect of salient extraction. When convolutional networks were used to extract image features, the shallow convolution features generally extracted the detailed features of the image, such as color, texture and location features, and the deep convolution features were generally referred to the semantic features of the image. On the coding layer, this algorithm downsampled the shallow convolution features and fused them into the deep convolution features, and upsampled the deep convolution features to the shallow convolution feature. Experiments show that this method can greatly improve the coding quality. In the decoding, it also fused the convolutional features by encoding to obtain the lost information in the decoding and also obtained a better decoded image. In addition, this paper designed a layer-by-layer supervision method to guide the training of the decoding layer, which used the standard region extraction map by down-sampling as the standard image for supervision training. The experimental results show that this algorithm can increase the F-measure by 0.071 on the basis of PAGRN, and reduce the MEA by 0.031 on average.