用于遥感舰船细粒度检测与识别的关键子区域融合网络

目的 遥感图像中的舰船目标细粒度检测与识别在港口海域监视以及情报搜集等应用中有很高的实际应用价值,但遥感图像中不同种类的舰船目标整体颜色、形状与纹理特征相近,分辨力不足,导致舰船细粒度识别困难。针对该问题,提出了一种端到端的基于关键子区域特征的舰船细粒度检测与识别方法。方法 为了获得更适于目标细粒度识别的特征,提出多层次特征融合识别网络,按照整体、局部子区域两个层次从检测网络得到的候选目标区域中提取特征。然后结合候选目标中所有子区域的信息计算每个子区域的判别性显著度,对含有判别性组件的关键子区域进行挖掘。最后基于判别性显著度将子区域特征与整体特征进行自适应融合,形成表征能力更强的特征,对舰船目标进行细粒度识别。整个检测与识别网络采用端到端一体化设计,所有候选目标特征提取过程只需要经过一次骨干网络的计算,提高了计算效率。结果 在公开的带有细粒度类别标签的HRSC2016(high resolution ship collection)数据集L3任务上,本文方法平均准确率为77.3%,相较于不采用多层次特征融合识别网络提升了6.3%;在自建的包含45类舰船目标的FGSAID(fine-gr...     

基于区域性能的自适应遥感图像融合方法

为了把图像的融合效果评价信息加入到融合规则的选取过程当中,针对合成孔径雷达和可见光两种常见的遥感图像,提出了一种基于区域性能的自适应融合方法。该方法首先利用平滑滤波抑制SAR图像斑点噪声,再分别对源图像作小波分解。融合图像的低频系数由一组区域性能评价参量按隶属度控制规则自适应调节得到;高频系数则直接采用可见光图像的高频系数,对新的低频和高频系数实施小波反变换即可得到融合图像。实验结果表明该方法能够取得很好的融合效果。     

Information fusion techniques for change detection from multi-temporal remote sensing images

In order to investigate the impacts of different information fusion techniques on change detection, a sequential fusion strategy combining pan-sharpening with decision level fusion is introduced into change detection from multi-temporal remotely sensed images. Generally, change map from multi-temporal remote sensing images using any single method or single kind of data source may contain a number of omission/commission errors, degrading the detection accuracy to a great extent. To take advantage of the merits of multi-resolution image and multiple information fusion schemes, the proposed procedure consists of two steps: (1) change detection from pan-sharpened images, and (2) final change detection map generation by decision level fusion. Impacts of different fusion techniques on change detection results are evaluated by unsupervised similarity metric and supervised accuracy indices. Multi-temporal QuickBird and ALOS images are used for experiments. The experimental results demonstrate the positive impacts of different fusion strategies on change detection. Especially, pan-sharpening techniques improve spatial resolution and image quality, which effectively reduces the omission errors in change detection; and decision level fusion integrates the change maps from spatially enhanced fusion datasets and can well reduce the commission errors. Therefore, the overall accuracy of change detection can be increased step by step by the proposed sequential fusion framework.     

Pan-sharpening based on common saliency feature analysis and multiscale spatial information extraction for multiple remote sensing images

ABSTRACT

The requirements of spectral and spatial quality differ from region to region in remote sensing images. The employment of saliency in pan-sharpening methods is an effective approach to fulfil this kind of demands. Common saliency feature analysis, which considers the mutual information between multiple images, can ensure the consistency and accuracy when assigning saliency to regions in different images. Thus, we propose a pan-sharpening method based on common saliency feature analysis and multiscale spatial information extraction for multiple remote sensing images. Firstly, we extract spatial information by the guided filter and accurate intensity component estimation. Then, a common saliency feature analysis method based on global contrast calculation and intensity feature extraction is designed to obtain preliminary pixel-wise saliency estimation, which is subsequently integrated with text-featured based compensation to generate adaptive injection gains. The introduction of common saliency feature analysis guarantees that the same pan-sharpening strategy will be applied to regions with similar features in multiple images. Finally, the injection gains are used to implement the detail injection. Our proposal satisfies diverse needs of spatial and spectral information for different regions in the single image and guarantees that regions with similar features in different images are treated consistently in the process of pan-sharpening. Both visual and quantitative results demonstrate that our method has better performance in guaranteeing consistency in multiple images, improving spatial quality and preserving spectral fidelity.     

Secure fusion of encrypted remote sensing images based on Brovey

Dear editor, In the field of image fusion,panchromatic images captured by the Satellite Pour l'Observation de la Terre(SPOT)[1]have high spatial resolutions,whe...     

基于局部-全局特征耦合与边界引导的遥感图像建筑物变化检测

针对现有变化检测方法局部特征和全局特征难以兼顾、变化对象和背景之间分界模糊的问题,提出了一种基于局部-全局特征耦合与边界引导的遥感图像建筑物变化检测方法。该方法在编码阶段采用并行的卷积神经网络和Transformer分别提取遥感图像的局部特征与全局表示。在不同尺度下,使用局部-全局特征耦合模块融合局部特征和全局特征表示,以增强图像特征的表达能力。引入边界引导分支获取变化对象的先验边界信息,使其引导变化图突出建筑物的结构特征,促进边界精确定位。该方法在LEVIR-CD和WHU数据集上进行实验验证,其F1-score分别为91.25%和91.27%,IoU分别为83.90%和83.95%。实验结果表明,该方法在检测精度上有较大的提升,且具有良好的泛化能力。     

基于视觉注意机制的遥感图像显著性目标检测

显著性目标检测是遥感图像处理的重要研究领域,传统的方法通过逐个像素点的计算来实现目标检测,难以满足遥感图像大面积实时处理的要求。将视觉注意机制应用到遥感图像的显著性目标检测中,在训练阶段,将所有的目标融合成目标类,所有的背景融合成背景类,目标类的显著性均值与背景类的显著性均值的比值得到一个权重向量;在检测阶段,所有的特征图乘以权重向量得到自顶向下的显著性图;自顶向下和自底向上的显著性图融合生成全局显著性图。实验结果表明当目标和背景不是总成对出现时,该方法的检测结果优于Navalpakkam模型和Frintrop模型的检测结果。     

Hierarchical fusion and divergent activation based weakly supervised learning for object detection from remote sensing images

Object detection and location from remote sensing (RS) images is challenging, computationally expensive, and labor intense. Benefiting from research on convolutional neural networks (CNNs), the performance in this field has improved in the recent years. However, object detection methods based on CNNs require a large number of images with annotation information for training. For object location, these annotations must contain bounding boxes. Furthermore, objects in RS images are usually small and densely co-located, leading to a high cost of manual annotation. We tackle the problem of weakly supervised object detection under such conditions, aiming to learn detectors with only image-level annotations, i.e., without bounding box annotations. Based on the fact that the feature maps of a CNN are localizable, we hierarchically fuse the location information from the shallow feature map with the class activation map to obtain accurate object locations. In order to mitigate the loss of small or densely distributed objects, we introduce a divergent activation module and a similarity module into the network. The divergent activation module is used to improve the response strength of the low-response areas in the shallow feature map. Densely distributed objects in RS images, such as aircraft in an airport, often exhibit a certain similarity. The similarity module is used to improve the feature distribution of the shallow feature map and to suppress background noise. Comprehensive experiments on a public dataset and a self-assembled dataset (which we made publicly available) show the superior performance of our method compared to state-of-the-art object detectors.     

Small-scale aircraft detection in remote sensing images based on Faster-RCNN

Multimedia Tools and Applications - Detecting aircraft in remote sensing images becomes increasingly important in both military and civilian fields. However, the accuracy of existing detection...     

基于阴影概率模型的遥感影像阴影检测方法

阴影区像素光谱响应的不一致性使得依据阈值获取的阴影检测结果与真实情况出入较大。针对这一问题,结合不透明度和亮度两种信息设计了一个全新的阴影概率模型。在此基础上,针对邻域像素信息未能充分利用的问题,提出了一个基于多尺度马尔可夫随机场(MRF)的遥感影像检测方法。首先,用所提出的模型描述多尺度影像中像素的阴影概率;然后,使用Potts模型建模多尺度标记场,同时兼顾尺度内和尺度间的邻域像素的交互关系;最后,基于最大后验(MAP)概率准则获取最终阴影检测结果。通过与色调亮度比值方法、差分双阈值方法、主成分分析法和支持向量机分类方法的对比实验证明,所提出的方法能够提高高分辨率城区遥感影像的阴影检测精度。     

基于GA-EM算法的GMM遥感影像变化检测方法*

提出了一种基于GA-EM算法的高斯混合模型(GMM)遥感影像变化检测方法。该方法采用主成分分析(PCA)与传统差值法相结合的方式构造差异影像;然后使用N个成分的GMM对差异影像分布进行建模;再利用进化的迭代方法对模型进行自适应参数估计;最后利用贝叶斯准则实现变化和未变化像元分布的变化检测结果。仿真结果表明,该方法对变化目标的检测有效而可靠,具有较大的实用价值。     

Fusion based feature reinforcement component for remote sensing image object detection

Multimedia Tools and Applications - In recent years, convolutional neural networks (CNN) have been extensively used for generic object detection due to their powerful feature extraction...     

融合波段特征的多光谱遥感影像感知哈希认证算法

目的 多光谱遥感影像的完整性、真实性等安全问题逐步受到人们的关注,但是,传统认证技术更多地关注数据载体的认证,其不能满足多光谱遥感影像的认证需求。针对多光谱遥感影像的数据特点,提出一种融合波段感知特征的多光谱遥感影像感知哈希认证算法。方法 首先,采用隐形格网划分将多光谱影像的各个波段划分成不同的区域;然后,采用离散小波变换对各波段相同地理位置的格网单元进行分解,并分别采用不同的融合规则对小波变换后的不同分量进行融合;最后,通过Canny算子与奇异值分解提取融合结果的感知特征,再对提取的感知特征进行归一化,最终生成影像的感知哈希序列。多光谱影像的认证过程通过精确匹配感知哈希序列来实现。结果 本文算法采用Landsat TM影像和高分二号卫星的融合影像数据为实验对象,从摘要性、可区分行、鲁棒性、算法运行效率以及安全性等方面进行测试与分析。结果表明,该算法只需要32字节的认证信息就能够实现多光谱遥感影像的认证,摘要性有了较大提高,且算法运行效率提高约1倍;同时,该算法可以有效检测影像的恶意篡改,并对无损压缩和LSB水印嵌入保持近乎100%的鲁棒性。结论 本文算法克服了现有技术在摘要性、算法运行效率等方面不足,而且有较好的可区分性、鲁棒性,能够用于多光谱遥感影像的完整性认证,尤其适合对摘要性要求较高的环境。     

联合显著性特征与卷积神经网络的遥感影像舰船检测

目的 针对高分辨率遥感影像舰船检测受云雾、海浪以及海岛等复杂因素干扰,存在虚警率高、漏检率高、目标检测和识别困难等问题,提出一种联合视觉显著性特征与卷积神经网络的海面舰船目标检测方法。方法 基于频率域相位谱显著性检测能够有效抑制高分辨率遥感影像上云层、海面杂波干扰的特点,计算影像多尺度显著图并进行加权融合。采用对数变换对融合后的图像进行空间域灰度增强以提高目标与背景的区分度,利用灰度形态学闭运算填充舰船目标孔洞,采用大津分割法来提取疑似舰船目标作为兴趣区域。最后构建舰船样本库,利用迁移学习的思想训练卷积神经网络模型,对所有兴趣区域切片进行分类判断和识别,得到最终检测结果。结果 利用多幅不同背景下的高分辨率遥感影像,分别从视觉显著性检测、舰船粗检测与船只类型识别3个方面进行实验验证,选取检测率、虚警率、识别率3个指标进行定量评价。结果表明,本文方法相比于其他方法能有效排除云雾、海岛等多种因素的干扰,检测率、虚警率、识别率分别为93.63%、3.01%、90.09%,明显优于其他算法,能够实现大范围影像上多种类型舰船的快速准确检测和识别。结论 本文将图像视觉显著性检测快速获取图像显著目标的特点与卷积神经网络在图像分类的优势相结合,应用于遥感影像的海域舰船目标检测,能够实现对复杂背景下舰船目标的检测和船只类型的精细化识别。     

一种基于深度学习的遥感图像目标检测算法

遥感图像分析在国土资源管理、海洋监测等领域有着极为广阔的应用前景。深度学习技术已在图像处理领域取得突破性进展,然而,遥感图像固有的尺寸大、目标小而密集等特点,使得将面向普通图像的深度学习方法用于遥感目标检测普遍存在定位不准确、小目标检测难、大图检测精度差等问题。针对上述难题, 提出了一种新型遥感图像目标检测算法DFS。与传统机器学习方法相比,DFS 设计了新的维度聚类模块、定制损失函数和滑动窗口分割检测机制。其中,维度聚类模块通过设计聚类机制优化定制先验框,提高定位精度;定制损失函数提高对船只等小目标的检测精度;滑动窗口分割检测解决大图检测精度低的问题。在经典遥感数据集上开展的实验对比表明,与YOLOv2相比,DFS算法的mAP提高了256%,小目标检测效率及大图检测效能大幅提高。     

基于影像特征融合的遥感图像重构模式研究

基于影像特征级数据融合的遥感图像重构是在突出目标地物的空间结构和纹理特征情况下的信息融合。在数字图像小波多分辨率分析理论基础上,采用小波变换方法对高分辨遥感图像的目标地物边缘进行信息增强,然后与多光谱遥感图像进行特征信息融合。在融合过程中,首先对多光谱图像中的R、G、B三个波段的图像进行小波分解,得到相应的低频图像,然后对特征增强后的高分辨率图像进行小波分解,再将分解后的高频图像分别与低频图像进行融合,最后经RGB合成为彩色图像。该方法既改善了图像的清晰度和分辨率,同时也保留了原图像的光谱信息。通过融合实验验证了上述结论。     

基于特征量积与PCA的小波遥感图像融合

在遥感图像融合中,传统PCA算法会损失部分有用信息,从而使得融合结果的光谱分辨率受到较大影响,针对这种情况,借助小波变换优良的时频分析特性,利用特征量积来融合多光谱图像的第一主成分,实现了一种基于特征量积与PCA的小波遥感图像融合算法。通过对来自不同场景不同卫星的多光谱和全色图像进行融合实验,结果表明,该算法无论在主观视觉还是在客观统计数据上,均具有比其他方法较佳的融合效果。     

Object detection in remote sensing images based on deep transfer learning

Multimedia Tools and Applications - Object detection is a basic part in remote sensing image processing. At present, it is more common to conduct the topic based on deep learning, however the...