融合混合域注意力的YOLOv4在船舶检测中的应用

海上船舶检测在海事监管领域发挥着重要的作用,然而由于海上的复杂环境以及船型的多样性,现有的基于卷积神经网络的方法在船舶检测领域难以同时满足高精度和实时的要求。针对复杂环境下海上船舶实时检测困难的问题,提出一种基于YOLOv4的YOLO-Marine模型,该模型将混合注意力机制引入检测网络的backbone部分,首先使用Mosaic方法对船舶数据进行预处理,然后通过K-Means+〖KG-*3〗+聚类得到初始anchor,并在Darknet上实现模型,用真实船舶数据集对模型进行训练和评估。实验结果表明YOLO-marine与YOLOv4相比,将船舶检测任务的mAP提升了2.1个百分点,在保证实时性的同时有效提高了船舶检测的精度,且在小目标和遮挡目标检测方面效果突出。     

基于视觉感知的机器人工件识别方法研究

目的 解决定制化木门尺寸规格不统一、表面纹理多样而导致的堆垛分类困难、搬运效率低下等问题。方法 提出采用深度学习方法进行定制式木门工件检测,以YOLOV3网络为基本框架开展机器人工件识别方法研究。首先,通过图像数据增强和预处理,扩充定制式木门数据;然后,进行YOLO V3损失函数改进,并根据木门特征进行定制式木门数据集锚框尺度的重新聚类;最后,应用空间金字塔池化层进行YOLO V3中特征金字塔网络改进,并通过随机选取的测试集验证本文方法的有效性。结果 测试数据集的平均检测准确率均值达到98.05%,检测每张图片的时间为137 ms。结论 研究表明,本文方法能够满足木门生产线对准确率和实时性的要求,可大大提高定制化木门转线及堆垛效率。     

Convergence of Stereo Vision-Based Multimodal YOLOs for Faster Detectionof Potholes

Road potholes can cause serious social issues, such as unexpected damages to vehicles and traffic accidents. For efficient road management, technologies that quickly find potholes are required, and thus researches on such technologies have been conducted actively. The three-dimensional (3D) reconstruction method has relatively high accuracy and can be used in practice but it has limited application owing to its long data processing time and high sensor maintenance cost. The two-dimensional (2D) vision method has the advantage of inexpensive and easy application of sensor. Recently, although the 2D vision method using the convolutional neural network (CNN) has shown improved pothole detection performance and adaptability, large amount of data is required to sufficiently train the CNN. Therefore, we propose a method to improve the learning performance of CNN-based object detection model by artificially generating synthetic data similar to a pothole and enhancing the learning data. Additionally, to make the defective areas appear more contrasting, the transformed disparity map (TDM) was calculated using stereo-vision cameras, and the detection performance of the model was further improved through the late fusion with RGB (Red, Green, Blue) images. Consequently, through the convergence of multimodal You Only Look Once (YOLO) frameworks trained by RGB images and TDMs respectively, the detection performance was enhanced by 10.7% compared with that when using only RGB. Further, the superiority of the proposed method was confirmed by showing that the data processing speed was two times faster than the existing 3D reconstruction method.     

Improved traffic sign recognition algorithm based on YOLOv4-tiny

This study offers an enhanced yolov4-tiny traffic sign identification method for easy deployment on mobile or embedded devices to address the difficulties of a high number of parameters, low recognition accuracy, and poor real-time performance of traffic sign recognition models in complex scenarios. The yolov4-tiny network serves as the model’s foundation. To begin, Octave Convolution is incorporated into the backbone network to eliminate low-frequency feature redundancy, lowering the number of parameters in the model and enhancing computational efficiency. Second, the convolutional block attention module is employed to improve the recognition accuracy of small and medium-sized targets by strengthening the weights of traffic sign regions and suppressing the weights of invalid features. Finally, in the feature fusion stage, the Feature Pyramid Networks structure is replaced with the Simplified Path Aggregation Network structure to improve the fusing of shallow feature information with deep semantic knowledge and lower the miss detection rate even more On the TT100K data set as well as on CCTSDB dataset, the experimental results suggest that our technique can achieve good recognition performance. With a 16MB model size, our solution improves the mean average precision by 3.5 percent and the Frame Per Second by 12.5 f/s when compared to the yolov4-tiny algorithm. Our method outperforms yolov4-tiny in terms of recognition accuracy and detection speed, and it can easily meet the real-time requirements for traffic sign recognition.     

Efficient Object Detection and Classification Approach Using HTYOLOV4 and M²RFO-CNN

Object detection and classification are the trending research topics in the field of computer vision because of their applications like visual surveillance. However, the vision-based objects detection and classification methods still suffer from detecting smaller objects and dense objects in the complex dynamic environment with high accuracy and precision. The present paper proposes a novel enhanced method to detect and classify objects using Hyperbolic Tangent based You Only Look Once V4 with a Modified Manta-Ray Foraging Optimization-based Convolution Neural Network. Initially, in the pre-processing, the video data was converted into image sequences and Polynomial Adaptive Edge was applied to preserve the Algorithm method for image resizing and noise removal. The noiseless resized image sequences contrast was enhanced using Contrast Limited Adaptive Edge Preserving Algorithm. And, with the contrast-enhanced image sequences, the Hyperbolic Tangent based You Only Look Once V4 was trained for object detection. Additionally, to detect smaller objects with high accuracy, Grasp configuration was observed for every detected object. Finally, the Modified Manta-Ray Foraging Optimization-based Convolution Neural Network method was carried out for the detection and the classification of objects. Comparative experiments were conducted on various benchmark datasets and methods that showed improved accurate detection and classification results.     

基于YOLO框架的无锚框输电线多种缺陷检测

检测并及时修复输电线路的缺陷是电能安全输送的重要保障。针对现有检测方法存在效率低、对多尺度目标检测精度低、泛化能力差等不足,提出了一种基于无人机影像的无锚框输电线缺陷检测方法。该方法基于YOLO系列目标检测框架构建了一种无锚框的检测网络,设计了相匹配的正负样本分配方式,融入了多种优化策略,有效改善了现有方法的不足。实验结果表明,提出的方法能够同时对输电线的断股、散股、断线、烧伤和异物5种缺陷进行有效检测。相比于传统输电线缺陷识别方法和基于深度学习的缺陷检测方法SSD、Faster R-CNN、YOLOv4、YOLOv5,该方法的平均精度均值(mAP)达到78.31%,每秒传输帧数(FPS)为103.5 f/s,同时兼备检测的快速性和高精度,在5类输电线缺陷检测任务中均具有良好的性能。     

油气站场视频监控系统的设计与应用

安全监控系统的集成化、智能化升级是油气站场亟待解决的问题。针对当前系统的弊端,设计开发油气站场智能视频监控系统。利用宽动态技术,解决早期监控摄像头采集到的视频信号易受天气影响,画质不佳,有用信息不足等问题。并利用YOLO目标检测算法,实现对区域内人员未戴安全帽的行为进行监控。最后构建基于B/S架构的安防设备集成管理平台,将算法同监控视频画面集成,并显示站场三维地图,为后续站场数据可视化预留扩展接口。实践应用表明该系统能显著提升油气站场智能视频监控水平。     

铁路接触网支柱的图像序列自适应识别方法

接触网支柱数字化管理是电气化铁路运维的关键环节,基于移动视频建立接触网支柱数字台账是高效、经济、便捷的技术手段。为实现对于移动视频图像序列中接触网支柱杆号的精准识别,提出了一种基于区域相关和改进SVTR网络的接触网支柱识别算法。针对视频图像中接触网支柱区域重叠、结构模式复杂的特点,采用了YOLO v4网络对单帧图像中支柱区域和号牌标识区域分别进行检测,并通过测算交叠区域来获得距观察点最近的杆位和对应的号牌区域。此外,针对接触网杆号牌尺度多样性和字符变长的问题,在杆号文字识别问题中采用了SVTR-tiny网络,并进一步引入迁移学习方法增强模型对于复杂杆号的识别精度和对于不同线路场景的泛化性能。通过在实际高铁线路采集的移动视频数据集上进行测试,结果表明算法在移动视频中视野最近杆位杆号区域的定位检出率可达98.01%,杆号文本的识别准确率达到96.13%,适用于我国高速铁路主要干线建设配套的接触网支柱结构。     

改进YOLOX的轻量级安全帽检测方法

针对施工环境下安全帽数据集少,被检测物体目标小和现有检测模型参数量大导致的模型鲁棒性差,准确率低,训练时间长问题,提出了一种改进YOLOX网络的安全帽检测方法。使用在线困难样本挖掘（OHEM）寻找数据集中的困难样本,结合马赛克（Mosaic）方法对困难样本拼接来扩充训练集数量;在模型预测端（prediction）加入分支注意力模块,将网络输出分为两部分输入模块来提取空间层面和通道层面上关键信息;提出一种新的余弦退火算法,初始时加入预热（warm up）,过程中逐段减小学习率曲线的振荡幅度,训练中减小模型的收敛时间。实验结果表明,与原方法相比,改进安全帽检测方法对安全帽检测的mAP、准确率、召回率分别提高了6.77、2.52、9.14个百分点,训练中使用CDWR余弦退火算法在同周期下损失值减少了0.5～1.0,与原算法相比训练收敛时间减少约50%。     

多尺度特征在YOLO算法中的应用研究

针对YOLO算法在下采样过程中丢失了部分大尺寸特征图的有效信息,从而导致在检测任务中因目标定位不够精准而影响模型整体检测精度的问题。提出利用多尺度特征融合的方法来解决YOLO定位不精准的问题,首先,对YOLO算法的网络模型进行修改,利用YOLO网络模型中不同尺寸特征图具有不同特征属性的特点,融合不同尺寸特征图来提高检测网络对目标的定位精度;其次在预训练模型的基础上对修改后的网络模型进行重新训练;最后在计算机中对训练好的模型进行检测试验。实验结果表明,基于多尺度特征的YOLO目标检测算法在精确率上相对于YOLO目标检测算法提高了3.02%,mAP提高了1.53%。