红外与可见光图像实时配准融合系统

描述了一个自主研制的基于实时分布式多处理机的图像配准和融合系统的设计与实现方案。本系统是具有并行计算机体系结构的通用高速实时图像融合处理系统，选择VxWorks实时操作系统和VEM64x总线的软硬件平台，采用AD公司新型的TS101DSP处理器为核心，多DSP处理器分布并行进行处理，完成多源图像实时高速配准和融合需要进行的大量运算，CPLD芯片完成了采集控制以及多传感器视频同步。由于采用了基于高性能DSP的实时嵌入式系统和通用标准化总线结构设计，该系统可以灵活地应用多种配准和融合算法来实现可见光和红外双通道数字图像的高速实时融合处理，比较好地解决多尺度图像配准融合算法的大数据量计算处理与系统实时性要求之间的矛盾，为多传感器实时图像配准融合处理系统的研制奠定了良好的技术基础。     

二维平面内的增强现实虚实配准问题研究

增强现实是把计算机产生的虚拟物体或其它信息合成到用户看到的真实世界中的一种技术。实现虚拟信息与真实景象的正确匹配或有机结合是每个增强现实实用系统都必须完成的一项重要任务。文中在对二维平面内增强现实应用研究分析的基础上,重点讨论了图像分析技术在虚实配准问题中的应用,提出了一种基于数值背景表达的快速虚实配准策略,以提高虚实配准过程中场景特征点提取的精度和速度。     

基于VME总线视频融合系统

融合方法的理论研究较多,而通用的实时图像融合系统较少.本文给出了具有VME总线、并行分布式结构的系统方案,核心是基于标准总线的实时系统,DSP并行完成多源图像实时配准和融合,FPGA实现总线和视频同步控制.所实现的系统具有运算能力强、通信带宽大、可扩展性和通用性强的特点,实用表明了它的可行性.     

A Novel Image Mosaicking Technique for Enlarging the Field of View of Images Transmitted over Wireless Image Sensor Networks

Existing image mosaicking algorithms generate a complete scene that incorporates a number of images captured by several cameras. The traditional image mosaicking approaches cannot be applied directly to the emerging Wireless Image Sensor Networks (WISNs), since the low performance of image transmission over wireless sensor networks causes a noticeable delay before an entire image is received by a control center node. In this work, we propose a Progressive Image Mosaicking Algorithm (PIMA) based on the multi-scan feature of Progressive JPEG (P-JPEG). The originality of PIMA is based essentially on how it successfully performs mosaicking by using incremental image quality, as opposed to traditional methods that require complete data from all images. PIMA builds mosaics of images that are decoded from P-JPEG scans at three levels of quality, and delivers an approximate view of the scene in a short time while the reception of further image data is still in progress. Thereafter, it updates the image registration on two other refined levels to gradually enhance the display quality. We also propose the concept of Richer Information and Likeliest (RIL) block pair, which is a variation of the Sum of Absolute Difference (SAD). RIL can improve significantly the accuracy of image registration. We have conducted an extensive set of experiments and evaluated our proposed schemes against selected existing approaches. Our performance results indicate that PIMA decreases the delay before the first display of the scene, while preserving equivalent performance and image quality when compared to existing patch-based image mosaicking algorithms.     

光学被动热补偿方式实现红外与可见光图像融合物镜设计

图像融合的配准精度是关系到图像融合质量的一个重要性能指标。本文所述的红外与可见光图像融合物镜系统采取平行光路布局、光学被动热补偿的方式提高图像融合的配准精度。本文首先分析对比了机械热补偿方式与光学热补偿方式对提高图像配准精度的贡献;其次根据图像融合物镜系统的性能指标对红外物镜和可见光物镜进行光学被动热补偿的优化设计,并分析了对可见光物镜进行光学被动热补偿设计的必要性;第三从光学布局型式及畸变变化来分析图像融合物镜系统的图像配准精度;最后根据图像融合物镜系统的成像质量和图像配准效果,可得出融合图像质量好、能满足指标要求的结论。     

高帧频DMD红外景象仿真设备电路与光学系统设计

针对红外半实物仿真试验中DMD红外景象仿真设备存在的时序同步、高帧频显示、光学匹配等使用问题,设计与研制了一套能够与常见被测红外凝视成像设备匹配使用的基于DMD的红外景象仿真设备。首先提出了合理可行的同步延时驱动方案和显示控制方案,设计与研制了同步信号处理电路和驱动电路,实现了仿真图像的时序同步和高帧频显示;其次根据常见被测红外凝视成像设备的光学参数,进行了光学系统设计与仿真,研制了照明光学系统和投影光学系统,实现了与常见被测红外凝视成像设备光学匹配。检测结果表明:该设备能够与多种被测红外凝视成像设备在时序上保持同步,并实现光学匹配,输出的仿真图像帧频可达300 Hz、最大可模拟温度为160℃、最小可模拟温差为0.03℃、最大图像对比度为0.7、空间非均匀性优于1%,已在红外半实物仿真试验中发挥了巨大作用。     

Registration algorithm based on image matching for outdoor AR system with fixed viewing position

An image registration method based on the Fourier-Mellin transform is introduced for an outdoor augmented reality (AR) system. For this type of AR system, the observation position is fixed, and a complex 3-D registration problem can be reduced to a 2-D image registration for this fixed viewing position system. An observation globe model for this method is proposed. Under this supposition, a Fourier-Mellin transform is used in image registration, and the architecture of this system is illustrated. Experimental results show that this image registration algorithm is accurate and robust. It is effective for an outdoor AR system with a fixed viewing position.     

A robust image reconstruction algorithm and its parallel implementation in electrical impedance tomography

An efficient and robust image reconstruction algorithm for static impedance imaging using Hachtel's augmented matrix method was developed. This improved Newton-Raphson method produced more accurate images by reducing the undesirable effects of the ill-conditioned Hessian matrix. It is demonstrated that the electrical impedance tomography (EIT) system could produce two-dimensional static images from a physical phantom with 7% spatial resolution at the center and 5% at the periphery. Static EIT image reconstruction requires a large amount of computation. In order to overcome the limitations on reducing the computation time by algorithmic approaches, the improved Newton-Raphson algorithm was implemented on a parallel computer system. It is shown that the parallel computation could reduce the computation time from hours to minutes.     

基于并行分离增广拉格朗日乘子法的字符矫正

字符矫正是光学字符识别(OCR)系统预处理过程中 的重要步骤,针对传统的增广拉格朗日乘子法(ALM)求解字符矫正问题时收敛性和计算速度 的不足,本文研究了并行分离的增广拉格朗日乘子法,综合考虑字符矫正模型的建立过程, 提出并行分离方法与ALM相结合的思想解决字符 矫正问题。用并行方式将迭代问题分解成3个子问题,计算时能够同时求解分解后的这3个 子问题,然后进行凸组合,最 后收敛到问题的最优解。实验结果表明,本文算法能够快速准确地对变形的字符图像进 行矫正,并且具有良好的实时性和适 应性,可用于OCR系统的矫正预处理中,提高OCR系统的识别率。     

Design and evaluation of a system for microscope-assisted guided interventions (MAGI)

The problem of providing surgical navigation using image overlays on the operative scene can be split into four main tasks--calibration of the optical system; registration of preoperative images to the patient; system and patient tracking, and display using a suitable visualization scheme. To achieve a convincing result in the magnified microscope view a very high alignment accuracy is required. We have simulated an entire image overlay system to establish the most significant sources of error and improved each of the stages involved. The microscope calibration process has been automated. We have introduced bone-implanted markers for registration and incorporated a locking acrylic dental stent (LADS) for patient tracking. The LADS can also provide a less-invasive registration device with mean target error of 0.7 mm in volunteer experiments. These improvements have significantly increased the alignment accuracy of our overlays. Phantom accuracy is 0.3-0.5 mm and clinical overlay errors were 0.5-1.0 mm on the bone fiducials and 0.5-4 mm on target structures. We have improved the graphical representation of the stereo overlays. The resulting system provides three-dimensional surgical navigation for microscope-assisted guided interventions (MAGI).     

Simultaneous homographic and comparametric alignment of multiple exposure-adjusted pictures of the same scene

An approach is presented that can simultaneously align multiple exposure-adjusted pictures of the same scene both in their spatial coordinates as well as in their pixel values. The approach is featureless and produces an image mosaic at a common spatial and exposure reference and also addresses the misalignment problem common to methods that compose mosaics from only pair-wise registered image pairs. The objective function considered minimizes the sum of the collective variance over pixels of a global coordinate grid on which to create the final image. The models employed relate images spatially by homographic transformations and tonally by comparametric functions. The importance of performing joint spatial and tonal registration on exposure-adjusted images is emphasized by providing two examples in which spatial-only registration fails. The performance between pair-wise and simultaneous registration under both spatial-only and joint registration procedures is discussed.     

基于显著性检测的不同视角下红外与可见光图像融合

融合红外图像的热源目标和可见光图像的清晰背景可以实现低照度条件下与场景关联的异常行为识别。现有以特征匹配为主的融合方法,受监控场景下可见光与红外成像的尺度、视角、目标特性等差异影响,配准及融合效率及准确性受限。针对该问题,本文提出了基于显著性检测的不同视角下红外与可见光图像融合方法。通过预设热敏感目标,计算可见光与红外的视场转换模型,预先配准红外与可见光视场。使用Mask R-CNN网络提取红外图像中的行人目标显著性区域,根据视场转换模型点将每个目标区域与可见光图像局部融合。最后,通过违规入侵行为辨识为目标进行实验验证。实验表明,论文提出的融合方法能够有效地将红外图像的热敏目标信息与可见光的场景进行融合,可以准确地判断是否发生违规入侵行为。     

A VLSI Architecture for Image Registration in Real Time

Image registration is an ubiquitous task occurring in countless image analysis applications. A dedicated implementation of image registration algorithms is the best approach to meet the intensive computation requirements of implementing image registration schemes in real time. This paper presents an efficient VLSI architecture for real-time implementation of image registration algorithms using an exhaustive search method. Normalized cross correlation function, mean square error, and blue screen technique algorithms are implemented for image registration. The architecture is based on a data flow design that allows sequential inputs but performs parallel processing. Based on the architecture, a programmable chip can be designed for image registration. Chips can be cascaded to achieve better performance and sizes of both the search and the reference image which can vary with time from a small to a very large value.     

同时偏振成像探测系统的偏振图像配准研究

同时偏振成像探测技术是一种新型的偏振成像探测技术,它能在同一个探测器上同时获得被探测目标0、45、90、135 4个偏振方向的偏振强度图像。为了准确获取被探测目标的偏振信息,这４幅图像的配准显得尤为重要。为了使配准精度达到0.1个像元,结合同时偏振成像探测系统的成像方式,提出了一种基于空域和频域互相关的偏振图像配准方法。该方法使用硬件和软件相结合的方式完成图像的配准。首先使用空域互相关的算法实现图像的像元级粗配准;然后使用频域互相关的像元级配准算法进行像元级精配准;最后使用频域互相关的亚像元配准算法实现偏振图像的亚像元级配准。     

视频序列闪烁减弱的一种方法

减弱闪烁是摄像机预处理模块中非常关键的技术之一.提出了一种采用时域滤波来减弱序列闪烁的方法,该方法首先根据闪烁形成的原因得出闪烁的频率,进而设计相应的时域滤波器来减弱闪烁.对于静止或低速变化的场景变换,该方法可以取得很好的效果;对于高速变化的场景,通过设定阈值的方法来判断是否使用滤波器,也能达到较好的效果.     

大规模水下传感器网络时间同步研究

该文针对大规模水下传感器网络,对信标节点覆盖内的节点,设计了基于静态信标节点的时间同步算法;对信标节点覆盖范围外的节点,设计了动态节点辅助的时间同步算法。减少了节点移动对同步精度的影响。同时,根据水下声速变化规律,设计了水下传感器网络分层时间同步机制,有效克服了已有算法在处理大规模水下传感器网络时间同步问题上的不足。仿真结果表明,该方法的同步效果明显好于现有的算法。     

In vivo micro-image mosaicing

Recent advances in optical imaging have led to the development of miniature microscopes that can be brought to the patient for visualizing tissue structures in vivo. These devices have the potential to revolutionize health care by replacing tissue biopsy with in vivo pathology. One of the primary limitations of these microscopes, however, is that the constrained field of view can make image interpretation and navigation difficult. In this paper, we show that image mosaicing can be a powerful tool for widening the field of view and creating image maps of microanatomical structures. First, we present an efficient algorithm for pairwise image mosaicing that can be implemented in real time. Then, we address two of the main challenges associated with image mosaicing in medical applications: cumulative image registration errors and scene deformation. To deal with cumulative errors, we present a global alignment algorithm that draws upon techniques commonly used in probabilistic robotics. To accommodate scene deformation, we present a local alignment algorithm that incorporates deformable surface models into the mosaicing framework. These algorithms are demonstrated on image sequences acquired in vivo with various imaging devices including a hand-held dual-axes confocal microscope, a miniature two-photon microscope, and a commercially available confocal microendoscope.     

Parallel image processing with the block data parallel architecture

Many digital signal and image processing algorithms can be speeded up by executing them in parallel on multiple processors. The speed of parallel execution is limited by the need for communication and synchronization between processors. In this paper, we present a paradigm for parallel processing that we call the block data flow paradigm (BDFP). The goal of this paradigm is to reduce interprocessor communication and relax the synchronization requirements for such applications. We present the block data parallel architecture which implements this paradigm, and we present methods for mapping algorithms onto this architecture. We illustrate this methodology for several applications including two-dimensional (2-D) digital filters, the 2-D discrete cosine transform, QR decomposition of a matrix and Cholesky factorization of a matrix. We analyze the resulting system performance for these applications with regard to speedup and efficiency as the number of processors increases. Our results demonstrate that the block data parallel architecture is a flexible, high-performance solution for numerous digital signal and image processing algorithms     

基于DMD的红外景象投射器灰度调制与同步技术

基于数字微镜（DMD）的红外场景投射器可以被应用于场景仿真系统中。论述了应用于红外仿真系统的DMD显示灰度图像的原理和对应的DMD的工作时序,并且设计了基于TI的0.7XGA芯片组的红外场景投射器。该设计支持外部同步触发,投射图像是灰度级是8位,并且投射图像的帧频大于250Hz。仿真系统中的热像仪和投射器的同步将影响采集的结果,分析了热像仪的积分时间包含、超前和滞后于投射器播放时间对系统采集到的图案灰度产生影响,论证了严格同步在红外仿真系统中的必要性,并通过实验数据进一步证明了分析的结果。     

Aerial video surveillance and exploitation

There is growing interest in performing aerial surveillance using video cameras. Compared to traditional framing cameras, video cameras provide the capability to observe ongoing activity within a scene and to automatically control the camera to track the activity. However, the high data rates and relatively small field of view of video cameras present new technical challenges that must be overcome before such cameras can be widely used. In this paper, we present a framework and details of the key components for real-time, automatic exploitation of aerial video for surveillance applications. The framework involves separating an aerial video into the natural components corresponding to the scene. Three major components of the scene are the static background geometry, moving objects, and appearance of the static and dynamic components of the scene. In order to delineate videos into these scene components, we have developed real time, image-processing techniques for 2-D/3-D frame-to-frame alignment, change detection, camera control, and tracking of independently moving objects in cluttered scenes. The geo-location of video and tracked objects is estimated by registration of the video to controlled reference imagery, elevation maps, and site models. Finally static, dynamic and reprojected mosaics may be constructed for compression, enhanced visualization, and mapping applications