A time-code ALU for a microprocessor-based video editing system

An Arithmetic Logic Unit (ALU) was designed for use in a microprocessor-based video editing system. The hardware ALU developed implemented the time-code addition/subtraction required for video editing operating using the European Broadcasting Union standard format for time-code. The ALU was interfaced to an S-100 bus and tested with the North Star Z80A microprocessor development system.     

Analogies based video editing

A well-produced video always creates a strong impression on the viewer. However, due to the limitations of the camera, the ambient conditions or the skills of the videographer, the quality of captured videos sometimes falls short of one's expectations. On the other hand, we have a vast amount of superbly captured videos available on the web and in digital libraries. In this paper, we propose the novel approach of video analogies that provides a powerful ability to improve the quality of a video by borrowing features from a higher quality video. We want to improve the given target video in order to obtain a higher quality output video. During the matching phase, we find the correspondence between the pair by using feature matching. Then for the target video, we utilize this correspondence to transfer some desired traits of the source video into the target video in order to obtain a new video. Thus, the new video will obtain the desired features from the source video while retaining the merits of the target video. The video analogies technique provides an intuitive mechanism for automatic editing of videos. We demonstrate the utility of the analogies method by considering three applications – colorizing videos, reducing video blurs, and video rhythm adjustment. We describe each application in detail and provide experimental results to establish the efficacy of the proposed approach.     

真实感视频雨景编辑

用计算机来模拟雨景是影视制作中经常面临的一个课题。目前主要采用的粒子系统方法一般都需要大量的粒子和复杂的物理模型来模拟真实的雨景。提出了一种新的基于图像的方法来实现真实感雨景的绘制。用最小值滤波和改进的Matting算法相结合的方法,从视频中分割出真实的雨幕,然后根据目标场景的光照条件改变雨幕的颜色,最后将其与目标场景融合在一起。实验证明,该方法十分有效。同时该方法是完全基于视频图像的,避免了昂贵的3D场景建模,适合于低成本的影片制作和影视素材重用领域。     

Interactive 3D video editing

We present a generic and versatile framework for interactive editing of 3D video footage. Our framework combines the advantages of conventional 2D video editing with the power of more advanced, depth-enhanced 3D video streams. Our editor takes 3D video as input and writes both 2D or 3D video formats as output. Its underlying core data structure is a novel 4D spatio-temporal representation which we call the video hypervolume. Conceptually, the processing loop comprises three fundamental operators: slicing, selection, and editing. The slicing operator allows users to visualize arbitrary hyperslices from the 4D data set. The selection operator labels subsets of the footage for spatio-temporal editing. This operator includes a 4D graph-cut based algorithm for object selection. The actual editing operators include cut & paste, affine transformations, and compositing with other media, such as images and 2D video. For high-quality rendering, we employ EWA splatting with view-dependent texturing and boundary matting. We demonstrate the applicability of our methods to post-production of 3D video.     

自动装载与视频监控远程控制系统

设计了一种嵌入式自动装载与视频监控系统,并通过网络实现远程控制。该系统采用S3C2410处理器,移植Linux操作系统,成功运行在S3C2410上。视频监控模块使用的摄像头是USB接口形式,移植对应的Linux驱动程序,摄像头才能正常采集数据。移植Libjpeg开源库,对经硬件压缩的图像进行解压,通过显示终端显示,进而实时对现场进行监控。自动装载模块的实现,首先设定期望的货物摆放路径,其次利用Framebuffer帧缓冲写屏技术在显示终端上显示自动装载过程。通过Socket网络接口,上位机可对该系统进行远程控制。     

Disk scheduling in video editing systems

Modern video servers support both video-on-demand and nonlinear editing applications. Video-on-demand servers enable the user to view video clips or movies from a video database, while nonlinear editing systems enable the user to manipulate the content of the video database. Applications such as video and news editing systems require that the underlying storage server be able to concurrently record live broadcast information, modify prerecorded data, and broadcast an authored presentation. A multimedia storage server that efficiently supports such a diverse group of activities constitutes the focus of this study. A novel real-time disk scheduling algorithm is presented that treats both read and write requests in a homogeneous manner in order to ensure that their deadlines are met. Due to real-time demands of movie viewing, read requests have to be fulfilled within certain deadlines; otherwise, they are considered lost. Since the data to be written into disk is stored in main memory buffers, write requests can be postponed until critical read requests are processed. However, write requests still have to be processed within reasonable delays and without the possibility of indefinite postponement. This is due to the physical constraint of the limited size of the main memory write buffers. The new algorithm schedules both read and write requests appropriately, to minimize the amount of disk reads that do not meet their presentation deadlines, and to avoid indefinite postponement and large buffer sizes in the case of disk writes. Simulation results demonstrate that the proposed algorithm offers low violations of read deadlines, reduces waiting time for lower priority disk requests, and improves the throughput of the storage server by enhancing the utilization of available disk bandwidth     

高精度指针仪表自动读数识别方法

实现一个高精度指针仪表读数自动识别系统．用数码摄像头采集仪表的图像,然后利用数字图像处理技术识别刻度和指针,根据指针和刻度的相对位置计算指针读数值．使用条件霍夫变换（Constrained HOUGH Transfer）和中心投影分析法实现刻度的全自动识别,采用快速中心投影法进行指针检测与识别,识别速度达到68ms．实验结果表明该方法比传统方法速度快、精度高,系统读数平均误差仅为0．016％．     

Temporally coherent and spatially accurate video matting

Image and video matting are still challenging problems in areas with low foreground‐background contrast. Video matting also has the challenge of ensuring temporally coherent mattes because the human visual system is highly sensitive to temporal jitter and flickering. On the other hand, video provides the opportunity to use information from other frames to improve the matte accuracy on a given frame. In this paper, we present a new video matting approach that improves the temporal coherence while maintaining high spatial accuracy in the computed mattes. We build sample sets of temporal and local samples that cover all the color distributions of the object and background over all previous frames. This helps guarantee spatial accuracy and temporal coherence by ensuring that proper samples are found even when distantly located in space or time. An explicit energy term encourages temporal consistency in the mattes derived from the selected samples. In addition, we use localized texture features to improve spatial accuracy in low contrast regions where color distributions overlap. The proposed method results in better spatial accuracy and temporal coherence than existing video matting methods.     

VIDOS, a system for video editing and format conversion over the Internet

VIDOS is a Java-based server–client video management system that permits one to customize a personal version of any downloadable digital video file over the Internet or local intranet. It enables one, without purchasing expensive video editing software, to edit the video spatially and temporally, to specify the desired zoom factor, frame rate and video format, and to choose the nature and quality of digital compression before downloading the edited video. VIDOS permits videos to be adapted to suit their end uses. By potentially reducing their size, it can improve corporate and personal efficiency by speeding network transfers and cutting disc storage requirements.     

Searching and editing MPEG-compressed video in a distributed online environment

WebClip (on-line demo at http://www.ctr.columbia.edu/webclip) is a compressed video searching and editing system operating over the World Wide Web. WebClip uses a distributed client-server model including a server engine for content analysis/editing, and clients for interactive controls of video browsing/editing. It specializes several unique features, including compressed-domain video feature extraction and manipulation, multi-resolution video access, content based video browsing/retrieval, and a distributed network architecture.     

Learning automatic concept detectors from online video

Concept detection is targeted at automatically labeling video content with semantic concepts appearing in it, like objects, locations, or activities. While concept detectors have become key components in many research prototypes for content-based video retrieval, their practical use is limited by the need for large-scale annotated training sets. To overcome this problem, we propose to train concept detectors on material downloaded from web-based video sharing portals like YouTube, such that training is based on tags given by users during upload, no manual annotation is required, and concept detection can scale up to thousands of concepts. On the downside, web video as training material is a complex domain, and the tags associated with it are weak and unreliable. Consequently, performance loss is to be expected when replacing high-quality state-of-the-art training sets with web video content.This paper presents a concept detection prototype named TubeTagger that utilizes YouTube content for an autonomous training. In quantitative experiments, we compare the performance when training on web video and on standard datasets from the literature. It is demonstrated that concept detection in web video is feasible, and that – when testing on YouTube videos – the YouTube-based detector outperforms the ones trained on standard training sets. By applying the YouTube-based prototype to datasets from the literature, we further demonstrate that: (1) If training annotations on the target domain are available, the resulting detectors significantly outperform the YouTube-based tagger. (2) If no annotations are available, the YouTube-based detector achieves comparable performance to the ones trained on standard datasets (moderate relative performance losses of 11.4% is measured) while offering the advantage of a fully automatic, scalable learning. (3) By enriching conventional training sets with online video material, performance improvements of 11.7% can be achieved when generalizing to domains unseen in training.     

HJ-1 CCD图像自动几何精纠正系统的设计与实现

由于环境与灾害监测预报小卫星HJ-1A/1B星CCD数据幅宽大,时间分辨率高,数据量大,实现一个自动几何精纠正系统有迫切的现实意义。描述一个HJ-1 CCD图像自动几何精纠正系统的框架设计和集成实现方案,包括系统功能组成、工作流程和模块集成方法以及系统的具体实现过程和实验结果的分析。系统采用全球或局部区域的经过地理编码的TM数据作为基准图像,将图像精纠正问题转化为图像自动配准的问题,同时通过任务流程管理实现图像的批量处理功能。     

Non-interactive automatic video segmentation of moving targets

Extracting moving targets from video accurately is of great significance in the field of intelligent transport.To some extent,it is related to video segmentation or matting.In this paper,we propose a non-interactive automatic segmentation method for extracting moving targets.First,the motion knowledge in video is detected with orthogonal Gaussian-Hermite moments and the Otsu algorithm,and the knowledge is treated as foreground seeds.Second,the background seeds are generated with distance transformation based on foreground seeds.Third,the foreground and background seeds are treated as extra constraints,and then a mask is generated using graph cuts methods or closed-form solutions.Comparison showed that the closed-form solution based on soft segmentation has a better performance and that the extra constraint has a larger impact on the result than other parameters.Experiments demonstrated that the proposed method can effectively extract moving targets from video in real time.     

Practical automatic background substitution for live video

Computational Visual Media - In this paper we present a novel automatic background substitution approach for live video. The objective of background substitution is to extract the foreground from...     

A framework for automatic semantic video annotation

Hypermedia composite templates define generic structures of nodes and links to be added to a document composition, providing spatio-temporal synchronization semantics. This paper presents EDITEC, a graphical editor for hypermedia composite templates. EDITEC templates are based on the XTemplate 3.0 language. The editor was designed for offering a user-friendly visual approach. It presents a new method that provides several options for representing iteration structures graphically, in order to specify a certain behavior to be applied to a set of generic document components. The editor provides a multi-view environment, giving the user a complete control of the composite template during the authoring process. Composite templates can be used in NCL documents for embedding spatio-temporal semantics into NCL contexts. NCL is the standard declarative language used for the production of interactive applications in the Brazilian digital TV system and ITU H.761 IPTV services. Hypermedia composite templates could also be used in other hypermedia authoring languages offering new types of compositions with predefined semantics.     

基于视频图像的火灾自动检测

首先分析了火焰的基本特性,给出了火焰图像的特征描述,然后利用火焰图像序列的边缘不稳定和相似性等可识别特征以及面积大小和颜色等信息,实现了对视频序列图像中火焰的自动检测。实验证明,所实现的系统检测效果好、误判率低。     

Modeling the timing of cuts in automatic editing of concert videos

Multimedia Tools and Applications - Increasing amount of video content is being recorded by people in public events. However, the editing of such videos can be challenging for the average user. We...