一种MPEG2视频解码器的系统设计

对于设计像 MPEG2视频解码器的复杂系统 ,关键的难点是其系统结构的设计。文中设计了一种适合 VL SI实现的 MPEG2解码器的系统结构。它支持 MPEG2 (MP@ML)码流 ,并且兼容 MPEG1码流。为了设计和优化这个结构 ,采用硬件描述语言 VHDL 设计了系统级的 MPEG2视频解码器。此解码器在 Viewlogic系统中进行了模拟 ,并且对一些码流进行了测试验证。     

基于宏块类型信息的快速视频分段算法

提出了一种基于宏块类型信息的快速视频分段算法:对MPEG视频流进行两次分析,第一次(粗略分析)只分析P-帧中宏块统计信息,检测出可能存在的镜头边界,第二次(精确分析)再对粗略分析找出的边界邻近的B-帧和P-帧的宏块类型进行分析,从而对场景变换进行精确分析和定位。实验结果表明,粗略分析可以满足实时检测的速度要求,帧定位误差控制在10帧之内,精确分析可以进一步把帧定位误差控制在2帧之内。     

On modeling MPEG video traffics

This paper traces the development/evolution of three of our previously proposed MPEG coded video traffic models, that can capture the statistical properties of MPEG video data. The basic ideas behind these models are to decompose an MPEG compressed video sequence into several parts according to motion/scene complexity or data structure. Each part is described by a self-similar process. These different self-similar processes are then combined to form the respective models. In addition, Beta distribution is used to characterize the marginal cumulative distribution (CDF) of the self-similar processes. Comparison among the three models shows that the latest model (called the simple IPB composite model) is the most practical one in terms of accuracy and complexity. Simulations based on many real MPEG compressed movie sequences, including StarWars, have demonstrated that the simple model can capture the autocorrelation function (ACF) and the marginal CDF very closely.     

Error-Resilient Performance of Dirac Video Codec Over Packet-Erasure Channel

Video transmission over the wireless or wired network requires error-resilient mechanism since compressed video bitstreams are sensitive to transmission errors because of the use of predictive coding and variable length coding. This paper investigates the performance of a simple and low complexity error-resilient coding scheme which combines source and channel coding to protect compressed bitstream of wavelet-based Dirac video codec in the packet-erasure channel. By partitioning the wavelet transform coefficients of the motion-compensated residual frame into groups and independently processing each group using arithmetic and forward error correction (FEC) coding, Dirac could achieves the robustness to transmission errors by giving the video quality which is gracefully decreasing over a range of packet loss rates up to 30% when compared with conventional FEC only methods. Simulation results also show that the proposed scheme using multiple partitions can achieve up to 10 dB PSNR gain over its existing un-partitioned format. This paper also investigates the error-resilient performance of the proposed scheme in comparison with H.264 over packet-erasure channel.     

Performance Analysis for MPEG‐4 Video Codec Based on On‐Chip Network

In this paper, we present a performance analysis for an MPEG‐4 video codec based on the on‐chip network communication architecture. The existing on‐chip buses of system‐on‐a‐chip (SoC) have some limitation on data traffic bandwidth since a large number of silicon IPs share the bus. An on‐chip network is introduced to solve the problem of on‐chip buses, in which the concept of a computer network is applied to the communication architecture of SoC. We compared the performance of the MPEG‐4 video codec based on the on‐chip network and Advanced Micro‐controller Bus Architecture (AMBA) on‐chip bus. Experimental results show that the performance of the MPEG‐4 video codec based on the on‐chip network is improved over 50% compared to the design based on a multi‐layer AMBA bus.     

一种新的基于场景的VBR MPEG压缩视频源统计模型

由于VBRMPEG视频流可以获得统计复用增益和恒定的图像质量,它已经成为网络视频业务的主流,但是也给网络服务质量的控制带来了困难。因此,我们很有必要针对这些视频业务流对承载它们的网络带来的影响进行研究和评估。精确的MPEGVBR视频源统计模型不但有助于提高网络仿真的准确度,而且有助于研究网络其它方面的问题,如网络延时、分组丢失、延迟扰动等。本文提出了一种新的基于场景的VBRMPEG压缩视频源统计模型,该模型不仅计算简便,能快速产生符合要求的视频流样本,还能同时拟合原始视频业务数据的概率分布情况、自相关函数和自相似特性。     

Simulation study on ATM multiplexing of MPEG video sources

In this paper we study the performance of ATM multiplexing of homogeneous MPEG video sources. A source scheduling method is developed to improve the performance of ATM multiplexer for MPEG video sources. Simulation results show that the level of burstiness for the aggregated MPEG traffic is reduced and the network performance is enhanced. Based on the rationale of the source scheduling method, a simple but efficient bandwidth allocation algorithm is also derived for connection admission of MPEG video in an ATM multiplexer. Copyright © 2001 John Wiley & Sons, Ltd.     

Performance modeling of MPEG‐4 video streaming over IEEE 802.11 using distribution coordination function

Delivering video streaming over wireless Internet is becoming increasingly popular. However, most of the research studies focused on the modeling analysis of system performance such as saturation throughput and channel utilization. Perceived quality of video streaming cannot be assessed solely based on the results of analytical models. In this paper, we propose a model to assess the perceived quality of MPEG‐4 video streaming over IEEE 802.11 distribution coordination function (DCF)‐based wireless local area networks. The analysis of our proposed model considers not only effects of losses such as collision loss from channel access competition but also wireless loss caused by wireless interferences. Moreover, the impact of the loss of specific MPEG‐4 video frames is also taken into account in the performance analysis. The model was validated by comparing our performance results with results obtained from simulation and analytical models. The results show that our proposed model is able to predict the perceived quality of MPEG‐4 video streaming over DCF‐based WLAN more accurately than other models. Copyright © 2010 John Wiley & Sons, Ltd.     

New architecture for MPEG video streaming system with backward playback support.

MPEG digital video is becoming ubiquitous for video storage and communications. It is often desirable to perform various video cassette recording (VCR) functions such as backward playback in MPEG videos. However, the predictive processing techniques employed in MPEG severely complicate the backward-play operation. A straightforward implementation of backward playback is to transmit and decode the whole group-of-picture (GOP), store all the decoded frames in the decoder buffer, and play the decoded frames in reverse order. This approach requires a significant buffer in the decoder, which depends on the GOP size, to store the decoded frames. This approach could not be possible in a severely constrained memory requirement. Another alternative is to decode the GOP up to the current frame to be displayed, and then go back to decode the GOP again up to the next frame to be displayed. This approach does not need the huge buffer, but requires much higher bandwidth of the network and complexity of the decoder. In this paper, we propose a macroblock-based algorithm for an efficient implementation of the MPEG video streaming system to provide backward playback over a network with the minimal requirements on the network bandwidth and the decoder complexity. The proposed algorithm classifies macroblocks in the requested frame into backward macroblocks (BMBs) and forward/backward macroblocks (FBMBs). Two macroblock-based techniques are used to manipulate different types of macroblocks in the compressed domain and the server then sends the processed macroblocks to the client machine. For BMBs, a VLC-domain technique is adopted to reduce the number of macroblocks that need to be decoded by the decoder and the number of bits that need to be sent over the network in the backward-play operation. We then propose a newly mixed VLC/DCT-domain technique to handle FBMBs in order to further reduce the computational complexity of the decoder. With these compressed-domain techniques, the proposed architecture only manipulates macroblocks either in the VLC domain or the quantized DCT domain resulting in low server complexity. Experimental results show that, as compared to the conventional system, the new streaming system reduces the required network bandwidth and the decoder complexity significantly.     

基于H.264/SVC的视频加密技术研究

随着网络的不断普及和发展,视频数据在网络中有了越来越多的应用,随之也提出了视频安全的问题,通过视频加密可以很好地解决此问题。文中分析了目前主流的H.264SVC标准所采用的可分级视频编码技术,根据视频分级编码特点选取关键信息进行分层加密,实现不同级别的视频加密。同时,所提方案采用了序列密码进行加密,具有较高的安全性。试验结果表明:该方案具有安全性高、复杂度适中、实时性好等特点。     

Predictive dynamic bandwidth allocation for efficient transport ofreal-time VBR video over ATM

This paper presents a novel approach to dynamic transmission bandwidth allocation for transport of real-time variable-bit-rate video in ATM networks. Video traffic statistics are measured in the frequency domain. The low-frequency signal captures the slow time-variation of consecutive scene changes while the high-frequency signal exhibits the feature of strong frame autocorrelation. Our queueing study indicates that the video transmission bandwidth in a finite-buffer system is essentially characterized by the low-frequency signal. We further observe in typical JPEG/MPEG video sequences that the time scale of video scene changes is in the range of a second or longer, which localizes the low-frequency video signal in a well-defined low-frequency band. Hence, in a network design it is feasible to implement dynamic allocation of video transmission bandwidth using on-line observation and prediction of scene changes. Two prediction schemes are examined: recursive least square method and time delay neural network method. A time delay neural network with low-complexity high-order architecture, called “pi-sigma network,” is successfully used to predict scene changes. The overall dynamic bandwidth-allocation scheme presented is shown to be promising and practically feasible in obtaining efficient transmission of real-time video traffic     

基于神经网络的量化参数预测研究

在视频有损压缩编码中,量化是为达到压缩视频的目的,将原信号值映射到较小取值范围的过程。一个合适的量化参数(QP)可以在增加压缩效率的同时平衡视频质量和编码复杂度。现有的码率控制算法对运动剧烈及存在场景切换的连续帧控制不精确,视频PSNR值波动大。本文提出一种基于神经网络的视频量化参数选择,利用已编码帧信息对当前帧的量化参数计算进行调整。神经网络模型选取当前帧的目标比特、当前帧的MAD和前一帧编码的QP和实际比特数作为输入,输出值经过反归一化及取整处理对视频进行量化。实验表明,编码时使用该方法进行与H.264/AVC的标准参考软件JM14.2相比,在保证码率精确度和平均PSNR值基本不变的情况下,减小了PSNR的波动。     

A GACS modeling approach for MPEG broadcast video

Accurate MPEG source models are needed to support high speed networks such as ATM and Internet. In this paper, we propose a video model called Gaussian auto-regressive and chi-square processes (GACS) for MPEG coded video traffic. The GACS models the sizes of MPEG I, P, and B frames according to the MPEG syntax I-frame>P-frame>B-frame. This is done by decomposing the process of each frame size into a weighted sum of a number of chi-square sequences. Each chi-square sequence is then obtained by squaring a Gaussian process, which is efficiently generated by using an auto-regressive (AR) model whose parameters are determined from an estimated covariance matrix. We evaluate the effectiveness of our model by conducting a series of experiments using a wide variety of long empirical video sequences. The results show that the proposed model leads to excellent data fit and accurate prediction of queuing performance.     

基于DirectX的音频视频无线传输系统设计与实现

主要介绍一种基于微软DirectX平台实现音频视频无线传输的系统,该系统利用Direct Play Voice实现音频传输,利用DirectShow实现视频传输。针对音频传输过程中延时、抖动现象,利用RTP协议包头时间戳和建立缓冲池的方法进行消除,提高音质;利用RTP/RTCP协议传输MPEG-4码流,提高视频质量。探讨了该系统的基本结构和实现细节,实际测试表明该系统音频和视频质量令人满意,具有稳定性好、占用带宽低等优点。     

Video rate control using a radial basis function estimator for constant bit-rate MPEG coders

Compressed video is a source of bursty traffic in communication networks whose data rate needs to be controlled within the available channel capacity, particularly, when it is transmitted via a fixed rate channel. Since the video rate is nonstationary and bursty at large-scene variations in a statistical sense, we propose a feed-forward, estimator-based rate control scheme associated with spatio-temporal activity features (STAF) for MPEG video encoders. This information is used to estimate the video rate of input picture frames. The estimated video rate enables the future buffer occupancy to be calculated and permits the encoder to adapt the quantisation step size to limit the increase or decrease in video rate due to dramatic scene variation. The current and future occupancies are used in a nonlinear quantiser control scheme to determine an appropriate quantisation step size depending on them. The novelty of this technique is that the nonlinear prediction and the nonlinear quantiser control are combined to achieve effective feed-forward video rate control, particularly, for realistic video containing various scene variations. In this paper, we highlight the innovative structure of the scheme and evaluate the performance of rate control algorithms with heuristic, linear and nonlinear rate estimators in the framework of the MPEG2 test model 5 video encoder. The performance measures are the occupancy of a two-frame delay buffer and peak signal-to-noise ratio (PSNR) for video quality.     

A heuristic approach of bandwidth management for video sources in ATM networks

One of the most important properties in the ATM network is that the resource of the network, including buffer and bandwidth, can be flexibly managed according to different demands of various applications. The network bandwidth can be effectively allocated and utilized if the data volume of the arrival traffic can be predicted precisely. In this paper, we study the bandwidth management schemes for variable bit rate (VBR) pre‐coded MPEG video sources. The proposed bandwidth allocation method, which predicts the bandwidth by the frame correlation, demonstrates a quite good performance when comparing with a previous scheme, especially for the video scenes with the combination of intraframes and interframes. Bandwidth allocation of a multiplexer connected to several video sources is also studied by using heuristic information. The experimental results show that the proposed method is much better than that of the fixed bandwidth allocation and is suitable for the application of MPEG video services. Copyright © 2000 John Wiley & Sons, Ltd.     

RQRP protocol for video delivery over IP

The Digital Audio‐Visual Council has adopted the Request/Reply (RQRP) protocol, proposed by one of the authors, for the delivery mechanism of MPEG video streams. In this paper, we investigate the network characteristics of the RQRP protocol and analyse the protocol's performance via both simulation as well as actual experimental results. In this simulation, the RQRP protocol was mathematically an ideal model first and later, a feedback control system. Simulation results showed that, for both models, the network traffic is able to follow the playout rate at the receiver. In the case of the latter, which involves a simpler implementation, oscillation in network traffic is observed. A video‐on‐demand (VoD) system using the RQRP protocol was developed and experiments were performed. The results obtained are consistent with the simulation results. Copyright © 2001 John Wiley & Sons, Ltd.     

基于ARM嵌入式局域网视频监控系统的设计与实现

设计了一种基于S3C2410X的ARM9 linux系统组成的远程嵌入式视频监控系统,该系统通过局域网实现对现场情景的监控,首先介绍了ARM处理器的基本结构、性能等情况;然后重点论述了远程监控系统的信息传输方案,就监控软硬件的开发做了简要描述.结果表明,该系统达到设计要求,为应用ARM技术实现远程监控及视频网络传输提供了解决方案.     

Optimal nonlinear adaptive prediction and modeling of MPEG video inATM networks using pipelined recurrent neural networks

This paper investigates the application of a pipelined recurrent neural network (PRNN) to the adaptive traffic prediction of MPEG video signal via dynamic ATM networks. The traffic signal of each picture type (I, P, and B) of MPEG video is characterized by a general nonlinear autoregressive moving average (NARMA) process. Moreover, a minimum mean-squared error predictor based on the NARMA model is developed to provide the best prediction for the video traffic signal. However, the explicit functional expression of the best mean-squared error predictor is actually unknown. To tackle this difficulty, a PRNN that consists of a number of simpler small-scale recurrent neural network (RNN) modules with less computational complexity is conducted to introduce the best nonlinear approximation capability into the minimum mean-squared error predictor model in order to accurately predict the future behavior of MPEG video traffic in a relatively short time period based on adaptive learning for each module from previous measurement data, in order to provide faster and more accurate control action to avoid the effects of excessive load situation. Since those modules of PRNN can be performed simultaneously in a pipelined parallelism fashion, this would lead to a significant improvement in the total computational efficiency of PRNN. In order to further improve the convergence performance of the adaptive algorithm for PRNN, a learning-rate annealing schedule is proposed to accelerate the adaptive learning process. Another advantage of the PRNN-based predictor is its generalization from learning that is useful for learning a dynamic environment for MPEG video traffic prediction in ATM networks where observations may be incomplete, delayed, or partially available. The PRNN-based predictor presented in this paper is shown to be promising and practically feasible in obtaining the best adaptive prediction of real-time MPEG video traffic