Dynamic service migration strategy based on MDP model with multiple parameter in vehicular edge network

To handle with the service interruption caused by vehicles’ mobility and limited service coverage of edge servers,a dynamic service migration algorithm based on multi-parameters Markov decision process (MDP) model was put forward for vehicular edge network,which was called as dynamic service migration algorithm based on multiple parameter (DSMMP).Combining delay,bandwidth,server capacity with vehicle motion information,DSMMP constructed a multi-parameters MDP revenue function to remedy the deficiency of distance-based schemes.By using vehicle motion and delay constraints,a candidate server set with several candidate servers was defined,and migration decision through long-term Bellman revenue values was made.In order to improve the dynamic adaptability of the proposed algorithm,the weight values were calculated and updated by leveraging historical information.Simulation results show that our strategy has a good performance in terms of delay,packet loss ratio and service migration times.     

D2D协作边缘缓存系统中基于传输时延的缓存策略

为了满足5G系统低时延高可靠的需求,针对单缓存终端直传(D2D)协作边缘缓存系统,提出了一种基于传输时延的缓存策略。运用随机几何理论,将请求用户和空闲用户的动态分布建模为相互独立的齐次泊松点过程,综合考虑内容流行度、用户位置信息、设备传输功率以及干扰,推导出用户的平均传输时延与缓存概率分布的关系式。以平均传输时延为目标函数建立优化问题,提出了一个低复杂度的迭代算法,得到平均传输时延次优的缓存策略。仿真结果表明,该缓存策略在传输时延方面优于常见的几种缓存策略。     

Enhancing live virtual machine migration process via optimized resource allocation in next generation mobile edge network: A hybrid evolutionary approach

The evolution of 5th Generation wireless technology introduced Mobile Edge Computing, where edge servers are placed at the edge of the network, and are associated with evolved Node Base Stations (eNBs). This enables mobile users to offload their resource‐intensive tasks to these servers and improve network performance by reducing end‐to‐end delay. However, frequent user mobility leads to frequent re‐planning of network and increases network load. This demands dynamic Virtual Machine (VM) migration in Mobile Edge paradigm for an improved Quality of Service (QoS). For an enhanced VM migration process, an optimal pair of migrating VMs and destination edge servers needs to be chosen. In this paper, we propose an optimized decision‐making policy that chooses such optimal pairs. Several decision parameters such as average wait time, processing delay, migration delay, transmission power, and processing power are modeled. A profit function is developed using these modeled decision parameters that chooses the optimal pairs. This function is maximized using the proposed hybrid evolutionary algorithm, which combines the advantages of PSO and GA. The pairs are chosen in such a manner, that the selection guarantees high network throughput, reduced service delay, and energy consumption which is reflected in the simulation.     

边缘计算多约束可信协同任务迁移策略

为保障边缘计算的服务质量,提出一种在多约束条件下边缘计算可信协同任务迁移策略。该策略基于任务需求,由边缘计算协同服务盟主节点组织调度协同服务盟员,基于用户任务迁移的K维权重指标,确定协同盟员调度优先级,以盟员负载均衡性为适应函数,通过贪心算法执行盟员任务分配与调度,基于路由捎带选择备用节点,通过迁移优先级评估,实现协同服务异常时的调度和迁移,由此提高边缘计算任务迁移的服务质量,保障任务迁移的可靠性。仿真实验表明,该机制能有效完成协同任务分发与迁移调度,提高边缘计算协同效率,保障网络服务质量。     

Service migration in mobile edge computing: A deep reinforcement learning approach

In mobile edge computing, service migration can not only reduce the access latency but also reduce the network costs for users. However, due to bandwidth bottleneck, migration costs should also be considered during service migration. In this way, the trade-off between benefits of service migration and total service costs is very important for the cloud service providers. In this paper, we propose an efficient dynamic service migration algorithm named SMDQN, which is based on reinforcement learning. We consider each mobile application service can be hosted on one or more edge nodes and each edge node has limited resources. SMDQN takes total delay and migration costs into consideration. And to reduce the size of Markov decision process space, we devise the deep reinforcement learning algorithm to make a fast decision. We implement the algorithm and test the performance and stability of it. The simulation result shows that it can minimize the service costs and adapt well to different mobile access patterns.     

基于深度强化学习的云边协同计算迁移研究

基于单一边缘节点计算、存储资源的有限性及大数据场景对高效计算服务的需求,本文提出了一种基于深度强化学习的云边协同计算迁移机制.具体地,基于计算资源、带宽和迁移决策的综合性考量,构建了一个最小化所有用户任务执行延迟与能耗权重和的优化问题.基于该优化问题提出了一个异步云边协同的深度强化学习算法,该算法充分利用了云边双方的计算能力,可有效满足大数据场景对高效计算服务的需求;同时,面向边缘云中边缘节点所处环境的多样及动态变化性,该算法能自适应地调整迁移策略以实现系统总成本的最小化.最后,大量的仿真结果表明本文所提出的算法具有收敛速度快、鲁棒性高等特点,并能够以最低的计算成本获得近似贪心算法的最优迁移决策.     

基于边缘计算的数据密集型服务部署

日益增长的数据量对数据处理的要求越来越高,于是出现了数据密集型服务。在解决复杂问题时,多个数据密集型服务通常会形成一个服务组合。由于服务组件之间存在大量的数据传输,巨大的传输时延会对系统的整体性能造成影响。在边缘计算环境中,基于否定选择算法,为降低服务组合中的数据传输时间提出了一种优化部署策略。首先,给出了此类数据密集型服务组件部署问题的定义,并为该部署问题构建优化模型;然后,设计了一种否定选择算法来获取最佳的部署方案;为了评估该算法的适用性和收敛性,使用遗传算法和模拟退火算法与其对比,结果显示,提出的算法在这种数据密集型服务组件的部署问题中表现得更为出色。     

Virtual network function deployment strategy based on improved genetic simulated annealing algorithm in MEC

In order to effectively improve the end-to-end service delay of the flow in multi-clusters coexisting mobile edge computing (MEC) network,a virtual network function deployment strategy based on improved genetic simulated annealing algorithm was proposed.The delay of mobile service flow was mathematically modeled through the open Jackson queuing network.After proving the NP attribute of this problem,a solution combining genetic algorithm and simulated annealing algorithm was proposed.In this strategy,the advance mapping mechanism avoids the possibility of network congestion,and the occurrence of local optima was avoided through using the methods of individual judgment and corrective genetic.Extensive simulation was set up to evaluate the effectiveness of the proposed strategy under different parameter settings,such as different volume of requests,different scale of service nodes,different number of MEC clusters,and logical link relationships between virtual network functions.Results show that this strategy can provide lower end-to-end services delay and better service experience for latency-sensitive mobile application.     

车载边缘计算中任务卸载和服务缓存的联合智能优化

针对车载环境下有限的网络资源和大量用户需求之间的矛盾,提出了智能驱动的车载边缘计算网络架构,以实现网络资源的全面协同和智能管理。基于该架构,设计了任务卸载和服务缓存的联合优化机制,对用户任务卸载以及计算和缓存资源的调度进行了建模。鉴于车载网络的动态、随机和时变的特性,利用异步分布式强化学习算法,给出了最优的卸载决策和资源管理方案。实验结果表明,与其他算法相比,所提算法取得了明显的性能提升。     

移动边缘网络中基于用户移动的服务功能链迁移策略

移动边缘计算(Mobile Edge Computing,MEC)通过在网络边缘部署服务器,提供计算和存储资源,可为用户提供超低时延和高带宽业务。网络功能虚拟化(Network Function Virtualization,NFV)与MEC技术相结合,可在MEC服务器上提供服务功能链(Service Function Chain,SFC),提升用户的业务体验。为了保证移动用户的服务质量,需要在用户跨基站移动时将SFC迁移到合适的边缘服务器上。主要以最小化用户服务的端到端时延和运行成本为目标,提出了MEC网络中具有资源容量约束的SFC迁移策略,以实现移动用户业务的无缝迁移。仿真结果表明,与现有方案相比,该策略具有更好的有效性和高效性。     

Dynamic computation offloading in time-varying environment forultra-dense networks: a stochastic game approach

To meet the demands of large-scale user access with computation-intensive and delay-sensitive applications, combining ultra-dense networks (UDNs) and mobile edge computing (MEC)are considered as important solutions. In the MEC enabled UDNs, one of the most important issues is computation offloading. Although a number of work have been done toward this issue, the problem of dynamic computation offloading in time-varying environment, especially the dynamic computation offloading problem for multi-user, has not been fully considered. Therefore, in order to fill this gap, the dynamic computation offloading problem in time-varying environment for multi-user is considered in this paper. By considering the dynamic changes of channel state and users queue state, the dynamic computation offloading problem for multi-user is formulated as a stochastic game, which aims to optimize the delay and packet loss rate of users. To find the optimal solution of the formulated optimization problem, Nash Q-learning (NQLN) algorithm is proposed which can be quickly converged to a Nash equilibrium solution. Finally, extensive simulation results are presented to demonstrate the superiority of NQLN algorithm. It is shown that NQLN algorithm has better optimization performance than the benchmark schemes.     

Dynamic theoretic proactive caching placement game for energy saving in H‐CRAN

Edge caching is an effective feature of the next 5G network to guarantee the availability of the service content and a reduced time response for the user. However, the placement of the cache content remains an issue to fully take advantage of edge caching. In this paper, we address the proactive caching problem in Heterogeneous Cloud Radio Access Network (H‐CRAN) from a game theoretic point of view. The problem is formulated as a bargaining game where the remote radio heads (RRHs) dynamically negotiate and decide which content to cache in which RRH under energy saving and cache capacity constraints. The Pareto optimal equilibrium is proved for the cooperative game by the iterative Nash bargaining algorithm. We compare between cooperative and noncooperative proactive caching games and demonstrate how the selfishness of different players can affect the overall system performance. We also showed that our cooperative proactive caching game improves the energy consumption of 40% as compared with noncooperative game and of 68% to no‐game strategy. Moreover, the number of satisfied requests at the RRHs with the proposed cooperative proactive caching scheme is significantly increased.     

5G边缘计算和网络切片技术

由于能够以低成本提供5G无线网络中多样化的业务场景,网络切片和边缘计算一直以来深受学术界和工业界的提倡.网络切片通过将网络实体划分成多个逻辑独立网络,为不同业务场景提供所需服务,而边缘计算利用网络中用户和边缘网络设备的计算和存储功能,承载部分核心节点中的控制、管理、业务功能,能够提升传统移动宽带业务能力和应对新兴的机器类业务.将网络切片和边缘计算融合,提出了基于边缘计算的接入网络切片,能够满足5G中广泛的用例和商业模型,使得运营商能够根据第三方需求和网络状况以低成本为用户灵活提供个性化的网络服务.     

Cooperative caching algorithm of UAV and user in UAV-assisted cellular network

Aiming at the problem of mass data content transmission and limited wireless backhaul resource of UAV in UAV-assisted cellular network,a cooperative caching algorithm for cache-enabled UAV and user was proposed.By deploying caches on UAV and user device,the popular content requested by user was cached and delivered,which alleviated the backhaul resource and energy consumption of UAV,reduced the traffic load and user delay.A joint optimization problem of UAV and user caching was established with the goal of minimizing user content acquisition delay,and decomposed into UAV caching sub-problem and user caching sub-problem,which were solved based on alternating direction method of multiplier and global greedy algorithm respectively.The iterative way was used to obtain convergent optimization result,and the cooperative caching of UAV and user was realized.Simulation results show that the proposed algorithm can effectively reduce user content acquisition delay and improve system performance.     

V2X多节点协同分布式卸载策略

为了应对车联网中计算资源密集、可分离型任务的卸载环境动态变化和不同协同节点通信、计算资源存在差异的问题,提出了一种在V2X下多协同节点串行卸载、并行计算的分布式卸载策略。该策略利用车辆可预测的行驶轨迹,对任务进行不等拆分,分布式计算于本地、MEC及协同车辆,建立系统时延最小化的优化问题。为求解该优化问题,设计了博弈论的卸载机制,以实现协同节点串行卸载的执行顺序;鉴于车联网的动态时变特性,利用序列二次规划算法,给出了最优的任务不等拆分。仿真结果表明,所提策略能够有效减少计算任务系统时延,且当多协同节点分布式卸载服务时,所提策略在不同的参数条件下仍然能够保持稳定的系统性能。     

V2X多节点协同分布式卸载策略

为了应对车联网中计算资源密集、可分离型任务的卸载环境动态变化和不同协同节点通信、计算资源存在差异的问题,提出了一种在V2X下多协同节点串行卸载、并行计算的分布式卸载策略。该策略利用车辆可预测的行驶轨迹,对任务进行不等拆分,分布式计算于本地、MEC及协同车辆,建立系统时延最小化的优化问题。为求解该优化问题,设计了博弈论的卸载机制,以实现协同节点串行卸载的执行顺序;鉴于车联网的动态时变特性,利用序列二次规划算法,给出了最优的任务不等拆分。仿真结果表明,所提策略能够有效减少计算任务系统时延,且当多协同节点分布式卸载服务时,所提策略在不同的参数条件下仍然能够保持稳定的系统性能。     

移动性感知下基于负载均衡的任务迁移方案

针对移动边缘计算中用户移动性导致服务器间负载分布不均,用户服务质量(Quality of Service, QoS)下降的问题,提出了一种移动性感知下的分布式任务迁移方案。首先,以优化网络中性能最差的用户QoS为目标,建立了一个长期极大极小化公平性问题(Max Min Fairness, MMF),利用李雅普诺夫(Lyapunov)优化将原问题转化解耦。然后,将其建模为去中心化部分可观测马尔可夫决策过程(Decentralized Partially Observable Markov Decision Process, Dec-POMDP),提出一种基于多智能体柔性演员-评论家(Soft Actor-Critic, SAC)的分布式任务迁移算法,将奖励函数解耦为节点奖励和用户个体奖励,分别基于节点负载均衡度和用户QoS施加奖励。仿真结果表明,相比于现有任务迁移方案,所提算法能够在保证用户QoS的前提下降低任务迁移率,保证系统负载均衡。     

合作认知无线网络中能效最优资源分配

针对能量受限的合作认知网络,该文研究在保证主用户服务质量要求下,认知用户能量效率最大化问题。认知用户利用信能同传技术接收主用户信号,并采用解码转发协议协助主用户通信。基于分式规划和引入辅助变量将原始非凸问题转换为凸优化问题进行求解,并提出一种迭代的资源分配算法。仿真结果表明,所提算法能够快速收敛于最优解。与能量合作方案相比,该文所采用方案能量效率显著提高,同时能更好地保证主用户服务质量要求。     

An optimal OSA approach based on channel-usage estimate under collision probability constraint in cognitive radio systems

Opportunistic spectrum access system allows the secondary user to access spectrum holes not being utilized by the primary user. Traditional opportunistic spectrum access approaches only sense and utilize current spectrum holes. This can result in uncontrollable collision probability, which exceed the maximum collision probability allowed by the primary user network. In this paper, we consider a cognitive radio system with one primary channel and one secondary user, and then, we introduce a channel-usage pattern model and a fundamental access scheme in this system. Based on the fundamental access scheme, we adopt fixed detection duration and transmission duration ratio approach to analyze what and how to determine spectrum holes utilization and collision probability in this model. On the basis of this model and fundamental access scheme, we study optimal opportunistic spectrum access problem and formulate it as an optimization problem that the secondary user maximizes spectrum holes utilization under the constraint of collision tolerable level, and then we solve this optimization problem in two cases: one is that the idle period is exponential distribution, the other is that the idle period is Pareto distribution. According to the solution of the optimization problem, we respectively propose an optimal opportunistic spectrum access algorithm in each case. Theoretical analysis and simulation results both show that the optimal opportunistic spectrum access algorithms can maximize spectrum holes utilization under the constraint that the collision probability is bounded below collision tolerable level.     

Optimal cooperative strategy based on quantum bat for cognitive radio of energy harvesting

In order to reduce energy consumption and improve spectral efficiency of the cognitive relay wireless communication system in 5G network,an optimal cooperative transmission strategy of information and energy was designed for cognitive relay radio with wireless energy harvesting.For the proposed optimal cooperative strategy,the maximal throughput formula and outage probability of secondary user were deduced.In order to resolve the derived maximum throughput equation,a quantum bat algorithm which was based on the optimization mechanism of quantum computing and bat algorithm was designed to solve the deduced equation,and the optimal cooperative transmission scheme for information and energy could be obtained.Simulation results show that the proposed optimal cooperative strategy not only can meet the information transfer demand of primary user,but also can realize the energy self-supply of the secondary user system and improve the communication quality of the secondary user.The proposed optimal cooperative strategy has a better performance than the cooperative strategy of existing cognitive relay radio for different simulation scenarios.