基于多智能体Q学习的异构车载网络选择方法

异构车载网络环境下如何选择接入网络对于车载终端用户的服务体验而言至关重要,目前基于Q学习的网络选择方法利用智能体与环境的交互来迭代学习网络选择策略,从而实现较优的网络资源分配.然而该类方法通常存在状态空间过大引起迭代效率低下和收敛速度较慢的问题,同时由于Q值表更新产生的过高估计现象容易导致网络资源利用不均衡.针对上述问...

A multi-agent Q-learning based selection method for heterogeneous vehicular network

How to select an access network in heterogeneous vehicular network environment is crucial for the service experience of vehicular terminal users. The current Q-learning based network selection method uses the interaction between the agent and the environment to iteratively learn network selection strategies and further realize better network resource allocation. However, this kind of methods usually have the problems of inefficient iterations and slow convergence caused by oversized state space. Besides, overestimations caused by the updates of Q tables lead to unreasonable utilization of network resources. Aiming at above problems, a Multi-agent Q-learning based Selection Method (MQSM) is proposed for heterogeneous vehicular network with 5G communication. The above method adopts the multi-agent cooperative learning idea and gets the total return value of action selection by alternate update of double Q tables. Finally, it achieves a long-term effective optimal network selection decision set in heterogeneous vehicular network environment. Experiment results show that, compared with similar methods, MQSM has better performance in terms of total system handovers, average discount values and network resource utilization.