Predicting the Expected Behavior of Agents that Learn About Agents: The CLRI Framework |
| |
Authors: | José M. Vidal Edmund H. Durfee |
| |
Affiliation: | (1) Swearingen Engineering Center, University of South Carolina, Columbia, SC, 29208;(2) Advanced Technology Laboratory, University of Michigan, Ann Arbor, MI, 48102 |
| |
Abstract: | We describe a framework and equations used to model and predict the behavior of multi-agent systems (MASs) with learning agents. A difference equation is used for calculating the progression of an agent's error in its decision function, thereby telling us how the agent is expected to fare in the MAS. The equation relies on parameters which capture the agent's learning abilities, such as its change rate, learning rate and retention rate, as well as relevant aspects of the MAS such as the impact that agents have on each other. We validate the framework with experimental results using reinforcement learning agents in a market system, as well as with other experimental results gathered from the AI literature. Finally, we use PAC-theory to show how to calculate bounds on the values of the learning parameters. |
| |
Keywords: | multi-agent systems machine learning complex systems |
本文献已被 SpringerLink 等数据库收录! |
|