Knowledge distillation for portfolio management using multi-agent reinforcement learning

Min You Chen, Chiao Ting Chen, Szu Hao Huang*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

Many studies have employed reinforcement learning (RL) techniques to successfully create portfolio strategies in recent years. However, since financial markets are extremely noisy, past research has found it challenging to train a stable RL agent using historical data. In this work, we first apply a role-aware multi-agent system to model volatile security markets. Three major roles that are used in our system are presented, and while maximizing their own targets in the Taiwan stock exchange (TWSE) historical data, they also observe trading behavior and compete with other agents. To build a trading strategy, we construct a student–teacher framework in which multi-agent targeting distills the market information and a student RL model is taught using the distilled target. The results show that our method is capable of developing profitable strategies in a quickly changing financial market. In addition, our market distilling technique has the potential to develop a flexible asset allocation strategy by using different student networks.

Original languageEnglish
Article number102096
JournalAdvanced Engineering Informatics
Volume57
DOIs
StatePublished - Aug 2023

Keywords

  • Artificial stock market
  • Knowledge distillation
  • Multi-agent reinforcement learning
  • Portfolio management

Fingerprint

Dive into the research topics of 'Knowledge distillation for portfolio management using multi-agent reinforcement learning'. Together they form a unique fingerprint.

Cite this