Publishing House SB RAS:

Publishing House SB RAS:

Address of the Publishing House SB RAS:
Morskoy pr. 2, 630090 Novosibirsk, Russia



Advanced Search

Avtometriya

2024 year, number 5

APPLICATION OF A TRANSFORMER FOR ENCODING STATES IN REINFORCEMENT LEARNING

D. A. Kozlov
Samara National Research University, Samara, Russia
Keywords: reinforcement learning, transformer, SAC

Abstract

This article explores the application of the transformer architecture for encoding states in reinforcement learning algorithms. A new approach is presented, which integrates transformers with existing methods, such as Soft Actor-Critic (SAC), to enhance their performance and generalization ability. The results of experimental studies show that the proposed approach can improve learning in complex tasks of acquiring movement skills in a three-dimensional space.