Multi-Modal-Instruction-based-Reinforcement-Learning-using-MoME-Transformer

In this research, we present a model architecture for employing reinforcement learning with transformers to train machine learning models for multimodal tasks. Using trans- formers allows us to take use of the Transformer architecture’s simplicity and scalability, as well as developments in language