Abstract: Model-based planners and controllers are commonly used to solve complex manipulation problems as they can efficiently optimize diverse objectives and generalize to long horizon tasks.

Since the introduction of the transformer architecture [1], which addressed the limitations of earlier seq2seq models, attention-based models have become the standard for most Natural Language ...