Abstract: The Transformer architecture, introduced since 2017, has demonstrated its power in machine translation tasks. However, significant challenges persist, notably in accurately understanding and ...