Partial Answer of How Transformers Learn Automata
Published: Apr 29, 2025
Last Updated: Apr 29, 2025
Authors:Tiantian, Zhang
Abstract
We introduce a novel framework for simulating finite automata using representation-theoretic semidirect products and Fourier modules, achieving more efficient Transformer-based implementations.