A Princeton Researcher Proposes Recurrent Looped Transformer (RLT) that Carries Decoder State across Every Token, Fixing 96 Blocks per Token with Unbounded Temporal Depth
In most decoder-only LLMs, nothing computed on the final layer of token t feeds the primary layer of token t+1; positions talk solely via consideration over cached keys and values. A Princeton researcher’s (Yifan Zhang) technical report, Recurrent Looped Transformer (RLT), proposes closing that loop. The decoder’s last hidden state and its layerwise sliding-window consideration…
