We propose a recurrent transformer for robotics, which can maintain a compact representation of the history of observations useful for continuous robotic operations.