We present the first long-term rehearsal learning approach, which demonstrates favorable properties such as variance reduction and optimality.