Learning to forecast in the transformed domain improves forecasting performance.

Our Orthogonal Residual Update improves deep networks by adding only novel, stream-orthogonal module outputs, boosting generalization, stability, and efficiency.