We show that kernel ridge regression under covariate shift can be made computationally efficient using Nyström random projections, achieving optimal statistical rates without sacrificing accuracy.