Our paper shows that ensemble learning via majority voting achieves exponentially faster risk decay, improving base learners with slow rates.