We balance fairness and predictive accuracy by decomposing feature representations and analyzing their impact using influence functions.