An inference energy benchmark and automated optimizer, with measurements and insights on how ML design choices impact energy consumption and optimization opportunities.