Researcher, Google DeepMind
2 papers at NeurIPS 2025
We introduce the "DataRater", a meta-learning approach to automatically learn the value of data and use it to improve the compute efficiency of training foundation models.
We provide a formal definition of plasticity under minimal assumptions, and highlight a fundamental connection to empowerment