Catherine Arnett

Researcher, EleutherAI

1 paper at NeurIPS 2025

Homepage· OpenReview· Semantic Scholar· Google Scholar

Poster Session 3

1 paper

Thursday, December 4, 2025 · 11:00 AM → 2:00 PM

Exhibit Hall C,D,E

Explaining and Mitigating Crosslingual Tokenizer Inequities

#1909 · Catherine Arnett, Tyler A. Chang, Stella Biderman, Ben Bergen

We identify several factors that lead to token premium effects in monolingual tokenizers and provide two interventions which significantly reduce tokenizer inequities.