Principal Researcher, Morgan Stanley
2 papers at NeurIPS 2025
We propose SAS to simulate larger attention head numbe and hidden size per head for better performance, keeping the original model size.