today local_bar

Jianqiao Lu

PhD student, University of Hong Kong

2 papers at NeurIPS 2025

Homepage· OpenReview· Semantic Scholar· Google Scholar

Poster Session 1

Wednesday, December 3, 2025 · 11:00 AM → 2:00 PM

Exhibit Hall C,D,E

Model Merging in Pre-training of Large Language Models

#3411 · Yunshui Li, Yiyuan Ma, Shen Yan, Chaoyi Zhang, Jing Liu, Jianqiao Lu, Ziwen Xu, Mengzhao Chen, Minrui Wang, Shiyi Zhan, Jin Ma, Xunhao Lai, Yao Luo, Xingyan Bin, Hongbin Ren, Mingji Han, Wenhao Hao, Bairen Yi, LingJun Liu, Bole Ma, Xiaoying Jia, zhou Xun, liang xiang, Yonghui Wu

Poster Session 3

Thursday, December 4, 2025 · 11:00 AM → 2:00 PM

Exhibit Hall C,D,E

DeltaFormer: Unlock the state space of Transformer

#5311 · Mingyu Xu, Tenglong Ao, Jiaao He, Jianqiao Lu, Guang Shi, Shu Zhong

We propose a more expressive Transformer, which exceeding its original $TC^0$ expressiveness.