Pretraining & Midtraining
Building reasoning and coding abilities into large language models during pretraining and mid-training, including long-context and pretrain-stage reasoning.
Ph.D. Student / National University of Singapore
Leheng (Leon) Sheng is a Ph.D. student in the School of Computing at
National University of Singapore.
He works on pretraining and mid-training of large language models, and studies how they
reason, how to keep them aligned, and what their internal
representations can do.
He is currently a research intern at
Tencent Hunyuan (Code Pretrain),
and was previously a research intern at
ByteDance Seed (Pretrain Team).
He received his M.S. in Fintech from Tsinghua University and his B.E. in Computer Science from Southeast University.
Building reasoning and coding abilities into large language models during pretraining and mid-training, including long-context and pretrain-stage reasoning.
How large reasoning models plan their thinking budget, learn from self-evolving rubrics, and reason over long contexts with gated memory.
Steering behaviour through a model’s internal representations, from refusal steering under null-space constraints to safety alignment with lightweight RL.
Joined Tencent Hunyuan (Code Pretrain) as a research intern through the Qingyun Talent Program.
Self-Evolving Rubrics and When to Memorize released; When to Memorize accepted by ICML 2026.
AlphaSteer accepted by ICLR 2026.
On Reasoning Strength Planning accepted by NeurIPS 2025.
Joined ByteDance Seed (Pretrain Team) as a research intern.
Language Representations Can Be What Recommenders Need accepted by ICLR 2025 as an Oral.
First and co-first author. * co-first, † corresponding.
Tencent Hunyuan
Research Intern, Code Pretrain · Qingyun Talent Program
Code pretraining for large language models.
ByteDance Seed
Research Intern, Pretrain Team
General & long-context LLM reasoning; pretrain-stage reasoning.
NExT++ Lab, NUS
Research Intern
LLM-based agent simulation for recommendation; a large-scale LLM agent simulation platform.
CITIC Securities
Quantitative Research Assistant, Research Dept.
Fund style classification.