Publications

You can also find my articles on my Google Scholar profile.

Conference Papers

Tactic: Adaptive Sparse Attention with Clustering and Distribution Fitting for Long-Context LLMs

Kan Zhu^*, Tian Tang^*, Qinyu Xu, Zhan Jin, Yile Gu, Zhichen Zeng, Rohan Kadekodi, Liangyu Zhao, Ang Li, Arvind Krishnamurthy, and Baris Kasikci ^*Equal contribution. International Conference on Learning Representations (ICLR), 2026 Paper

Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models

Keisuke Kamahori^*, Tian Tang^*, Yile Gu, Kan Zhu, and Baris Kasikci ^*Equal contribution. International Conference on Learning Representations (ICLR), 2025 Paper

CONCUR: High-Throughput Agentic Batch Inference of LLM via Congestion-Based Concurrency Control

Qiaoling Chen, Zhisheng Ye, Tian Tang, Peng Sun, Boyu Tian, Guoteng Wang, Shenggui Li, Yonggang Wen, Zhenhua Han, and Tianwei Zhang International Conference on Machine Learning (ICML), 2026 Paper

CROPHE: Cross-Operator Dataflow Optimization for Fully Homomorphic Encryption Accelerators

Xinhua Chen, Jiangbin Dong, Hongren Zheng, Tian Tang, and Mingyu Gao IEEE International Symposium on High Performance Computer Architecture (HPCA), 2026 Paper

Twilight: Adaptive Attention Sparsity with Hierarchical Top-p Pruning

Chaofan Lin, Jiaming Tang, Shuo Yang, Hanshuo Wang, Tian Tang, Boyu Tian, Ion Stoica, Song Han, and Mingyu Gao Conference on Neural Information Processing Systems (NeurIPS), 2025 Paper

NanoFlow: Towards Optimal Large Language Model Serving Throughput

Kan Zhu, Yilong Zhao, Liangyu Zhao, Gefei Zuo, Yile Gu, Dedong Xie, Yufei Gao, Qinyu Xu, Tian Tang, Zihao Ye, Keisuke Kamahori, Chien-Yu Lin, Stephanie Wang, Arvind Krishnamurthy, and Baris Kasikci Symposium on Operating Systems Design and Implementation (OSDI), 2025 Paper

Preprints

Expert-as-a-Service: Towards Efficient, Scalable, and Robust Large-scale MoE Serving

Ziming Liu, Boyu Tian, Guoteng Wang, Zhen Jiang, Peng Sun, Zhenhua Han, Tian Tang, Xiaohe Hu, Yanmin Jia, Yan Zhang, He Liu, Mingjun Zhang, Yiqi Zhang, Qiaoling Chen, Shenggan Cheng, Mingyu Gao, Yang You, and Siyuan Feng arXiv preprint, 2025 Paper