mTuner: Accelerating Parameter-Efficient Fine-Tuning on Multi-GPU Servers with Elastic Tensor

Kezhao Huang, Siqi Zhu, Mingshu Zhai, Liyan Zheng, Kinman Lei, Jiaao He, Yuyang Jin, Jidong Zhai
January, 2025
Cite URL
Type
Conference paper
Publication
Proceedings of the 2025 USENIX Annual Technical Conference, USENIX ATC 2025, Boston, MA, USA, July 7-9, 2025
Kezhao Huang
Kezhao Huang
Ph.D. Student
Mingshu Zhai
Mingshu Zhai
Ph.D. Student
Liyan Zheng
Liyan Zheng
Ph.D. Student
Kinman Lei
Kinman Lei
Ph.D. Students
Jiaao He
Jiaao He
Ph.D. Student
Yuyang Jin
Yuyang Jin
Postdoc
Jidong Zhai
Jidong Zhai
Professor
(长聘教授、博士生导师)