QFactory: Accelerating Quantized Large Language Model Serving with Qtile Graphs

Qihao Zhang, Mingshu Zhai, Rui Sun, Jidong Zhai
January, 2025
Cite URL
Type
Conference paper
Publication
Proceedings of the 2025 USENIX Annual Technical Conference, USENIX ATC 2025, Boston, MA, USA, July 7-9, 2025
Qihao Zhang
Qihao Zhang
Ph.D. Student
Mingshu Zhai
Mingshu Zhai
Ph.D. Student
Rui Sun
Rui Sun
MS Student
Jidong Zhai
Jidong Zhai
Professor
(长聘教授、博士生导师)