Jenga: Effective Memory Management for Serving LLM with Heterogeneity
Chen Zhang,
Kuntai Du,
Shu Liu,
Woosuk Kwon,
Xiangxi Mo,
Yufeng Wang,
Xiaoxuan Liu,
Kaichao You,
Zhuohan Li,
Mingsheng Long,
Jidong Zhai,
Joseph Gonzalez,
Ion Stoica
January, 2025
