FastCache: Optimizing Multimodal LLM Serving through Lightweight KV-Cache Compression Framework

Jianian Zhu, Hang Wu, Haojie Wang, Yinghui Li, Biao Hou, Ruixuan Li, Jidong Zhai
January, 2025
Cite DOI URL
Type
Journal article
Publication
CoRR
Haojie Wang
Haojie Wang
Researcher
Jidong Zhai
Jidong Zhai
Professor
(长聘教授、博士生导师)