Kaichao You

Latest

• Jenga: Effective Memory Management for Serving LLM with Heterogeneity