Sandhi: Fine-grained Merging for Memory Efficient Multi-Model Serving

Picture of Vima Gupta
Vima Gupta
Picture of Oytun Kuday Duran
Oytun Kuday Duran
Picture of Nandan Suresh Meda
Nandan Suresh Meda
Picture of Ikhyun An
Ikhyun An
Picture of Ganesh Ananthanarayanan
Ganesh Ananthanarayanan
Picture of Anand Iyer
Anand Iyer
Published at ACM SOSP 2026