Sandhi: Fine-grained Merging for Memory Efficient Multi-Model Serving

Vima Gupta, Oytun Kuday Duran, Nandan Suresh Meda, Ikhyun An, Ganesh Ananthanarayanan, Anand Iyer

ACM Symposium on Operating Systems Principles (SOSP), Sep 2026

PDF Code

VTC: DNN Compilation with Virtual Tensors for Data Movement Elimination

Muyan Hu, Ahan Gupta, Jiachen Yuan, Vima Gupta, Taeksang Kim, Xin Xu, Janardhan Kulkarni, Ofer Dekel, Vikram Adve, Charith Mendis

USENIX Symposium on Operating Systems Design and Implementation (OSDI), Jul 2026

OMEGA: A Low-Latency GNN Serving System for Large Graphs

Geon-Woo Kim, Donghyun Kim, Jeongyoon Moon, Henry Liu, Tarannum Khan, Anand Iyer, Daehyeok Kim, Aditya Akella

IEEE International Parallel and Distributed Processing Symposium (IPDPS), May 2026

Scalable and Verifiable Foundations for Graph Learning

Mingyu Guan

Ph.D. Thesis, Georgia Institute of Technology, Apr 2026

Defense

CHAI: CacHe Attention Inference for text2video

Joel Mathew Cherian, Ashutosh Muralidhara Bharadwaj, Vima Gupta, Anand Iyer

arXiv preprint, Feb 2026

PDF arXiv: 2602.16132

SAFuzz: Semantic-Guided Adaptive Fuzzing for LLM-Generated Code

Ziyi Yang, Kalit Inani, Keshav Kabra, Vima Gupta, Anand Iyer

arXiv preprint, Feb 2026

PDF arXiv: 2602.11209

Aragog: Just-in-Time Model Routing for Scalable Serving of Agentic Workflows

Yinwei Dai, Zhuofu Chen, Anand Iyer, Ravi Netravali

arXiv preprint, Nov 2025

PDF arXiv: 2511.20975

Principles and Methodologies for Serial Performance Optimization

Sujin Park, Mingyu Guan, Xiang Cheng, Taesoo Kim

USENIX Symposium on Operating Systems Design and Implementation (OSDI), Jul 2025

PDF

FLEX: Fast, Accurate DNN Inference on Low-Cost Edges Using Heterogeneous Accelerator Execution

Tanmoy Sen, Haiying Shen, Anand Iyer

European Conference on Computer Systems (EuroSys), Apr 2025

Heterogeneous Graph Neural Network on Semantic Tree

Mingyu Guan, Jack W. Stokes, Qinlong Luo, Fuchen Liu, Purvanshi Mehta, Elnaz Nouri, Taesoo Kim

The 39th Annual AAAI Conference on Artificial Intelligence, Feb 2025

PDF arXiv: 2402.13496

ReInc: Scaling Training of Dynamic Graph Neural Networks

Mingyu Guan, Saumia Singhal, Taesoo Kim, Anand Iyer

arXiv preprint, Jan 2025

PDF arXiv: 2501.15348

Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving

Yinwei Dai, Rui Pan, Anand Iyer, Kai Li, Ravi Netravali

ACM Symposium on Operating Systems Principles (SOSP), Nov 2024

PDF

Improving DNN Inference Throughput Using Practical, Per-Input Compute Adaptation

Anand Iyer, Mingyu Guan, Yinwei Dai, Rui Pan, Swapnil Gandhi, Ravi Netravali

ACM Symposium on Operating Systems Principles (SOSP), Nov 2024

PDF

Lynx: Enabling Efficient MoE Inference through Dynamic Batch-Aware Expert Selection

Vima Gupta, Kartik Sinha, Ada Gavrilovska, Anand Iyer

arXiv preprint, Nov 2024

PDF arXiv: 2411.08982 Code

USHER: Holistic Interference Avoidance for Resource Optimized ML Inference

Sudipta Saha Shubha, Haiying Shen, Anand Iyer

USENIX Symposium on Operating Systems Design and Implementation (OSDI), Jul 2024

PDF

Vulcan: Automatic Query Planning for Live ML Analytics

Yiwen Zhang, Xumiao Zhang, Ganesh Ananthanarayanan, Anand Iyer, Yuanchao Shu, Victor Bahl, Z. Morley Mao, Mosharaf Chowdhury

USENIX Symposium on Networked Systems Design and Implementation (NSDI), Apr 2024

PDF

Gemel: Model Merging for Memory-Efficient, Real-Time Video Analytics at the Edge

Arthi Padmanabhan, Neil Agarwal, Anand Iyer, Ganesh Ananthanarayanan, Yuanchao Shu, Nikolaos Karianakis, Guoqing Harry Xu, Ravi Netravali

USENIX Symposium on Networked Systems Design and Implementation (NSDI), Apr 2023

PDF