CS 592: ML System Co-Design (Fall 2026)

  • Instructor: Haoran You (haoran@purdue.edu)
  • Semester: Fall 2026, Purdue University
  • Time: Tuesday & Thursday, 4:30 – 5:45 pm
  • Classroom: LWSN B134
  • Syllabus: PDF

Schedule

WeekDateTopicReading
1Aug. 25 (Tue)Course Overview and LogisticsShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization, NeurIPS'24
EyeCoD: Eye Tracking System Acceleration via FlatCam-based Algorithm & Accelerator Co-Design, ISCA'22
Drawing Early-Bird Tickets: Towards More Efficient Training of Deep Networks, ICLR'20
HiLo-Token: Input-Adaptive High-Low Frequency Token Compression for Efficient Image Editing Model Serving, arXiv'26
Aug. 27 (Thu)Intro to ML System Co-Design
2Sep. 1 (Tue)Paper DiscussionKairos: A Scalable Serving System for Physical AI, arXiv'26
Sep. 3 (Thu)Invited TalkMixFusion: A Patch-Level Parallel Serving System for Mixed-Resolution Diffusion Models, PPoPP'26
FlexCache: Flexible Approximate Cache System for Video Diffusion, arXiv'24
Attacks on Approximate Caches in Text-to-Image Diffusion Models, Usenix Sec’26
3Sep. 8 (Tue)Paper DiscussionTowards High-Goodput LLM Serving with Prefill-decode Multiplexing, ASPLOS'26
Sep. 10 (Thu)Paper DiscussionDistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving, OSDI'24
4Sep. 15 (Tue)Paper DiscussionPatterns behind Chaos: Forecasting Data Movement for Efficient Large-Scale MoE LLM Inference, ISCA'26
Sep. 17 (Thu)Paper DiscussionCassandra: Enabling Reasoning LLMs at Edge via Self-Speculative Decoding, ISCA'26
5Sep. 22 (Tue)Paper DiscussionCombating the Memory Walls: Optimization Pathways for Long-Context Agentic LLM Inference, ISCA'26
Sep. 24 (Thu)Paper DiscussionTetris: Efficient Long-context LLM Serving with Chunkwise Dynamic Sequence Parallelism, ISCA'26
6Sep. 29 (Tue)Paper DiscussionExecuTorch -- A Unified PyTorch Solution to Run AI Models On-Device, MLSys'26
Oct. 1 (Thu)Paper DiscussionStreamDiffusionV2: A Streaming System for Dynamic and Interactive Video Generation, MLSys'26
7Oct. 6 (Tue)Paper DiscussionAegaeon: Effective GPU Pooling for Concurrent LLM Serving on the Market, SOSP'25
Oct. 8 (Thu)Paper DiscussionKaleido: Algorithm-Hardware Co-Design for Video DiTs by Exploiting Latent Space Correlations, MICRO'26
8Oct. 13 (Tue)Fall Break
Oct. 15 (Thu)Paper DiscussionHeteroMosaic: Exposing and Exploiting Heterogeneous Opportunities for Energy-Efficient Edge LLM Inference, MICRO'26
9Oct. 20 (Tue)Paper DiscussionBeyond Utilization: Energy-Conscious GPU Sharing for Inference Serving, SOSP'26
Oct. 22 (Thu)Paper DiscussionDiFlow: A System for Micro-Serving Text-to-Image Diffusion Workflows, SOSP'26
10Oct. 27 (Tue)Paper DiscussionSharpen the Spec, Cut the Code: A Case for Generative File System with SYSSPEC, FAST'26
Oct. 29 (Thu)Paper DiscussionKerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Models, PACT'26
11Nov. 3 (Tue)Paper DiscussionXtrace: High-Fidelity GPU Intra-Kernel Tracing via Binary-Level Instruction Splicing, arXiv'26
Nov. 5 (Thu)Invited TalkAVO: Agentic Variation Operators for Autonomous Evolutionary Search, arXiv'26
AlphaEvolve: A Coding Agent for Scientific and Algorithmic Discovery, arXiv'25
12Nov. 10 (Tue)Paper DiscussionSPLASH: Co-Designing Sparse Attention with High-Bandwidth Flash for Efficient Long-Context Inference, arXiv'26
Nov. 12 (Thu)Paper DiscussionOptimus: Elastic Decoding for Efficient Diffusion LLM Serving, arXiv'26
13Nov. 17 (Tue)Paper DiscussionParallelKittens: Systematic and Practical Simplification of Multi-GPU AI Kernels, MLSys'26
Nov. 19 (Thu)Paper DiscussionCAKE: Compiler-Agent Co-Design for Frontier Kernel Evolution, arXiv'26
14Nov. 24 (Tue)Paper Discussiondb-SP: Accelerating Sparse Attention for Visual Generative Models with Dual-Balanced Sequence Parallelism, MLSys'26
Nov. 26 (Thu)Thanksgiving Break
15Dec. 1 (Tue)Final Project Presentation
Dec. 3 (Thu)
16Dec. 8 (Tue)
Dec. 10 (Thu)
17Dec. 15 (Tue)Exam Week (No Schedule)
Dec. 17 (Thu)