Topic

#LLM serving

1 article exploring LLM serving. Expert insights and analysis from our editorial team.

Showing 1–1 of 1 articles
Related topics:
prefill decode disaggregation inference infrastructure Mooncake

Articles

Newest first
AI Infrastructure

Prefill-Decode Disaggregation: The Architecture Shift Redefining LLM Serving at Scale

Prefill-decode disaggregation separates compute-bound prefill from memory-bound decode onto dedicated hardware, eliminating phase interference.

· 9 min read
Browse All Topics