#llm-scheduling

LACE Forces vLLM and SGLang to Rethink How Parallel Reasoning Threads Run

LACE lets parallel reasoning threads share state mid-inference, yielding 3-7 point accuracy gains but forcing vLLM and SGLang to abandon independent-sequence batching.