DeepSeek's new Director system accelerates distributed MoE serving via online proactive expert placement, reducing end-to-end latency by 11-55%. This breakthrough has significant implications for the AI industry, enabling faster and more efficient model serving. The Director system uses prediction-driven expert placement and online migration to minimize downtime and optimize performance.

DeepSeek's new study explores the effectiveness of learned stopping in reasoning models, finding that it can improve performance in certain tasks. The study introduces LearnStop, a hidden-state-free checkpoint stopper, and evaluates its performance across 18 task-model settings. The results show that learned stopping can be useful in tasks where many questions become correct before full budget but do not exhibit a single reliable scalar stopping signal.