DeepSeek Releases Open Source Framework That Boosts AI Inference Speed by Up to 85%
DeepSeek releases DSpark, a free open-source AI framework that boosts large language model inference speeds by up to 85% using confidence-scheduled speculative decoding, delivering over 50% throughput gains in live production and supporting popular open-weight models like Qwen and Gemma.