DeepSeek publishes DeepInfer for offline inference
The Apache 2.0 framework supports V4.1 Flash on Nvidia SM100 GPUs and Huawei Ascend 950 NPUs; a complete serving service still needs additional components. Release date unconfirmed; observed October 20.