Prefill a 284B model on Nvidia. Decode it on Apple Silicon. Over plain 10GbE

Posted by jnaina 6 hours ago

Counter2Comment1OpenOriginal

Comments

Comment by jnaina 6 hours ago

pd-bridge — heterogeneous prefill/decode for DeepSeek-V4-Flash