Predictive Speculative KV Replication for Bursty LLM Inference

Posted by shreybirmiwal 3 days ago

Counter41Comment4OpenOriginal

https://github.com/jwlaboratory/bite-the-bullet

Comments

Comment by msp26 2 days ago

the hand drawn diagrams and highlights are charming

Comment by shreybirmiwal 2 days ago

thank you so much

Comment by holtkam2 2 days ago

Awesome animations!

Comment by shreybirmiwal 2 days ago

thanks a lot

Comment by federicoTXTS 2 days ago

[flagged]