From Carnegie Mellon and Meta.

TriForce.

Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding.

With large language models (LLMs) widely deployed in long content generation recently, there has emerged an increasing demand for…

---

Join the discussion on this paper page.