Menu

Blog

Jan 17, 2024

Paper page — DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference

Posted by in category: futurism

Join the discussion on this paper page.

Leave a reply