Paper page — Infinite-LLM: Efficient LLM Service for Long Context with DistAttention and Distributed KVCache

Posted by Cecile G. Tamura in futurism