Menu

Blog

Apr 10, 2024

Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence

Posted by in category: futurism

Eagle and Finch.

RWKV with Matrix-Valued States and Dynamic Recurrence.

We present Eagle (RWKV-5) and Finch (RWKV-6), sequence models improving upon the RWKV (RWKV-4) architecture.


Join the discussion on this paper page.

Leave a reply