Lifeboat Foundation

“Semiparametric Token-Sequence Co-Supervision”

We introduce semiparametric token-sequence co-supervision, which trains LM by simultaneously leveraging supervision from a parametric token and a nonparametric sequence embedding space.

✅ Paper: https://arxiv.org/abs/2403.09024 ✅ Code: https://avatars.githubusercontent.com/u/44370759?s=64&v=4

Contribute to kaistAI/Semiparametric_Token-Sequence_Co-Supervision development by creating an account on GitHub.