Toggle light / dark theme

Paving the way to efficient architectures: StripedHyena-7B, open source models offering a glimpse into a world beyond Transformers

One of the focus areas at Together Research is new architectures for long context, improved training, and inference performance over the Transformer architecture. Spinning out of a research program from our team and academic collaborators, with roots in signal processing-inspired sequence models, we are excited to introduce the StripedHyena models. This release includes StripedHyena-Hessian-7B (SH 7B), a base model, and StripedHyena-Nous-7B (SH-N 7B), a chat model. StripedHyena builds on the many lessons learned in the past year on designing efficient sequence modeling architectures: H3, Hyena, HyenaDNA, and Monarch Mixer.

Mastering Clear Thinking: Shane Parrish’s Guide

Shane Parrish is the Founder of Farnam Street, an ex-Canadian Intelligence Agency Operative and an author. Our lives are mediated by our thoughts. The more accurately we can make decisions, the better and happier our existence will be. Therefore it makes sense to spend some time learning how to think more clearly and frameworks to keep us rational. Expect to learn if its truly possible to think independently, what it takes to become a clear thinker, the most common pitfalls holding you back from seeing the world accurately, how to build more strength in your mind, how to better manage your weaknesses, strategies to become an effective decision maker, the biggest lies that people follow when they focus in life and much more…

Understanding Status in Mating and Dating: Evolutionary Psychology Insights

While evolutionary psychology can be incredibly useful in explaining much of modern mating and dating preferences, it fails, in my opinion, to adequately appreciate the influence of status on intersexual dynamics. The standards of attractiveness fluctuate (somewhat) from generation to generation and from culture to culture; however, what remains constant is the collective selection of some subset of partner traits considered to be “desirable.” Attracting a partner with more of these traits — irrespective of how arbitrary or superficial those traits might be — generally redounds to increased survival and prosperity.

Is a founding member of The Consilience Project and works in preventing global catastrophic risk

Having accurate sensemaking is a superpower in the 21st century. As the volume of information we need to sort through increases, the ability to distinguish signal from noise becomes ever more important. Given this, I wanted to ask Daniel exactly how he would advise someone to become an adept sensemaker. Expect to learn the characteristics that a good sensemaking agent should have, why the relationship between sense, meaning and choice making is so crucial, whether Daniel thinks that humanity is too emotional to reach our full potential, at what stage of personal actualisation we should begin to help the world and much more…

/* */