Keshav Ramji

keshavramji.bsky.social

06 October 2026 16:18

A simple mechanism that minimizes overhead in pre-training looped transformers and learns what to store over the recursions through a gradient highway!

Yoav Artzi

yoavartzi.com

06 October 2026 16:13

Simple, straightforward, and just work well: looping with no KV overhead, and this also gives you a gradients highway that makes backprop work much better

Zizhao Chen

ch272h.bsky.social

27 September 2026 22:33

@giomonea.bsky.social look we worked on agent interrraction

Conference on Language Modeling

colmweb.org

20 March 2025 19:57

A bit of a mess around the conflict of COLM with the ARR (and to lesser degree ICML) reviews release. We feel this is creating a lot of pressure and uncertainty. So, we are pushing our deadlines: Abstracts due March 22 AoE (+48hr) Full papers due March 28 AoE (+24hr) Plz RT 🙏

Yoav Artzi

yoavartzi.com

18 February 2025 18:53

We recently pushed an update to our in-context RL paper. Usually, updates don't justify a post, but this one is exceptionally contentful -> 🧵 tl;dr: all the findings are stronger, and the behaviors are super cool! arxiv.org/abs/2410.05362