CJ

virmalised.us

21 October 2026 00:05

The kouign amann place!

Aniello De Santo

anids.bsky.social

21 October 2026 00:05

I’m gonna be in Montreal (for #NWAV54 !!) for a few days! Suggestions accepted to things to do in a lil free time (food! Places to walk and see nice things! More food and maybe music? Art?)

Aniello De Santo

anids.bsky.social

18 October 2026 23:52

Not our building getting flooded during Fall break 🙃😭😅

William Timkey

wtimkey.bsky.social

16 October 2026 23:10

Transformer LMs develop attention heads that appear to track syntactic dependencies. But do these heads actually drive syntax-sensitive predictions? In a new preprint with @tallinzen.bsky.social, we put this to the test. The answer was surprisingly mixed. 🧵 Paper link: arxiv.org/abs/2610.192...

William Timkey

wtimkey.bsky.social

16 October 2026 23:10

The takeaway: heads that appear to track syntactic dependencies aren’t the main mechanism that drives syntax-sensitivity in LM predictions, reaffirming the ancient wisdom that attention is not explanation. Paper link: arxiv.org/abs/2610.192...