You just have to let Nick have a look at the network and he can figure it out.

Show Post

yeah I don't really get it, can someone explain why people are making such a big deal about this? It seems the primary thrust is "I used to think polysemanticity arose for one reason but now I think it's because of another reason" which might matter to people who know what polysemanticity is but

Show Post

the actual significance of this seems to be more-or-less aesthetic if not straight up religious. And, again, they don't actually demonstrate that their theory is true let alone say anything about what you're supposed to do with it.

Show Post

the muse, the muse, the muse is on fire (let the mf burn)

Show Post

How much representational diversity exists around a trained network? A lot, it turns out! Moving a ViT’s weights by 1.3% while preserving its predictions, its representations end up less similar to the original than a random-init ViT’s ‼️ New paper: Hessian Null Space Continuation (HNC) 💫🧵 (1/12)

Show Post