markjeffrey.bsky.social
Investoor, Authoor, Podcastoor
👤 Joined on 18 October 2023
Followers
Following
Total Posts
@markjeffrey.bsky.socialStill astounded how people think that the government force-closing a social network that's literally used by 170 million people in the US is just fine or even good. It would not surprise me if they go after VPNs next. They tried this already: en.wikipedia.org/wiki/RESTRIC...
Show PostTo my surprise, we find the opposite of what I thought when we started this project: The approach to reasoning LLMs use looks unlike retrieval, and more like a generalisable strategy synthesising procedural knowledge from many documents doing a similar form of reasoning.
Show PostHow do LLMs learn to reason from data? Are they ~retrieving the answers from parametric knowledge🦜? In our new preprint, we look at the pretraining data and find evidence against this: Procedural knowledge in pretraining drives LLM reasoning ⚙️🔢 🧵⬇️
Show PostThe absence of verified profiles makes this almost unusable
Show Post