shockroborty.bsky.social
building aadi labs. ML/LLM research. Prev @BrownUniversity
👤 Joined on 30 October 2024
Followers
Following
Total Posts
@shockroborty.bsky.socialNew blog applying Continual Harness to ARC-AGI-3. The heavy test-time learning required by the benchmark pushes agents to form an internal world model of the rules and mechanics that updates with new evidence. Continual Harness scored 20.54%. sethkarten.substack.com/p/continual-...
Show PostExcited to share a new open-source, RL recipe paper! TMax is the best openly available terminal-bench style training data, establishing the open frontier of small terminal agents with RL training. Many great insights into training in the work led by Hamish Ivison and Oscar Yin.
Show PostGood things are possible and we don’t have to settle.
Show PostInstead of behavior cloning, what if you asked an LLM to write code to describe how an agent was acting, and used this to predict their future behavior? Our new paper "Modeling Others' Minds as Code" shows this outperforms BC by 2x, and reaches human-level performance in predicting human behavior.
Show PostThe way Sutton himself interprets the “bitter lesson” in this interview definitely caught a lot of bitter lesson enthusiasts off guard. LLMs not actually being an example of the bitter lesson was quite a nuance no one saw coming. youtu.be/21EYKqUsPfg?...
Show Post