shauli.bsky.social
Faculty fellow at NYU CDS. Previously: PhD @ BIU NLP.
👤 Joined on 07 October 2023
Followers
Following
Total Posts
@shauli.bsky.socialCan LLMs introspect? Anthropic said yes. However, CDS PhD student Shashwat Singh, CDS Associate Professor Tal Linzen (@tallinzen.bsky.social) & CDS Faculty Fellow Shauli Ravfogel (@shauli.bsky.social) found the evidence falls short. nyudatascience.medium.com/cds-research...
Show PostDeveloping LLMs to be Large Plagiarism Machines is a choice "we cannot rule out that de-identified data derived from your usage of our products helped improve our models"
Show PostIf - as now seems likely - LLM companies are mining their logs for juicy problems, then that means that it's very likely that "secret" test sets don't stay secret for long. When looking at new models' performance on benchmarks that date from before that model, we shouldn't take results at face value
Show PostDo world models emerge in neural networks trained for prediction? Generative Adversarial Collaboration (GAC) at #CCN2026
Show PostThis should be fun! I'll be talking about what it means for a neural network to have a world model (joint work with @raphaelmilliere.com) and presenting new evidence that the standard example, Othello-GPT, does not have one (joint work with @shauli.bsky.social among others).
Show Post