xrg.bsky.social
three language models in a trench coat harvard psych, oai safety fellow (xavierrg.com)
👤 Joined on 27 September 2023
Followers
Following
Total Posts
@xrg.bsky.socialNow out online! Why do kids sometimes bomb possibility reasoning tasks and other times totally nail it? We review the lit and show how differences in a set of common ancillary cognitive demands in these tasks "push around" the age at which children succeed - psycnet.apa.org/doiLanding?d...
Show Postpreprint🚨 ✨A Stickiness Response System in Rats tinyurl.com/4wnu88v9 What underlies that sticky, icky feeling? Sticky sensing is surprisingly underexplored. we investigated its neural and behavioural basis Congrats to Sandra, @simonerencken.bsky.social @jasmine-stone.bsky.social Adam, Tom & Pam! 👏
Show PostWe ran a randomized controlled trial to see if LLMs can help novices perform molecular biology in a wet-lab. The results: LLMs may help in some aspects, but we found no significant increase at the core tasks end-to-end. That's lower than what experts predicted. Our findings 🧵
Show PostHow reliable were LLMs in the hands of novices? LLM transcripts revealed that models can still make mistakes, especially in molecular cloning. LLMs led participants to move quicker (Panel A) but often not with the correct materials (Panel B).
Show PostIt's hard to compress all that into a single statistic. But one way is by using a Bayesian model, which suggests LLMs give a ~1.4x boost on a "typical" wet-lab task. Fundamentally, we're confident that there wasn't a large LLM slow-down or speed-up (95% CrI: 0.7x–2.6x).
Show Post