ankareuel.bsky.social
Computer Science PhD Student @ Stanford | Geopolitics & Technology Fellow @ Harvard Kennedy School/Belfer | Vice Chair EU AI Code of Practice | Views are my own
👤 Joined on 25 November 2024
Followers
Following
Total Posts
@ankareuel.bsky.socialA recent Stanford paper reveals that many popular AI benchmarks are fundamentally flawed: They can be outdated, easily gamed, or inaccurate. Stanford HAI Graduate Fellow @ankareuel.bsky.social talks about how researchers are rethinking AI benchmarks: www.emergingtechbrew.com/stories/2025...
Show PostOrganizers: Ben Bucknall, @lisasoder.bsky.social, @ankareuel.bsky.social @fbarez.bsky.social, @carlosmougan.bsky.social Weiwei Pan, Siddharth Swaroop, @ankareuel.bsky.social , Robert Trager @maosbot.bsky.social
Show PostThis work was done at MATS led by Leon Staufer and Mick Yang. Great to collaborate with @ankareuel.bsky.social as well.
Show Postoh shit, this is nice! holding an eval hackathon atm, will share! is this limited to the current paradigm of static dataset type benchmarks, or could it also work for like llm judges, environments for agents, cellular automata simulation, etc?
Show Postoh sweet, you have agentbench here, so it does. ok, will share
Show Post