mkirchhof.bsky.social
RS on uncertainty quantification for agents at Apple
👤 Joined on 19 November 2024
Followers
Following
Total Posts
@mkirchhof.bsky.social🚀 We're hiring a Research Scientist, Machine Learning Research (MLR), Barcelona ☀️ 👉 Apply here: jobs.apple.com/en-us/detail... #MachineLearning #MLResearch #AI #Hiring #Apple #Barcelona #ResearchScientist #DeepLearning
Show PostWithin just 3 years, Victor's work and contributions led to 3 x NeurIPS, 2 x ICML, 1 x ICRA, 1 x preprint. @vletzelter.bsky.social is a brilliant, yet humble researcher and a joy to work with. We're super proud of his progress, wish him good luck and congratulate the lab that will have him ^^
Show PostHow can agents learn in long, open-ended tasks where success is rare and rewards are sparse? 👀 🚨 Enter ∆Belief-RL: We show how to use agent’s own belief updates as a dense reward for turn-level credit assignment. The result? Surprisingly strong generalization. (1/8) 🧵⬇️
Show PostAnother interesting finding was how little the loss of token-selection methods tells about downstream factual accuracy on its own. Across multiple methods and model scales, validation loss (both on tokens where the model called, didn’t call, etc) is not correlated with factuality. 🧵 7/7
Show Post