Badr AlKhamissi

bkhmsi.bsky.social

19 May 2026 20:58

Huge shoutout to my amazing co-authors on Mixture of Cognitive Reasoners: @cndesabbata.bsky.social, @gretatuckute.bsky.social, @eric-zemingchen.bsky.social, @mschrimpf.bsky.social, and @abosselut.bsky.social! Link: cognitive-reasoners.epfl.ch Poster below👇

Mete

mismayil.bsky.social

13 April 2026 17:08

LLMs can retrieve knowledge — but can they connect it in *creative* ways to solve problems? Introducing CresOWLve 🦉, a new benchmark that evaluates creative problem-solving over real-world knowledge, using puzzles that require multiple creative thinking strategies.👇

Mete

mismayil.bsky.social

13 April 2026 17:08

These aren't your typical trivia questions. CresOWLve spans 34 knowledge domains — from Literature to Astronomy to Art — covering 2,061 carefully curated puzzles across more than 26 cultures. Solving them demands *connecting facts across domains in non-obvious ways* 🌍📚

Mete

mismayil.bsky.social

13 April 2026 17:08

And it's not just *what* you know — it's *how* you think. 72% of puzzles require lateral thinking. Many involve analogy-making, abstraction, metaphors, jokes, and puns. Most questions combine 2+ creative reasoning strategies.

Mete

mismayil.bsky.social

13 April 2026 17:08

LLM performance? 📉 Non-thinking models under 30% (with CoT), most thinking models under 60%. 📉 Models perform up to 17% worse on creative vs. factual questions. Crucially, models *can* retrieve the relevant facts — they just fail to form the creative connection between them.