petar-v.bsky.social
Senior Staff Research Scientist, Google DeepMind Affiliated Lecturer, University of Cambridge Associate, Clare Hall GDL Scholar, ELLIS @ellis.eu 🇷🇸🇲🇪🇧🇦
👤 Joined on 15 November 2024
Followers
Following
Total Posts
@petar-v.bsky.social🧵 Tropical Attention --> Softmax is out, Tropical max-plus is in 🦾 1/ 🔥Ever experinced softmax attention fade as sequences grow? That blur is why many attention mechanisms stumble on algorithmic and reasoning tasks. Well, we have a Algebraic Geometric Tropical solution 🌴
Show PostAwesome Does it make sense for software engineer read the book as a big inner in Geometric Deep Learning? I mean, in terms of the book complexity.
Show PostGLOW is returning on 𝗠𝗮𝗿𝗰𝗵 𝟮𝟲𝘁𝗵, 𝟱𝗽𝗺 𝗖𝗘𝗧 with a special guest: @petar-v.bsky.social 🌟 He will lecture on LLMs as GNNs – a topic which received quite some attention at our last session. Specifically, we will learn how Graph ML tools can help understand LLM generalisation
Show PostTrying to copy the greats Pietro and @petar-v.bsky.social giving a guest lecture for the GDL class today!
Show Post