DINOv2 has never seen a caption, and Qwen3 has never seen an image. We still aligned their embedding spaces without a single image-caption pair. It even works when the images and the captions come from different datasets. Project page: dominik-schnaus.github.io/unpaired-rosetta ⬇️

Show Post

19 scientists gathered in Spain for a two-day workshop of the ELLIS Multimodal Learning Systems Program, discussing topics from foundation models & medical imaging to egocentric vision & document understanding. The recap: https://ellis.eu/news/ellis-multimodal-learning-systems-program-annual-meeting

Show Post

Went cycling to escape AI. Crossed 2 cyclists 🚴‍♂️ 🚴‍♀️ and overheard "So with AI this has all now become much easier ..." 😵‍💫

Show Post

Students sometimes ask me if it still makes sense, in this accelerating age, to pursue a PhD in AI. Perhaps counterintuitively, I think it's a great time to do so. I wrote up some thoughts on this here: web.mit.edu/phillipi/www...

Show Post

Let's make this a thread ... Lyon is seen in the background, with the towers at La Part Dieu. The hill I am standing on is Mt. Thou. Mt. Cindre is in the background. The highest elevation is unfortunately only 629m. This is not Grenoble 😬

Show Post