orionweller.bsky.social
PhD Student at Johns Hopkins University. Previously: Allen Institute for AI, Apple, Samaya AI. Research for #NLProc #IR
👤 Joined on 15 September 2023
Followers
Following
Total Posts
@orionweller.bsky.socialFind out more or check the leaderboard here: 📑 Paper: arxiv.org/abs/2502.135... 📈 Leaderboard: huggingface.co/spaces/mteb/... 👩💻 GitHub: github.com/embeddings-b...
Show PostI would especially like to thank the managing team Isaac Chung, @imeneker.bsky.social, Márton Kardos, Roman Solomatin, @tomaarsen.com, Chenghao Xiao, @vaibhavadlakha.bsky.social, @orionweller.bsky.social, Siva Reddy. and @muennighoff.bsky.social, who all have done fantastic work 🙏
Show PostThis work resulted from a large-scale collaboration, and I would like to thank all of the authors and contributors on MTEB.
Show PostThis new release also comes with a whole new leaderboard, where it is possible to build benchmarks tailored to your use case using in-depth task selection.
Show PostSuch an extensive collection of tasks comes with a considerable computational cost. Thus, we have added multiple optimizations to ensure the benchmark is accessible and quick to run. We see notable speedups for the English benchmark while maintaining relative rank.
Show Post