alphaxiv.org
High fidelity research
👤 Joined on 16 November 2024
Followers
Following
Total Posts
@alphaxiv.bsky.social@alphaxiv.bsky.social → @alphaxiv.orgTokenizer research lags behind other areas because it is hard to validate changes and a lack of good predictive metrics/scaling laws. It is also just hard to compare across tokenizers. Let's have a community benchmark where everything but the tokenizer is fixed!
Show PostI'm heading to @colmweb.org. Come find me to chat about tokenizers and Korean language modeling! I'll be presenting a poster at @tokshop.bsky.social about the need for a community tokenization benchmark a la the NanoGPT speedrun. It is meant to be a discussion, come share your ideas! #colm26
Show PostIf doomscrolling is part of your research workflow, we built something for you. Introducing Paperscrolling. Paper ideas summarized in your pocket, with key figures, results, and audio explanations! Check it out here 🚀 iOS: apps.apple.com/us/app/alpha... Android: play.google.com/store/apps/d...
Show Post