soldaini.net
I like tokens! Leading the Olmo data team at @ai2.bsky.social with @kylelo.bsky.social // all opinions sampled from my own stochastic parrot more at https://soldaini.net
👤 Joined on 04 March 2023
Followers
Following
Total Posts
@soldni.bsky.social@soldni.bsky.social → @soldaini.net@soldaini.net → @soldni.bsky.social@soldni.bsky.social → @soldaini.netWe’re updating olmOCR, our model for turning PDFs & scans into clean text with support for tables, equations, handwriting, & more. olmOCR 2 uses synthetic data + unit tests as verifiable rewards to reach state-of-the-art performance on challenging documents. 🧵
Show PostHow much data people use to train tokenizers nowadays? Trying to figure out, but so often people just use a trained tokenizer, so a bit tricky cc @soldaini.net and the OLMo folks
Show PostGiving a talk at NYU text as data tomorrow (Thursday) at 11! Catch me there buds
Show Post