craigschmidt.com
Interested in ML, AI, and NLP. Particularly interested in tokenization. Live in the Boston area and work in R&D at Kensho Technologies.
👤 Joined on 24 November 2024
Followers
Following
Total Posts
@craigschmidt.bsky.social@craigschmidt.bsky.social → @craigschmidt.comSemantic embeddings capture what is said. Style embeddings capture how, and get far less attention. Our #EMNLP2026 survey on representing linguistic style: definitions, methods, evaluation, open problems 🧵 📄 annawegmann.github.io/pdf/Style_Su... 🧑💻 annawegmann.github.io/StyleSurvey/
Show PostTAG mentioned! at #colm2026 (by @adinawilliams.bsky.social maybe?) in context of this really cool paper on compound tokenization arxiv.org/abs/2610.055...
Show Postif you're at #colm2026, why not come listen to some fun #tokenization talks? Continental 1, all day long tokenization-workshop.github.io/schedule/
Show PostI'm heading to @colmweb.org. Come find me to chat about tokenizers and Korean language modeling! I'll be presenting a poster at @tokshop.bsky.social about the need for a community tokenization benchmark a la the NanoGPT speedrun. It is meant to be a discussion, come share your ideas! #colm26
Show Post🚨 [Token][ization] Paper Alert 🚨 Tokenization is a wildly understudied area of language modeling despite it having effects across all of NLP. Over the past ~8 months, 32 (!) tokenizer researchers put together the most comprehensive survey of the field. Check it out!
Show Post