jlibovicky.bsky.social
Researcher at Charles University | multilingual natural language processing, machine translation
👤 Joined on 07 December 2023
Followers
Following
Total Posts
@jlibovicky.bsky.socialif you're at #colm2026, why not come listen to some fun #tokenization talks? Continental 1, all day long tokenization-workshop.github.io/schedule/
Show Postarxiv has the opportunity to do the funniest thing ever
Show PostThere are also all kinds of tests, of you measure average performance, sure best to be close to the one with the best average performance right? But what it is not because it knows everything the rest does, just knows more. So if you care for information(or skills) commonly found elsewhere
Show PostEffective language identification based on a tokenizer UnigramLM tokenizer already gives probabilities, testing those to identify a language is fast and effective. Whiceh leads me to wonder, can we identify language during training and affect behavior? arxiv.org/abs/2602.17655 @tpimentel.bsky.social
Show PostCome to La Palmaraie (EACL) for the first Multilingual Multicultural Evaluation workshop! 🧐 now. Organized by @pinzhen.bsky.social @hanxuhu.bsky.social @simi97k.bsky.social Wenhao Zhu @bazril.bsky.social Alexandra Birch @afaji.bsky.social Rico Sennrich @sarahooker.bsky.social
Show Post