skylion.bsky.social
Maker of the OpenWebText. Mozilla Rise25 @PyTorch Core Reviewer. PhD Candidate at @Cornell (interning at @MosaicML) Previously @FacebookAI and @BrownUniversity
👤 Joined on 14 February 2024
Followers
Following
Total Posts
@skylion.bsky.socialSome of the CDC's main channels for communicating urgent health information to the public have gone silent.
Show PostI think this is precisely the point. Not all LLMs are the same just because they’re LLMs. People make choices about training—what data to include, what the mix should be, whether to upsample, and a million other little things. They don’t just happen, and they aren’t foregone conclusions.
Show PostWe knew the bots had taken over Twitter once Musk got ahold of it. But now the bots actually OWN Twitter . . . www.foxbusiness.com/technology/e...
Show PostLlama 3.1 70B contains copies of nearly the entirety of some books. Harry Potter is just one of them. I don’t know if this means it’s an infringing copy. But the first question to answer is if it’s a copy at all/in the first place. That’s what our new results suggest: arxiv.org/abs/2505.12546
Show PostThese results surprised me, so we ran as many books and models as possible with the time and resources available. And we’re going to explore this more.
Show Post