18.71 billion documents. 25.25 trillion tokens. 152 data sources, deduplicated, decontaminated, and sorted into 200 buckets before a single training run. A new blog from Will Held @williamheld.com on Datakit, the Marin team's pretraining data pipeline: openathena.ai/blog/marin-d...

Show Post

The original MoE

Show Post

In a new blog, Russell Power explains how the Marin team nearly doubled its sustained TPU usage by creating a custom global scheduler: Iris. Iris searches every region where Marin has compute, places each job wherever capacity appears, and moves data along as needed. 🔗 openathena.ai/blog/cluster...

Show Post

🚨 New paper alert 🚨 Using LLMs as data annotators, you can produce any scientific result you want. We call this **LLM Hacking**. Paper: arxiv.org/pdf/2509.08825

Show Post

Reflecting (in late Aug 2025) on Seattle at sunset, DC under occupation, and how targeted cities around the country need to plan to fight back — both against the propaganda justifying occupation and the occupation itself: www.facebook.com/share/p/15C8... (Using FB to reach my Seattle network.)

Show Post