hessianfree.bsky.social
Optimization Generative Modeling @Caltech, PhD @UCLA. ex Research Scientist Intern @AIatMeta (opinions are my own) why is jax so difficult
👤 Joined on 21 November 2024
Followers
Following
Total Posts
@hessianfree.bsky.socialPretraining will only end once we find the optimal scaling law.
Show PostIt being physically small and very low power consumption at idle probably also plays a role (vs having a desktop computer with 2 4090s idling)
Show Postthe o3 announcement feels very analogous to the GPT-3 announcement in early 2020: "here is new tech, it's very powerful, but it's super expensive to run and we're super selective with who we give access to"
Show Postwho remembers GPT-3 Davinci pricing?
Show PostProbably my biggest naming blunder was the name "auto-encoding variational Bayes" for a method that (in its default version) is only Bayesian over the latent variables, not the parameters. Blasphemy in the church it Bayes 😂
Show Post