loppsean.bsky.social
Dagster, RStudio, Looker. Dad. Bikes. Coffee.
👤 Joined on 11 November 2024
Followers
Following
Total Posts
@loppsean.bsky.socialNew post: I think the debate around whether LLMs can replace developers is lacking some nuance because, if we're lucky, we as developers don't work without context. I work with my Alphabet Radio on, streaming the greatest hits of the best devs I've worked with. vickiboykis.com/2024/12/16/w...
Show PostThis is my preferred way of doing things right now. The CLI only selects the config. All of your config params are grouped together in a single object. You get nice type hints and validation from pydantic. Your script contains a record of previously-run configs.
Show PostWhen choosing between parallelizing within your orchestrator or out to a parallelization engine like dash, “choose a breakpoint that makes sense to a human operator” is great guidance. Applies to lots of aspects of designing systems. Human operators should not be an afterthought!
Show PostMonte Carlo methods use random sampling to solve tough problems (optimization, integration, ...) @13:55 When your simulations are expensive, you want to be clever about sampling (Quasi Monte Carlo) -> less samples, same info @32:00 cleverness of different sampling methods compared #datascience
Show Post