pipeline2insights.bsky.social
P2I shares knowledge, tutorials, and experiences to help others grow in the data industry. We focus on learning, collaboration, and making complex data/AI topics easy to understand. Substack: pipeline2insights.substack.com
👤 Joined on 26 November 2024
Followers
Following
Total Posts
@pipeline2insights.bsky.socialAs a data engineer, you probably already: Gather requirements from people who don't speak in specs Work with systems you didn't design Build quickly when requirements are unclear Translate between business problems and technical systems Those aren't just DE skills. They're core FDE skills, too.
Show PostWhat does it take to build a product people actually keep using? On Wednesday, we're hosting Sameer Alsakran, Founder & CEO of @metabase.com, at our office in Berlin for a live conversation with Francesco Mucio from Data Berlin. 🧵
Show Postthere’s something fascinating happening where developers use ai all day, but still won’t fully rely on it. that gap feels important. like we’re watching trust being earned in real time, not declared in benchmarks.
Show PostThe craziest part of the new dltHub AI release? The MCP integration. Asked Claude Code for an OpenAI pipeline -> it searches the dlt context -> scaffolds the exact code with schema & incremental loading. No more starting from scratch. https://dlthub.com/blog/ai-workbench
Show PostSpring brings good things and more than just flowers. 🌸 ❄️ Catch up on Module 1 of our dlt + Snowflake course before Module 2 drops next week! Learn nested data normalization, schema evolution, incremental loading, and merge strategies (upsert, SCD2), all in plain Python.
Show Post