New engineers at Kilo ship code on day one. MVP feature by end of week. In production the next week. "We ruthlessly hunt down bureaucracy." Scott Breitenother on Data Renegades #AIAgents #Engineering

"These technologies, they're not robots replacing us. They're exoskeletons that make us better, faster, stronger." Scott Breitenother on Data Renegades #DataEngineering #AI

Scott Breitenother jumped into every Slack thread at Brooklyn Data. It made the company fast and him the bottleneck. His fix: subscribe to replies, don't comment, check back in 3 hours. #Leadership #DataTeams

Code changes have AI review tools. Data changes don't... until now. Our own Kent Chen wrote about how the team built a multi-agent system with Claude Agent SDK and MCP that reviews data changes in every dbt PR. Orchestrator + two specialist agents using 6 Recce MCP tools.

"The team still exists, but it's not five humans, it's one human and four agents." Scott Breitenother on why the unit of productivity has changed. #DataEngineering #AIAgents

Bryan Bischof's hot take: self-serve data analytics is the hype trend most likely to derail. "People are selling third base. I'm still on first base." #DataEngineering #Analytics

New episode of Data Renegades is live Scott Breitenother built a 100-person data consultancy, watched himself become the bottleneck, and rebuilt everything at Kilo Code Their data team is one person plus four AI agents.

"I shit you not. I found one where it gave three backpacks." Bryan Bischof on the production bug where out-of-distribution items sat near the null vector and showed up in every recommendation. #MachineLearning #DataScience

"Saying 'you are wrong' is not curious. Saying 'why are your priors different than what the data is showing' is curious." Bryan Bischof on Data Renegades #DataScience #DataCulture

Happy Valentine's Day to everyone who spent this week falling back in love with their data stack. Five days. Five companies. No slides. No safety nets. Thank you Greybeam, dltHub, Database Tycoon, & bauplan for doing this with us and shipping in front of an audience.

"The best analytics asks more questions than it answers." Roger Magoulas on why dashboards shipped is the wrong success metric. The real measure is whether the work generates questions worth investigating. 🎧 www.heavybit.com/library/podc... #dataengineering #analytics

An AI agent tried to write to production. The lakehouse said no. Day 5 of Data Valentine Challenge: @BauplanLabs brought the finale. Aldrin let Claude Code build his entire pipeline from scratch — on transactional branches that caught every mistake 🧵

"The best code is the code you don't write. Or in this case, the code you delete." Day 4 of Data Valentine Challenge: Database Tycoon ran a live dbt makeover. Stephen volunteered his NYC transit project. Chloe walked the lineage and cut everything dead.

"We didn't write a single line of Python." Day 3 of Data Valentine Challenge: Ashish from dltHub walked through the workspace workflow — GitHub API to DuckDB to reports, no code. One command. One prompt. Pipeline runs 🧵

"Why don't these numbers match?" Kyle from @greybeam_ai opened Day 2 of Data Valentine Challenge with a scenario every data person knows too well. The fix? Query Snowflake, Google Sheets, and raw APIs, all in one SQL statement. 🧵

A feed broke. Roger Magoulas didn't notice. Tim O'Reilly called it out. His fix: a weekly "Synced" email confirming data freshness. Then he added insights. Soon it went company-wide. 🎧 Full episode: youtu.be/z3E0Pi4XaLg #dataengineering #datateams

Tell your agents you love them. Seriously. 💕 CL opened Data Valentine Challenge with 300 benchmark trials testing emotional framing on coding agents. The question: what happens when you add "you totally got this, take your time, love you" to every prompt? 🧵

Phone numbers are seven digits because humans retain about four things plus or minus three. Roger Magoulas on why 47-tab dashboards don't work. Stakeholders will remember none of it. 🎧 www.heavybit.com/library/podc... #analytics #dataviz

What percentage of your data team's time goes to pipeline maintenance versus exploratory analysis? Roger Magoulas argues the ratio determines whether you generate insight or just keep the lights on. 🎧 youtu.be/z3E0Pi4XaLg #dataengineering #datateams

Want a better data stack + love fun data-pun stickers? Join the Data Valentine Challenge Feb 9–13 🦾 Attend all 5 webinars + 1 social post = get a sticker. Signup here: reccehq.com/data-valenti... #DataEngineering #DataQuality

Next week: Fall in love with your data 💕 The Data Valentine Challenge 💘 5 days, 5 companies, 5 real fixes Data teams are drowning. You need quick wins. 30-60 -min daily challenges that actually move the needle. Recce • Greybeam • dltHub • Database Tycoon • Bauplan Details soon 👀 #DataEngineering

LLMs are non-deterministic. But the code they generate is deterministic. Roger Magoulas: prompt for SQL that monitors your pipelines. Run the code. Sidestep the hallucination problem. 🎧 Full episode: www.heavybit.com/library/podc... #llm #dataengineering

"I had casually said, I think I could build a data warehouse in 90 days. My boss said, OK, go to it." Listen to Roger Magoulas on how curiosity and chance encounters beat formal training. 🎧 youtu.be/z3E0Pi4XaLg #dataengineering #analytics #bigdata

Data engineers are so buried in pipeline maintenance, feed monitoring, and DAG management that they cannot shift into insight mode. All reaction. No anticipation. Roger Magoulas on how the value gets crowded out.

Mode raised 80 million over 10 years and resisted being called a BI tool until the market forced consolidation. Lesson: technical tools drift toward BI because wall-to-wall deployments require value for non-technical users. #BITools #DataEngineering

New episode of Data Renegades podcast is live with guest Roger Magoulas. He coined the term "big data" and has 30 experience years of building data teams. Check it out on your favorite podcast app, youtube, or directly here: www.heavybit.com/library/podc...

Benn predicts BI tools get displaced by LLMs analyzing support tickets, not by better dashboards. Execs already decide based on customer stories they heard, not numbers. AI just makes qualitative analysis scale. #AI #DataEngineering Watch the full clip: youtube.com/shorts/vZjaL...

Mode's product strategy: Don't average 50 customer opinions into a Frankenstein feature set. Find the single most opinionated user who gets it and build exactly what they want. Character beats consensus. #ProductStrategy #DataEngineering

"You have to write it over and over until you can stand it. Your bar isn't too high. Getting through the point where it stops being fun is how you make it good." Benn Stancil shared this quote about writing, but it applies to building products.

We sat down with Benn Stancil (Co-founder of Mode). Here are the takeaways 🧵:

If you've ever nuked a production database, wondered why data teams can't share code like frontend teams, or want to know why Max thinks AI will hit data roles harder than software roles, listen to this. Full episode: youtu.be/6dQntoiQBY8 #DataEngineering #AIEngineering

Max evangelized Airflow to over 50 companies before it gained real traction. One interaction at a time on GitHub plus being present in the community. Hear how he did it: youtube.com/shorts/O2J0H... #OpenSource #CommunityBuilding

If you use Airflow or Superset in production, what's one feature you wish existed that would 10x your workflow? Drop your answer below. #DataEngineering #OpenSource

Hearing Max explain how he told Airbnb he would not work without building Airflow is a masterclass in knowing your leverage as an engineer. Watch: youtube.com/shorts/-n833... #CareerAdvice #Airflow

Data engineering has no npm. Every company rebuilds sessionization, DAU calculations, and experimentation frameworks because SQL dialects fragment everything and we lack unified data models for parametric pipelines. Watch Max explain: youtube.com/shorts/zS5L_... #DataEngineering #CodeReuse

New Data Renegades episode is live! @clkao.bsky.social & @doriwilson.com sat down with @bennstancil.bsky.social founder of Mode. Listen on your fave podcast app to hear: ⭐ Why the modern data stack was a distraction ⭐ The identity crisis every BI tool faces Or stream directly here:

"I wanted to build something that matters. Open source gave me scope of impact beyond one company." Max on why he evangelized Airflow to 50 companies before momentum hit. #OpenSource #TechImpact

We sat down with Max Beauchemin, creator of Airflow and Superset. Here are the takeaways: 🧵 #DataEngineering #Airflow

I'm in an episode of the new Data Renegades podcast with CL Kao and Dori Wilson talking about data journalism and Datasette and related topics - it's a fun conversation, here are some extracted highlights simonwillison.net/2025/Nov/26/...

The data industry is noisy. We wanted to help create some quiet. 🤫 We are proud to launch the Data Renegades podcast today, the brainchild of our founder @clkao.bsky.social and Head of Data @doriwilson.com They set out to build the show they actually wanted to listen to: 🧵👇

Proud and excited to be hosting so many community events today & tomorrow in San Francisco for @techweekbya16z.bsky.social!

hosting 3 events in sf this week 💪 tues 2-5:30pm: data + code unconference (you set the agenda) tues 4pm: happy hour w/ posthog + deskree (ice cream + pizza) wed 5pm: devex demos at convex (vercel, grafana, arthur ai, deskree, convex, recce) pure community vibes. links in thread 👇

#SFTechWeek calendar just dropped & we're doing something different at Recce. Instead of the slide decks + swag bags that most of these become, we're hosting events focused on real community. Thread on our lineup 👇

Ad-hoc validation scripts accumulate from past incidents but don't transfer to new contexts. Under time constraints, data practitioners can only rely on validation scripts. Impact Radius addresses this challenge through metadata analysis alone. cloud.reccehq.com

Marketing reports conversion issues. Investigation approach matters: ❌ Random data exploration ✅ Metadata-guided investigation Click problematic column → column lineage shows derived or passthrough → trace upstream → identify real issue.

Metadata analysis eliminates unnecessary validation queries. Data practitioners commonly validate dbt changes by checking row counts across all downstream models: 47 models generating significant warehouse costs to identify the 3 that actually changed. Try using metadata only

💡 For viadukt, data accuracy isn't a nice-to-have. It's core to their product. "Now, with Recce Cloud, we've dramatically improved our ability to deliver reliable data and address issues before they impact our customers." — Pascal Biesenbach, CEO & Co-founder, viadukt reccehq.com/case-study-v...

Column-level lineage emerges from standard dbt artifacts. Running `dbt run` and `dbt docs generate` produces artifacts that enable column-level lineage visualization and impact analysis. cloud.reccehq.com accepts dbt artifacts to demonstrate metadata analysis

The validation need is universal. The setup capability varies significantly. Teams with robust infrastructure can implement comprehensive validation processes. Teams without DevOps have troubles. The gap creates an adoption barrier. Read more on closing this gap in our blog.

"The PRs created by John are always high quality. I can review them easily." Users love having data validation included in their PR process. But how easy a tool is to set up determines actual usage. Read more in our blog.