New Dagster best practices video on how to bring assets managed by other processes into Dagster. youtu.be/R92umN1voH8

Otto's data teams were stuck. Some drowning in endless Argo YAML configurations, others testing directly in production. When your data platform fights against good practices, your teams waste time on operational overhead instead of building value. dagster.io/blog/otto-ca...

I have finally published my post about Moneyball, as promised (a long time ago). If you're interested in baseball, numbers, or movies, please take a look. I'd love to know what you think. cc @matsonj.com @alexnoonan.bsky.social djpardis.medium.com/revisiting-m...

Come for Dark @alexnoonan.bsky.social , stay for the amazing speed that you can get up and running with an end to end data platform using Dagster’s new dg + Components features #dataBS youtu.be/NaaF7sw1W_8?...

Turns out the Chinese have a lot too teach us with respect to slop technology substack.com/@noonanlabs/...

The abundance guys are 100% right on the problems we face with our urban governance. substack.com/@noonanlabs/...

🚀 Want to preview the brand new `dg` cli, and a framework for building and working with YAML DSLs built on top of Dagster called "Components"? You can find a link to demo videos and a GitHub discussion in the thread!

Join us on April 1st for a deep dive into how Lee Littlejohn built a data platform at US Foods with Dagster! Lee applies kitchen principles to data: minimizing action, reusing components, and creating a single source of truth. lp.dagster.io/deep-dive-us...

We're pleased to announce that Dagster has officially earned Snowflake Technology Industry Competency status. This milestone validates our position as a critical component in modern data ecosystems!

Hear from our Community! Emil Sundman is a Data Engineer at Bizware and an experienced data professional across the entire data stack. Thanks Emil!

We understand that your data platform is highly contextual, and you need a tool to accommodate this. Components provide a low-code YAML interface for your users, backed by tools that support software engineering best practices and give platform teams complete control. lp.dagster.io/components

It's never been easier to get the benefits of Dagster with your old Airflow DAGs with Airlift. Check out my new video about Airlift! youtu.be/IaurHOKTycQ?...

A postgres user just came into my house and ate my leftover Chinese food without asking. I was saving that too

This is the founder of MongoDB

I can't believe USAID gave 50 million dollars to my followers to not reply ("banger", "rizz god") under my posts.

AIs have a tough time using JSON structure because that data structure isnt ensouled

The teacher always said I was good with shapes and colors. That's how I ended up in data

In times like these I like to take solace in Data Engineering

I just found what I was looking for on StackOverflow

Your data pipelines will not be ensouled unless you add metadata

Companies should do WWE style promos to hype people for product launches

The new Dagster docs experience is here, complete with dark mode! This makes it easier than ever to get started with Dagster. Our focus was on creating a more user-friendly docs structure to ensure that all of the information you need is available within just a few clicks https://buff.ly/4awa90j

I was there when John Dagster wrote the first DAG

Waiting for the build to finish

The Real Estate Data platform project is really coming together in my latest update I added: Github Actions for Orchestration @motherduck.com for the Data Warehouse and expanded my evidence project youtu.be/XC4MEX5VLmc?...

RAGs & DAGs man

Not only was George Washington a founding father he was also a father who stepped up. Powerful

Friday talk! 🎤 @matsonj.com talked about why we should use more SQL and go hands-on with some practical examples of how to read from Iceberg using dbt, DuckDB, and MotherDuck. youtu.be/FMVgwGh8RQA

They wont let me access the forbidden knowledge

Extremely proud of this blog I wrote about Dual Execution on @motherduck.com - it brings the magic of insanely scalable cloud for prod and fast iteration on local to dbt in a seamless way. Very happy to share this with the world. motherduck.com/blog/dual-ex...

I think it's time for this old cowboy to take his talents to Xiaohongshu

When I speed up the recordings of me coding 4x it makes me seem like a 10x engineer. Lesson there

I'm always really enjoying these presentations, sharing all the code and showcasing what's possible today. Amazing integrating BI tools such as Power BI, Looker, Tableau, or Sigma. I believe that's the first time an open-source orchestrator is fully end-to-end. 📺 youtu.be/z3trqkKPbsI?...

Excuse me Garçon, the beef for this steak, is it open-source?

In case you missed it, Shifting Left and Moving Forward with @matsonj.com, @colton.boo, and me is now live on Youtube! youtu.be/z3trqkKPbsI?...

Join us tomorrow where @alexnoonan.bsky.social, @matsonj.com, and @colton.boo will discuss: 🦆 Building an end-to-end data platform ingesting Bluesky data into MotherDuck, and PowerBI 👈 Shifting Left in Data Engineering 🧠 And AI-powered Data Engineering best practices lp.dagster.io/deep-dive-sh...

You may not like it but this is what peak performance data engineering looks like

It costs a fortune to come from nothing these days

duck wait for it db [crowd goes wild]

Community Spotlight! Georg Heiler shared a powerful template that brings together some of the best open-source tools in data engineering: DuckDB, Dagster, dbt, and Rust-based tooling for ensuring code quality and Pixi for dependency management. https://buff.ly/4feldk6

Did you know Dagster asset checks can directly access data from an asset using the built-in I/O manager. Here's a quick snippet showing how it's done!

This time of year is full of reflection and self-improvement. That's why our upcoming deep dive (Jan 14 at 9 a.m. PT) with @matsonj.com at MotherDuck will focus on improving data engineering workflows and leveraging AI tools at their best. Register here: lp.dagster.io/deep-dive-sh...

@dagster.io really is just awesome. Especially loving all the metadata/visibility it provides above and beyond actually running jobs and materializing assets.

Gm

There are graphs everywhere for those with eyes to see

Hello Friends. We have a fascinating deep dive tomorrow with one of our Dag-stallions, Edson Nogueira! Register here lp.dagster.io/deep-dive-ar...

I saw this and immediately thought it would make a good picture for a joke on python virtual environments

The Azure UI was designed by a group of truly deranged minds

"Battle tested" isn't the vote of confidence you think. I only like tools that win battles

Monday Mornings can't hurt you open.spotify.com/track/5FhjSH...