This profile in ‘Significance’ on DuckDB co-founder Hannes Mühleisen is quite interesting, and has helpful insights about data quality and the changing meaning of “big data.” Also some good professional advice in here for statisticians. academic.oup.com/jrssig/artic...

We took Canada’s Spatial Access Measures dataset (big, clunky CSVs) → turned it into a single GeoParquet file. Add DuckDB-WASM + deck.gl & you get - instant queries - smooth maps - no backend Public data, but actually usable. developmentseed.org/blog/2025-10... @saadiqmohiuddin.bsky.social

pg_lake just went open source! (Apache 2.0) pg_lake is a set of extensions (from Crunchy Data Warehouse) that add comprehensive Iceberg support and data lake access to Postgres, with @duckdb.org transparently integrated into the query engine. Announcement blog: www.snowflake.com/en/engineeri...

The PyData Amsterdam 2025 keynote “Minus Three Tier: Data Architecture Turned Upside Down” by @hannes.muehleisen.org is out now. www.youtube.com/watch?v=DxwD...

🎞️ 𝘊𝘢𝘯 you store a movie in DuckDB? In today's blog post, @hannes.muehleisen.org shows how to store a movie as a table encoding the RGB codes pixel-by-pixel, and how to process it: duckdb.org/2025/10/27/m... Now, whether you 𝘴𝘩𝘰𝘶𝘭𝘥 store a movie in DuckDB... we'll leave that to your judgment.

📣 New blog post by @dtenwolde.bsky.social. 🕸️ In this post, we show how to use DuckDB and the DuckPGQ community extension to analyze financial data for fraudulent patterns with the SQL/PGQ graph syntax that's part of SQL:2023. 📖 Visit duckdb.org/2025/10/22/d... to read the post.

duckdb-mlpack 0.0.2: mlpack is now a duckdb community extension Bringing mlpack machine learning to duckdb SQL dirk.eddelbuettel.com/blog/2025/10...

🇫🇮 ​We are hosting a pub session next week during the @helsinkidataweek.bsky.social, where you can chat with DuckDB's co-creator, @hannes.muehleisen.org and have a drink with members of the DuckDB community. 🎟️ Sign up on Luma: luma.com/s5sl9qxx

ML quacks: Combining duckdb and mlpack dirk.eddelbuettel.com/blog/2025/10... A 'minimally viable product / demo' of extending @duckdb.org with #mlpack

I'm grateful that Jack Waudby gave me the chance to set the CTE record straight on his @disseminatepodcast.bsky.social. Hear us talk about what you can do with iterative queries in SQL, how efficient variants of recursion in SQL found their way into @duckdb.org, and how trampolines come into play.

Learn how to build powerful yet lightweight #data workflows using #Python, #DuckDB, and #Smallpond with Valery C. Briz, #Pythonista, senior #dataengineer on the 23rd of October in our #online #workshop 18:00-19:30 CEST Register here: www.meetup.com/pyladiesams/...

🚀 We released DuckDB v1.4.1, the first bugfix release of our LTS edition. 🔎 We expect LTS users to be particularly curious about changes in the system, so we wrote up a short blog post highlighting the most important fixes and improvements. duckdb.org/2025/10/07/a...

Today's Future Data Systems Seminar Speaker: Jordan Tigani (@jrdntgn.bsky.social) will present how @motherduck.com supports modern workloads with DuckLake. Zoom talk open to public at 4:30pm ET. YouTube video available after: db.cs.cmu.edu/events/futur...

✨ We launched a new installation page for DuckDB! 🚀 The new page lets you install the latest stable DuckDB release with just one or two clicks. If the defaults don't fit your use case, no worries: alternative download methods remain available for many clients.

After trying @duckdb.org with terabytes of parquet I'm hardly going back for data exploration to anything else. Hell, I'm now spawning DuckDB for analyzing even .csv and .json files due to how ergonomic its SQL is.

We published a new deep dive by Laurens Kuiper, who recently redesigned DuckDB's sort. One data point: ordering the TPC-H SF100 lineitem table with the memory limit set to 30 GB is 3× faster in DuckDB v1.4 than in v1.3. Read more at duckdb.org/2025/09/24/s...

🚀 We released version 0.3 of the DuckLake specification and the DuckDB ducklake extension today. It includes interoperability with Iceberg, support for geometry types and more. Check the announcement blog for more details ducklake.select/2025/09/17/d...

This is the most exciting time ever to be working in data, and I'm not talking about AI. 3 years ago, I wrote a database-centric guide in my book for analyzing the full 92 million record 1910 Census. Now, with #rstats and @duckdb? Analyze those 92 million rows in seconds.

I'm speaking soon at #PositConf at the 2:40PM session "Get Your Ducks in a Row with Databases" in Regency VI! My talk is "Semantic Search for the Rest of Us with DuckDB (and Llama.cpp)" #PositConf2025

📈 DuckDB 1.4.0 is out! This is our first LTS release which comes with *one year of community support*. It also supports database encryption, the MERGE SQL statement and Iceberg writes. For more details, read the announcement blog post at duckdb.org/2025/09/16/a...

We're testing a new distribution channel for @duckdb.org : #docker images. For now they live at `hfmuehleisen/duckdb`, feel free to test them out. And yes, hell got a little colder today. hub.docker.com/r/hfmuehleis...

Such a fun listen on ducklake and duckdb with @hannes.muehleisen.org and @markraasveldt.bsky.social! Learned a lot, the future of ducklake looks very bright! overcast.fm/+AAH1YOLrL6Q

We are holding the DuckDB Amsterdam Meetup next week, featuring talks by @rolandbouman.bsky.social, Tania Bogatsch and @qxip.bsky.social: www.meetup.com/duckdb/event... The event is already at capacity but consider joining the wait list because there are always last-minute RSVP cancellations.

Excited to be a keynote speaker at PyData Amsterdam 2025 (September 24–26). My talk is titled 'Minus Three Tier: Data Architecture Turned Upside Down'. Use code PYDATADB10 for 10% off tickets amsterdam.pydata.org/conference #PDAmsterdam2025 #10YearsPDAmsterdam

Big Data on the Move: Can a Framework Laptop 13 ultrabook run terabyte-sized workloads with DuckDB? @szarnyasg.org ran the experiments and shared his finding in our latest blog post: duckdb.org/2025/09/08/d...

We just launched the “DuckDB in Science” site, a curated collection of papers, lectures and podcasts about DuckDB in research: duckdb.org/science/ 🎡 If you would like to learn more about DuckDB in Science, consider joining our meetup in London this Thursday: www.meetup.com/duckdb/event...

🕐 🤔 Timestamps and time zones can be confusing! 😵 💡 To help you make sense of time zones in SQL, Richard Wesley wrote a short guide that covers some typical pitfalls: duckdb.org/docs/stable/...

Vol:18 No:8 → Saving Private Hash Join 👥 Authors: Laurens Kuiper, Paul Gross, Peter Boncz, Hannes Mühleisen 📄 PDF: https://www.vldb.org/pvldb/vol18/p2748-kuiper.pdf

New blog post by Petrica Leuca: Basic Feature Engineering with DuckDB In this post, we show how to perform essential machine learning data preprocessing tasks—like missing value imputation, categorical encoding, and feature scaling—directly in DuckDB using SQL and benchmark it against scikit-learn.

A little demo of reactive SQL in Observable Notebooks 2.0, first using (native) DuckDB to bake data from a remote source, followed by DuckDB-Wasm to create and query reactive views in the client. Should be released this week!

🎓 On September 4, we are hosting a new kind of meetup in London which will focus on the use of DuckDB in Science and Education! ⚡️ We still have some spots for lightning talks. If you're working with DuckDB in your research and/or classroom, consider sharing your story! 🔗 duckdb.org/events/2025/...

Stretching DuckDB w/ Common Crawl, ~1.7B rows, ~300 parquet files. ~2-3s for single-column aggregations, ~2-3 mins to SUMMARIZE the data, peaking at ~12-14GB memory usage. Not exactly real-time, but the fact you can do this on a laptop with no server setups or Spark pipelines is still amazing.

🔥 DuckDB is featured in @fireship.bsky.social's “100 seconds” series: 🚀 www.youtube.com/watch?v=uHm6...

Not every job needs Spark or BigQuery. Sometimes, you just need DuckDB. Find out why it’s a game-changer for local analytics 🐤 👉 Read the Frog Blog by Joe! www.purplefrogsystems.com/2025/08/why-... #DuckDB #SQL #DataEngineer

I'm excited to speak this afternoon at #useR2025 on outgrowing your laptop with #Positron for #rstats users! You can check out my slides at juliasilge.github.io/useR-2025/

I went through DuckDB's WAL, and it does everything I was asking for in my blog post: 1. Per record checksum 2. Explicit error on checksum failure 3. Configurable behavior 4. Partial recovery 5. Safe truncation of the WAL only when WAL contents are checkpointed

We just published a deep dive on spatial joins in DuckDB by @maxxen.bsky.social. In this blog post, Max explains how spatial joins evolved in DuckDB and how the current operator harnesses R-Trees. Read the full post at duckdb.org/2025/08/08/s...

@hannes.muehleisen.org, Co-Creator of @duckdb.org, will be talking about the DuckLake project at the Open Lakehouse Meetup in Amsterdam on August 27th! Don't miss it. 🦆🦀 Sign up here ➡️ lu.ma/OLM-827 #duckdb #opensource #oss #deltalake #openlakehouse

I'm going to be answering questions in the chat during the video premiere starting now: www.youtube.com/watch?v=YQEU... #ducklake

48M14S by PySpark 6M07S by Python with #DuckDB ... that is a difference.

#SD25 online continues tomorrow! Join Cpt. @hannes.muehleisen.org for his talk on DuckLake Aug 4 at 10am PT / 1pm ET / 7pm CET www.youtube.com/watch?v=YQEU...

We just launched Foursquare Spatial Desktop – a geospatial analysis tool powered by embedded DuckDB and built on sqlrooms.org. Everything runs locally: your data stays on your machine, no cloud needed. A modern reimagining of Kepler.gl. Mac only for now. More coming. foursquare.com/products/spa...

Datenarchitektur: DuckLake vereint Katalog und Tabellenmetadaten https://www.heise.de/hintergrund/Datenarchitektur-DuckLake-vereint-Katalog-und-Tabellenmetadaten-10478541.html?utm_source=flipboard&utm_medium=activitypub Gepostet in Nachrichten @nachrichten-heiseonline

Heya #EconSky #DataSky Moving from Stata to duckdb (thx @alemartinello.com for the push) Wrote my 1st substack post about it (and share code). Read for free and please suggest how I can make it faster. Thanks! hanshenriksievertsen.substack.com/p/moving-to-...

This week, I learned how to create and explore a data lake with duckdb, using its new ducklake extension. It was surprisingly easy to hand over the creation and management of parquet files with larg(ish) tables to ducklake. I loved being able to explore the data using R, python or plain SQL - […]

Another @posit.co Positron blog post! To make it easier to work with some huge data in one of my projects, I've loaded it into @duckdb.org. The Connections Pane makes it really easy and convenient to connect to and explore databases with #rstats. Here's how: www.andrewheiss.com/blog/2025/07...

Mit der Spezifikation DuckLake und deren Implementierung eines Lakehouse-Formats treten die DuckDB-Macher gegen OpenTable-Formate wie Iceberg und Co. an. #Software

🚀 The DuckDB 1.3.2 bugfix release is out! 📦 The Python and CLI clients are already on the latest version, while the rest will follow in the coming days. 🔖 See the detailed change log at github.com/duckdb/duckd...

📢 DuckLake 0.2 is out! We added new features to the specification and improved support in the DuckDB ducklake extension. See the announcement blog post at duckdb.org/2025/07/04/d....

Sneak peek: github.com/duckdb/duckd...