Parquet just finalized a years long effort to standardize everyone's favorite topic: ordering of FloatingPoints and Nan statistics. It takes a while but the spec does evolve github.com/apache/parqu...

I just had the chance to watch @samyak.me 's talk about cancellation safety and async Rust (and how a `&mut` can lead to a deadlock). If this is a topic that interests you, I recommend checking it out: samyak.me/talks/cancel/

July 22 in Denver, CO Apache DataFusion meetup: Join myself, Andy Grove, Brent Gardner to find out about DataFusion, meet other users, and talk about Databases. We still have speaking slots left (10-15 minutes) and would love to have you join us luma.com/jsu6faie

Apache DataFusion physical meetups are fundamentally discriminatory for certain groups based on location, but we try hard to always post the technical content. Here is a link to the recordings and slides from our May 14 2026 meeting in NYC: github.com/apache/dataf...

Waynexia and Xudong369 and others are planning a @ApacheDataFusio meetup in China in June 2026. Let them know if you are interested in attending: github.com/apache/dataf...

New Database product based on Apache DataFusion from @langchain.bsky.social -- focused on agent observability. It is really neat to see how people are building (very) customized data + query systems faster than ever now that they don't have to build the whole stack www.langchain.com/blog/introdu...

Great talk, which led to this follow up issue and discussion. github.com/tokio-rs/tok...

DuckLake connector in @ApacheDataFusio contrib: github.com/datafusion-c... is an interesting alternative for people looking for faster performance and don't need the current (and ever growing) feature set of Apache Iceberg

Using Tokio for CPU-Bound Tasks (Works Really Well) youtu.be/FeqRdDG1Y7g (has nothing to do with AI, just scheduling and Database plans)

It is rare that low level optimization work **also** makes code easier to follow, but that is happening in the Rust Apache Parquet reader thanks to HippoBaro from @datadoghq.com: github.com/apache/arrow...

Another Apache DataFusion backed startup got funded openobserve.ai/blog/series-...

"Why XYZ matters" -- A sure tell that it was AI generated (at least in part)? I actually think such sections typically add value (good docs do explain why things matter), but I find the newly emerging pattern fascinating (and craze widespread)

It was great to see everyone last night in Portland for the Apache DataFusion Meetup. Thanks to Mustafa Akur for hosting and the talk about sorted analysis. Also to Lu Qiu for discussing distributed query Execution. Finally to @westonpace.bsky.social for keeping it real about Row Groups

This is a cool breakdown of what organizations / people have been contributing to DataFusion theconsensus.dev/p/2026/04/03...

This blog does a great job explaining and exampling (?) the benefits of using DataFusion to build systems: thedataquarry.com/blog/datafus...

I am going to give a talk about why tokio.rs is a great choice for running CPU bound tasks in Database Query Egnines

If you are coming to tokio.conf or are in the Portland area on April 22 we are having holding a DataFusion meetup at OHSU -- thanks to Mustafa Akur for helping arrange the details. Signup here luma.com/dsp3ud82

DataFusion 53.0.0 is released: datafusion.apache.org/blog/output/...

We are holding an @ApacheDataFusio meetup on Wed April 22 in Portland: luma.com/dsp3ud82 Yes, this is a day before the meetup in Seattle/Bellevue on April 23 luma.com/hxshbp0m

In depth blog on how to write table providers for Apache DataFusion : datafusion.apache.org/blog/2026/03...

Another example of incorporating the latest Database Research (in this case Limit Pruning from ❄️) in Apache DataFusion datafusion.apache.org/blog/2026/03....

DataFusion getting in the agent skills game too: github.com/datafusion-c...

The video is here www.youtube.com/watch?v=pqoR... and is quite a good summary of how to build a modern database backed by Object Storage. This one is worth watching.

Recording and slides available from the DataFusion Stockholm Meetup: Recording: youtu.be/9u4cNmL14Xs Slides: github.com/apache/dataf...

Join us for another NYC DataFusion Meetup: luma.com/adhshv92 May 12, 2026 As always, we would love any/all speakers anything DataFusion related (what you have built using DataFusion, projects you are working on, etc)

In 2026, VLDB is returning to the Boston area 5 decades after it was born here (first VLDB was in Framingham). A good opportunity to get your company's name on the program (and earn the everlasting gratitiude of the organizing committee) vldb.org/2026/sponsor...

Here is a new blog about Parquet Variant, including use case, and shredding examples parquet.apache.org/blog/2026/02...

It came up on the Parquet sync today if anyone has practical experience with comparing FastLanes encoding vs "classic" bit packing (without the unified shuffled layouts). If you have would love to know your experience

Simply applying basic linting rules (like don't compress pages where it doesn't help) reduces parquet files sizes by 5% and decreases decode time by 20%. @xiangpeng.systems shows how in his latest blog blog.xiangpeng.systems/posts/parque...

Great inaugural post about the geospatial types on the Parquet blog. Thank you Jia Yu, Dewey Dunnington , Kristin Cowalcijk, Feng Zhang. More posts coming ! parquet.apache.org/blog/2026/02...

Just a few more weeks until the Stockholm DataFusion meetup: luma.com/ctqtiqap

📖 Apache Parquet recently added native support for Geospatial. This post explains what that means and why it is important: parquet.apache.org/blog/2026/02...

kellabyte.substack.com/p/building-a... -- Exactly the kind of thing that shows the power of DataFusion. You can build the database and not (re) build the core query engine

You can use ApacheParquet for Vector Search with embedded indexes: > We don’t change the file format; we just tune it. Xiangpeng Hao explains how in blog.xiangpeng.systems/posts/vector...

Different techniques are needed to max out modern NVMe SSDs. @westonpace.bsky.social LanceDB blog is so good if you want the industrial version: lancedb.com/blog/one-mil... Viktor Leis's LeanStore paper is great if you want the academic version: vldb.org/pvldb/vol16/...

A somewhat academic talk about the AI usecases driving changes in Apache Parquet and new formats in "Column Storage for the AI Era" Recording: youtu.be/k9uhw7yqPsQ Slides: docs.google.com/presentation...

Optimized implementation of SQL CASE expressions in column stores requires careful engineering. The latest Apache DataFusion blog from Pepijn Van Eeckhoudt and Raz Luvaton explains how it works datafusion.apache.org/blog/2026/02...

One downside of tools like Codex is that it enables even more "side quests" -- I was already pretty bad at focusing, and now the ability to write the equivalent of a ticket and have some code to review in 10 minutes makes the problem far worse.

DataFusion 52 Release Blog is Published datafusion.apache.org/blog/2026/01...

I love it when I see a whole pile of commits I didn't review go to DataFusion main github.com/apache/dataf...

1/5 ➡️ Why Rust Will Help You Deliver Better Low-latency Systems and Happier Developers with Andrew Lamb bit.ly/47kgmwU @andrewlamb1111.bsky.social #RustLang #LowLatency

I have been working on a talk about the future of table formats, specifically what is needed for AI workloads, and I found Weston's blogs on LanceDB well written and super helpful: lancedb.com/blog/designi...

We’re excited to share the complete list of speakers joining us at TokioConf 2026 covering performance tricks, architecture patterns, and more. See all our speakers: www.tokioconf.com/speakers (Schedule coming soon) Tickets are on sale: www.eventbrite.com/e/tokioconf-...

Apache DataFusion meetup in San Francisco: luma.com/p7r6fp2z Thursday, February 19. We are looking for more speakers and attendees!

DataFusion blog from Geoffrey Claude explains how to extend DataFusion to support: -- Postgres style operators SELECT payload->'user'->>'id' FROM logs; -- Statistical sampling SELECT * FROM sensor_data TABLESAMPLE BERNOULLI(10 PERCENT); datafusion.apache.org/blog/2026/01...

Stoked to be attending North East Database Day on Friday. It is a great mini conference and highlights some of the great research work going on in this area nedbday.github.io/2026/

Great paper about pruning from Snowflake: arxiv.org/pdf/2504.11540 The LIMIT pruning they describe is 🤯 (so clever once you get it) We have implemented almost all of the techniques in Apache DataFusion, FWIW

Come meet fellow Apache DataFusion users and committers at the Stockholm meetup March 5, luma.com/ctqtiqap

Latest Apache DataFusion blog: more efficient plans and how to efficiently contribute: datafusion.apache.org/blog/output/...

Qiwei Huang explains how we use Late Materialization (LM) in the Apache Rust Parquet reader to accelerate filtering. LM can describe several techniques, but this is a core one (also applies to joins, Top-K, etc) arrow.apache.org/blog/2025/12...