In 2026, VLDB is returning to the Boston area 5 decades after it was born here (first VLDB was in Framingham). A good opportunity to get your company's name on the program (and earn the everlasting gratitiude of the organizing committee) vldb.org/2026/sponsor...

Here is a new blog about Parquet Variant, including use case, and shredding examples parquet.apache.org/blog/2026/02...

It came up on the Parquet sync today if anyone has practical experience with comparing FastLanes encoding vs "classic" bit packing (without the unified shuffled layouts). If you have would love to know your experience

Simply applying basic linting rules (like don't compress pages where it doesn't help) reduces parquet files sizes by 5% and decreases decode time by 20%. @xiangpeng.systems shows how in his latest blog blog.xiangpeng.systems/posts/parque...

Great inaugural post about the geospatial types on the Parquet blog. Thank you Jia Yu, Dewey Dunnington , Kristin Cowalcijk, Feng Zhang. More posts coming ! parquet.apache.org/blog/2026/02...

Just a few more weeks until the Stockholm DataFusion meetup: luma.com/ctqtiqap

📖 Apache Parquet recently added native support for Geospatial. This post explains what that means and why it is important: parquet.apache.org/blog/2026/02...

kellabyte.substack.com/p/building-a... -- Exactly the kind of thing that shows the power of DataFusion. You can build the database and not (re) build the core query engine

You can use ApacheParquet for Vector Search with embedded indexes: > We don’t change the file format; we just tune it. Xiangpeng Hao explains how in blog.xiangpeng.systems/posts/vector...

Different techniques are needed to max out modern NVMe SSDs. @westonpace.bsky.social LanceDB blog is so good if you want the industrial version: lancedb.com/blog/one-mil... Viktor Leis's LeanStore paper is great if you want the academic version: vldb.org/pvldb/vol16/...

A somewhat academic talk about the AI usecases driving changes in Apache Parquet and new formats in "Column Storage for the AI Era" Recording: youtu.be/k9uhw7yqPsQ Slides: docs.google.com/presentation...

Optimized implementation of SQL CASE expressions in column stores requires careful engineering. The latest Apache DataFusion blog from Pepijn Van Eeckhoudt and Raz Luvaton explains how it works datafusion.apache.org/blog/2026/02...

One downside of tools like Codex is that it enables even more "side quests" -- I was already pretty bad at focusing, and now the ability to write the equivalent of a ticket and have some code to review in 10 minutes makes the problem far worse.

DataFusion 52 Release Blog is Published datafusion.apache.org/blog/2026/01...

I love it when I see a whole pile of commits I didn't review go to DataFusion main github.com/apache/dataf...

1/5 ➡️ Why Rust Will Help You Deliver Better Low-latency Systems and Happier Developers with Andrew Lamb bit.ly/47kgmwU @andrewlamb1111.bsky.social #RustLang #LowLatency

I have been working on a talk about the future of table formats, specifically what is needed for AI workloads, and I found Weston's blogs on LanceDB well written and super helpful: lancedb.com/blog/designi...

We’re excited to share the complete list of speakers joining us at TokioConf 2026 covering performance tricks, architecture patterns, and more. See all our speakers: www.tokioconf.com/speakers (Schedule coming soon) Tickets are on sale: www.eventbrite.com/e/tokioconf-...

Apache DataFusion meetup in San Francisco: luma.com/p7r6fp2z Thursday, February 19. We are looking for more speakers and attendees!

DataFusion blog from Geoffrey Claude explains how to extend DataFusion to support: -- Postgres style operators SELECT payload->'user'->>'id' FROM logs; -- Statistical sampling SELECT * FROM sensor_data TABLESAMPLE BERNOULLI(10 PERCENT); datafusion.apache.org/blog/2026/01...

Stoked to be attending North East Database Day on Friday. It is a great mini conference and highlights some of the great research work going on in this area nedbday.github.io/2026/

Great paper about pruning from Snowflake: arxiv.org/pdf/2504.11540 The LIMIT pruning they describe is 🤯 (so clever once you get it) We have implemented almost all of the techniques in Apache DataFusion, FWIW

Come meet fellow Apache DataFusion users and committers at the Stockholm meetup March 5, luma.com/ctqtiqap

Latest Apache DataFusion blog: more efficient plans and how to efficiently contribute: datafusion.apache.org/blog/output/...

Qiwei Huang explains how we use Late Materialization (LM) in the Apache Rust Parquet reader to accelerate filtering. LM can describe several techniques, but this is a core one (also applies to joins, Top-K, etc) arrow.apache.org/blog/2025/12...

Thanks to funnel.io, we are hosting a DataFusion meetup in Stockholm Date: Thursday March 5, 2026: 17:30 - 20:00 Signup: luma.com/ctqtiqap

There is some crazy (good) activity on the Apache Parquet mailing list for new encodings. A sample: PFOR, FSST, ALP, Strings and Cascaded Encodings. 🤯 Huge kudos to Arnav Balyan, Prateek Gaur, and Micah Kornfield for driving this. lists.apache.org/list.html?de...

ASF reached 10,000 committers: news.apache.org/foundation/e... (Datafusion has 54)

Here are the slides and recordings from our Boston DataFusion Meetup in September: Youtube: youtu.be/wCAud478Dg8 Slides (pdf): drive.google.com/file/d/18KGH...

DataFusion 51.0.0 release blog: datafusion.apache.org/blog/2025/11...

Why rebuild the wheel? @olimpiupop.bsky.social talks with @andrewlamb1111.bsky.social about how Apache Arrow, Parquet, and the FDAP stack are letting database teams focus on innovation instead of reinventing the basics. youtu.be/Gd-mhbiy8Vo?...

Building Modern Databases with the FDAP Stack • Andrew Lamb & Olimpiu Pop • GOTO 2025 www.youtube.com/watch?v=Gd-m...

Does anyone know a good academic / industrial overview of how to implement (not use) LATERAL joins in SQL? It keeps coming up in DataFusion and I need to get reasonable background on it. github.com/apache/dataf...

Save the date -- Wednesday July 22, 2026 for the first Apache DataFusion meetup in Denver: luma.com/jsu6faie

Jobs at F5 for working in Arrow and DataFusion : ffive.wd5.myworkdayjobs.com/f5jobs/job/S...

One fun nugget from the Boston @apachedatafusion.bsky.social meetup on Wednesday: DataDog reports they run 68+million queries per hour with DataFusion

Here is a nice examination of the benefits of building new systems using the extensibility of @apachedatafusion.bsky.social vs other systems. www.bauplanlabs.com/post/duck-hu...

Excited to be one of the attendees and present our work on the DataFusion-powered SedonaDB alongside a great lineup of talks! If you're in the Boston area come and say hi!

"if you want to go fast, go alone; If you want to go far, go together" New Apache Parquet Community page is up: parquet.apache.org/community/

We are holding the next Apache DataFusion meetup next Wednesday Nov 12 in Boston. lu.ma/w9pw5rce

If anyone wants to know why Xiangpeng Hao is a great mentor, they can read this response: github.com/XiangpengHao...

New version of Rust Apache Arrow and Apache Parquet is out -- includes new new metadata parser, new avro reader, geometry and variant support 🤯 arrow.apache.org/blog/2025/10...

I have heard from 3 people/projects in the last three days they are considering forks of iceberg-rust. I filed a ticket to see if we can figure out how to consolidate efforts: github.com/apache/icebe...

Apache DataFusion's policy for AI assisted contribution: AI is great, but not AI dumps: maintainers could finish the task faster by using AI directly, and the submitters gain little knowledge when acting as a pass through AI proxy. datafusion.apache.org/contributor-...

Some Apache Parquet nerd humor for Friday afternoon lists.apache.org/thread/36rdg...

We made Apache Parquet metadata parsing 3x-9x faster in the latest release of the Rust implementation arrow.apache.org/blog/2025/10...

Today's Future Data Systems Seminar Speaker: Ian Cook (@ian.columnar.tech) will present @columnar.tech's work on Apache Arrow's database connectivity API (ADBC). ADBC is available in modern DBMSs. Zoom talk open to public at 4:30pm ET. YouTube video available after: db.cs.cmu.edu/events/futur...

More Products built with Apache DataFusion: Palantir Foundry's Pipeline Builder www.palantir.com/docs/foundry...

Prateek Gaur and co at Snowflake reproduced the (great) results for the ALP encoding algorithm from CWI / Azim Afroozeh / Peter Boncz ALP achieves ZSTD levels of compression and much faster decode. We are discussing adding it to @ApacheParquet: lists.apache.org/thread/tjtln...

The talk on Votex @db.cs.cmu.edu youtube.com/watch?v=zyn_... is a great one. I think it would also be interesting to hear a counterpoint about Apache Parquet that explains actual technical details of that format, the Cathedral vs Bizzaar management, options with Metadata, etc