LiquidCache a distributed pushdown cache for DataFusion, designed to cut down S3 requests for diskless databases. 💻 Code: github.com/XiangpengHao... 📄 Paper (VLDB 2026): github.com/XiangpengHao...

Join my PhD prelim talk next Monday: Data-Aware Caching for Cloud Analytics 🕐 May 19, 1PM CDT 📍 CS2310 or Zoom: uwmadison.zoom.us/j/3081128886

My manifesto on optimizing SQL and DataFrames in query engines (including an explanation of why Apache DataFusion doesn't have a complex join ordering algorithm): www.influxdata.com/blog/optimiz... www.influxdata.com/blog/optimiz...

New blog post: "Build your own S3-Select in 400 lines of Rust" Check it out 😉: blog.xiangpeng.systems/posts/build-...

I submitted a PR that cuts average ClickBench latency by 15% for DataFusion! But reviewing it wasn't straightforward due to the nature of complex performance tuning dynamics, so I made a blog post to explain why it works -- check it out: blog.xiangpeng.systems/posts/parque...

We are excited to share Fray Debugger (aoli.al/blogs/deadlo...), an IntelliJ plugin that allows you to control concurrent execution deterministically! We have translated the Deadlock Empire (deadlockempire.github.io) into Java to demonstrate how to use Fray Debugger.

@xiangpeng.systems shared a great post about system researchers. I wrote a comment on it and would like to share some thoughts here and offer complementary ideas. In short: build paper with open source. xuanwo.io/links/2025/0...

Wrote a blog post reflecting my thoughts on DeepSeek, NSF funding and system research communities in general. Apologies for the bold claims -- hope they can invite some discussions. blog.xiangpeng.systems/posts/system...

Checkout the underneath framework: github.com/cmu-pasta/fray Looking forward to a future Rust support😉

My weekend project now comes with AI super power! Now you can explore Parquet data with natural language! parquet-viewer.haoxp.xyz

This is amazing -- an open source query engine build on open standard is now the fastest, and it is in Rust! datafusion.apache.org/blog/2024/11...

New blog post on the fun new hardware advancements which databases can leverage for great gains, and why the cloud means it doesn't matter that they exist. 🫠 transactional.blog/b...

My shoddy ASCII art about writing data to disk was surprisingly popular, so I finished off an old set of notes talking more comprehensively about durably writing data to disk and added a better version of the diagram. transactional.blog/h...

Checkout my weekend project on Parquet explorer: xiangpenghao.github.io/parquet-expl... It compiles Rust Parquet into WebAssembly, allowing you to explore the structure of Parquet files directly in your browser!

New blog post on caching in DataFusion! See how my research is advancing DataFusion’s capabilities and what’s next: blog.haoxp.xyz/posts/cachin...

DataFusion implements one of the most advanced Parquet readers🚀, checkout how: blog.haoxp.xyz/posts/parque...