Here is a nice examination of the benefits of building new systems using the extensibility of @apachedatafusion.bsky.social vs other systems. www.bauplanlabs.com/post/duck-hu...

Apache Arrow 22.0.0 is now available for download: buff.ly/rFyGsDV This release includes 213 resolved issues. #opensource

This @posit.co::conf(2025) talk is everything: "The geospatial suite for Arrow is relatively new...so this is a PSA that it exists and it's really powerful and impressive. I actually also found it very easy to use...and I didn't really have much trouble learning it" www.youtube.com/watch?v=EHyg...

RE: https://fosstodon.org/@underdarkGIS/113300727609804149 Over 250 #geospatial #gischat counts to follow: https://gist.github.com/anitagraser/a37118d74b839602e0f474375f548dfd

Day 6 of the #30DayMapChallenege is Dimensions! Here I create a beautiful space-time dataset with M values and a proper temporal CRS with SedonaDB...and then ignore it because I couldn't find a tool that can animate M values (let me know if there is one!). dewey.dunnington.ca/post/2025/da...

Day 5 of the #30DayMapChallenege! In which I attempt simple LiDAR processing for the first time using SedonaDB. Behold...a high-resolution elevation map of what's under my feet in my hometown of Winnipeg, Manitoba. Code + walk through included! dewey.dunnington.ca/post/2025/da...

Excited to be one of the attendees and present our work on the DataFusion-powered SedonaDB alongside a great lineup of talks! If you're in the Boston area come and say hi!

#30DayMapChallenge day three is polygons...here's a map I made for my Ph.D. thesis...a standard Fig 1 for lakes papers. This paper is about land use and how it is resolved in sediment, so I tried to communicate urban development in each catchment using very thin roads. This one is 100% QGIS!

#30DayMapChallenege day two is lines! Here's an animated version of the stream traversal with SedonaDB post I made a few weeks ago but using the Gaspereau River, which drains Gaspereau Lake (featured in day one). dewey.dunnington.ca/post/2025/da...

Day 1 of the #30DayMapChallenege is points! This one is entitled "Always Plot Your Test Data"...I've been using data called ns-water_point for a long time without properly inspecting it. It turns out the points are almost all rocks! They're pretty much all rocks. dewey.dunnington.ca/post/2025/da...

GeoArrow is undoubtedly a superior format to GeoJSON, yet GeoJSON remains the dominant standard in web browsers. I'm hoping we'll reach a point where using GeoArrow is just as easy and seamless as using GeoJSON. I hope my talk helps to figure out what's still missing in the ecosystem.

#30DayMapChallenge starts tomorrow: 30 days, 30 map ideas. If you’re using R, Python, or Julia, consider sharing open-source examples or tutorials. 🧭 30daymapchallenge.com #GeoData #DataViz #Maps #SpatialViz

New version of Rust Apache Arrow and Apache Parquet is out -- includes new new metadata parser, new avro reader, geometry and variant support 🤯 arrow.apache.org/blog/2025/10...

We're cooking up a lot of great stuff, check out our announcement to learn more. I've been really lucky to get to work on Arrow the last few years and even luckier to get to keep doing that!

We made Apache Parquet metadata parsing 3x-9x faster in the latest release of the Rust implementation arrow.apache.org/blog/2025/10...

Absolutely wonderful from @vickiboykis.com - newsletter.vickiboykis.com/archive/i-wa...

This week's Apache Sedona drop: lazy/selective GeoParquet reads in SedonaDB, @duckdb.org, GDAL, and GeoPandas! This is how querying a GeoParquet file plonked on a web server can be queried locally (and why GeoParquet can be even faster locally!) dewey.dunnington.ca/post/2025/la... #gischat

This in turn was due to @yutannihilation-en.bsky.social's fantastic work on Savvy (lightweight R bindings for Rust)!

Thanks to @paleolimbot.bsky.social's great work, the sedonadb R package is now also available to Windows via R-universe 🎉 I'm excited particularly because I believe sedonadb is the easiest tool for R users to access GeoParquet data. #rstats apache.r-universe.dev/sedonadb

Our new thrift parser in the Rust Apache Parquet implementation is a 🎁 that keeps on giving performance wise 🚀 github.com/apache/arrow... We are also working on a blog post that has a deeper explanation

Well deserved!

Yesterday I learned about the SpatialBench from Sedona github.com/apache/sedon... Which they based on the tpchgen-rs project from @clflushopt.bsky.social github.com/clflushopt/t... (BTW I a still looking for some more github watchers on tpchgen-rs so I can get it on homebrew)

I'm aiming for a weekly Apache Sedona drop...this week's edition: wrangling some uncooperative input data into GeoParquet output using SedonaDB's excellent @arrow.apache.org interop. Bonus: learn about the postage stamps of farm field dotting the prairies! dewey.dunnington.ca/post/2025/ge...

Great news for Arrow (and more work for us 😄). Also, those work items also implicitly apply to #ApacheParquet. @julien.ledem.net

New blog post! kylebarron.dev/blog/fast-py... This dives into performance pitfalls of Python bindings, why projects like Lonboard are so fast, and why I care about Apache Arrow so much. The post is high level and you don't need to know C/C++/Rust to understand it!

Interesting...I think of GeoParquet and GeoArrow as tech that allows more people to avoid the cloud (i.e., use your laptop to do things that everyone thought they needed "the cloud" for five years ago). When your 14 GB .fgb files become 2GB GeoParquets, you can fit a whole lot more of them locally!

R-Universe by @rOpenSci is an extremely useful project. My latest R package, {pmtiles}, is not a good fit for CRAN as it bundles a pre-compiled Go library. With R-Universe, I was able to get installable cross-platform binaries built in hours! #rstats walkerke.r-universe....

Last week Apache Sedona announced SedonaDB...and now I finally get to write about it! Here I use SedonaDB to demonstrate the explore/iterate/visualize cycle...SedonaDB's CRS support + @kylebarron.dev's `lonboard` is 👌 for exploring new data!) dewey.dunnington.ca/post/2025/st...

I cannot say enough about DataFusion...in order to build an engine that considers spatial types at every level we needed to customize types, functions, optimizer rules, joins, Parquet pruning, and more. DataFusion not only made this possible but documented even the most obscure bits. So cool!

"Introducing SedonaDB: A single-node analytical database engine with geospatial as a first-class citizen" Built in Rust with Apache DataFusion sedona.apache.org/latest/blog/...

I'm beyond excited for this! Built on Apache DataFusion and Apache Arrow, a composable single-node analytical database with spatial types as first-class citizens. GeoPandas IO, KNN joins, CRS support, R/Python bindings, and top-notch lazy GeoParquet reads. sedona.apache.org/latest/blog/...

100 stars🎉 Savvy is a niche framework for those who want to use Rust in an R package yet extendr is not their fit, so I didn't expect to see so much stars! github.com/yutannihilat...

Spatial Data Science across languages now has a website: https://spatial-data-science.github.io/ Thanks @martinfleis !

Looking forward to attending this! #apachearrow

Published arro3-core v0.6 with wider dtype support for converting numpy ndarrays to Arrow. It now additionally supports: - datetime64 - timedelta64 - fixed-width strings/bytes - variable-width strings - object arrays of str/bytes And the Python wheel is still just 2.5MB! github.com/kylebarron/a...

In September the @columnar.tech crew are headed to PyData Paris 2025 and the first ever Apache Arrow Summit. The organizer @quantstack.bsky.social is a dedicated supporter of @arrow.apache.org. We’re delighted to be sponsoring the event.

Check out "Scaling the r-spatial ecosystem" by Dewey Dunnington 🌍📦 An exploration of how R’s spatial tools can be used for big(ger) data. Video: youtu.be/tjNEoIYr_ag?... Slides: dewey.dunnington.ca/slides/rspat... #RStats #rspatial #GIS #SpatialData

Glad to see another proof that Rust-powered R packages work fine on webR! For those who are wondering what "savvy" is, it's a framework to use Rust in an R package. #rstats yutannihilation.github.io/savvy/guide/...

polars can be used via webR, thanks to the work of @gws.phd both on webR and on the Rust component of polars. It also uses savvy, developed by @yutannihilation-en.bsky.social‬, to connect Rust and R.

#rstats polars 1.0.0 is now available! polars provides bindings to the eponymous Rust library, a very efficient dataframe library. This is the outcome of a 1-year long rewrite led by @eitsupi to refactor the internals and match the API of Python polars. pola-rs.github.io/r-polars/ Details ⬇️

A new version of @arrow.apache.org is out! I'm personally excited about the Parquet support for Geometry/Geography but there's a lot of other great features in this release...check out the release post for all the details! arrow.apache.org/blog/2025/07...

Voting started! I hope my proposal of a talk about GeoArrow is attractive enough 🙏

Just a reminder that this call closes July 26! Get your proposal(s) in by then. If you have any questions or need help, feel free to DM.

@duckdb.org just merged a PR for a new, simpler, and -- mostly importantly -- non-deprecated @arrow.apache.org C API: github.com/duckdb/duckd.... #apachearrow #duckdb

New @arrow.apache.org nanoarrow release! nanoarrow is a C library for producing and consuming Arrow data with bindings in #rstats and #Python. v0.7.0 brings a revamp of the Python build system, support for shared linkage, a vcpkg port, ZSTD decompression support, and support for new types!

This was so fun! Check out the slides/repo if you missed it or would like to connect! 🛝 @ dewey.dunnington.ca/slides/rspat... 🐈‍⬛ @ github.com/paleolimbot/...

Lonboard v0.11 is released! - Choose between a tooltip and side panel for inspecting data - Supports GeoArrow box arrays from 0.2 spec - fixes some DuckDB and CSS bugs - Ensures compatibility with geoarrow-pyarrow v0.2 See full changelog: github.com/developments...

The community is working to codify some standards for moving Arrow data around with plain old HTTP at github.com/apache/arrow... to address that gap. Might be of interest.

So excited for this! Join us on June 24 for a deep dive on techniques you can use in when your #gischat data feels like it's stretching the limits of #rstats.

Still the ggoat