They’re calling it our most boring feature yet. boring(n): mundane; works exactly as expected; the highest praise you can give a database

tpuf Python client went async today! 🐡 ❤️ 🐍 Async client perf slightly edges out sync client perf under heavy query load. github.com/turbopuffer/...

Big day today at turbopuffer HQ.

when we said "coming soon" we really meant it now puffin' in aws-us-east-1 and aws-eu-central-1

Things move fast at turbopuffer. Now puffin' in aws/us-east-1 and aws/eu-central-1 too.

I've been dreaming about conditional writes on S3 for years. I couldn't have asked for a better way to celebrate than getting to ship tpuf on AWS. 🐡

It’s a rare day that my love of going to battle with build systems pays off like this. Kudos to GCP for a very impressive new SKU. 🐡💨

Couldn't be more excited to be joining the team at @turbopuffer.bsky.social. 🐡💨

Just catching up on my NULL BITMAPS and this is easily the best intuition for write skew I've ever seen described. The analogy to merge skew in a codebase is genius.

Well well well: www.crunchydata.com/blog/pg_incr... Incremental pipelines come to Postgres via Crunchy Data! This is like "dbt incremental", not true incremental view maintenance like @materialize.com or Snowflake's dynamic tables, but it's a neat step towards IVM.

The 6th (and last of 2024!) NYC Systems talks are next Thursday! We've got @jaronoff.com of Omlet and @benesch.bsky.social of Materialize speaking. :) nycsystems.xyz/december-202...

🚀 Postgres Compatibility Index (PCI): Think your shiny new Postgres derivative is "Postgres-compatible"? Test it, score it, and know the truth. 🐘 Thanks @gunnarmorling.dev @tudor.golubenco.org @benesch.bsky.social @deverts.bsky.social for the inspiration. Blog ==> tinyurl.com/mmfcbczz

First new post in a couple of weeks! There's been a lot of activity around regattastorage.com this week, so I decided to write about the space. tl;dr It's pretty exciting!

Today's third blog post on Aurora DSQL: this time looking at the write and commit path, and how conflicts are detected and handled: brooker.co.za/blog/2024/12...

For anyone keeping score in the open table format wars, AWS launching their s3 table bucket with only Iceberg support seems like a really big deal. Nothing is named in such a way that they can't add support for Delta down the line, but this feels like a huge endorsements of Iceberg (vs. others)

My second blog post on Aurora DSQL, with a deep dive on how reads work: brooker.co.za/blog/2024/12...

S3 (Iceberg) Tables is everything I dreamt of, and more. I blogged some long-form thoughts: meltware.com/2024/12/04/s... I think we're about to see an explosion of data tools (@materialize.com, @clickhouse.com, @duckdb.org, et al.) learn to write Iceberg tables via S3 table buckets. #databs

Aurora DSQL uses most of the SQL layer (parser, planner, optimizer, etc) from PostgreSQL itself. The storage layer, concurrency control, replication, etc are ground-up.

GCP is now the only major cloud provider without a serverless Postgres offering. As of today AWS has DSQL: aws.amazon.com/about-aws/wh... Azure partnered with Neon in August: neon.tech/blog/neon-is...

IT'S HERE! Amazon Aurora Distributed SQL (DSQL). It's DynamoDB and Postgres merged into a truly serverless relational database. This is THE announcement of Re:Invent 2024. Everything else is irrelevant.

S3 gets *native* Iceberg support. 🤯 From the AWS blog: aws.amazon.com/blogs/aws/ne... We knew something like this was coming (bsky.app/profile/bene...), but it's an even deeper integration than I expected.

@glaubercosta.bsky.social nails an explanation of 1) why vector databases are mostly a feature not a product but 2) why nonetheless @turbopuffer.bsky.social is on to something. From a Software Huddle interview a few months back: www.youtube.com/watch?v=a4X7...

@fasterthanli.me what's the performance of loona like? 👀 I'm in the market for a faster S3 client in Rust and loona is the first plausible project I surfaced. bsky.app/profile/bene...

Awesome work from @antiguru.bsky.social that can cut @materialize.com memory use by 50% on a common class of workload. Most importantly for our customers: Materialize is now 50% cheaper on these workloads!

Somehow Starlark inherited all the same Unicode problems that Python 2 had. 🙃 github.com/tidbyt/pixle... cost me more time than I would like to admit.

Something interesting is brewing in Iceberg-on-S3 land. 👀 lists.apache.org/thread/v7x65... cc @eatonphil.bsky.social

Annoying detail about S3's new `If-Match` implementation: these writes can fail with 409 Conflict (docs: docs.aws.amazon.com/AmazonS3/lat...) I guess you're just meant to retry, but it's not clear to me why S3 wouldn't just retry internally. The whole point is that the requests are now idempotent!

S3 has finally added `put-if-match` for compare-and-swap! Expect AWS turbopuffer regions very soon aws.amazon.com/about-aws/wh...

Mission accomplished! I’ll be living in luxury with eight (8!) upcoming subway arrivals displayed on my Tidbyt. Developing for the Tidbyt was a mostly pleasant experience. Needing to hand roll a protobuf parser in Starlark was a curveball though: github.com/benesch/tidb...

Working on the important stuff today: teaching my Tidbyt to display subway arrival times for more than two trains at a time. Here’s what the current app looks like.

Went to write my first app for my Tidbyt today only to discover they've decided to join Modal: tidbyt.com/blogs/tidbyt... What a bittersweet moment. I think the world of the folks at Modal, but I'm sad to see the end of Tidbyt manufacturing.

Full house at the NYC dbt Meetup tonight

Anyone know what happened to PlanetScale Boost? It seems to have disappeared from @planetscale.com's docs and blog.

@arjunnarayan.com 👋

Has anyone made an Iceberg catalog implementation that uses only S3? Should be possible now that S3 supports conditional puts. Seems like it'd be a lot easier to operate than any of the existing Iceberg catalogs.