A short post on Iceberg deletions : vigneshc.github.io/blog/iceberg...

Exploring Apache Iceberg and SlateDB formats - with a repo link for additional exploration. datapapers.substack.com/p/exploring-...

Short talk on Iceberg use cases in last week's Seattle Iceberg meetup. youtu.be/F7qpOVVnxek?...

If you find yourself in SF next week, @almog.xyz is talking about SlateDB at the SF Systems Meetup on Wednesday!

1/ Nice read: medium.com/@xiafan/time... Software engineer growth in AI era: * Build composable tools. * Assume non deterministic outcomes from a group of ai agents. * Understand how LLM works to the next level, like how you would understand to read a query plan.

Just added sqlync.com to SlateDB's adopters list! They're building a streaming system that speaks MQTT or PostgreSQL across millions of connected users and devices. 🤯

Insane amount of SlateDB work going on: - snapshot reads - split/merge DBs (zero copy) - deterministic simulation testing And someone just pushed Python bindings in a PR! 🤯

My Data council talk on SlateDB. youtu.be/gcTRXZeKbNg?...

SlateDB 0.6.0 is out! github.com/slatedb/slat... Highlights include a hybrid cache (using Foyer), a lot of internal cleanup, and more groundwork for transactions. Oh, and put performance jumped ~80% for write-heavy workloads :) slatedb.io/performance/...

Today marks SlateDB’s one year anniversary! It’s been a lot of fun. Thanks to @rohanpd.bsky.social @flaneur2024.bsky.social @almog.ai @vigneshc.bsky.social @paulbutler.org Jason Gustafson, David Moravek, and many others for joining the project. 😀

Commonhaus is 1! 🎂 14 projects, solid foundations, and more on the way. If you believe in light governance, shared care, and thoughtful support for open source, come see what we’re building. www.commonhaus.org/activity/253...

Yo SF Bay Area #databs crew, want to talk lakehouses at a real Lake House? :) Next week after Data Council, join the founders of @clickhouse.com, @motherduck.com, @startreedata.bsky.social, and @tobikodata.com to talk real-time databases and next-generation ETL. www.rilldata.com/events/data-...

SlateDB 0.5.0 is out! Features: - Checkpoints - Clones - Read only client - Split/merge database foundation - TTL filtering on reads - Last version with breaking byte format changes By the numbers: - 62 commits - 2 new contributors - 10 total contributors github.com/slatedb/slat...

datapapers.substack.com/p/building-c... New post.

DEBS conference hosts a grand challenge every year. This year's challenge is detecting outliers in a stream of images from laser powder bed fusion. The challenge involves submitting a kubernetes app (constraint: 2 cores 8 gb). Interesting to try if you have the time! 2025.debs.org/call-for-gra...

Python Folks - which data/workflow engine has the best developer experience for packaging code? We have looked into - Modal, Beam, Airflow, Flyte, AWS Lambda, Prefect, Dagster and Spark. Haven’t seen any approach which is fast, reliable and intuitive.

What are some papers or blogs about data quality challenges? I see tools like great expectations, table formats features like 'check constraints' in Delta. I don't yet see it as a first class property of catalogs. Found this, are there others? journalofbigdata.springeropen.com/articles/10....

Great talk by Binwei Yang on Apache Gluten last week. youtu.be/GWTj3INSzPg?... Apache Gluten moves execution of spark operators to native backend like Velox, accelerating query performance. It has basic iceberg support too! github.com/apache/incub...

SlateDB 0.4.0 is out! Features: - Range scans - No DynamoDB needed for S3 - Nightly perf tests - Merge operator groundwork - GC improvements By the numbers: - 57 commits - 5 new contributors - 11 total contributors github.com/slatedb/slat...

SlateDB is now part of @commonhaus-fdn.bsky.social! I think we might be the first non-JVM project. Looking forward to more projects joining us here. Our experience with the foundation has been excellent so far. github.com/commonhaus/f...

The 3 reasons to backfill: 1) new pipeline, who dis? 2) logic changed, recompute 3) whoops downstream lost everything. resend it.