new rule: talk about Iceberg without mentioning Hive or ACID properties. the vast majority of SQL users don't care (and shouldn't)! it's like explaining Dropbox starting w/ bringing up libfuse If you're new to iceberg lmk if you get something from this! roundup.getdbt.com/p/iceberg-gi... #databs

lots of juicy looking papers in the agenda for EDBT/ICDT 2025 happening this year in Barcelona! definitely going to be diving in more later today edbticdt2025.upc.edu?contents=det... #databs #edbc2025 #icdt2025

I FINALLY asked for pronouncement on PEP 751 -- lock files for #Python : peps.python.org/pep-0751/ .

this is the clearest case for Arrow that I've ever seen. I love that it's high-level but also doesn't shy away from details when it's important. this should be a #databs canon text imho. thanks @ianmcook.bsky.social !

TIL about relationalplayground.com makes relational algebra accessible to a SQL monkey like me. much better than in a dry textbook where it's normally found. #databs

imho, the most clear case Databricks has made in public on their Iceberg future post-Tabular acquisition. I agree with this vision of the future and it's nice to see DBRX sharing how they see themselves participating in it. worth clicking through the deck! #databs speakerdeck.com/databricksja...

1) my top-level takeaways on DeepSeek's smallpond: a distributed data processing framework used for training LLMs #databs

Mark Zuckerberg messages Facebook engineer April 5, 2012

Just finished watching the webinar on introducing SDF by dbt team. After seeing SDF in action, I have to admit that I am really looking forward to the future of dbt engine. I was wondering when dbt was going to bring in notable changes to the developer experience and this might be it. #databs

Building Query Compilers by Guido Moerkotte (695 pages) Note: This is repost of @emresevinc.bsky.social's on X Link: pi3.informatik.uni-mannheim.de/~moer/queryc...

post two! The key technologies behind SQL Comprehension #databs, do not fear compiler concepts -- embrace them and the new world order they enable for us! read the great blog (& pretty diagrams!) @daveconnors3.bsky.social, truly a masterpiece docs.getdbt.com/blog/sql-com...

post one of a new series kicking off today whose larger thrust is effectively: understanding SQL, not just a job for the database! Post 1 lays out what the levels of understanding docs.getdbt.com/blog/the-lev... #databs

Look forward to these every year. Always love Andy's candor and insight on our little corner of the world. #databs

#ghostty dropping today is the GitHub equivalent of a Beyoncé album. My whole feed is everyone following it. Now I gotta at least try it right? github.com/ghostty-org/...

my experience installing MSFT's ODBC driver on M-series macbook re-stokes my long-burning ire for Simba drivers and the company behind them. One might think MSFT is to blame for a less than medoicre database driver, but in a way they're victims here too, held captive by Simba. #databs

does anyone use the 1Password CLI? I feel it has potential to be very valuable for managing environment variables (esp for teams). but i'm hesitant to adopt bc it requires that every command you run consume the output of `op` developer.1password.com/docs/cli/get...

admittedly, I'm triggered by SFTP, but it's a good analogy! What if there was an SFTP where you didn't have to parse random-delimited text files, but could just query the tables inside?

art history major = business stakeholder? 😜 #databs

Great breakdown of the new S3 Tables feature that leverages Apache Iceberg. Including an explanation of the costs... which are complicated. #dataBS bigdata.2minutestreaming.com/p/meet-your-...

in AWS Glue Data Catalog, you can now read and write Iceberg tables using the Iceberg REST API. aws.amazon.com/blogs/big-da... previously platforms had to write a custom integration to read/write Glue Iceberg tables, not you can use the REST API! #databs #apacheiceberg #aws

S3 (Iceberg) Tables is everything I dreamt of, and more. I blogged some long-form thoughts: meltware.com/2024/12/04/s... I think we're about to see an explosion of data tools (@materialize.com, @clickhouse.com, @duckdb.org, et al.) learn to write Iceberg tables via S3 table buckets. #databs

S3 tables?!? #databs #apacheiceberg

Need a holiday gift for the nerd in your life? How about a copy of my new book, Platform Engineering: A Guide for Technical, Product, and People Leaders! amzn.to/4eUz5zB

anyone have a good term to collectively refer to the data "languages" like #SQL, #polars, #pandas, #dplyr, #malloy, #preql #numpy etc? "data transformation APIs" (DTAPIs) is the best I've got so far but I'm dreaming of a better word #databs

Hey #dataBS and #datasky folks, Our new post about "how understanding Big O Notation & Execution Plans can optimize SQL queries" has just been posted. Check it out if you're interested, and we'd love to hear your thoughts! @hopefanhe.bsky.social open.substack.com/pub/pipeline...

Oh, we just full table scanning huh #databs

Welcome to #dataBS the creator of Apache Calcite & Mondrian, architect @ Looker, mentor to many @ ASF, and wizard of SQL: @julianhyde.bsky.social One of Julian’s most popular recent initiatives is bringing the metrics layer to SQL: hydromatic.net/hyde2024meas...

Hey #databs, I'm submitting to speak at Data Council in April, vote with a like to the reply with the talk that you think is the most interesting! www.datacouncil.ai/cfp-2025

must read, imho. high-level and clear on the problems solved. but also not a free lunch! "the creation of Iceberg at Netflix['s goal was] to define a better table abstraction on top of blob storage. […] Suddenly, many operations become a lot easier. […] Yes, we also re-invented the DBA role."

parquet's not good enough?! two new file formats: BtrBlocks -- claims better performance on cloud object store. Vortex -- claims order(s) of magnitude better scans and reads than parquet. conflicted bc file formats are stickier than table formats, so hard to forsee uptake but... novelty! #dataBS

early days still for #iceberg, but you can't ignore a PR that shows me the end of the table format wars is nigh. Delta-only deletion vectors to land in v3 spec Incredible to see SWEs from DBRX, SNOW, GCP, and more chime in. Nature is healing. Iceberg is real! #databs github.com/apache/icebe...

I'm so jazzed on my team's operating model that I don't think I could ever not work like this. check out @jasnonaz.bsky.social's write up on how it works at a high-level?

wish: if we take as inevitable that LLMs take the throne of ads monetization from search engines. I propose that SEO be supplanted by: RAGU (RAG ¿utilization?) honestly idc what the word is as long as it starts with U

THE SIMPSONS PARADOX