Jan Kaul
@jankaul.bsky.social
📤 70
📥 89
📝 87
reposted by
Jan Kaul
Martin Kleppmann
4 months ago
At long last,
@chris.blue
and I have submitted the final manuscript of Designing Data-Intensive Applications, second edition, to the publisher. There is always more that could be improved but at some point we just have to call it done. Now it goes into production; probably shipping in ~4 months.
12
309
30
So
#databs
, who wants to try S3Tables? I've created a Datafusion distribution with support for S3Tables that you can run from the command line. This is all you need: frostbow -u arn:aws:s3tables:us-east-1:123456789:bucket/my-bucket-prefix Check it out the example:
github.com/JanKaul/fros...
loading . . .
https://github.com/JanKaul/frostbow/blob/main/examples%2Fcopy-csv.md
about 1 year ago
0
17
4
Does anybody have an idea how S3 Tables can achieve 3x performance compared to regular Iceberg tables on S3? Does it work similar to the object-store file layout?
iceberg.apache.org/docs/latest/...
#databs
loading . . .
AWS - Apache Iceberg™
https://iceberg.apache.org/docs/latest/aws/#object-store-file-layout
about 1 year ago
1
0
0
Join me tomorrow for my talk: "Dashtool - A data build tool to use Iceberg Materialized Views for data transformations" as part of the Open Source Analytics Community Series. December 3rd, 15:00 UTC
us02web.zoom.us/w/8299438519...
Passcode: 299889
about 1 year ago
1
1
0
reposted by
Jan Kaul
Andrew Lamb
about 1 year ago
This has been a long time coming. After the concerted efforts many engineers from across companies and across continents, posted some great benchmark results
datafusion.apache.org/blog/2024/11...
2
12
8
There is a discussion on the Top 2025 Data Trends with Matt Housley today. Could be interesting.
#databs
www.linkedin.com/events/top20...
loading . . .
Top 2025 Data Trends with Matt Housley | LinkedIn
What are the top data trends entering 2025 and who will win the data and AI wars? This week we're joined by superstar author and Leonardo Dicaprio lookalike Matthew Housley to go deep on what data tre...
https://www.linkedin.com/events/top2025datatrendswithmatthousle7262543075854409731
about 1 year ago
0
2
0
I recently gave a talk about Iceberg Materialized Views at Chill Data Summit London. I think Iceberg Materialized Views can really revolutionize the way we approach data transformations. Watch the recording here:
youtu.be/bDxUeReHyHQ?...
loading . . .
Analytical Data Transformations with Apache Iceberg Materialized Views | Presentation by Jan Kaul
YouTube video by Upsolver
https://youtu.be/bDxUeReHyHQ?feature=shared
over 1 year ago
0
1
0
reposted by
Jan Kaul
Jack Vanlightly
over 1 year ago
Databricks wants to merge Apache Iceberg and Delta Lake...
1
20
6
Bluesky now has over 10 million users, and I was #2.062.888!
over 1 year ago
0
1
0
you reached the end!!
feeds!
log in