If you’re excited about hard technical problems and want to shape the future of real-time systems, Feldera is hiring (remotely!) for a Solutions Engineer (Enterprise) and a Software Engineer (Reliability, Performance) jobs.ashbyhq.com/feldera/544a...

Some of my work at @feldera.bsky.social involves containers. I keep getting spam from some vendor who wants to sell me casters to put on the containers 🤣

"This is the true power of incremental compute. By only needing compute resources proportional to the size of the change, instead of the size of the whole dataset, businesses can dramatically slash compute spend for their analytics." 👇 www.feldera.com/blog/how-fel...

At @feldera.bsky.social I've been doing a lot of performance work. I needed an easy way to watch the Prometheus metrics for a pipeline, so I wrote a simple tool for the Feldera CLI that shows the pipeline metrics. Here's the progress of a pipeline that runs in about 30 seconds.

If you've written even the most basic compute program, you've likely already written programs that "integrate". Integration is central to Feldera and its underlying theory of incremental compute. It is also all around us in the real world! 👇

"We chose performance over security" - a dilemma no data team should face. #DataEngineering #DataSecurity #RealTimeAnalytics

New tech talk: How to Incrementally Get Results from Your Graph Data with Feldera. Interested in practical techniques for incremental computation or want to see how this fits into modern data engineering workflows? Check it out: youtu.be/vpVAZbaZ2Hg

Mihai Budiu, our exceptional Chief Scientist, won the 2025 #ACM #SIGCOMM Networking Systems Award for his groundbreaking work on #P4. Details: www.sigcomm.org/awards/sigco...

📢 Webinar - Tomorrow! -6/18 at 9am PST- Stop re-running complex recursive queries when your graph data changes. Feldera incrementally evaluates recursive graph computations-ideal for real-time applications in authorization, networks, and observability. Sign Up - t.co/0iWPIMZY8C

Don't miss our webinar tomorrow! -6/18 at 9am PST- Stop re-running complex recursive queries when your graph data changes. Feldera incrementally evaluates recursive graph computations-ideal for real-time applications in authorization, networks, and observability. tinyurl.com/rb5my7d8

📢 Webinar - 6/18 at 9am PST! Stop re-running complex recursive queries when your graph data changes. Feldera incrementally evaluates recursive graph computations. Learn to easily build these mechanisms with #SQL, without the hassle of constant recomputation. tinyurl.com/rb5my7d8

We’ll be at the #Databricks Data + AI Summit in SF next week (6/9–12). If you’re around and want to chat about how incremental computing can make your #SparkSQL workloads go from hours to seconds — let’s connect. Grab some time here: calendly.com/matt-feldera... #DataAISummit #DataEngineering

Today, the USENIX newsletter ;login: published an interview with me: www.usenix.org/publications.... Read it to find out about Open vSwitch, @feldera.bsky.social, and more!

🧵1/ Real-Time Medallion, No Re-Architecture Required. A customer came to us with a classic Medallion setup: Spark + Delta Lake, batch jobs moving data from bronze to gold. It worked—until users started asking for fresher insights.

Feldera's Chief Scientist, Mihai Budiu will be giving a talk on the convergence between stream processing and databases at EventCentric in Antwerp on June 4: 2025.eventcentric.eu/program/unif...

It's a wonderful time to join us at @feldera.bsky.social! 🚀 If you're a systems engineer who loves working on data-intensive systems and is fluent in Rust, Kubernetes, Docker and cloud tech, do apply! jobs.ashbyhq.com/feldera/9754...

Learn how to transform your slow batch jobs into real-time, always-up-to-date insights with our new user guide for converting Spark jobs to incremental Feldera pipelines. www.feldera.com/blog/warpspeed

#SQL Quiz! What do you think is the meaning of SELECT * FROM T ORDER BY X DESC NULLS LAST? (Answer on Monday)

Incremental Update 22 adds new storage defaults and SQL features to Feldera, following our recent work reducing Rust compile times from 30 to 2 minutes. Building and deploying complex pipelines is now faster and more seamless than ever. www.feldera.com/blog/increme...

Ever wish batch jobs didn’t take the scenic route? We get it. See how Feldera keeps your data up-to-date, no endless reruns. Catch the webinar recording (live demo + real examples) here: www.youtube.com/watch?v=rcq3...

Our Rust compilation shenanigans have hit HN

It's unthinkable that we've cut pipeline compilation times for our users by a factor of 15, but we did! Want to learn more about how we made this possible? Check out a new blog by @zgerd.bsky.social : www.linkedin.com/feed/update/...

Join us in one hour!

Say farewell to stale data! 🚀 With Feldera, harness #SQL for real-time analytics that evolve with your data. Instant insights, dynamic authorization, real-time fraud detection—at a fraction of the cost & time. Join us and redefine data analytics! www.feldera.com/blog/feldera...

Join us for an in-depth webinar on how Feldera transforms batch analytics with its incremental computation engine. Register shorturl.at/zQTLu Wednesday, April 9th at 9am PST, 12pm EST

New Update 🏃‍♂️Faster pipelines w/ parallel connector initialization, common-subexpression elimination passes, bloom-filters for recursive programs 📈Delta-lake connector filtering feature = fine-grained data ingestion control 📜New backfilling pipelines documentation www.feldera.com/blog/increme...

Incremental computing works great, but can someone help with GitHub Actions? www.feldera.com/blog/the-pai...

Listen to @thegeeknarrator.bsky.social podcast! @feldera.bsky.social CEO, @lalithsuresh.bsky.social, discusses Feldera's approach to incremental view maintenance and the foundational breakthrough -- DBSP -- that powers it, engine internals, storage, handling late events. youtu.be/GpcIoABwF60?...

👀Our latest release ⚡ Streamlined Batch Analytics: Sort new data without reprocessing everything. ⚡ Enhanced SQL Functions: Accurate number rounding and word joining made easy. ⚡ Improved Engine Performance: Restart with ease, thanks to saved filters. www.feldera.com/blog/increme...

If you want to learn how Feldera can provide you faster, more efficient data processing swing by our booth at the Fintech Meetup. Not at Fintech? Jump in our sandbox: try.feldera.com

If you're attending the Fintech Meetup next week in Las Vegas, come find @feldera.bsky.social at the startup lounge (Booth S6). We want to meet you!

Last month, we announced S3 support for our pipelines. Today, we're making it real: You can now try it out directly in the online sandbox. No SQL changes are needed—tweak a bit of JSON in your pipeline settings, and you're set. www.feldera.com/blog/leverag...

@feldera.bsky.social v0.38 release - packed with improvements: - A new redis output connector, easily and efficiently send data to the popular KV-store. - Support for input connector orchestration so you can easily manage complex backfill scenarios Learn more: www.feldera.com/blog/increme...

Mihai is giving a talk today at 4:30p PST at the Apache Calcite Hybrid Meetup February 2025 www.meetup.com/apache-calci...

Are you OTel Curious? Feldera Engineer Abhinav Gyawali breaks down how to compute on streams of OTel data using Feldera. If you're looking to build your own observability solutions, check out this blog! www.feldera.com/blog/opentel...

Hello v0.37, what's new? Storage: Bloom filters, file compression, smarter data management, a configurable memory cache. Code Generation: Avoids data duplication & optimizes outer joins. Runtime Optimizations: Data is stored, handled internally, for the better. www.feldera.com/blog/increme...

You can learn more about Feldera's capabilities in our interactive sandbox environment. No commitment, just pure exploration. Take the first step towards faster, more efficient data processing. try.feldera.com

Join our Slack community and connect with fellow data enthusiasts. Share insights, ask questions, and stay updated on the latest in data engineering. We can’t wait to meet you. 👋 felderacommunity.slack.com

📢 S3-backed Pipelines coming to Feldera! 🚀Handle datasets larger than local storage with ease using Amazon S3, Google Cloud Storage, or Azure Blob Store. Unprecedented scalability for real-time & batch processing. Preview for Enterprise users in Feb! www.feldera.com/blog/s3-back...

Feldera v0.36 is here: -📈 runtime & compilation performance for big programs & complex SQL schemas -Optimized LEFT JOINs for ⬇️memory usage & ⬆️throughput -Data compression capabilities for ⬆️storage $ -Multiway merging strategy for improved LSM-tree mgmt www.feldera.com/blog/increme...

Unlike traditional databases that slow down with data growth, our fully automatic incremental computation maintains consistent performance. Ideal for both batch and real-time data processing. Learn more about steady performance as your #data grows! www.feldera.com/blog/batch-p... #datastreaming

It's another incremental update for all you fine folks! This latest release includes: Fixed handling of large records in ad-hoc queries for web-console and fda. Switched from YAML to JSON for internal configuration. Stay tuned for upcoming features! Details: www.feldera.com/blog/increme...

It's ain't much but it's honest work. github.com/feldera/feld...

We've got some artists here: xls.feldera.io 🌞

Need to build a high-performance Fine-Grained Authorization (FGA) system without sending your cloud bill through the roof? Use incremental computation. We've been working with several users to build high-performance FGA systems using Feldera. www.feldera.com/blog/fine-gr...

We've posted two exciting new use cases to our documentation 🔐 a policy engine for fine-grained authorization 🚀 building live and real-time web applications We have also improved HTTP performance and sprinkled in some SQL compiler bug fixes. www.feldera.com/blog/increme...

This is a great post from @lalithsuresh.bsky.social. Discusses differential and model based testing. Unreasonably effective ideas.

What a great demo & presentation. Easily one of the most interesting tech demos I've seen in a half decade.

Federa Tutorial: Building a Billion-Cell Spreadsheet: create a fully functional, scalable spreadsheet web application using just 100 lines of SQL! www.youtube.com/watch?v=ROa4...

THIS WEDNESDAY! Let's build real-time web applications with Feldera: a Billion-Cell Spreadsheet! | Jan 8th, 9-10a PST Are you ready to pump up your web app development game? Join us for an exclusive webinar. www.eventbrite.com/e/feldera-we...