shikhar
@schmizz.net
📤 2094
📥 462
📝 103
Making streams serverless
@s2.dev
reposted by
shikhar
S2, the Stream Store
5 days ago
add a skeleton here at some point
0
3
3
S2's REST API now supports long polling, besides SSE! Long polling is a simple way for client-driven consumption with stateless HTTP requests. You just need to specify the ?wait=<seconds> query parameter. If no records are available, the response will only return after the duration elapses.
loading . . .
Read records. - S2
Retrieve a batch of records, or continuously stream.
https://s2.dev/docs/rest/records/read#parameter-wait
7 days ago
0
7
2
I shared more context on Reddit:
www.reddit.com/r/databasede...
add a skeleton here at some point
20 days ago
0
11
3
We open sourced a read-through cache for S3, called Cachey
github.com/s2-streamsto...
loading . . .
GitHub - s2-streamstore/cachey: Read-through cache for object storage
Read-through cache for object storage. Contribute to s2-streamstore/cachey development by creating an account on GitHub.
https://github.com/s2-streamstore/cachey
20 days ago
1
39
11
After a bout of hallucination, I had GPT5 generate some backronyms for itself: - Generally Pretends Truthfully - Gullible People’s Trick - Greatly Pretends Things - Generated, Probably Twisted - Guessing, Passing, Tricking - Good at Pretending Truths - Generally Produces Tall-tales
about 1 month ago
0
2
1
reposted by
shikhar
about 1 month ago
OpenTelemetry 🤝
@s2.dev
Are you building infrastructure for sandbox environments (e.g., agent sandbox, CI/CD sandbox) and want to stream execution logs to users in real time? If so, check out
s2.dev/docs/integra...
and let us know what you think.
loading . . .
OpenTelemetry - S2
https://s2.dev/docs/integrations/otlp
0
6
2
ok, google
about 1 month ago
1
2
0
reposted by
shikhar
about 1 month ago
I wrote a bit about how we verify linearizability of
@s2.dev
using Porcupine!
s2.dev/blog/lineari...
loading . . .
Linearizability testing S2 with deterministic simulation
How we validate strong consistency
https://s2.dev/blog/linearizability
0
7
4
You are a stream integrator!
add a skeleton here at some point
about 2 months ago
0
3
1
reposted by
shikhar
about 2 months ago
Added some visibility into usage metrics to the
@s2.dev
dashboard!
loading . . .
0
6
3
There needs to be a non-violent alternative to "cattle, not pets". Claude suggests: (a) crops, not gardens (b) numbered, not named (c) stamps, not paintings (d) legos, not sculptures I think I'll be rolling with (b) 😅
about 2 months ago
2
7
0
s2.dev
got a refresh ✨
2 months ago
1
6
3
when database founders meet, it's called an fsync
2 months ago
1
10
0
reposted by
shikhar
Mehul Arora
2 months ago
Our Star Wars quickstart got good feedback, and now you can view the stream from the dashboard too 🫣 This comes in real handy for live debugging and observability — especially in systems built around agentic workflows, microservices, or event sourcing using
@s2.dev
loading . . .
0
4
3
add a skeleton here at some point
2 months ago
0
2
0
CRC32C -> CRC64NVME ✅
2 months ago
1
2
0
S2 playground was briefly on HN and someone got a shared session going. yy2wi21o, I agree. APPEND. ALL. THE. THINGS.
news.ycombinator.com/item?id=4452...
3 months ago
1
4
0
reposted by
shikhar
3 months ago
Can you build a realtime BBS on s2? Yes, in fact...
s2.dev/playground
loading . . .
https://s2.dev/playground
0
4
3
My AI tell: This isn't just X. This is Y.
3 months ago
1
1
0
Agents need granular streams. And yes,
@s2.dev
fits the bill nicely!
s2.dev/blog/agent-s...
3 months ago
0
8
4
reposted by
shikhar
3 months ago
Super cool XTDB plugin from
@chuck.cassel.dev
, which implements the write-ahead log using
@s2.dev
streams:
github.com/chucklehead-...
loading . . .
GitHub - chucklehead-dev/s2-log
Contribute to chucklehead-dev/s2-log development by creating an account on GitHub.
https://github.com/chucklehead-dev/s2-log
0
7
4
reposted by
shikhar
Mehul Arora
3 months ago
Change data capture from Postgres is simple with the right tools. We collaborated with
sequinstream.com
on an integration so you can use
@s2.dev
to ship real-time features faster!
0
6
3
reposted by
shikhar
4 months ago
Had a lot of fun with this 😄 – a multiplayer, "instant re-playable" pseudoterminal that uses
@s2.dev
streams as a transport instead of SSH:
s2.dev/blog/s2-term
loading . . .
0
6
4
You can now safely share
@s2.dev
streams directly with end clients like browsers, apps, or agents! No proxying required. Check it out,
s2.dev/blog/access-...
4 months ago
0
11
5
reposted by
shikhar
Lalith Suresh
4 months ago
I'm so happy to see teams going clean slate in this space. Being at the mercy of a poorly designed protocol and spaghetti like librdkafka just isn't worth it.
0
4
2
Kind words from Chris about S2! I felt strongly that we needed to not hitch our wagon to Kafka. It is not even a priority for us, for now. This may seem like a strange analogy... but if Kafka is OLAP, we want to be OLTP. See this demo to understand what I mean:
s2.dev/docs/integra...
add a skeleton here at some point
4 months ago
1
11
3
reposted by
shikhar
4 months ago
@s2.dev
now has an MCP server! The entire API is available for tool-use by AI assistants like Claude -- see it in action here:
www.youtube.com/watch?v=wLFk...
loading . . .
S2 via MCP in Claude Desktop
YouTube video by S2, the Stream Store
https://www.youtube.com/watch?v=wLFkyYSgKJg
0
4
3
reposted by
shikhar
Mehul Arora
4 months ago
We were inspired by Vercel's take on resumable streams in the Chat SDK, and thought — what if we took it a step further with S2? With the @s2-dev/resumable-stream npm package, you can use S2 as the backend for stream resumption in AI chat applications.
loading . . .
1
2
2
reposted by
shikhar
Corey Quinn
4 months ago
It’s priced per DCU. If you don’t know what that is, rest easy; neither does AWS.
7
73
2
reposted by
shikhar
LiveStore
4 months ago
Introducing LiveStore (beta) LiveStore is a next-generation state management framework based on reactive SQLite and built-in sync engine.
livestore.dev
loading . . .
LiveStore: Local-first data layer for high-performance appsArrowArrowArrowArrowLiveStore
LiveStore is a state management framework based on SQLite and event-sourcing. It’s designed for demanding applications and based on years of research.
https://livestore.dev
1
72
25
anybody here got thoughts on Redis Streams (
redis.io/docs/latest/...
)? Love / hate / why you reached for it / why you didn't
4 months ago
0
0
1
What if you could share an S2 stream directly with an end client, no additional proxy middleware to implement? S2 now supports granular scopes on access tokens! I'll share more on it soon.
5 months ago
0
4
2
S2 now supports timestamps! 🕰️ How we made streams understand time:
s2.dev/blog/timesta...
5 months ago
0
17
9
Adding a familiar tail command to the
@s2.dev
CLI felt natural! Some folks have compared Stream Store to a "serverless named pipe." It's an intuitive analogy, and here are some ways S2 is so much more: - Record-oriented - Durable on object storage - Built-in concurrency control
loading . . .
5 months ago
0
4
2
reposted by
shikhar
Johannes Schickling
6 months ago
Event-driven design is highly underutilized. It's the right architectural approach for many systems and applications but often it's too inconvenient to do. I'm trying to fix that with @livestoredev by making the right thing easy.
2
40
3
S3 express pricing update takeaways - 512 KiB writes are actually 8% more expensive, 1 MiB writes are 33% cheaper.
aws.amazon.com/blogs/aws/up...
6 months ago
0
12
3
reposted by
shikhar
Vaibhav Rabber
6 months ago
Create streams on the fly with ease. Just turn on this setting for your basin.
@s2.dev
loading . . .
0
4
5
I blogged about our DST journey with
@s2.dev
s2.dev/blog/dst
loading . . .
DST for async Rust
Taming distributed systems with deterministic simulation testing.
https://s2.dev/blog/dst
6 months ago
0
18
10
reposted by
shikhar
Carl Sverre
6 months ago
What if your app could combine the simplicity of physical replication with the efficiency of logical replication? Meet Graft: lazy, partial, strongly consistent edge replication.
#OpenSource
#EdgeComputing
#Replication
sqlsync.dev/posts/stop-s...
loading . . .
Stop syncing everything
Discover Graft, an open-source transactional storage engine built to solve the challenges of syncing data at the edge. Inspired by lessons from SQLSync, Graft enables lazy, partial, and strongly consi...
https://sqlsync.dev/posts/stop-syncing-everything/
1
40
22
reposted by
shikhar
Luke Hedger
7 months ago
Just watched
@sbalogh.bsky.social
HYTRADBOI talk and I love the idea behind
@s2.dev
: using a stream as your database ✨ The simplicity of the API/concepts is going to make it accessible to teams who'd otherwise have to reach for ~kafka to get a similar architecture
www.hytradboi.com/2025/f2cc03c...
loading . . .
Serverless primitives for the shared log architecture
https://www.hytradboi.com/2025/f2cc03cb-14fc-42f4-ad38-b4b15a15815f-serverless-primitives-for-the-shared-log-architecture
0
10
3
reposted by
shikhar
Akshat Sharma
9 months ago
With my final semester coming up, its time to put up an open to work post and put my hat in the market. Open to work in distributed systems/databases and backend positions. I have experience writing systems that implement different distributed consensus protocols. Résume:
resume.akshatsharma.xyz
loading . . .
https://resume.akshatsharma
1
5
4
reposted by
shikhar
7 months ago
Bytewax connector for
@s2.dev
is out now!
bytewax.io/blog/s2-conn...
loading . . .
Announcing the Bytewax Connector for S2! – bytewax
We’re excited to introduce the Bytewax connector for S2 (Stream Store). S2’s philosophy—that **the stream deserves to...
https://bytewax.io/blog/s2-connector
0
4
3
reposted by
shikhar
Alex Miller
7 months ago
I gave a #HYTRADBOI talk which was a plea to not just choose Raft by default for replicating data:
transactional.blog/t...
loading . . .
Talks: Enough With All The Raft
There's better ways to replicate data than Raft.
https://transactional.blog/talk/enough-with-all-the-raft
1
51
12
reposted by
shikhar
S2, the Stream Store
7 months ago
A walkthrough of the CLI that will give you a good sense of S2 overall:
www.youtube.com/watch?v=l-31...
loading . . .
S2 command line interface walkthrough
YouTube video by S2, the Stream Store
https://www.youtube.com/watch?v=l-31vK75PzQ
0
5
1
reposted by
shikhar
HYTRADBOI
7 months ago
Talk 24: "Serverless primitives for the shared log architecture" by Stephen Balogh (
@sbalogh.bsky.social
)
1
9
6
reposted by
shikhar
7 months ago
We're also releasing an alpha version of a Flink connector for S2 streams:
github.com/s2-streamsto...
See the demos for an example real-time feature pipeline for turning beacons (stored on S2) into complex events, and ultimately a dynamic table of ML features stored upsert-style on an S2 stream.
loading . . .
GitHub - s2-streamstore/flink-connector-s2: Flink connector for S2 [WIP]
Flink connector for S2 [WIP]. Contribute to s2-streamstore/flink-connector-s2 development by creating an account on GitHub.
https://github.com/s2-streamstore/flink-connector-s2
0
3
4
Is Kafka a log? No Is a Kafka topic a log? No, the topic-partition is the log. A Kinesis stream is not a log either. The stream-shard is. S2 does not bury the core abstraction everyone can get behind. An S2 stream is a log.
7 months ago
2
8
1
bringing back the IRC experience with 23 lines of bash
8 months ago
0
1
0
reposted by
shikhar
Frederic Branczyk
8 months ago
On a more personal level, we are honoured that we got to work with
@schmizz.net
and the rest of the
@s2.dev
team ahead of their launch and managed to play a small role in their really awesome product!
add a skeleton here at some point
0
8
3
This manages to cover a lot of ground! From writing to an S2 stream using Python, to streaming in real-time with Typescript over our new REST API.
add a skeleton here at some point
8 months ago
0
3
1
Load more
feeds!
log in