I'm investigating a skyfeed outage, will post updates in this thread.

Whoops, the skyfeed.xyz did:web (used for OnlyPosts and Discover) was broken because caddy could not renew the TLS cert due to the disk being full. Sorry about that, fixed now!

🎉 The first RC of @iroh.computer 1.0 is here, we made it! Yes it is real, after more than 50 releases, it is time for [email protected] Thank you everyone for making this a reality! www.iroh.computer/blog/iroh-1-...

Switched to the new feed service url! (new url is just a proxy to the old service for now, but it's the first step) Let me know in this thread if you notice any NEW (not before seen) issues or degradations in your feeds while I continue with the next steps :)

Hey SkyFeed users, I will switch the skyfeed service url to a new backend later today. I expect this to go smoothly, but if not feeds might go down for a short period of time. This is the first step of migrating to the new architecture, which will be significantly more reliable and fix a lot of bugs

I'm currently in the final refinements to my optimized atproto indexer for skyfeed and just learned that there is no efficient way to detect deletions with incremental repo sync :( does anyone know a good solution to this issue?

Folks have been reaching out about how to support Graze beyond our core product. We think that support needs to go beyond Graze. That's why we've teamed up with our direct competitors @skyfeed.app and @blueskyfeedcreator.com to jointly support all our work:

Announcing my new app atmoprints.xyz, an atproto 3d printing host that saves models in your pds. Upload your favorite model, we need content.

Hi! SkyFeed is struggling and I need to find a solution. If you don't know SkyFeed, it's a service I built 2 years ago, enabling anyone to build and publish feeds using a visual block-based editor. SkyFeed is still hosting the most feeds on Bluesky, but that comes at a cost [1/X]

skyfeed is currently down, main database seems to be having issues - sorry about this, I'm on it and trying to fix it asap

I get pinged quite frequently about all skyfeed feeds having issues, but then I go online, check a few feeds and everything seems to be fine. however despite this being the case, there has been a concerning amount of pings the past few days, so I assume that maybe one of the servers is broken. [1/2]

It would be nice if IPv6 used underscores instead of colons for separating groups. __1:5050 is so much nicer than [::1]:5050 imo and you would be able to double-click to select a long address in most places!

The #WHY2025 AT Protocol and Bluesky Meetup is TODAY at 15:00! We will meet at this location: map.why2025.org#m=52.6925197... I will be holding a Plushtodon, so you can use that to recognize me. If you can't find us, send me a Bluesky DM 🦋 See you later!

Hey, if you're at #WHY2025, I'm organizing a little AT Protocol & Bluesky Meetup 🦋 It doesn't matter if you're already building something on AT Proto, are just a user interested in how everything works under the hood or simply want to talk about decentralized social media, everyone's welcome!

Made a feed for #WHY2025, see you there! bsky.app/profile/did:...

anyone here going to #WHY2025 ?

can anyone load 🫟.st ?

latest canvas is now always pinned on @placebot.pds.amsel.dev's profile

we made a r/place-style game to try out our small Rust-based bluesky bot framework we've been working on ~ go place some pixels, we need load testing :P

Ethersync enables real-time collaborative editing of local text files. You can use it for pair programming or note-taking, for example. It's the missing real-time complement to Git! github.com/ethersync/et...

which terminal emulators do y'all use on your system?

appviewappviewappview - after 6 months, I'm running what is, afaik, the first full-network bluesky appview - you can use it at zeppelin.social, query it at bsky.zeppelin.social, read about it at whtwnd.com/futur.blue/3..., & help me keep it up for more than a few weeks at github.com/sponsors/fut...

skyfeed servers are currently down, sorry about that. trying to get everything back online asap

deltarune now store.steampowered.com/app/1671210/...

📣 Join us for @redsolver.dev's talk on @skyfeed.app's evolution to an open-source platform with custom Rust indexing for AT Protocol. Learn how it could enable a fully independent, EU-hosted AppView - solving a key Bluesky decentralization challenge! ahoy.eu/speakers/red...

🚀 Early bird tickets for Ahoy European Social Web Day Hamburg 2025 are now LIVE! 🎟️ Grab yours before they're gone - limited time offer for the community! We'll be announcing our first speakers later this week. ti.to/ahoy/ahoy-eu... #bluesky #atproto #conference

Ahoy Europe! Social Media is worthing fixing and we need a strong European movement to build viable alternatives. Save the date and let's build further momentum together: 24th of April in Hamburg. Sign up for the newsletter today - tickets will become available next week. #atproto #bluesky

Hey SkyFeed users, fly.io is currently having a "Major Outage" in the IAD region where the skyfeed cache infrastructure is hosted: status.flyio.net As a result, all skyfeed feeds are currently down until fly.io is back online, very sorry about that.

I've been trying to get the infra back online for the last 30 minutes and looks like it's recovering now. I deployed a new version of the query-engine yesterday and it looks like it got extremely slow after starting to use swap mem, which resulted in very long timeouts and as a result, broken feeds.

Good Morning, just woke up. I'm sure nothing bad happened during the night

The SkyFeed Discover feed is now finally back online! Feel free to try it and let me know if it shows you relevant results: bsky.app/profile/did:... If it's empty, you might need to like some posts first because it only uses your recent likes as input.

Very sorry about yet another SkyFeed downtime, feeds should be recovering now. Took a while to notice because it's 5 AM over here.

About 45 minutes ago, quite a lot of SkyFeed feeds went down. Sorry about that, all of them should be back online now! Read below for a more detailed explanation of what caused this:

SkyFeed is having issues atm, I'm trying to get everything back online asap!

Would anyone be interested in a Bluesky (dev) meetup at the #38C3?

Made a feed for #38C3 👾 See you at congress! bsky.app/profile/did:...

This took a while, but all SkyFeed feeds should now be back online! After fly.io resolved their incident, their API was still returning inconsistent responses. For ~50% of requests, it said that my app doesn't exist :D So I gradually re-deployed all containers by hand and now it seems to be healthy

I'm sorry for the current SkyFeed outage, I'm pretty sure it's caused by @fly.io which I use for smart caching of feeds. It usually works great. See https://status.flyio.net/ for status

I've been getting reports of some posts not being indexed by SkyFeed correctly. I suspect that this is caused by my indexer being overloaded and the firehose stream being a bit wonky. So I'm currently in the process of rewriting the indexer in Rust with a self-hosted jetstream instance and relay2

we did it! 🥳

I'm looking for a UI designer for the web version of my open-source project vup.app (decentralized e2e-encrypted file hosting service) I prefer EU-based designers who have a VAT identification number, but if I like your existing work this is optional. If you're interested, please send me a DM :)

Thank you for bearing with me during the recent SkyFeed outages, I'm trying my best to keep them online <3 With the recent increase in users, I also had to add some new servers. If you would like to support SkyFeed and cover infrastructure expenses, you can donate here: github.com/sponsors/red...

I'm looking for a UI designer for the web version of my open-source project vup.app (decentralized e2e-encrypted file hosting service) I prefer EU-based designers who have a VAT identification number, but if I like your existing work this is optional. If you're interested, please send me a DM :)

The main Skyfeed database is down atm, I'm on it.

A few hours ago, 2/3 SkyFeed Query Engine servers stopped fetching new posts from the database. So about 2/3 of feed requests did not show the most recent posts. Should be fixed now, I suspect that it was caused by them getting stuck after the short Hetzner vSwitch network maintenance earlier today.

SkyFeed database server is not reachable for some reason, I'm on it

SkyFeed: I'm running two separated full copies of the database in two different locations. Both of them broke at the same time, looks like due to some bug in the DB. So I'm now trying to somehow recover the corrupted DB state

SkyFeed feeds should be back up, reply here if you find one that's not! Sorry for the downtime

I deployed a fix yesterday, looks like all feeds mentioned in this thread are back online now: bsky.app/profile/reds...

Hey SkyFeed users, I'm sorry for not yet responding to the current feed issues 🙁 From my current data it looks like only a subset of feeds is affected, but of course that's still unacceptable. So if you see a feed that seems to be broken, please reply to this post and I'll check them all in 10 hours