@oetenergy.bsky.social @maxparzen.bsky.social we stumbled across your Awesome Electricity Demand repo and were wondering if you're open to secondary sources? We republish hourly EIA-930 & FERC-714 data as Parquet, including versions with outliers & gaps flagged & imputed. github.com/open-energy-...

Ah, @oetenergy.bsky.social is on here after all!

A new dashboard from Open Energy Transition, tracking the development and community activity of more than 200 different open source energy modeling projects. #EnergySky openmod-tracker.org

Ooh, much bigger addressable memory, which I think should make it easier to host live in-browser data science notebooks that do real work with @marimo.io or @jupyter.org and #pyiodide?

We're building PUDL usage metrics dashboards with @marimo.io and have been wondering how to differentiate @duckdb.org queries coming from our WASM-based web-app: data.catalyst.coop and folks using DuckDB directly.

Not exactly shocking, but definitely bad. Hopefully the hourly CEMS data keeps flowing. www.nytimes.com/2025/09/12/c...

The energy transition continues w/o the US. Insights from a new database (not yet public) tracking more than $200B of Chinese foreign direct investment in low-carbon energy manufacturing. #EnergySky by @70sbachchan.bsky.social & @nzpolicylab.bsky.social www.netzeropolicylab.com/china-green-...

Gas turbine supply chains are booked out, and prices have risen dramatically as a result. Common grid modeling inputs like NREL ATB don't reflect the current reality. GridLab & Halcyon have compiled some up-to-date cost estimates here. #EnergySky gridlab.org/portfolio-it...

Nobody likes admitting they got phished, but it happens, and the speed and transparency of @duckdb.org's response here is admirable. github.com/duckdb/duckd...

Hey #EnergySky we've retired our @datasette.io deployment (which was falling over with the volume of data we publish) and are re-using the domain for our new @duckdb.org + #Parquet + #WASM based data preview interface. Check it out and let us know if anything is broken: data.catalyst.coop

me ayudan?🫡 open.substack.com/pub/tacosded...

We have a new monthly PUDL release out, with EIA-860M data up through July, and some other small tweaks. Announcement up here: github.com/orgs/catalys... #EnergySky #OpenData

"[T]he car is a luxury good. And the essence of luxury is that it cannot be democratized. If everyone can have luxury, no one gets any advantages from it." www.resilience.org/stories/2018...

The 🐍 Python Documentary is a lot of fun* It's interesting to see how these sociotechnical systems evolve. And the weird hobbyist vs. megacorp dynamic. *except for the part where it takes 26 years for the first woman become a core contributor. 👋 @mariatta.ca www.youtube.com/watch?v=GfH4...

NYers go tell Kathy to protect our future! publicpowerny.org/take-action/

Thanks to @seerai.bsky.social for capturing a snapshot of many of the DHS HIFLD geospatial datasets before the system was decommissioned last week. You can browse it through their web interface here: www.seer.ai/the-open-pla...

Next Wed. (9/10) we're piloting a new hands-on workshop on analyzing messy energy data, aimed at grad students and other researchers who have touched #Python, but want to learn more. If that's you, and you're up to give us feedback, register here! #EnergySky www.eventbrite.com/e/open-energ...

Just found out that EIA downscales annual generation to monthly at most hydro plants using a sample of surveyed plants. ORNL has a paper where they reconstruct monthly generation from 1980-2019 at plants >10MW using local proxies. #EnergySky @catalyst.coop www.nature.com/articles/s41...

Hey, we have finally implemented a privacy policy for our online data viewer, and are starting to collect usage data. But not in a creepy way. Mostly we want to understand who looks at what data, so we can concentrate on making the right things better: viewer.catalyst.coop/privacy-policy

Progress on distributing large scientific datasets via #BitTorrent and preservation via Lots of Copies Keeps Stuff Safe. This feature allows uploads and torrent modifications via a web interface, so you can participate even if your institution blocks BT #OpenData blog.sciop.net/2025-08-29/w...

Our solarpunk present is shaping up to be a weird mix of thermopunk, electropunk, and cyberpunk (derogatory).

A look at the drivers of US electricity prices from @rff.org, based partly on EIA & FERC data accessed through our PUDL project. #EnergySky www.resources.org/archives/wha...

NEW: The first evidence of a solar take-off in Africa☀️✈️ x33 rise in Algeria solar panel imports in the 12 mths to June 2025, compared to previous 12 mths. x8 in Zambia x7 in Botswana x6 in Sudan x3 in each of Liberia, DRC, Benin, Angola, Ethiopia 🧵

"At their core, #WorkerCoops are democratic institutions: businesses owned and governed by their workers, who share both risks and rewards. They offer a model of economic self-determination—rooted in values of equity, solidarity, and accountability." 🌲🌲 nonprofitquarterly.org/whats-next-w...

@robgramlichdc.bsky.social Maybe you've already seen, but the 2024 FERC-714 load forecast data is available in PUDL as of our last release. If there are fixable units reporting errors or a rollup of nested respondents that you'd like us to integrate let's chat! github.com/orgs/catalys...

We've updated our PUDL example notebooks on @kaggle.com to point directly at Parquet files in S3, which also means they can be run locally without needing to download data first. In the process we added support for GeoParquet outputs to PUDL too. #EnergySky www.kaggle.com/catalystcoop...

Like, it's right there out in the open? What do you think "energy dominance" means if not this? They mean it literally. They always mean all of it literally.

if you are trying to understand the inconsistency btw AI boosterism and shutting down renewable electricity projects, understand they have an ideological, economic, political stake in the fossil fuel industry, which enjoys when energy demand increases while energy supply competitors are restrained.

A useful suggestion from Greg Wilson (via Mastodon): If you are using AI coding tools, please copy your prompt into the generated code as a comment (or have your agent do that): 1. You wrote a precise requirement spec - why throw it away? 2. It'll help the next person understand the code. 🧵1/2

We've been trying Claude Code for data analysis and ... well ... ... let's just say that the recording of it has plenty of lessons we've learned. youtu.be/fDiylmtYlWM

I wrote a few tips here that should transfer well to DuckDB building-with-llms-pycon-2025.readthedocs.io/en/latest/te...

Huh, @duckdb.org just keeps sprouting extensions. Here's one that offers a bunch of functions for working with statistical distributions: query.farm/duckdb_exten...

Have folks been having good luck exploring sizeable domain-specific datasets with LLMs? Are there any good open source options for providing MCP access to a pile of Parquet files in S3? Are the costs on the client or server side? Cc: @simonwillison.net #EnergySky github.com/orgs/catalys...

We've finally been able to get the FERC EQR processed into a nice orderly Parquet dataset using @duckdb.org. Now we want to identify the wind & solar PPA transactions hiding in its 4.63 billion records. #EnergySky

Oh man, Pennsylvania PUC staff being unexpectedly honest... #EnergySky

We've started using Marimo notebooks for our internal usage metrics dashboards. They're pretty cool! The ability to publish them as read-only interactive web-apps is really useful. We had to set up a little FastAPI app internally. Nice to see a shared notebook environment. molab.marimo.io/notebooks

This work wouldn't be possible without Catalyst Cooperative. Supporting them supports me, RMI, and countless others in our industry trying to use defensible data to inform policies.

Very cool @openstreetmap.bsky.social project to map the remaining 30% of the world's high-voltage transmission system from Open Energy Transition. And also... the next 100% of the grid as it builds out in coming decades! #EnergySky #OpenData h/t @maxparzen.bsky.social mapyourgrid.org

The uneconomic coal dispatch work that HCI has funded at @rockymtninst.bsky.social led by @electronecon.bsky.social relies on the bulk FERC & EIA data that we publish through our Public Utility Data Liberation Project (PUDL). #OpenData #EnergySky

Grid Strategies used our FERC-714 outputs for their now famous load growth report.

Our summer release of the Public Utility Data Liberation Project (PUDL) is out. Full release notes up here: #EnergySky #OpenData catalystcoop-pudl.readthedocs.io/en/v2025.8.0...

We've finally finished migrating all our PUDL data validations out of our old DIY pytest+pandas setup and into @getdbt.com running @duckdb.org on Parquet files. It runs a lot more tests now, and takes 45 seconds instead of ~3 hours. Plus we got to learn SQL.

Tech worker co-ops aren't (yet!) that common in the US, and we get a lot of requests from researchers to do interviews or surveys, so we finally decided to just interview ourselves and share. Cc @usworker.coop www.youtube.com/watch?v=mBjj...

The Splink (@robinlinacre.bsky.social) folks are working on some record-linkage extensions for @duckdb.org. Mostly focused on string standardization and homophones for now. Looks cool! What other record linkage extensions might make sense? github.com/moj-analytic...

Hey #EnergySky we have a new PUDL data release -- it includes refreshed EIA-860M and early release data for EIA-860/923. We're experimenting with a monthly release cadence. Open discussion here if you want to say hi or highlight any issues you find in the release: github.com/orgs/catalys...

Hey #EnergySky we wrote up some notes on the results of our first annual open energy data user survey. At the top level: - It's hard to find energy data - We already have many of the most used datasets. - More folks have python / open source experience than we thought. catalyst.coop/2025/06/24/k...

I think my favorite kind of book is when I find someone else that has thought longer and harder about an idea I've also had, but in a fuzzy way. It's like getting to fill in all the gaps for free! Precursor paper up here. #EnergySky www.cambridge.org/core/journal...

VERY excited for @greenprofgreen.bsky.social's new book. This is basically the theory behind most of the work @catalyst.coop has supported with open utility & financial data. We stumbled into it on our own fighting Xcel's coal plants in Colorado around 2013. #EnergySky heatmap.news/podcast/shif...

I've spent some time recently with NERC's reliability assessments - it's interesting to look back over the last several years of reliability assessments and compare. There's a long-run trend of declining summer reliability risk nation-wide as regions have ramped up deployment. 🧵 #energysky

Does anybody have examples of #opendata projects using #OpenSearch / #ElasticSearch to provide meaningful public access to large collections of documents? Or to give #opensource developers API access to documents, metadata, and text embeddings? Maybe @propublica.org? #EnergySky