Open-source projects should stop making the public project repo a Pypi trusted publisher. Configure the public repo's CI to make a release with all the wheels and other release artefacts attached. Then configure a private repo to do the publication. GHA is really easy to mess up and get pwned.

A self-replicating thing doesn’t have to be very smart to cause major problems. Generally we can plan ahead though, and contain the damage. Well, we could do that. In theory. Or we could spice things up a bit. Maybe run some bat-licking ecotours instead. Why not? honnibal.dev/blog/clownpo...

I guess my socials are way more tech focussed than my...social, so maybe this take gets kind of a "duh" here. Not sure. But: Why I don't think AI is a bubble honnibal.dev/blog/ai-bubble (basically an argument that LLM progress probably won't plateau. Not a finance guy)

Basic take I know, but "the information stays on ChatGPT" and "the information is used to decide which ads to serve" are not compatible statements.

If your tests ever find anything interesting, Claude Code will challenge you to a little contest-of-wills where it tries to cope, rationalise or lie egregiously to avoid fixing the problem. I call this minigame 'sneaky quokka'. honnibal.dev/blog/sneaky-...

Style (and mindset) tips for less experienced developers working with AI honnibal.dev/blog/llm-sty...

I've been working on a post on LLM-assisted coding, and I guess I've built up a bunch of writer's debt, because it turns out there's a bunch of tangents I wanted to write up first. One really concrete thing that came up is try/except usage -- so, here's the post. honnibal.dev/blog/try-exc...

I feel like my Claude Code got a lot worse after I made some grumpy changes to my system prompt. I was annoyed that it kept trying to condition around invalid data instead of failing and fixing the data at the source, so I added some instructions to the prompt that were maybe too blunt. However...

I'm back from a busy four days in London! 💜 I had a great time at @pydatalondon.bsky.social‬ and you can read my recap and highlights here: www.linkedin.com/feed/update/...

Hi Berlin people! @hugobowne.bsky.social is in town & we're celebrating by hosting a meetup together 🎉 This one is all about building with AI & we'll also open the floor for lightning talks. If you're around, come hang out with us! 📆 June 16, 18:00 📍 Native Instruments (Kreuzberg) 🎟️ lu.ma/d53y9p2u

Back to streaming spaCy! Working on Python 3.13 compatibility today: www.youtube.com/watch?v=wgjQ...

Another great @pyconde.bsky.social is over and I'm exhausted but happy, and feel very inspired! ⚡ Here are my personal highlights: www.linkedin.com/feed/update/...

My friend @hugobowne.bsky.social launched new course on Building LLM Applications for Data Scientists and Software Engineers! I'll be joining for a guest lecture on human-in-the-loop development and distillation workflows. You can get 10% off with my code + lots of perks: maven.com/hugo-stefan/...

I don't normally write advice columns but this question I got deserved its own post: With all the hype around Generative AI, how can you, as a developer, communicate the nuances and advocate for new and modular solutions that are better, easier and cheaper? explosion.ai/blog/modular...

So many good events coming up this season. Here's my schedule – hope to see you there! Apr 10: data:unplugged (Münster) Apr 23: @pyconde.bsky.social (Darmstadt) May 31: @pyconit.bsky.social (Bologna) Jun 5: ECONDAT (London) Jun 7-8: @pydatalondon.bsky.social (London) 📆 Details: explosion.ai/events

@explosion-ai.bsky.social Only the best companies will send you stickers if you are a fan and beg for them! Thank you so much, Ines and Matt!!!!

New case study: How Love Without Sound built innovative AI-powered tools for the music industry and law firms, and helped publishers recover hundreds of millions of dollars in lost revenue for artists. explosion.ai/blog/love-wi...

Out now: Prodigy v1.18! New features include: ✍️ edit text during span annotation 💬 fully custom UI translations 🎛️ new JavaScript events and functions ✅ various small fixes and docs More details: prodi.gy/docs/changelog

These are the kinds of NLP stories I love! TFW you "accidentally" train a great 2 MB (!) task-specific model 🤯 @strickvl.bsky.social

Look what arrived in the mail today! 🎉 This is the 2nd edition of "Mastering spaCy" by Duygu Altinok and Déborah Mesquita, featuring how to build structured NLP solutions with custom components, and updated content on using models powered by LLMs. You can get it here: www.amazon.com/dp/B0DVBTX2BL

spaCy development live stream continues today! Today I'll be looking at getting Confection updated, to allow Python 3.13 support and add a file-management feature. Playlist: www.youtube.com/watch?v=TTEW... The spaCy+PyTorch design has been going well, but we need that file management feature now.

Pretty happy with how the spaCy+PyTorch design is coming together. And hopefully I'll continue to get smoother at streaming :) www.youtube.com/watch?v=YeKi...

Live again now, doing more design work on what it would look like if we rebuilt spaCy on PyTorch: www.youtube.com/watch?v=fzFH...

Enjoyed giving my keynote on "What the history of the web can teach us about the future of AI" at PyCon+Web. I wrote it up as a blog post because I think there are many interesting parallels and lessons we can learn: explosion.ai/blog/history... Here are the most important points 🧵

Okay let's try this again -- Live now! Streaming software issues hopefully sorted 🤞

Will do another short (~2h or so) stream this afternoon, at 13:00 CET. Last week I was limited in what I could do because the main thing I was working on was build system stuff, and OBS was crashing when I tried to create a desktop view. This week we can look at a more interesting topic.

Going live now! Join me for the first pilot stream on YouTube: www.youtube.com/live/kViiI5B...

Trying something new this year: I'm going to stream spaCy and other open-source development and maintenance twice a week! I hope this will give the community a better inside look while things are in progress. I'll also answer your questions and chat about NLP, OSS and more.

Writing a new talk on "What the history of the web can teach us about the future of AI" 🔮 I've wanted to do this for so long because I think there are some great lessons and analogies here. I'll be presenting it for my keynote at PyCon+Web in Berlin on Jan 25 – hope to see you there!

Happy Birthday to me! 🥳 It feels like a good opportunity to look back at 2024, an eventful but also difficult year for me. So here's my personal review, including travel, talks, writing and various things I did and enjoyed. ines.io/blog/year-in...

New post: From PDFs to AI-ready structured data 📃✨ A deep dive into document processing, layout analysis and a modular workflow for building end-to-end document understanding and information extraction pipelines using PDFs, Word documents, scans and more. explosion.ai/blog/pdfs-nl...

Many of you have been asking about PDF table extraction and I finally got around to experimenting with it 👀 Here's tabular data converted with Docling + TableFormer, anchored within the document text and accessible as a pandas.DataFrame:

NEW: Prodigy now supports multi-page documents in a single view, without losing the efficiency of its card-based design ✨ It's especially cool for images and PDFs, and for building fully custom interfaces. And it was quite fun to build! More details, examples and docs here: prodi.gy/docs/custom-...

I've been experimenting with Docling + spaCy for PDFs and Word docs, and it's really promising so far 🔥 A big missing piece for end-to-end NLP, and it gives you clean & workable structured output. Will publish this soon and really want to work on data collection and annotation recipes next!

With Bluesky picking up steam, here's a quick intro: I'm Ines, co-founder of @explosion-ai.bsky.social, and I work on spacy.io and prodi.gy. I post about NLP, open source, dev tools, UX, data collection, LLMs, software & applied real-world AI beyond the hype. 👩‍💻 Blog: ines.io 💥 Work: explosion.ai

Prodigy in the cloud is now just one command away with our new Prodigy Modal plugin! From your local CLI: 💻 Deploy a web endpoint for instant annotator access 🔒 Protect it with SSO 💚 Launch model training on GPU with free $30/mo. compute on Modal explosion.ai/blog/modal-p...

Paris recap – merci for a great #dotAI2024 💛 www.linkedin.com/feed/update/...

Had a busy week filled with events and meeting lots of people, so here's another little recap of what I've been up to! 🥨⚡ www.linkedin.com/feed/update/...

Back from a great PyData Amsterdam and as always, here are some of my highlights ✨ www.linkedin.com/feed/update/...

🔥 New case study: How GitLab built scalable spaCy pipelines to process a year's worth of support tickets and create actionable insights to better support their community. explosion.ai/blog/gitlab-...

Ready for the upcoming conferences! 💥

First time attending a PhD defense and watched Rehan present his work on event coreference. Thanks for inviting us & congrats on the huge milestone! 👏 Especially cool to see a whole section on efficient model-in-the-loop annotation and his workflows using Prodigy ✨

When designing new AI products, we often imagine them as human-shaped replacements. But most innovations don't work this way. So when you're tasked with automating human work, ask yourself: Are you building a window-knocking machine or an alarm clock? ines.io/blog/window-...

Leaving Bengaluru tomorrow morning and still buzzing from such a great #DataHackSummit2024 ✨ Here are some of my personal highlights: www.linkedin.com/feed/update/...

Hello from Bengaluru, India 🌴 @honnibal.bsky.social and I are here for Data Hack Summit by Analytics Vidhya and I'll be speaking about applied NLP in the age of Generative AI in my keynote on Friday. Looking forward to meeting the local community – if you're attending, come and say hi!

I'm getting back to hands-on spaCy development. We raised money in 2021, but building a venture-backed company isn't quite like building a library. I hate how vaguely these things are usually discussed, so I wrote a long post: honnibal.dev/blog/back-to...

10 years ago today @honnibal.bsky.social pushed the first commit to spaCy 🎉 Since then, the library has evolved as the field moved forward, but also stayed true to its core mission: industrial-strength NLP and bringing structure to unstructured text.

⚗️ New blog post: A practical guide to human-in-the-loop distillation How to use state-of-the-art LLMs in real-world applications and distill their knowledge into smaller and faster components you can run and maintain in-house. explosion.ai/blog/human-i...

Here's my PyData London talk on human-in-the-loop distillation: ⚗️ LLMs → distilled task-specific models 🌎 real-world case studies 📉 avoid prototype plateau ✊ no need to compromise on best practices & privacy Slides: speakerdeck.com/inesmontani/... Video: www.youtube.com/watch?v=pgLL...