Very much looking forward to presenting at this tomorrow. I will be making my usual pitch that datasets are the foundational infrastructure for cultural heritage to benefit from and create useful AI models and tools. Be warned, I did fire up the meme generator for my slides...

Over the last 24 hours, I have finetuned three Qwen3-VL models (2B, 4B, and 8B) on the CATmuS dataset on @hf.co . The first version of the models are now available on the Small Models for GLAM organization with @danielvanstrien.bsky.social (Links below) Working on improving them further.

DeepSeek-OCR just got vLLM support 🚀 Currently processing @natlibscot.bsky.social's 27,915-page handbook collection with one command. Processing at ~350 images/sec on A100 Using @hf.co Jobs + uv - zero setup batch OCR! Will share final time + cost when done!

🤗 Sentence Transformers is joining @hf.co! 🤗 This formalizes the existing maintenance structure, as I've personally led the project for the past two years on behalf of Hugging Face. I'm super excited about the transfer! Details in 🧵

OCR is one of AI's oldest challenges (first systems: early 1900s!) Modern vision-language models have transformed what's possible: handwriting, 100+ languages, math formulas, tables, signature extraction... New @hf.co guide on OCR huggingface.co/blog/ocr-ope...

Small models work great for GLAM but there aren't enough examples! With @wjbmattingly.bsky.social I'm launching small-models-for-glam on @hf.co to create/curate models that run on modest hardware and address GLAM use cases. Follow the org to keep up-to-date! huggingface.co/small-models...

Small models work great for GLAM but there aren't enough examples! With @wjbmattingly.bsky.social I'm launching small-models-for-glam on @hf.co to create/curate models that run on modest hardware and address GLAM use cases. Follow the org to keep up-to-date! huggingface.co/small-models...

Very nice work! IMO, this is the kind of topic that more libraries/GLAM/DH people should be working on. The training of these models is *relatively* simple. As always, the missing ingredient is readily accessible data.

It's been brewing for months: @inriaparisnlp.bsky.social releases CoMMA (Corpus of Multilingual Medieval Archives) ! 📚 2.5bn tokens of mostly Latin and French texts 🕰️ 800→1600 CE 📜 23k manuscripts 🖥️ 18k on the reading interface: comma.inria.fr 🔍 Paper: inria.hal.science/hal-05299220v1 (1/🧵)

Another week, another VLM-based OCR model! Nanonets just released OCR2 - a 3B parameter vision-language model for document OCR 📄 You can run it with one command on @hf.co Jobs (no local GPU needed)

Another week, another VLM-based OCR model! Nanonets just released OCR2 - a 3B parameter vision-language model for document OCR 📄 You can run it with one command on @hf.co Jobs (no local GPU needed)

DoTS.ocr just got native vLLM support! I built a UV script so you can run SOTA multilingual OCR in seconds with zero setup using @hf.co Jobs Tested on 1800s library cards - works great ✨

DoTS.ocr just got native vLLM support! I built a UV script so you can run SOTA multilingual OCR in seconds with zero setup using @hf.co Jobs Tested on 1800s library cards - works great ✨

Card catalogues aren't just a relic of the past - many institutions still rely on them because full migration is too expensive. VLMs could help change that. I uploaded two new @hf.co datasets (~470K cards) for training/evaluating models to extract structured metadata from catalogue cards.

We’re hiring for two machine learning roles. A chance to do cutting edge things with ML to make this place a lot more personalized. jobs.gem.com/bluesky/am9i...

New @hf.co BigLAM dataset: 9,363 OA books with page images + rich MARC metadata for evaluating (and training) VLMs on metadata extraction. Libraries are starting to explore AI-assisted cataloguing, but we lack public evaluation data. Hoping this helps fill that gap. huggingface.co/datasets/big...

Blogged: Fine-tuning a VLM for art history in hours, not weeks iconclass-vlm generates museum catalog codes (fun fact: "71H7131" = "Bathsheba with David's letter"!) @hf.co TRL + Jobs = magic ✨ Guide here: danielvanstrien.xyz/posts/2025/i...

Blogged: Fine-tuning a VLM for art history in hours, not weeks iconclass-vlm generates museum catalog codes (fun fact: "71H7131" = "Bathsheba with David's letter"!) @hf.co TRL + Jobs = magic ✨ Guide here: danielvanstrien.xyz/posts/2025/i...

I fine-tuned a smol VLM to generate specialized art history metadata! iconclass-vlm: Qwen2.5-VL-3B trained using SFT to generate ICONCLASS codes (think Dewey Decimal for art!) Trained with @hf.co TRL + Jobs - single UV script, no GPU needed! Blog soon!

What if OCR models could show you their thought process? NuMarkdown-8B-Thinking from NuMind (YC S22) doesn't just extract text - it reasons through documents first. Could be pretty valuable for weird historical documents? Example here: davanstrien-ocr-time-capsule.static.hf.space/index.html?d...

You can now generate synthetic data using OpenAIs GPT OSS models on @hf.co Jobs! One command, no setup: hf jobs uv run --flavor l4x4 [script-url] \ --input-dataset your/dataset \ --output-dataset your/output Works on L4 GPUs ⚡ huggingface.co/datasets/uv-...

My latest post on @carpentries.carpentries.org blog is a call to action for the community to engage in curriculum development for workshops about genAI. How can we help our target audience make more informed choices about when and how to use it? carpentries.org/blog/2025/08...

I’m continuing my experiments with VLM-based OCR… How well do these models handle Victorian theatre playbills from @bldigischol.bsky.social? RolmOCR vs traditional OCR on tricky playbills (ornate fonts, faded ink, DRAMATIC ALL CAPS!) @hf.co Demo: huggingface.co/spaces/davan...

Many VLM-based OCR models have been released recently. Are they useful for libraries and archives? I made a quick Space to compare VLM OCR with "traditional" OCR using 11k Scottish exam papers from @natlibscot.bsky.social huggingface.co/spaces/davanstrien/ocr-time-capsule

Many VLM-based OCR models have been released recently. Are they useful for libraries and archives? I made a quick Space to compare VLM OCR with "traditional" OCR using 11k Scottish exam papers from @natlibscot.bsky.social huggingface.co/spaces/davanstrien/ocr-time-capsule

qwen3-30b-a3b-thinking-2507 no surprise, but today Qwen launched the thinking version of its laptop-sized MoE tasty, as usual. huggingface.co/Qwen/Qwen3-3...

yesssss! a small update to Qwen3-30B-A3B this has been one of my favorite local models, and now we get an even better version! better instruction following, tool use & coding. Nice small MoE! huggingface.co/Qwen/Qwen3-3...

HF Jobs just launched! 🚀 One command VLM based OCR with uv Scripts: hf jobs uv run [script] ufo-images ufo-text Classified UFO docs → clean markdown. Zero setup! Try it → huggingface.co/datasets/uv-...

Working to port VLaMy to an entirely free mode where you can just cache all your data in the browser for a project. Slowly adding all the features from the full version to this user-free version. Available now on @hf.co @danielvanstrien.bsky.social Link: huggingface.co/spaces/wjbma...

We've moved the first 20PB from Git LFS to Xet on @hf.co without any interruptions. Now we're migrating the rest of the Hub. We got this far by focusing on the community first. Here's a deep dive on the infra making this possible and what's next: huggingface.co/blog/migrati...

465 people. 122 languages. 58,185 annotations! FineWeb-C v1 is complete! Communities worldwide have built their own educational quality datasets, proving that we don't need to wait for big tech to support languages. Huge thanks to all who contributed! huggingface.co/blog/davanst...

465 people. 122 languages. 58,185 annotations! FineWeb-C v1 is complete! Communities worldwide have built their own educational quality datasets, proving that we don't need to wait for big tech to support languages. Huge thanks to all who contributed! huggingface.co/blog/davanst...

ShotBench: Cinematic Understanding Benchmark - 3,572 expert QA pairs - 3,049 images + 464 videos - 200+ Oscar-nominated films - 8 cinematography dimensions tested huggingface.co/datasets/Vch...

Added olmOCR to the OCR Time Machine! @ai2.bsky.social's olmOCR (one of the OG VLM-based OCR models) still performs v well. My takeaway from testing: there's no single "best" VLM for historical docs currently (maybe with a bit of fine-tuning, there could be 😉) huggingface.co/spaces/davan...

Everyone’s dropping VLM-based OCR models lately… But are they actually better than traditional OCR engines, which output XML for historical docs? I built OCR Time Machine to test it! 📄 Upload image + ALTO/PAGE XML ⚖️ Compare outputs side by side 🔗 huggingface.co/spaces/davan...

Everyone’s dropping VLM-based OCR models lately… But are they actually better than traditional OCR engines, which output XML for historical docs? I built OCR Time Machine to test it! 📄 Upload image + ALTO/PAGE XML ⚖️ Compare outputs side by side 🔗 huggingface.co/spaces/davan...

the semantic search for HuggingFace datasets mcp that @danielvanstrien.bsky.social made is really fun -- i just tried it in cursor's ai side bar. repo/info: github.com/davanstrien/...

The @europeana.bsky.social community has launched a “Culture for AI” assembly. It’s asking cultural heritage folks: how should we critically engage with AI? Can you guess how I answered the question below?!

“AI Scraping Bots Are Breaking Open Libraries, Archives, and Museums” – interesting piece via @404media.co Not a perfect fix, but making ML-ready datasets from collections can help. If you want help getting your data on @hf.co, I'd be happy to help.

As usual, I'm allowing myself a few memes for this presentation. The serious point of this one is that the barrier to doing data work has gotten much lower in the past year or two. You don't need to be an expert in XML to do useful stuff with XML data anymore.

Institutional Books: Massive Historical Text Corpus - 983K books, 242B tokens, 386M pages - 19th-20th century texts in 254 languages - Refined OCR with quality scores & metadata - Noncommercial early-access release huggingface.co/datasets/ins...

huggingface.co/Belykh-Lab I’m trying to start a trend in the applied math community of releasing data sets on @hf.co

How to Make Gallery, Library, Archive & Museum Collections Ready for AI 📚✨ Join me this Tuesday – I'm hosting a hands-on session for the #ai4lam community, where I'll show cultural institutions how to share data on Hub. 🗓️ June 17, 16:00 UK 📍 Details: docs.google.com/document/d/1...

Today we released Institutional Books 1.0, a 242B token dataset from Harvard Library's collections, refined for accuracy and usability. 🧵

One-Shot-CFT: Critique-Based Reasoning Dataset - Train on critiques from just 1 problem per task - 6K examples unlock +15% math, +16% logic gains - 5 GPU hours beats weeks of reinforcement learning - Scales from 1.5B to 14B parameters huggingface.co/datasets/TIG...

Inspired by @hf.co's official MCP server, I built my own to expose my semantic search API for the HF ecosystem! Features AI-powered search, parameter analysis via safetensors, and tools to find similar models/datasets. Try: "Find non maths reasoning datasets from 2025"!

ether0-benchmark: Where Every AI Answer is a Molecule - 325 chemistry problems testing reaction prediction, synthesis, properties - Unique design: all solutions are SMILES structures - Balanced ~25 questions per task type - Benchmarks frontier models on chemistry huggingface.co/datasets/fut...

OpenThoughts3-1.2M: State-of-the-Art Reasoning Dataset - 1.2M examples: 850k math, 250k code, 100k science - 16x annotations per question using QwQ-32B - Powers OpenThinker3-7B beating all open-data peers - Systematic curation from 1000+ ablations huggingface.co/datasets/ope...

AutoGKB: Benchmark for Pharmacogenomic Extraction Models - Evaluates AI's ability to extract variant-drug associations from literature - 4,516 expert annotations from 1,431 papers - Tests the extraction of efficacy, toxicity, dosage, and metabolism relationships huggingface.co/datasets/shl...