Longitudinal studies have always been a pain to run online. Every wave a separate study, allowlists by hand, attrition tracked in spreadsheets. You can now do it all in one organized flow on Prolific. #AcademicSky #BehavioralScience #Research

If you're at the @psychscience.bsky.social (APS) Annual Convention and haven't stopped by the Prolific booth yet, we'd love to hear from you. Head over to booth #5 in the exhibit hall to find out how we can support your behavioral research. #APS26BCN #AcademicSky #PsychSciSky #Research

Views from #APS26BCN

Dr @andrewgordon.bsky.social presented "Not All Samples Are Created Equal" at #APS26BCN this week - the most comprehensive comparison of data quality across online sample providers to date. Critical work for researchers making platform decisions. @psychscience.bsky.social #AcademicSky #Research

Fraud in online samples is at an all-time high, and platform choice matters. This afternoon at AAPOR, @andrewgordon.bsky.social presents "Not All Samples Are Created Equal," the largest benchmarking study of data quality across sample providers. 🕓 4:00 PM 📍 Beaudry B, Lobby Floor #AAPOR #Research

Be sure to say hello to the Prolific team at booth #105 if you're at AAPOR this week! We're available throughout the conference to show you how we uphold online data quality, support longitudinal research, and tackle the growing challenge of survey fraud. @aapor.bsky.social #ResearchIntegrity

Can AI replace human respondents? At AAPOR, @andrewgordon.bsky.social presented a benchmark of synthetic survey data against real human polling across multiple question domains, subgroups, and levels of specification. More from Andrew this Friday. @aapor.bsky.social #AcademicSky #Research

Prolific is coming to the AAPOR Conference in LA with a packed schedule. Staff Researcher @andrewgordon.bsky.social will be presenting a workshop and three key projects on the central themes of research trust and data quality 🧵 #AAPOR #AcademicSky #ResearchIntegrity

When tested against seven key AI agent detection methods, Prolific's bot authenticity checks were the only method to achieve 100% accuracy with zero false positives. Read the full methodology from @andrewgordon.bsky.social: www.prolific.com/resources/au... | #AcademicSky #ResearchIntegrity

AI chatbots aren’t yet completing online research surveys widely, according to a new study. My latest for @retractionwatch.com: retractionwatch.com/2026/04/30/a... @joinprolific.bsky.social, @davmicrot.bsky.social, @justinsulik.bsky.social, @seanjwestwood.bsky.social

Five days in Rio saw a lot of great research, scientific conversations, and connections at ICLR 🧪 Here's an #ICLR2026 highlights thread. @iclr-conf.bsky.social | #MLSky #AcademicSky #ArtificialIntelligence #Research

Tomorrow our sciences team are presenting "The Missing Red Line" at the #ICLR2026 ICBINB workshop which focuses on where LLMs need to improve and what rigorous failure audits reveal. Our researchers tested 8 frontier models in scenarios where commercial objectives conflict with user safety. 1/4 🧪

On our way to Sugarloaf Mountain for dinner with the AI research community ⛰️ #ICLR2026

Nice to see a packed room for our #ICLR2026 expo talk! Enzo, VP of Data & AI, and John, Sr. AI Research Engineer, shared lessons learned from building evaluation infrastructure for frontier AI and research. They talked about what works and surfaced the failures that matter. #ICLR #MLSky #Research

Come to our expo! Enzo and John from our sciences team will be in room 202C from 12:45 PM to talk about why frontier AI teams are outgrowing their evaluations and what it takes to build evaluation infrastructure that keeps pace. #ICLR2026 #ICLR #MLSky #ArtificialIntelligence

Today at #ICLR2026, our Sr. AI Research Engineer John Burden presents work from his time at CFI @cam.ac.uk on formalizing human-in-the-loop setups through computability theory. Legal status and safety implications vary considerably depending on how human oversight is structured. #MLSky #AcademicSky

We'll be at booth #206 in Pavilion 4 all day for those who want to stop by for a demo. Prolific gives AI research teams access to 200K+ verified, demographically diverse participants via platform or API, helping manage your pipeline from study design to data delivery. #ICLR2026 #ICLR #MLSky #AI

👋 Onto another day at @iclr-conf.bsky.social. Come say hello to our team members at booth #206! Our Sr. AI Research Engineer John Burden (prev. CFI at Cambridge) is also presenting his co-authored paper on formalizing human-in-the-loop setups today @ 3:15 PM. Poster session 4, Pavilion 4. #ICLR2026

🗣️ Our Staff Research Engineer Nora at ICLR on what's broken in AI evaluation. Current evals involve too little human feedback and overfocus on technical capabilities. Human preference cannot be faithfully simulated with synthetic data despite having its place. #ICLR2026 #ICLR #MLSky #Research

Congratulations to Philippe Laban, Jennifer Neville, and collaborators on their Best Paper Award at ICLR 2026 for “LLMs Get Lost In Multi-Turn Conversation.” msft.it/6017vE12f

📄 Today our researchers are presenting HUMAINE at #ICLR2026. HUMAINE is a living LLM evaluation benchmark built on demographically stratified human preference data, post-stratified to census data across the US and UK. Come along to the poster - P4-#4008, 3:15 PM. #ICLR #Research #MLSky #AcademicSky

Come find us at booth #206 throughout @iclr-conf.bsky.social to see what Prolific can do for your AI evaluation infrastructure. We also have a raffle running. Share your hot take on AI evaluation with us and we'll throw it out to our participants. You could win a Mac mini. 🖥️ #ICLR2026 #ICLR #MLSky

Already a packed booth this morning at #ICLR! Prolific sources 200K+ diverse participants to power your evaluation infrastructure. Check us out and share your hot takes - Booth #206, Pavilion 4. #ICLR2026 #MLSky #Research #ArtificialIntelligence @iclr-conf.bsky.social

👋 We're all set up here at @iclr-conf.bsky.social. Stop by booth #206 to talk end-to-end human evaluation infrastructure for frontier AI. #ICLR #ICLR2026 #MLSky

If you're heading to #ICLR2026, here is where to find us 📅 Two accepted research papers on the poster floor, expo talk, and an ICBINB workshop feature. Booth #206 is also open throughout the main conference. Book time with the team: www.prolific.com/iclr | #MLSky #AcademicSky

🧵 Aggregate leaderboards conceal systematic preference disagreement across populations. HUMAINE data shows a model's P(best) drops from 98.8% to 41.9% across evaluation dimensions. The contender changes every time you change the metric. 1/6 #MLSky #AcademicSky #Research #ICLR2026

Our researchers have had two papers accepted to ICLR 2026! Two poster sessions at the conference, plus presenting at the ICBINB workshop across the week in Rio. Thread below for information. 🧵 @iclr-conf.bsky.social #ICLR2026 #MLSky #AIResearch 🧪

Job ad: I'm hiring for a Research scientist to join my team at @joinprolific.bsky.social If you've ever wondered who's working on the hard questions in online research — data quality, sampling methodology, the effect of AI on how research gets done — this is that job. [1/4]

New pre-print: "AI Agent Prevalence and Data Quality Across Multiple Online Sample Providers,” led by Prolific's research sciences team and researchers from @msftresearch.bsky.social, Oklahoma State University, @lmu.de, Queen's University, and The Research Heads. 🧵 #AcademicSky #Research

New preprint out today (osf.io/preprints/ps...). We tested whether AI agents are actually infiltrating online surveys. Spoiler alert: they aren't Thread 🧵 [1/9]

Starting today, if an AI agent is detected in your Prolific study, we’ll give you twice the cost of that non-human participant back. You pay for human data. You expect human data. We’re backing that with our 100% Human Guarantee. Learn more: www.prolific.com/100-human-gu... #AcademicSky #Research

As of today, if an AI agent is detected in your Prolific study, you'll get twice the cost of that participant back. We’re calling this our 100% Human Guarantee. Years of investing into @joinprolific.bsky.social's system has made us confident in data integrity. www.prolific.com/100-human-gu...

New working paper on online research data quality, led by @univie.ac.at, reveals that pass rates on quality checks vary wildly by source. Pretty interesting. Prolific: 90% | Lab: 80% | Bilendi: 73% | Moblab: 55% | MTurk: 9% | AI agents: 0% github.com/survey-data-... CC @jyusof.bsky.social

We tested the most accurate methods for identifying agentic AI in online research. Our research team compared attention checks, consistency checks, cognitive traps, reCAPTCHA, and behavioral tracking against our new bot authenticity checks. 🧵 #AcademicSky #Research

Independent research by Celebi, Exley, Harrs, Kivimaki, @martaserragarcia.bsky.social & @jyusof.bsky.social (2026) compares data quality across online participants, AI agents, & human subjects in the lab, with interesting platform variation. (1/4) 🔗 www.ifo.de/en/cesifo/pu... #AcademicSky #EconSky

Our “How to bot-proof your online research” webinar series continues tomorrow, March 19th, with Dr Simon Jones and Rath Bala showing you how to verify participants on Prolific. 👉 resources.prolific.com/how-to-bot-p... Catch us live from 4:30 PM GMT / 12:30 PM EDT / 9:30 AM PDT. #AcademicSky

We recently warned of bots in online behavioral research. @achetverikov.bsky.social showed there is no evidence for that in our @joinprolific.bsky.social data - but that doesn't mean we're safe. Agentic AI can do behavioral tasks through prompting alone. Reply & videos: osf.io/3cztr/overview

When you collect data online, are the results from humans or AI? In a project led by Booth PhD student Grace Zhang, we estimate the prevalence of AI agents on commonly used survey platforms: osf.io/preprints/ps... 🧵

Google DeepMind's Crystal Qian raises that while most RLHF evaluation pipelines remain static and single-user, models are increasingly deployed in dynamic, multi-party settings. She underlines human-centric augmentation evaluations. Discussion → youtu.be/Mk9EFnXfBxA | #AcademicSky #MLSky #Research

I've developed a psychological countermeasure for AI voice deception… and it's surprisingly simple! 🗣️ Thread below 🧵 doi.org/10.1093/cybs...

Come find us at #SPSP2026 Chicago today 👋 Speak to the team at booth #19 and discover how to use Prolific’s bot detection tools in your academic research. $50 credits offer available for new users! @spspnews.bsky.social | #AcademicSky #SocialPsyc #Research

🔔 “How real is the LLM threat to online research in academia?” will be live today. Experts from Microsoft Research, MIT / Stanford, Max Planck Institute, and Prolific discuss the threat of agentic AI to online research, and how to protect against it. Link to join live below. #AcademicSky #Research

We ran a controlled study of 125 verified humans vs 5 AI agents. Can agents reliably be detected? Here's what we found: www.prolific.com/resources/au...

On Thursday I'll be taking part in a roundtable “How real is the LLM threat to online research in academia?” for @joinprolific.bsky.social alongside @davmicrot.bsky.social, Michael Nicholas Stagnaro, and Raluca Rilla. Sign up here: lnkd.in/em8-MpjN

📢 Webinar series: How to bot-proof your online research In the first of our three-part series, experts from @msftresearch.bsky.social, MIT / Stanford, and @mpib-berlin.bsky.social unpack the threat of LLM-powered bots and AI agents to research integrity in academia. #AcademicSky #Research

See you in Chicago! If you're heading to the @spspnews.bsky.social Annual Convention from Feb 26-28th, stop by booth #19 to find out how you can use Prolific’s new bot detection tool in your next study. 🎁 $50 credits offer available for first-timers. #AcademicSky #SocialPsyc #Research

On the first episode of The Frontier, we spoke to Crystal Qian, Senior Research Scientist at Google DeepMind about Deliberate Lab: an open-source platform for behavioral human-AI social experiments. 🧪 Developed by the PAIR (People + AI Research) team. #MLSky #AcademicSky #ArtificialIntelligence

AI agents are becoming a serious threat to research data quality. Today we’re rolling out Bot authenticity checks on @joinprolific.bsky.social, detecting agentic AI with 100% accuracy in testing. Comes with a native Qualtrics integration! More info: www.prolific.com/resources/in...

Introducing bot authenticity checks that detect agentic AI and bots in academic research. 100% accuracy in testing. Our tool flags automated browser scripts or non-human behavior within your Qualtrics studies, so you can collect data with high confidence that it's human. #AcademicSky #Research

What drives retention in online longitudinal research? We conducted an experiment (N=1,798) on @joinprolific.bsky.social, orthogonally manipulating payment rate (£6–£9/hr + bonus) and session interval (1, 2, or 4 weeks) across five sessions. The findings challenge some common assumptions 👇