I had many thoughts about that NYT grade inflation op-ed from a couple days ago. Here are some of them. // It's Gonna Be Much Harder Than People Think to Change the Narratives About Testing and Grades edpolicyhub.substack.com/p/its-going-...

What can large-scale studies tell us about reproducibility? In our webinar on April 16, researchers from COS, I4R, and META-REP will discuss findings from three papers—one from the recently published SCORE effort—and insights on reproducibility, transparency, and credibility cos-io.zoom.us/webin...

New: "Effect of Artificial Intelligence on Learning: A Meta-Meta-Analysis" by Wagenmakers and colleagues revealing evidence for "severe publication bias and extreme between-study heterogeneity" in existing meta-analyses of the effects of AI on learning: osf.io/preprints/ps...

New blog post, inspired by the excellent recent qualitative paper by Makel and colleagues: On the reliability and reproducibility of qualitative research. I reflect on how I will incorporate realist ontologies in my own qualitative research. daniellakens.blogspot.com/2026/02/on-r...

New #RSOS paper: ‘Don’t hate the players, hate the game’: qualitative insights from education researchers on questionable and open research practices. Read more: doi.org/10.1098/rsos... @mattmakel.bsky.social @sarahcaroleo.bsky.social @jesse-fleming.bsky.social @bryancook.bsky.social

54 weeks later, this preprint is now published: royalsocietypublishing.org/rsos/article...

Need some tips for searching PsyArXiv? Wrote a blog post blog.psyarxiv.com/2026/01/27/h...

New Publication alert: Making a List Requires Checking it Twice: A Call for Empirical Evidence in Characteristics Lists [https://journals.sagepub.com/doi/10.1177/00169862251392934] #OpenAccess

Job opportunity — Junior Professorship in Psychological Metascience @zpid.bsky.social leibniz-psychology.onlyfy.jobs/job/10kku5n7 h/t @bethclarke.bsky.social

🏆 Individual: @simine.com, psychologist at @unimelb.bsky.social & editor-in-chief of Psychological Science, is recognized for pioneering methodological rigor, reproducibility & collaborative research, driving initiatives such as @improvingpsych.org & the journal Collabra @ucpress.bsky.social. (2/5)

Job posting alert! Open Science Specialist at the University of Calgary (in Canada!) #job #OpenScience careers.ucalgary.ca/jobs/1704502...

📅 Mark your calendars for SIPS 2026! 📅 The SIPS 2026 in-person conference will take place in Washington, DC, June 8-10, 2026. The conference will be at the George Mason University Arlington, Virginia campus (thanks to @natonge.bsky.social, our 2026 local host!)

Job opportunity: postdoc for the National Center for Research on Advanced Education: apply.interfolio.com/175953 PhD in education or a related field? Have strong quantitative and mixed methods methodological skills? Experience with advanced education, gifted education, or talent development? Apply!

If colleagues or students share a dataset with you and you make this face, consider sharing these resources with them. ☺️ datamgmtinedresearch.com 1. Organizing data (Ch. 3) 2. Naming variables and files (Ch. 9) 3. Documenting data (Ch. 8) 4. Cleaning data (Ch. 14)

Hi all! I'm on sabbatical this year and have bandwidth to zoom into lab meetings to talk about open science in cog psych and speech research and/or how to implement practices that reduce research errors! (www.carleton.edu/perception-l...). Email me if that sounds fun to you too!

JOB OPPORTUNITY: @pkp.sfu.ca is looking for a Managing Director! This is a rare opportunity to lead a highly impactful #scholcomm organization. Role works closely with me (Scientific Director) to provide strategic and operational leadership. Help us spread the word! pkp.sfu.ca/2025/09/17/h...

If my experience in academia has taught me anything it's that logging in to my same account on my same computer requires 2FA *every time* lest someone hack in and see my course schedule, but the forgery-proof method for approving things is to paste in a JPG of one's signature into a Word document.

@elisabethbik.bsky.social if you need any recruits, she looks like she's got some serious skills www.instagram.com/reel/DHtAcJ-...

Children vary! We see this variation everywhere - within households, classrooms, and schools, but also in cross-cultural comparisons. We even see substantial variation within individual children from day to day. How can we measure and understand this variability? That's the goal of LEVANTE.

Our position paper is now out: "Learning Variability Network Exchange (LEVANTE): A Global Framework for Measuring Children's Learning Variability Through Collaborative Data Sharing". srcd.onlinelibrary.wiley.com/doi/10.1111/... (preprint: osf.io/preprints/ps...) What is LEVANTE? 🧵

Promising way to crowdsource data on academic journal decision timelines. I'm uploading my data. You can too!

The call for proposals is now up for our long awaited #AIMOS2025 conference in Sydney this November: aimos-inc.github.io/aimos.confer...

This is incredible. No. Wait. It is amazing.

oof

🏆 achievement unlocked 🏆 initial submission: minor revision resubmission: major revision I don't believe I have ever accomplished this feat before.

As many work to finish up #AERA26 submissions, @agustingarcia.bsky.social just told me that #AERA27 is going to be in Toronto, Canada! 🇨🇦

Yep, a good point. I either know what "Author (Year)" refers to, breaking blindness, or I don't, in which case I can't evaluate that part of the manuscript.

I wrote a popular press article about Replication Research! First time writing like this, but it was pretty fun. theconversation.com/research-rep...

I really appreciate being given the opportunity to contribute to this Nature article on best practices for versioning shared data! 🫱📂🫲 www.nature.com/articles/d41...

Getting a "Decision on manuscript" email, only to discover it is about something I reviewed and not my manuscript.

Using time series graphs to make causal claims be like

I know there's a lot going on, but today I am stuck marveling at the recommendation of no punctuation after the page number parenthetical at the end of block quotations in APA style. apastyle.apa.org/style-gramma...

Being a social scientist means holding two truths at once: 1. This is all deeply complicated 2. I have to submit something by Tuesday

More details on stats, assessments and research activities that @usedgov.bsky.social has restarted. (click within the story to see the full table) hechingerreport.org/proof-points...

I once silently stood next to Michael Fassbender at the airport while we saw several people who ordered after us get their food before we did. We made eye contact after the fourth person got their food. I did not have the courage to look back when my order came up.

Thrilled to see a news piece by @science.org on my recent paper. By analyzing p-values across >240k papers, the study suggests that the rate of statistically questionable findings in psychology has declined since the replication crisis began www.science.org/content/arti...

The impact of formative assessment on pupil academic achievement www.sciencedirect.com/science/arti... "Pupils in the formative assessment group did not outperform the control group. No significant differential effects were shown across pupil performance levels."

Please spread the word! Psych Science is recruiting volunteers to help conduct computational reproducibility checks. If you have experience writing reproducible analysis scripts in psychology, and want to join the team, please apply! www.psychologicalscience.org/publications...

I am asked this question a lot: What do you think the biggest data management issues are for education researchers? And from my experience (talking with researchers, working with researchers, and my own personal experiences), I think people struggle the most with the following things (a thread):

The jingle-jangle problem is getting out of control

Sanjay says we are in a Naming Crisis and is calling for a revolution in how we label things

snow not melting on the backs of Canadian geese

Let's measure beyond proficiency: Colleagues, please consider signing on to our SEDA letter supporting planned improvements to EDFacts data collection. Letter: docs.google.com/document/d/1... Sign-on form: docs.google.com/forms/d/e/1F...

I have a handy list of book recommendations on the science of learning! Retrievalpractice.org/books #edusky

Plot Twist: we had 2 independent qualitative analysis teams analyze the data. We wanted to see if they’d come up with similar findings when trying to answer the same research questions with the same data.

We think the 2 teams reported themes that were generally similar or overlapping, suggesting a robustness of the findings. We believe this suggests that independent qualitative analyst teams (with similar positionality) can use unique analytic paths and reach largely similar destinations

This is now published! #OpenAccess #OpenScience Reflections on Progress, Lessons Learned, & Suggestions for Continued Improvement journals.sagepub.com/doi/10.1177/... @drandreahoward.bsky.social @jnfrltackett.bsky.social @heatherurry.bsky.social @oliviajkirtley.bsky.social