If colleagues or students share a dataset with you and you make this face, consider sharing these resources with them. ☺️ datamgmtinedresearch.com 1. Organizing data (Ch. 3) 2. Naming variables and files (Ch. 9) 3. Documenting data (Ch. 8) 4. Cleaning data (Ch. 14)

Hi all! I'm on sabbatical this year and have bandwidth to zoom into lab meetings to talk about open science in cog psych and speech research and/or how to implement practices that reduce research errors! (www.carleton.edu/perception-l...). Email me if that sounds fun to you too!

JOB OPPORTUNITY: @pkp.sfu.ca is looking for a Managing Director! This is a rare opportunity to lead a highly impactful #scholcomm organization. Role works closely with me (Scientific Director) to provide strategic and operational leadership. Help us spread the word! pkp.sfu.ca/2025/09/17/h...

If my experience in academia has taught me anything it's that logging in to my same account on my same computer requires 2FA *every time* lest someone hack in and see my course schedule, but the forgery-proof method for approving things is to paste in a JPG of one's signature into a Word document.

You have been thinking about Canada. So just do it. careers.ucalgary.ca/jobs/1661564...

@elisabethbik.bsky.social if you need any recruits, she looks like she's got some serious skills www.instagram.com/reel/DHtAcJ-...

Children vary! We see this variation everywhere - within households, classrooms, and schools, but also in cross-cultural comparisons. We even see substantial variation within individual children from day to day. How can we measure and understand this variability? That's the goal of LEVANTE.

Our position paper is now out: "Learning Variability Network Exchange (LEVANTE): A Global Framework for Measuring Children's Learning Variability Through Collaborative Data Sharing". srcd.onlinelibrary.wiley.com/doi/10.1111/... (preprint: osf.io/preprints/ps...) What is LEVANTE? 🧵

Promising way to crowdsource data on academic journal decision timelines. I'm uploading my data. You can too!

The call for proposals is now up for our long awaited #AIMOS2025 conference in Sydney this November: aimos-inc.github.io/aimos.confer...

This is incredible. No. Wait. It is amazing.

oof

🏆 achievement unlocked 🏆 initial submission: minor revision resubmission: major revision I don't believe I have ever accomplished this feat before.

As many work to finish up #AERA26 submissions, @agustingarcia.bsky.social just told me that #AERA27 is going to be in Toronto, Canada! 🇨🇦

Yep, a good point. I either know what "Author (Year)" refers to, breaking blindness, or I don't, in which case I can't evaluate that part of the manuscript.

I wrote a popular press article about Replication Research! First time writing like this, but it was pretty fun. theconversation.com/research-rep...

I really appreciate being given the opportunity to contribute to this Nature article on best practices for versioning shared data! 🫱📂🫲 www.nature.com/articles/d41...

Getting a "Decision on manuscript" email, only to discover it is about something I reviewed and not my manuscript.

Using time series graphs to make causal claims be like

I know there's a lot going on, but today I am stuck marveling at the recommendation of no punctuation after the page number parenthetical at the end of block quotations in APA style. apastyle.apa.org/style-gramma...

Being a social scientist means holding two truths at once: 1. This is all deeply complicated 2. I have to submit something by Tuesday

More details on stats, assessments and research activities that @usedgov.bsky.social has restarted. (click within the story to see the full table) hechingerreport.org/proof-points...

I once silently stood next to Michael Fassbender at the airport while we saw several people who ordered after us get their food before we did. We made eye contact after the fourth person got their food. I did not have the courage to look back when my order came up.

Thrilled to see a news piece by @science.org on my recent paper. By analyzing p-values across >240k papers, the study suggests that the rate of statistically questionable findings in psychology has declined since the replication crisis began www.science.org/content/arti...

The impact of formative assessment on pupil academic achievement www.sciencedirect.com/science/arti... "Pupils in the formative assessment group did not outperform the control group. No significant differential effects were shown across pupil performance levels."

Please spread the word! Psych Science is recruiting volunteers to help conduct computational reproducibility checks. If you have experience writing reproducible analysis scripts in psychology, and want to join the team, please apply! www.psychologicalscience.org/publications...

I am asked this question a lot: What do you think the biggest data management issues are for education researchers? And from my experience (talking with researchers, working with researchers, and my own personal experiences), I think people struggle the most with the following things (a thread):

The jingle-jangle problem is getting out of control

Sanjay says we are in a Naming Crisis and is calling for a revolution in how we label things

snow not melting on the backs of Canadian geese

Let's measure beyond proficiency: Colleagues, please consider signing on to our SEDA letter supporting planned improvements to EDFacts data collection. Letter: docs.google.com/document/d/1... Sign-on form: docs.google.com/forms/d/e/1F...

I have a handy list of book recommendations on the science of learning! Retrievalpractice.org/books #edusky

Plot Twist: we had 2 independent qualitative analysis teams analyze the data. We wanted to see if they’d come up with similar findings when trying to answer the same research questions with the same data.

We think the 2 teams reported themes that were generally similar or overlapping, suggesting a robustness of the findings. We believe this suggests that independent qualitative analyst teams (with similar positionality) can use unique analytic paths and reach largely similar destinations

This is now published! #OpenAccess #OpenScience Reflections on Progress, Lessons Learned, & Suggestions for Continued Improvement journals.sagepub.com/doi/10.1177/... @drandreahoward.bsky.social @jnfrltackett.bsky.social @heatherurry.bsky.social @oliviajkirtley.bsky.social

“Why do you think this practice should or shouldn’t be used?” We asked education researchers about #QuestionableResearchPractices (e.g., selectively reporting results) and about #OpenScience practices like preregistration, open data, and replication. #Preprint osf.io/preprints/ed...

"Indeed, Hill and Stein surveyed 877 structural biologists and found that they significantly overestimated both the likelihood and costs of getting scooped. Respondents guessed that they had a 27 percent chance of getting scooped by a competitor, when the actual probability was only 3 percent."

SAT optional policies have no effect on diversity, gender ratios, student quality, or even application numbers (beyond a brief but fleeting increase.) It turns out people have largely been arguing over…nothing. www.sciencedirect.com/science/arti...

New #scholarlypublishing book! PRC, Publish-Review-Curate, can replace the cloistered traditional journal management system (Cathedral) way. By breaking up the monolithic scholarly communication Cathedrals, not only do we reduce gatekeeping and speed dissemination, www.linkedin.com/posts/adamhy...

“Why do you think this practice should or shouldn’t be used?” We asked education researchers about #QuestionableResearchPractices (e.g., selectively reporting results) and about #OpenScience practices like preregistration, open data, and replication. #Preprint osf.io/preprints/ed...

Qualitative Analysis of Open-ended Responses from Education Researchers on Questionable and Open Research Practices: http://osf.io/n2gby/

I think about this often www-cs-faculty.stanford.edu/~knuth/email...

Reviewers often demand an overly formulaic idea of theoretical coherence. Outlets for exploratory research provide only a partial remedy. Much can be learned by carrying out careful confirmatory tests of a phenomenon without claiming to know its relationship with past or future theories.

(Successful) creators understand something that I wish more (academic) scientists did: trust is earned (repeatedly); it's not just given away. You have to show people why they should trust you rather than assume they'll just give you their trust because you work at a fancy place.

Great thread explaining a phenomenon that likely generalizes widely

PS: an effect size of 0.2 SD would be quite large for student achievement outcomes measured by standardized tests, when a study is designed to support causal inferences about the program / practice / policy in question.

The best first sentence of a grant application I've read was (paraphrasing), "Tool X is widely used to do task Y; we will make it accessible to people living with condition Z (13% of the population) so that it is more equitable and more widely used". Let's unpack why, because there's a lesson. 🧵

Wonderful academic writing advice that I am adding to the syllabus for my methods class next semester