It takes a lot of training to conduct surveys, interviews, and other experiments with human subjects in a manner that is replicable, ethical, clear, doesn't accidentally introduce confounders. I very often see mistakes and lack of documentation in CV and ML papers using human annotators.
2 months ago