how not to run a research study

[nonelvis]

I know several people on my flist are scientists, researchers, or generally interested in science research, and since a few of you may not have heard yet about the fan fiction survey, consider this an object lesson in Doing It Wrong. Seriously, how do you get to the point of having a PhD in a scientific field and not realize that you can't change the questions in the middle of the survey without affecting your data? (And that's the least of the problems with this little project – it's just one of the most obvious points of Science Fail.)

The survey is finally down while the researchers "digest all this great feedback." Personally, I agree with the anonmeme theory that this is subtle code for "BRB, BU IRB SMACKING OUR ASSES, AND NOT IN THE GOOD WAY YOU FOLKS WRITE ABOUT."

Comments

[papilio-luna.livejournal.com]

And this, children, is why we pilot test our research instruments before loosing them on the world.

[elliptic-eye.livejournal.com]

I can't decide whether this one (http://ogi-ogas.livejournal.com/3544.html?thread=112600#t112600) is my favorite, or the subtle WTFery of this one (http://ogi-ogas.livejournal.com/3544.html?view=267224#t267224), or the not-so-subtle weirdness of this (http://ogi-ogas.livejournal.com/3544.html?thread=120024#t120024).

(The cluelessness here (http://ogi-ogas.livejournal.com/681.html?thread=3241#t3241) is rather impressive, as well. LURK MOAR, BB. 4 SRS.)

[ionlylurkhere.livejournal.com]

I'm convinced the whole exercise was only ever looking for anecdotal evidence for their non-peer-reviewed book, with lots of strange leading questions that seem to be designed to get people to tell stories about their involvement with fandom that can be used to point up all those Essential Gender Differences.

[iainpj.livejournal.com]

And now people are so mad that apparently they're creating RPS and art about the researchers for the express purpose of humiliating them publicly and shoving it in their faces. One could say that the researchers are indeed getting the full and forthright fandom experience.