how not to run a research study

[nonelvis]

I know several people on my flist are scientists, researchers, or generally interested in science research, and since a few of you may not have heard yet about the fan fiction survey, consider this an object lesson in Doing It Wrong. Seriously, how do you get to the point of having a PhD in a scientific field and not realize that you can't change the questions in the middle of the survey without affecting your data? (And that's the least of the problems with this little project – it's just one of the most obvious points of Science Fail.)

The survey is finally down while the researchers "digest all this great feedback." Personally, I agree with the anonmeme theory that this is subtle code for "BRB, BU IRB SMACKING OUR ASSES, AND NOT IN THE GOOD WAY YOU FOLKS WRITE ABOUT."

Comments

[ionlylurkhere.livejournal.com]

I'm convinced the whole exercise was only ever looking for anecdotal evidence for their non-peer-reviewed book, with lots of strange leading questions that seem to be designed to get people to tell stories about their involvement with fandom that can be used to point up all those Essential Gender Differences.

[nonelvis]

Ah, a "social experiment" ;)

It would make somewhat more sense if that were the case ... though if all he wanted was stories about involvement with fandom, I think he's got plenty of first-hand experience now.

[prof-pangaea.livejournal.com]

yep. and i could see where that survey was going from the first two questions -- "what was your biological sex at birth?" and "what is your current gender?". since their book deal is for a book that will "prove" essential gender differences, it's easy to see how that's going to dovetail into "hey trans people, you're not really a man becuse your BRAIN is female!" and vice versa, completely leaving out any kind of evidence for the roles of socialisation and, of course, individuality, since their whole point is to make a "unified fabric of human desire".

[elliptic-eye.livejournal.com]

This. It's just so fucking patently bad faith through and through, and you know what? I've realized something. People presenting lie as fact as pertains to gender makes me angry. But that's probably just because I'm an irrational wimmins and ruled by my emotions and things.

[nonelvis]

And your hormones. Don't forget those. It's why we can't be president, you know, 'cause we might get so crabby during the wrong time of the month that we'd start a nuclear war.

[prof-pangaea.livejournal.com]

yah, i'm not very fond of people presenting lie (or lazy presupposition) as fact in regards to anything, but gender is definitely one of the big DNWs.