First this: SCIENTIFIC REGRESS
One creative attempt to estimate how widespread such dishonesty really is involves comparisons between fields of varying “hardness.” The author, Daniele Fanelli, theorized that the farther from physics one gets, the more freedom creeps into one’s experimental methodology, and the fewer constraints there are on a scientist’s conscious and unconscious biases. If all scientists were constantly attempting to influence the results of their analyses, but had more opportunities to do so the “softer” the science, then we might expect that the social sciences have more papers that confirm a sought-after hypothesis than do the physical sciences, with medicine and biology somewhere in the middle. This is exactly what the study discovered: A paper in psychology or psychiatry is about five times as likely to report a positive result as one in astrophysics. This is not necessarily evidence that psychologists are all consciously or unconsciously manipulating their data—it could also be evidence of massive publication bias—but either way, the result is disturbing.
Read, as they say, the whole thing. He makes several salient points about the various biases that can creep in on a macro level having to do with the business of science, but as I’ve argued here before there are globs and globs of biases that can creep in apart from that. One portion that struck with me is the way science is operating in society these days:
Which brings us to the odd moment in which we live. At the same time as an ever more bloated scientific bureaucracy churns out masses of research results, the majority of which are likely outright false, scientists themselves are lauded as heroes and science is upheld as the only legitimate basis for policy-making. There’s reason to believe that these phenomena are linked. When a formerly ascetic discipline suddenly attains a measure of influence, it is bound to be flooded by opportunists and charlatans, whether it’s the National Academy of Science or the monastery of Cluny.
. . .
The Cult is related to the phenomenon described as “scientism”; both have a tendency to treat the body of scientific knowledge as a holy book or an a-religious revelation that offers simple and decisive resolutions to deep questions. But it adds to this a pinch of glib frivolity and a dash of unembarrassed ignorance. Its rhetorical tics include a forced enthusiasm (a search on Twitter for the hashtag “#sciencedancing” speaks volumes) and a penchant for profanity. Here in Silicon Valley, one can scarcely go a day without seeing a t-shirt reading “Science: It works, b—es!” The hero of the recent popular movie The Martian boasts that he will “science the sh— out of” a situation. One of the largest groups on Facebook is titled “I f—ing love Science!” (a name which, combined with the group’s penchant for posting scarcely any actual scientific material but a lot of pictures of natural phenomena, has prompted more than one actual scientist of my acquaintance to mutter under her breath, “What you truly love is pictures”).
I loathe that IFLS site as well as its bastard children involving bad language and archaeology and refuse to even link to them here. Because, you know, watching Big Bang Theory doesn’t make you a Science Geek.
Related is this: A Decades-Old Study, Rediscovered, Challenges Advice on Saturated Fat
So what was the result? Despite being one of the largest controlled clinical dietary trials of its kind ever conducted, the data were never fully analyzed.
Several years ago, Christopher E. Ramsden, a medical investigator at the National Institutes of Health, learned about the long-overlooked study. Intrigued, he contacted the University of Minnesota in hopes of reviewing the unpublished data. Dr. Frantz, who died in 2009, had been a prominent scientist at the university, where he studied the link between saturated fat and heart disease. One of his closest colleagues was Ancel Keys, an influential scientist whose research in the 1950s helped establish saturated fat as public health enemy No. 1, prompting the federal government to recommend low-fat diets to the entire nation.
We just don’t know much about anything really.