Friday, October 14, 2016

Experience, True

Researchers are increasingly seeking grants and tenure at the expense of sound science, argues Patrick J. Michaels in Investors Business Daily.

Michaels, a scholar with the libertarian Cato Institute, was commenting on an article recently published in a journal from Britain's Royal Society. The article, titled "The Natural Selection of Bad Science," explains that rewards for scientists have polluted the scientific process.

"The things that scientists crave – like tenure and research funding – incentivize frequent publishing of massive numbers of academic papers," Michaels wrote. "To publish that much, you need a tremendous amount of financial support. And when it comes to scientific work that could have regulatory implications, almost all of the money comes from Washington."

Michaels uses the example of climate science throughout his article, which is being heavily funded and incentivized to find dire predictions.

"So, instead of being rewarded for research that supports a prior hypothesis, no matter how sloppy it is, those involved in climate studies get published a lot not by testing (which can't be done in the prospective sense) but by producing dire, horrific results," Michaels wrote. "Because these often appear in prominent journals — which love to feature articles that generate big news stories — the greater the horror, the more likely is promotion, citation and more money."
Just like journalism, a good horror story sells well. The opposite is true as well; science also rewards optimistic "feel good" works. Sometimes the "feel good" story is about incremental progress on a horror story (see the post below this one for an example).
He also cites Stanford University researcher Daniele Fanelli, who found that positive results in research have been increasing for decades, which can't possibly be true. It's just not possible that we are able to propose a hypothesis and prove it true at such a high rate. But people who give money to scientists are funding the hypothesis, not the results. Negative findings are a waste of their money, so scientists are increasingly ensuring they prove their hypotheses true.
Positive results can increase, if researchers are less willing to test hypothesis that may be proven false, and thus become more willing to test branches off older, better tested hypothesis. This generates a lot of work and papers, but little progress.
Imagine you want funding to prove that soda causes heart disease. Do you think the financial backers would be happy to learn soda doesn't cause heart disease? Not unless the funders were from the soda industry, but they wouldn't likely fund a study with such a hypothesis in the first place. By the way, a study like this has been conducted, and the Google results show just how important finding positive results are — the more media headlines a "study" can create, the more funding.

No comments:

Post a Comment