25th - 26th SEPTEMBER 2019  |  OLYMPIA

The Science of This Pandemic Is Moving at Dangerous Speeds

Wired 28 Mar 2020 11:00

The Trump administration has made many stumbles in its response to the coronavirus pandemic, but one of the key failures was not having enough kits to test for the pathogen once it appeared in the United States. Instead of accepting kits from other countries—including the ones approved by the World Health Organization—the White House went its own way.

On March 17, Deborah Birx, the physician coordinating the administration’s scientific response to the Covid-19 outbreak in the United States, tried to explain the rejections. "It doesn't help to put out a test where 50 percent or 47 percent are false positives," Birx told reporters, suggesting that at least some overseas tests were deeply flawed. A few days later, FDA commissioner Stephen Hahn again mentioned the 47-percent error rate in an interview with National Public Radio, attributing it to “an abstract that was recently published in the literature.” He continued: “What that means is that if you had a positive test, it was pretty close to a flip of a coin as to whether it was real or not."

SUBSCRIBE

Subscribe to WIRED and stay smart with more of your favorite Ideas writers.

That sounds reasonable. After all, a test that is no better than a coin flip would do far more harm than good, burdening an already overwhelmed health care system with a tidal wave of well but worried people. Birx is a highly respected scientist whose résumé includes taking on the AIDS epidemic, and Hahn heads perhaps the nation’s most important health agency. But in this case, they appear to have relied on data that, for reasons that are still unclear, has been withdrawn from the scientific literature.

As it happens, both of Birx’s false-positive rates, the “50 percent or 47 percent,” came from a single study. That’s bad enough, if somewhat understandable given how quickly the pandemic has been spreading. Still, scientists are generally loath to base any decisions, including what they eat for breakfast, on a single, unreplicated finding. This time, they appear to have done so on a policy matter of the highest importance.

It’s far worse that the single study had already been retracted. As NPR has now reported, the paper was withdrawn a few days after its publication in a Chinese journal. In other words, the Trump administration may have blocked the importation of some Covid-19 tests at a critical moment in the evolution of the pandemic on the strength of a piece of research that is no longer in the literature.

This case is a particularly dismaying and consequential example of what happens when no one bothers to engage in scientific fact-checking. But it will not be the last time that something we thought we knew about the coronavirus because it was in a published paper will turn out to be wrong.

The last few weeks have seen a blizzard of publications about Covid-19—and, like the outbreak itself in this country, it’s just the beginning. Many of the papers have come from China, where researchers have had more time to study the infection than the rest of the world, but important papers have emerged from Italy, as well.

All of these articles have at least one thing in common: They were written, and published, in great haste. And while desperate times may dissolve norms, speed remains the enemy of rigorous science. (Thoughts and prayers for the poor armchair epidemiologists trying to follow along at home; everything they think they know changes by the hour.)

Consider: The research behind a normal paper takes months or even years to complete, and then months more—or longer—to be published. Journals subject manuscripts to peer review before deciding whether to accept them; once accepted, they must be edited and then ushered through what has typically been a lengthy production process. With the Covid-19 papers, however, the timeline has been radically condensed. At least one key paper—also touted by the Trump administration—was accepted just a day after it was submitted. (That paper is, as we write this, being fisked in multiple quarters.)

Continue reading original article...