Mista
SENIOR MEMBER
- Joined
- Jun 9, 2016
- Messages
- 4,567
- Reaction score
- 10
- Country
- Location
A long but fascinating read, for those who are interested. I will just provide the link and the conclusion below since the numbers can't really be copy-pasted.
Coronavirus Case Counts Are Meaningless*
*Unless you know something about testing. And even then, it gets complicated.
https://fivethirtyeight.com/features/coronavirus-case-counts-are-meaningless/
Coronavirus Case Counts Are Meaningless*
*Unless you know something about testing. And even then, it gets complicated.
https://fivethirtyeight.com/features/coronavirus-case-counts-are-meaningless/
But if you’re not accounting for testing patterns, it can throw your conclusions entirely out of whack. You don’t just run the risk of being a little bit wrong: Your analysis could be off by an order of magnitude. Or even worse, you might be led in the opposite direction of what is actually happening. A country where the case count is increasing because it’s doing more testing, for instance, might actually be getting its epidemic under control. Alternatively, in a country where the reported number of new cases is declining, the situation could actually be getting worse, either because its system is too overwhelmed to do adequate testing or because it’s ramping down on testing for PR reasons.
Failure to account for testing strategies can also render comparisons between states and countries meaningless. According to two recent epidemiological studies, which tried to infer the true number of infected people from the reported number of deaths, there is roughly a 20-fold difference in case detection rates between the countries that are doing the best job of it, such as Norway and the worst job, such as the United Kingdom. (The United States is probably somewhere in the middle of the pack by this standard.) That means, for example, that in one country that reports 1,000 COVID-19 cases, there could actually be 5,000 infected people, and in another country that reports 1,000 cases, there might be 100,000!
There are quite a few things to look at here. The most obvious and probably the most important one is simply that a 15-day delay between when someone gets infected and when their case shows up in the data as a positive test makes a huge difference. Even if everything else was going perfectly — 100 percent of the population was being tested and the tests are 100 percent accurate — with an R of 2.6, a 15-day delay would result in there being about 18 times more newly infected people in the population than the number of newly reported positive tests at any given time.
I already gave away the conclusion at the top of the story, so I’m just going to repeat it once more, hoping that this article has helped to convince you of it: The number of reported COVID-19 cases is not a very useful indicator of anything unless you also know something about how tests are being conducted.
In fact, in some cases, places with lower nominal case counts may actually be worse off. In general, a high number of tests is associated with a more robust medical infrastructure and a more adept government response to the coronavirus. The countries that are doing a lot of testing also tend to have low fatality rates — not just low case fatality rates (how many people die as a fraction of known cases) but also lower rates of death as a share of the overall population. Germany, for example, which is conducting about 50,000 tests per day — seven times more than the U.K. — has more than twice as many reported cases as the U.K., but they’ve also had only about one-third as many deaths.
Put another way: Doing more tests is good, and likely leads to better long-run outcomes, even if it also results in higher case counts that people will freak out about in the short run. I don’t usually like to be so didactic, but I hope you’ll be a more educated consumer of COVID-19 data instead of just looking at case counts ticking upward on cable news screens without context. That context includes not only reporting about the amount of testing, but also indications such as hospital strain, which are more robust since they aren’t subject to as many vagaries about how tests are conducted.
Even if you’re not from New York, Gov. Andrew Cuomo’s daily briefings are worth watching because they do the best job I’ve seen of providing this context.
And if you do want to play with your own scenarios to see how all of this works… here’s the link to that Excel sheet. Have fun, but keep in mind that even though there are a lot of parameters you can tweak, the scenarios are still a fairly crude simplification of the complex situation on the ground in any given state or country.