Well, it's 140 pages long, and poorly written. Using a method employed by the paper (pulling an estimate out of thin air), I'd estimate that less than 2% of those who have contributed to this thread have taken the time to read that paper with great care.
I was curious about the nature of Quay's argument, and whether he was doing the Bayesian analysis correctly, so I wasted some time this morning trying to read the paper.
First of all, the paper is poorly written. To start with, it's hard to perceive the paper's overall structure. The paper is 140 pages long, with no outline or table of contents, no numbering of sections or subsections, and indeed no clear indication of where sections/subsections begin other than a line or phrase of boldface text such as "Executive Summary." or "Zoonosis Hypothesis". For example, it is unclear where the "Executive Summary" is intended to end, although I assume it ends at the end of page 11. (It is also possible that Quay's "Executive Summary" is 140 pages, and that the 140 pages I see merely summarize another paper I haven't seen. I hope that's not true, but I can't tell for certain). For another example, page 15 says "The details of the evidence used to arrive at this conclusion is contained in Appendix 1." There is no "Appendix 1" in the paper, although I might guess we're expected to assume that appendix was to begin somewhere between page 12 and the green-highlighted "Evidence." on page 21. Perhaps the most likely start of the missing "Appendix 1" is the following line on page 18 (with bold face and highlighting as in the original, except the original highlighting is green rather than yellow):
Six lines later, Quay writes:
"Taken" is an understatement, as Quay's brief description of the Bayes Theorem was essentially copied and pasted from Jon Seymour's blog, including Seymour's crappy notations for multiplication (e.g. "P(E|H).P(H)") and hatted H (e.g. "P(E|^H)"), which might well be necessary to work around the limitations of software used by Seymour's blog but are inexcusable in a document we're supposed to take seriously as a scientific paper.
On page 19, Quay writes (with bolding and highlighting as in the original, except Quay highlights the first "independent" in green instead of yellow; I have no idea why he used different colors to highlighted two occurrences of the same word on the same line):
That's an important point. It took me a little time to confirm that all of Quay's adjustments to his prior probabilities were multiplications and divisions that are valid only if the associated bits of evidence are statistically independent. Before commenting on what appear to me to be examples of adjustments based on evidence that is probably
not statistically independent, let's look at the paragraph immediately following the paragraph I quoted above.
Some of you might have thought I was exaggerating when I spoke of Quay "pulling an estimate out of thin air", but no. Quay acknowledges the subjectivity of his discount factors.
To illustrate Quay's use of Bayes's Theorem, here is the conclusion of Quay's first adjustment (bolding and highlighting as in the original, except Quay highlights "Starting likehood..." and "Adjusted likelihood..." in green instead of yellow):
As you can see, the adjustment going from "1% laboratory origin" to "4.9%" is explicitly based on assumptions pulled out of the air, although the air used as source here may be more substantial than the air from which some of the paper's other assumptions were extracted.
Here are the three biggest adjustment to Quay's estimated probability of a laboratory origin:
- Lack of evidence of seroconversion in Wuhan and Shanghai (going from 4.9% to 19.1%)
- Lack of posterior diversity (from 19.1% to 69.2%)
- Lack of furin cleavage sites in any other sarbecovirus (from 69.2% to 95.3%)
The explicitly subjective discount factors Quay pulled out of thin air to come up with those adjustments are:
I have absolutely no competence in virology or any other biological science, but my remarks above explain why I am not at all impressed by Quay's paper.