Chris,So here is my question and anyone on either side is welcome to answer: when a scientific paper is beinmg published to test the findings of a prior study, is it expected that every aspect of the original protocol be followed to the letter, even if parts of the original study are believed to have been poorly carried out? Or is it more standard to ask the same question and then replicate only the relevant parts, and also filling in the missing parts of the original study (which is what Millette did)?
I don't want just the standard debunker answer, I'd like to know what the tradition is in scientific circles when publishing a paper that follows up on a prior published work.
First of all, let me say that I am not a scientist, but I am somewhat familiar with the publication process through several acquaintances.
I doubt that anyone is interested in publishing a replication of a previous study. Publishers typically reject material when it is not sufficiently novel; I've seen it happen several times. For that reason, the only results that would tend to be published at all are negative replications, not positive ones, even if they are performed, written and submitted. Scientists tend to be curious and 'systematically incredulous' people, after all, so I have no doubt that some results are replicated.
However, replication is the tool to use when there is suspicion of fraudulent data, not of flawed methodology: if the method is sound but the conclusions are suspicious based on the data, then by following the same protocols, if your data does not match that of the suspected paper, you have an indication of possible fraud.
But flawed methods are not necessarily fraud, they are just bad science. And this article explains why writing rebuttal papers is a bad idea:
http://dealingwithcreationisminastr.../why-dont-rebuttals-appear-in-scientific.html
The author postulates that it's better for bad science to fall into oblivion because citation raises the relevance of it. That was my concern if Millette's study gets published. Say 0.1 percent of scientists are gullible enough as to fall for the fallacies in Jones et al paper without having any previous preconception on 9/11 conspiracies. That means that If 1000 relevant neutral scientists around the globe have read the paper, 1 has fallen. Now imagine Millette publishes his results in a respectable journal, and it is read by 10,000 people. That means that 10 will fall for it. 10 more supporters for the cause, which facilitates it to gain momentum over time. Frankly, given the reputation of the journal where Jones et al. published, things are quite good as they are without giving the paper any more publicity.
Back to replication, is the ATM paper under suspicion of data fabrication? No, I have not seen anyone here claim any such thing. I personally don't believe that to be the case. But some of their methods and experiments are nonsensical, and their conclusions don't follow from their results, quite the opposite: their results disprove their conclusions. It is just bad science, and the best solution is oblivion. Perhaps that's why so many laboratories shut their doors on you.