Is this new ammo for the alternative medicine crowd?

It does seem faintly amusing that the eminent Prof Colquhoun is described here as a 'student'...
 
Actually the paper does NOT say honey is better than DM. On the contrary. That is just spin in the media, and, sad to say, in the press releases. My analysis of it is now at http://dcscience.net/?p=209
You state: "If you have got a cough, tough luck. There isn’t really anything available, conventional or alternative, that does much good. You’ll just have to wait for it to get better. But if you want to take something that tastes nice, why not honey? It won’t do much good but its safer than the standard cough medicine."

Are there any circumstances in which you would take a standard cough medicine? If so, which medicine and under what circumstances?
 
Didnt I read something a while back about an ingredient of dark chocolate being better than codeine for cough?

I use it as an excuse to eat more chocolate, so I really don't want to hear about it if that particular piece of research was rubbish...
 
Actually the paper does NOT say honey is better than DM. On the contrary. That is just spin in the media, and, sad to say, in the press releases. My analysis of it is now at http://dcscience.net/?p=209

Excellent review. I am glad you also touch upon what I consider to be a serious problem: that these studies appear in medical journals such as JAMA (which I assumed was an reputable peer-reviewed medical journal....??)

Most medical and pharmacological journals allow publications of findings that are misleading because they do not require the strict thresholds needed to eliminate the probability for the result being due to chance. Medical journals should follow the same guidelines as scientific journals; they should not publish extraordinary claims without extraordinary evidence, and studies should be required to undergo a series of rigid independent replications achieving the same results before they are published in academic journals and/or released to the press.
 
Excellent review. I am glad you also touch upon what I consider to be a serious problem: that these studies appear in medical journals such as JAMA (which I assumed was an reputable peer-reviewed medical journal....??)

Most medical and pharmacological journals allow publications of findings that are misleading because they do not require the strict thresholds needed to eliminate the probability for the result being due to chance. Medical journals should follow the same guidelines as scientific journals; they should not publish extraordinary claims without extraordinary evidence, and studies should be required to undergo a series of rigid independent replications achieving the same results before they are published in academic journals and/or released to the press.

What are you talking about? JAMA is a reputable peer-reviewed medical journal. Medical and pharmacological journals follow strict guidelines to determine the probability of the result being due to chance. They follow the same guidelines as other scientific journals.

And why the requirement for a series of rigid independent replications achieving the same results before publishing any results? How will anyone learn about this information, otherwise?

ETA: The study was published in the Archives of Pediatric and Adolescent Medicine which is under the umbrella of the AMA with JAMA.

Linda
 
Last edited:
What are you talking about? JAMA is a reputable peer-reviewed medical journal. Medical and pharmacological journals follow strict guidelines to determine the probability of the result being due to chance. They follow the same guidelines as other scientific journals.

And why the requirement for a series of rigid independent replications achieving the same results before publishing any results? How will anyone learn about this information, otherwise?

ETA: The study was published in the Archives of Pediatric and Adolescent Medicine which is under the umbrella of the AMA with JAMA.

Linda

I think Jaana's partly correct. While these journals have peer-review panels, that doesn't mean that every article is peer-reviewed. Some studies are printed for interest's sake, and there's usually a letters section where members can submit their thoughts. They are identified as non-peer-reviewed, of course.

The problem that stems from this is that from time to time, a quack writes a letter to the editor, gets his letter published, and then goes off into la-la-land and interprets it as an endorsement. I've seen many quacks who back up their fraudulent claims with 'references' that are merely letters to the editor or human interest articles, but have impressive titles, such as JAMA, CMAJ, JAPA, Lancet... It's deceptive, of course, but why give them this raw material?

My personal opinion is that this is an acceptable risk. The quacks are going to lie anyway, why let it take away some of our interesting reading?

Where I disagree with Jaana is that part of the point of these journals is to disseminate interesting ideas that could inspire readers to do related experiments that may actually bear fruit. I think it's impractical to go from one guy having a "new idea" to many independent experiments without some kind of published discussion about the merits of the "new idea" in the first place.

Ultimately, by the time there are several experiments, we're not talking about it being time to "publish": this has reached the point where we should be discussing a "literature review".
 
I think Jaana's partly correct. While these journals have peer-review panels, that doesn't mean that every article is peer-reviewed. Some studies are printed for interest's sake, and there's usually a letters section where members can submit their thoughts. They are identified as non-peer-reviewed, of course.

The problem that stems from this is that from time to time, a quack writes a letter to the editor, gets his letter published, and then goes off into la-la-land and interprets it as an endorsement. I've seen many quacks who back up their fraudulent claims with 'references' that are merely letters to the editor or human interest articles, but have impressive titles, such as JAMA, CMAJ, JAPA, Lancet... It's deceptive, of course, but why give them this raw material?

So how is any of this unique to medical journals?

Linda
 
Actually I don't think there was much wrong with the paper, though the discussion seemed biassed in favour of honey to a greater extent than their results section could justify. The problem lay in the very inaccurate press releases from Penn State, from JAMA and from the Press Association. The disappointing bit was that the Penn State media office told me today that their press release had been approved by the first author.
 
Actually I don't think there was much wrong with the paper, though the discussion seemed biassed in favour of honey to a greater extent than their results section could justify. The problem lay in the very inaccurate press releases from Penn State, from JAMA and from the Press Association. The disappointing bit was that the Penn State media office told me today that their press release had been approved by the first author.

I rail about the hopelessness of the lay-press when it comes to reporting on what the study actually said, but at least we have the excuse that we don't have control over what they write. To discover that the fault does lie with the researchers is disappointing.

Linda
 
Last edited:
Perhaps I misunderstand the function of peer-reviewed academic journals. My belief has always been that only proven, factual data is published in academic journals (at least those of higher ranks).

Do scientific journals publish data that is not peer-reviewed and proven true? If so, I would be interested in seeing such a case and apologize for my error.
 
Perhaps I misunderstand the function of peer-reviewed academic journals. My belief has always been that only proven, factual data is published in academic journals (at least those of higher ranks).

Do scientific journals publish data that is not peer-reviewed and proven true? If so, I would be interested in seeing such a case and apologize for my error.

Nothing is ever proven true and most published results are probably wrong. Linda will explain why if you ask her.

ETA: Here you go: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=1182327
 
Last edited:
Perhaps I misunderstand the function of peer-reviewed academic journals. My belief has always been that only proven, factual data is published in academic journals (at least those of higher ranks).

Academic journals publish the reports of original research. A researcher(s) formulate a hypothesis, figure out a way to test that hypothesis and proceed to gather the information necessary for the test. They then analyze the results and form a conclusion as to how the results relate to their original hypothesis.

Peer-review means that other scientists with expertise in the relevant area are asked to review the research and give their opinion as to whether the original hypothesis asks a valid and useful question, whether appropriate means of testing the hypothesis were used, if there are errors in the execution or analysis of the study, if the results support the conclusions made by the authors, as well as matters of form in the write-up.

I'm not entirely sure what part your term "proven, factual data" is meant to refer to.

Do scientific journals publish data that is not peer-reviewed and proven true? If so, I would be interested in seeing such a case and apologize for my error.

I don't understand what you are asking here. Are reports on good quality research sometimes published in non-peer-reviewed academic journals?

Linda
 
I rail about the hopelessness of the lay-press when it comes to reporting on what the study actually said, but at least we have the excuse that we don't have control over what they write. To discover that the fault does lie with the researchers is disappointing.

Linda
The only thing I can see wrong with the Penn State press release is that it is titled "Honey a better option for childhood cough than OTCs" rather than "Honey may be a better option for childhood cough than OTCs." The text of the press release is consistent with the study's findings, which were: "Significant differences in symptom improvement were detected between treatment groups, with honey consistently scoring the best and no treatment scoring the worst. In paired comparisons, honey was significantly superior to no treatment for cough frequency and the combined score, but DM was not better than no treatment for any outcome. Comparison of honey with DM revealed no significant differences."
 
Here's my anecdotal two-bits. As someone who makes his living by shouting while breathing lots of air pollution (tour guide in NYC), I sometimes develop a sore throat and cough. I would hardly call it a cold normally, since the cough is barely present when I'm not speaking loudly or shouting. However, when I have it, I cough every time I speak loudly or shout, and that's intolerable for everyone involved.

I've tried various honey preparations, which had little or no effect. However, Robitussin CF (Dextromethorphan/Guaifenesin/Phenylpropanolamine) works absolutely, positively fantastically. A couple of doses and I can shout my head off for six hours without coughing once.

Perhaps a child's cold is different from what I get, or perhaps the other ingredients make the difference for me, but I'm surprised to see the results of that study.
 
Nothing is ever proven true and most published results are probably wrong. Linda will explain why if you ask her.

ETA: Here you go: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=1182327

There have been quite a few disagreements with this opinion. [One ironic criticism was that, as apublished paper, it was also "wrong"].

That it is not totally evidence based is revealed in the author's opening gambit, in which he claims as fact:
There is increasing concern that in modern research, false findings may be the majority or even the vast majority of published research claims
This statement lends itself to the idea there is widespread concern within the scientific community that this is the case, but is not borne out in reality. What the author (Ioannidis) does not made clear is that the increasing concern is largely his own, and not the wider scientific community (of the 3 references for his claim, one is a a paper pointing to problems of misclassification of allelic heterogeneity when assessing genetic variability for complex phenotypic outcomes, one is a commentary by Iodannidis on the same problem, and the other a letter by Ioannidis on microarrays in molecular research relating to genetics). Hardly a ringing endorsement for his initial claim, I would have thought.
Having said that, there are many truths in what he does say, and it is a good article in which he does indicate where many problems lie within research methodology today.
 
Last edited:
There have been quite a few disagreements with this opinion. [One ironic criticism was that, as apublished paper, it was also "wrong"].

To be fair, the reason that his opinion is wrong is different from what he talks about in his paper. :)

And he doesn't demonstrate how results are wrong, but rather how the conclusions drawn from those results are wrong.

That it is not totally evidence based is revealed in the author's opening gambit, in which he claims as fact:This statement lends itself to the idea there is widespread concern within the scientific community that this is the case, but is not borne out in reality. What the author (Ioannidis) does not made clear is that the increasing concern is largely his own, and not the wider scientific community (of the 3 references for his claim, one is a a paper pointing to problems of misclassification of allelic heterogeneity when assessing genetic variability for complex phenotypic outcomes, one is a commentary by Iodannidis on the same problem, and the other a letter by Ioannidis on microarrays in molecular research relating to genetics). Hardly a ringing endorsement for his initial claim, I would have thought.
Having said that, there are many truths in what he does say, and it is a good article in which he does indicate where many problems lie within research methodology today.

I agree. His own claim is unfounded, but it is incidental when it comes to the real value I find in the paper. That he has developed a very useful model by which to evaluate research, outlined in detail the conditions which lead to erroneous conclusions, and provided a summary of the conditions for a broad range of research areas, is where the value lies. His own pet peeve could be removed entirely from the paper without changing the validity of what he has to say.

What is particularly interesting, even though he does not discuss research outside of the mainstream, is how well all the conditions that lead to erroneous conclusions apply to fields like parapsychology, homeopathy and DIM.

Linda
 
...This study is actually ammo for the evidence-based crowd. While we were able to identify honey as a true-positive, the methods used by the alt med crowd were unable to distinguish between honey and other treatments that we know to be ineffective, such as vitamin C. We can discover that honey helps and vitamin C does not. The alt med people still cannot make that claim.

And we can then go further and carry out studies to identify the active ingredient(s) in the honey, isolate it/them and possibly come up with a more efficient remedy. That is effectively what has happened over the years with "conventional" medicine (e.g. willow bark and aspirin). As soon as a method is proven to be effective, it ceases to be alternative medicine and simply becomes medicine.

But despite all of this, people in consumer societies will still have the freedom to choose between the snake oil and the one that works.
 
There have been quite a few disagreements with this opinion. [One ironic criticism was that, as apublished paper, it was also "wrong"].

I bet there has. Bringing inflated egos back down to earth with a dose of reality often generates much resentment toward the person(s) doing it.

That it is not totally evidence based is revealed in the author's opening gambit, in which he claims as fact:This statement lends itself to the idea there is widespread concern within the scientific community that this is the case, but is not borne out in reality. What the author (Ioannidis) does not made clear is that the increasing concern is largely his own, and not the wider scientific community (of the 3 references for his claim, one is a a paper pointing to problems of misclassification of allelic heterogeneity when assessing genetic variability for complex phenotypic outcomes, one is a commentary by Iodannidis on the same problem, and the other a letter by Ioannidis on microarrays in molecular research relating to genetics). Hardly a ringing endorsement for his initial claim, I would have thought.
Having said that, there are many truths in what he does say, and it is a good article in which he does indicate where many problems lie within research methodology today.

Why would there be concern so long as research grant applications are still being approved, PhD's / tenures handed out and, in general, names being made and bank accounts topped up?
 
Last edited:

ISF - Join now!

Every member here is approved by hand. No bots, no spam, just people who care about evidence and honest debate.

Membership is free!

Create your free account

Back
Top Bottom