Is this new ammo for the alternative medicine crowd?

The only thing I can see wrong with the Penn State press release is that it is titled "Honey a better option for childhood cough than OTCs" rather than "Honey may be a better option for childhood cough than OTCs." The text of the press release is consistent with the study's findings, which were: "Significant differences in symptom improvement were detected between treatment groups, with honey consistently scoring the best and no treatment scoring the worst. In paired comparisons, honey was significantly superior to no treatment for cough frequency and the combined score, but DM was not better than no treatment for any outcome. Comparison of honey with DM revealed no significant differences."

The text of the release states in several places that honey was better than DM, which is a finding that was not supported by the research.

Linda
 
Last edited:
The text of the release states in several places that honey was better than DM, which is a finding that was not supported by the research.

Such things are usually found to be a clever use of weasel words here and there.
 
The text of the release states in several places that honey was better than DM, which is a finding that was not supported by the research.

Linda
No, that is what the study found: "Significant differences in symptom improvement were detected between treatment groups, with honey consistently scoring the best and no treatment scoring the worst." In other words, honey scored best, DM was in the middle, and no treatment was worst. However, while honey's advantage over no treatment was statistically significant at the 5% level, it's advantage over DM was not significant at that level. Similarly, DM's advantage over no treatment was not significant at that level. If you're arguing that the research does not support a finding that honey is better than DM, then it follows that the research does not support a finding that DM is better than no treatment.
 
No, that is what the study found: "Significant differences in symptom improvement were detected between treatment groups, with honey consistently scoring the best and no treatment scoring the worst." In other words, honey scored best, DM was in the middle, and no treatment was worst. However, while honey's advantage over no treatment was statistically significant at the 5% level, it's advantage over DM was not significant at that level. Similarly, DM's advantage over no treatment was not significant at that level. If you're arguing that the research does not support a finding that honey is better than DM, then it follows that the research does not support a finding that DM is better than no treatment.

If the differences between two treatments are not significantly different, it implies that a repeat of the test could show the positions reversed. It is misleading to use the word "better" under those circumstances. It does follow that the research does not support a finding that DM is better than no treatment.

Linda
 
So how is any of this unique to medical journals?

It's not. I was paraphrasing Jaana's concern, to add context to my personal opinion, which was in the following paragraph.

I interpreted Jaana's concern to be that perhaps medical journals should be *different* than other publications, and restricted to only publishing high quality, peer-reviewed content.

I can see the point, but indicated that I disagreed. Many of these publications play multiple roles for their membership. JAMA includes the routine details of the proceedings of the AMA, for example, which is just ordinary society stuff. It includes stories about how their members go about their everyday work, news about members who have received special awards, or made news. There's an editorial, which talks to political or major technological developments in the profession.

CMAJ has a spoof article every April, in honour of April Fool's Day.

Even something intensely technical like Cell will have a light article or two in every issue.
 
CMAJ has a spoof article every April, in honour of April Fool's Day.

Some journals have a special issue at Christmas-time - CMAJ and BMJ for example - that includes weird, silly, and sometimes manufactured research, spoofs, etc. What is interesting is how often those who do not realize the nature of this issue take it seriously. I remember that pretty much every holiday season, when I lived in Canada, I would see letters to the editor in local papers or callers on call-in shows complaining about the sort of research our tax dollars were being wasted on. And the study they would refer to would be one of those from the holiday issue. And as discussed previously on this forum, one of the research articles in the BMJ holiday issue made it into a serious meta-analysis on the effect of prayer.

The audience that the journals are intended for understand the nature of what it means to be peer-reviewed, and which contents have been peer-reviewed. Those who are in unfamiliar territory may misunderstand, but I don't think that's a good reason to cater to the lowest-common-denominator.

Linda
 
Academic journals publish the reports of original research. A researcher(s) formulate a hypothesis, figure out a way to test that hypothesis and proceed to gather the information necessary for the test. They then analyze the results and form a conclusion as to how the results relate to their original hypothesis.

Peer-review means that other scientists with expertise in the relevant area are asked to review the research and give their opinion as to whether the original hypothesis asks a valid and useful question, whether appropriate means of testing the hypothesis were used, if there are errors in the execution or analysis of the study, if the results support the conclusions made by the authors, as well as matters of form in the write-up.

I'm not entirely sure what part your term "proven, factual data" is meant to refer to.

I don't understand what you are asking here. Are reports on good quality research sometimes published in non-peer-reviewed academic journals?

Linda


Hi Linda: Thank you for the explanation. It seems that your summary corresponds with my understanding of peer-reviewed journals.

I should probably rephrase "proven, factual data": Plainly, studies that follow the strict guidelines of science or EBM with credible and verifiable results.

The problem (as Dr. Harriet Hall wrote in the most recent edition of Skeptic Magazine) is that flawed studies are published in medical journals and released to the press, which result in public hysteria.

Hall provides an example of a study of Aspartame that was riddled with flaws in its design, results, and its number of test subjects. In this particular Aspartame study's results: 8% of the study "subjects" went blind. The 8% was actually one person -with a retinal detachment. (and this one subject was in the placebo group!) ....Yet, this study was published in a medical journal.

Another example: Remember the intercessory prayer study that also passed into a medical journal? (Actually, I believe there were 2 such studies that wound up published in medical journals, and later withdrawn.)

Can you see the problem??

Regarding scientific journals: My question is simply if such flawed studies as these are as frequently permitted in scientific journals as they are in medical journals? I have read in various sources that the answer to this question is no -but am open to hearing otherwise.

I understand the need to share research with peers, but my feeling is that there are many other venues where professionals can exchange such data for further studies until the research meets the criteria that, in my opinion, should be required before published in these esteemed journals.

If it is permissable for flawed or incomplete studies to be published in peer-reviewed journals, then were can someone like myself (who is admittedly not well versed in reading & assessing studies) find truthful and accurate information? Where can I find the "final word" on medical and scientific studies?

Please don't come down on me for the words: "final word." I am simply asking where, if not in peer-reviewed academic journals, can i find the most accurate and verifiable truths accepted by the experts of these fields?
 
The text of the release states in several places that honey was better than DM, which is a finding that was not supported by the research.

That statement is a lie. There is no statement in the report
http://archpedi.ama-assn.org/cgi/content/full/161/12/1140
that says honey was better than DM.

Here are all instances from the report of the use of the word "better".

In paired comparisons, honey was significantly superior to no treatment for cough frequency and the combined score, but DM was not better than no treatment for any outcome.

In any case, the fact that there was sufficient power to find that honey was superior to no treatment adds to the validity of our previous findings suggesting that DM was no better than a placebo treatment of simple syrup without a pharmacologically active substance.

Importantly for parents, neither their child's sleep nor their own sleep was significantly better when their child received medication compared with placebo.

Parents rated their children's sleep better after receiving honey, with a 2.49-point improvement for the honey group compared with a 1.79-point change for the DM group and a 1.57-point change for those not receiving treatment on the second night (P < .001).

In contrast, DM was not significantly better than no treatment for any study outcome.

The current results surprisingly indicate that DM was not significantly better than no treatment at all.

In any case, the fact that there was sufficient power to find that honey was superior to no treatment adds to the validity of our previous findings suggesting that DM was no better than a placebo treatment of simple syrup without a pharmacologically active substance.

See? While the authors mentions over and over that DM is "no better than placebo", they do not say "honey is better". They did report, Parents rated their children's sleep better after receiving honey, which might have confused you. But that isn't the same thing as saying honey is better than DM, which you stated. Which is a lie, of course, because it isn't true.

What is true, is that honey, that ancient and well tested remedy, is still a safe and inexpensive solution to certain health problems.

Honey has many purported health benefits and has repeatedly been shown to aid in wound healing, even for children. For cough and cold symptoms, honey is cited by the World Health Organization as a potential treatment. In the World Health Organization report on the treatment of URIs in young children, honey is considered as a demulcent that is cheap, popular, and safe. Although there is no scientific evidence to support the use of honey for symptoms associated with a URI, it is suggested in the World Health Organization report that demulcents may soothe the throat and can be recommended to provide some relief from cough in children. In addition to the demulcent effect, honey has antioxidant properties and increases cytokine release, which may explain its antimicrobial effects.

Much to the dismay of "pseudoskeptics" who just can't grasp that they are wrong, even when it is scientific and evidenced and all that cool stuff. It might be that the stubborn refusal of "science" to accept reality, does lead to "woos" increasing distrust of authority and the truth and accuracy of medical reports, studies and advice.
 
Last edited:
That statement is a lie. There is no statement in the report
http://archpedi.ama-assn.org/cgi/content/full/161/12/1140
that says honey was better than DM.
Linda was referring to the Penn State Press release, and not the original Penn State Research study. This is quite clear from her post.

This is what the Penn State press release said:
The study found that a small dose of buckwheat honey given before bedtime provided better relief of nighttime cough and sleep difficulty in children than no treatment or dextromethorphan (DM)
and
Honey did a better job reducing the severity, frequency and bothersome nature of nighttime cough from upper respiratory infection than DM
Dunno bout you, but my reading is that Linda is spot on (as usual).
 
Last edited:
That statement is a lie. There is no statement in the report
http://archpedi.ama-assn.org/cgi/content/full/161/12/1140
that says honey was better than DM.

Here are all instances from the report of the use of the word "better".

You're cute when you get all discombobulated. Dr. Colquhoun, Rodney and I were talking about the press release issued by Penn State, not the research article. That is why we used words like "press releases", "press release", "release", etc., rather than "paper", "study", "report", etc.

The press release does state that honey is better than DM.

"The study found that a small dose of buckwheat honey given before bedtime provided better relief of nighttime cough and sleep difficulty in children than no treatment or dextromethorphan (DM), a cough suppressant found in many over-the-counter cold medications.

Honey did a better job reducing the severity, frequency and bothersome nature of nighttime cough from upper respiratory infection than DM or no treatment."

(Bolding mine)

See? While the authors mentions over and over that DM is "no better than placebo", they do not say "honey is better". They did report, Parents rated their children's sleep better after receiving honey, which might have confused you. But that isn't the same thing as saying honey is better than DM, which you stated. Which is a lie, of course, because it isn't true.

What is true, is that honey, that ancient and well tested remedy, is still a safe and inexpensive solution to certain health problems.

Much to the dismay of "pseudoskeptics" who just can't grasp that they are wrong, even when it is scientific and evidenced and all that cool stuff. It might be that the stubborn refusal of "science" to accept reality, does lead to "woos" increasing distrust of authority and the truth and accuracy of medical reports, studies and advice.

So what does it mean when it turns out that True Skeptics just have poor reading comprehension?

Linda
 
Last edited:
You do realize I am agreeing with Linda, that saying "Honey is better than DM" is not supported by the study? That such a claim is a lie?

Yes, the study found that a small dose of buckwheat honey given before bedtime provided better relief of nighttime cough and sleep difficulty in children than no treatment or dextromethorphan (DM), and Honey did a better job reducing the severity, frequency and bothersome nature of nighttime cough from upper respiratory infection than DM. But at no point do they state "Honey is better than DM", which is the claim I pointed out is a lie.

Doing a better job, or "providing better relief" is not the same thing as stating "honey is better".
 
In case it isn't clear, neither the study nor the press release ever says "honey is better than DM", which is what Linda pointed out. So to say that either document claims "honey is better than DM" is simply not true.

The press release does state that honey is better than DM.
No, it does not. That claim is a lie.

So what does it mean when it turns out that True Skeptics just have poor reading comprehension?

You tell us. :D
 
Last edited:
You do realize I am agreeing with Linda, that saying "Honey is better than DM" is not supported by the study? That such a claim is a lie?

Yes, the study found that a small dose of buckwheat honey given before bedtime provided better relief of nighttime cough and sleep difficulty in children than no treatment or dextromethorphan (DM), and Honey did a better job reducing the severity, frequency and bothersome nature of nighttime cough from upper respiratory infection than DM. But at no point do they state "Honey is better than DM", which is the claim I pointed out is a lie.

Doing a better job, or "providing better relief" is not the same thing as stating "honey is better".
I realise you agree that "Honey is better than DM" is not supported by the study.

When the express aim of the treatment is to provide relief of cough, and to reduce its severity, frequency and bothersome nature, then the claim in the press release that honey performs better than DM for all of these is indeed a claim that "Honey is better than DM".

What do you think they are talking about in the press release? That honey is better than DM at sticking on roof tiles?
 
Last edited:
Doing a better job, or "providing better relief" is not the same thing as stating "honey is better".

You're so right! I could have meant "honey is better at sweetening tea" or "honey is better for licking off of naked bodies". There's absolutely no reason to think that I was referring to something like "honey is better at providing relief".

That'll teach me to leave my qualifiers dangling.

Linda
 
Linda was referring to the Penn State Press release, and not the original Penn State Research study. This is quite clear from her post.

Yes, and it is still wrong. The press releaser does not say "Honey is better than DM".

Here is the use of the word better in the Press release:

Honey a better option for childhood cough than OTCs

The study found that a small dose of buckwheat honey given before bedtime provided better relief of nighttime cough and sleep difficulty in children than no treatment or dextromethorphan (DM), a cough suppressant found in many over-the-counter cold medications.

Honey did a better job reducing the severity, frequency and bothersome nature of nighttime cough from upper respiratory infection than DM or no treatment.

DM was not significantly better at alleviating symptoms than no treatment.

In a previous study published in 2004, Paul and colleagues showed that neither DM nor diphenhydramine, another common component of cold medications, performed better than a placebo at reducing nighttime cough or improving sleep quality.

Across the board, parents rated honey as significantly better than DM or no treatment for symptomatic relief of their child’s nighttime cough and sleep difficulty.

It does not ever state "honey is better than DM", which I pointed out, is false statement. As Linda pointed out, the research does not support that claim.
 
Your response slipped in, I hadn't read it yet.

I realise you agree that "Honey is better than DM" is not supported by the study.

When the express aim of the treatment is to provide relief of cough, and to reduce its severity, frequency and bothersome nature, then the claim in the press release that honey performs better than DM for all of these is indeed a claim that "Honey is better than DM".

What the study reported was:

In paired comparisons, honey was significantly superior to no treatment for cough frequency and the combined score, but DM was not better than no treatment for any outcome.

In any case, the fact that there was sufficient power to find that honey was superior to no treatment adds to the validity of our previous findings suggesting that DM was no better than a placebo treatment of simple syrup without a pharmacologically active substance.

Importantly for parents, neither their child's sleep nor their own sleep was significantly better when their child received medication compared with placebo.

Parents rated their children's sleep better after receiving honey
, with a 2.49-point improvement for the honey group compared with a 1.79-point change for the DM group and a 1.57-point change for those not receiving treatment on the second night (P < .001).

That is not the same as stating "Honey is better than DM", which as we agree, would be a lie.
 
The crux of the matter seems to be in relation to - Parents rated their children's sleep better after receiving honey, with a 2.49-point improvement for the honey group compared with a 1.79-point change for the DM group and a 1.57-point change for those not receiving treatment on the second night (P < .001).

Is 2.49 compared to 1.79 important? What does that mean, statistics wise?

Obviously 1.79 compared to 1.57 means there is not much difference between the drug and a placebo.

But is 2.49 compared to 1.57 enough to be able to say honey works better than a placebo?
 

ISF - Join now!

Every member here is approved by hand. No bots, no spam, just people who care about evidence and honest debate.

Membership is free!

Create your free account

Back
Top Bottom