Is this new ammo for the alternative medicine crowd?

A fine example of backpedaling. Your first post calling the statement a lie was obviously an attack on what Linda said, citing the report and not the press release.

After other posters pointed out Linda talking about the press release, you have retreated to saying that (paraphrased):
If the press release had said exactly these words: "Honey is better than DM", then the author would be lying.

This argument is just plain silly, as the press release did say honey was better than DM in pretty much any way relevant to the discussion.

Much to the dismay of "pseudoskeptics" who just can't grasp that they are wrong

What about pseudo-woos who grasp, but won't admit, that they are wrong?
 
The crux of the matter seems to be in relation to - Parents rated their children's sleep better after receiving honey, with a 2.49-point improvement for the honey group compared with a 1.79-point change for the DM group and a 1.57-point change for those not receiving treatment on the second night.

Children's sleep was only one of five categories evaluated, and was not considered to be the a priori primary outcome -- rather, cough frequency was. The other three categories were parents' sleep, cough severity, and how bothersome the cough was. "All of the outcomes found honey to yield the greatest improvement, followed by DM, while no treatment consistently showed the least amount of improvement . . . When the results for these outcomes were combined by adding the scores from the individual categories, honey again proved to be the most effective treatment. The children in this group improved by an average of 10.71 points compared with 8.39 points for DM-treated children and 6.41 points for those who were not treated . . . In pairwise comparisons, honey was significantly superior to no treatment for our a priori primary outcome of cough frequency (P = .01) as well as the combined symptom score (P = .04) . . ."

So, the overall differences in improvement were: 1) Between honey and DM, 2.32 points; 2) Between DM and no treatment, 1.98 points; and 3) Between honey and no treatment, 4.30 points. Only the latter is statistically significant at the 5% level, but the other two differences in improvement should not be dismissed as if they didn't happen.
 
Last edited:
What does that 5% figure mean?

Significant differences in symptom improvement were detected between treatment groups, with honey consistently scoring the best and no treatment scoring the worst
http://archpedi.ama-assn.org/cgi/content/full/161/12/1140

The author obviously is saying that, "Significant differences in symptom improvement were detected". But what does that mean? Were the improvements enough to state that Honey is "better" than DM, in regards to the five criteria?

It is clear that both the published study and the press release state the results show Honey worked "better", in regards to children with a problematic cough.

This doesn't mean "Honey is better than DM". It means in their study, honey showed better results than DM, in regards to improving the symptoms and scores used.

But how much better? 5% better? That doesn't seem significant, especially compared to the placebo.
 
What does that 5% figure mean?
It means that there is a 95% likelihood that the difference in symptom improvement from using honey to treat the cough (rather than doing nothing) is not due to chance.

http://archpedi.ama-assn.org/cgi/content/full/161/12/1140

The author obviously is saying that, "Significant differences in symptom improvement were detected". But what does that mean? Were the improvements enough to state that Honey is "better" than DM, in regards to the five criteria?
Between honey and DM with regard to any of the five categories, no; between honey and no treatment with regard to problematic cough and overall, yes.

It is clear that both the published study and the press release state the results show Honey worked "better", in regards to children with a problematic cough.
Not just with regard to problematic cough, but with regard to all five categories.

This doesn't mean "Honey is better than DM". It means in their study, honey showed better results than DM, in regards to improving the symptoms and scores used.
Correct. However, if on a 20-question multiple choice test, you scored 95% and I scored 90%, would you not say you did better on the test?

But how much better? 5% better? That doesn't seem significant, especially compared to the placebo.
The 5% pertains to the level of statistical significance that is generally accepted by scientists as establishing that the differences are not attributable to chance. If you're trying to answer the question of "how much better" with regard to the overall results, the children in the honey-treated group improved by an average of 10.71 points compared with 8.39 points for DM-treated children and 6.41 points for those who were not treated. Accordingly, the honey-treated group improved by 2.32 points, or 28%, more than the DM-treated group and by 4.30 points, or 67%, more than the untreated group.
 
Thanks. If I understand this right, the difference between nothing (the first night), and honey, (the second night), was a 67% improvement. Compared to placebo.

And I understand this right, the difference between DM and honey, was a 28% improvement. Is that correct?
 
Hi Linda: Thank you for the explanation. It seems that your summary corresponds with my understanding of peer-reviewed journals.

I should probably rephrase "proven, factual data": Plainly, studies that follow the strict guidelines of science or EBM with credible and verifiable results.

The problem (as Dr. Harriet Hall wrote in the most recent edition of Skeptic Magazine) is that flawed studies are published in medical journals and released to the press, which result in public hysteria.

Hall provides an example of a study of Aspartame that was riddled with flaws in its design, results, and its number of test subjects. In this particular Aspartame study's results: 8% of the study "subjects" went blind. The 8% was actually one person -with a retinal detachment. (and this one subject was in the placebo group!) ....Yet, this study was published in a medical journal.

Another example: Remember the intercessory prayer study that also passed into a medical journal? (Actually, I believe there were 2 such studies that wound up published in medical journals, and later withdrawn.)

Can you see the problem??

Yes. Out of thousands of studies, you've identified three of questionable quality.

Regarding scientific journals: My question is simply if such flawed studies as these are as frequently permitted in scientific journals as they are in medical journals? I have read in various sources that the answer to this question is no -but am open to hearing otherwise.

What was it about your sources that led you to believe them in the first place? Can you share them?

I don't know the answer myself, although I'm inclined to think it's similar. I just think lay-people are more interested in medical research than they are in the structure of an organic compound. If someone gets that wrong, who cares? Who even heard about it in the first place?

I understand the need to share research with peers, but my feeling is that there are many other venues where professionals can exchange such data for further studies until the research meets the criteria that, in my opinion, should be required before published in these esteemed journals.

What are these other venues?

If you set the bar so high that nary a single flawed study makes it through, are you okay with all the other stuff that gets discarded along with it, say the initial reports on a new syndrome involving an immune deficiency?

If it is permissable for flawed or incomplete studies to be published in peer-reviewed journals, then were can someone like myself (who is admittedly not well versed in reading & assessing studies) find truthful and accurate information? Where can I find the "final word" on medical and scientific studies?

Journals are not intended to be the final word on medical and scientific studies. They are a venue for the publication of reports on research performed by scientists. They also provide a venue for other experts to give their opinion on the research by publishing letters-to-the-editor and editorials. This is an important part of process.

They are intended to be read by experts who are capable of understanding limitations and flaws, and are already familiar with the context in which the study was performed. And you don't agree, but I think it's important to be able to disseminate information that is promising, speculative, preliminary, questionable in any field, as many of our important discoveries started out that way.

Medical textbooks better represent what I think you mean by "final word", as they include information that has already gone through the filtering process of consideration by experts, replication, consensus, etc. They aren't particularly comprehensible without a lot of background knowledge, though.

Please don't come down on me for the words: "final word." I am simply asking where, if not in peer-reviewed academic journals, can i find the most accurate and verifiable truths accepted by the experts of these fields?

I would recommend reading books/articles written by reliable, knowledgeable, experienced and unbiased sources aimed at a general audience.

I agree that it becomes a big problem when the lay-press attempts to report on the results of a new study and inevitably gets it wrong, when others (deliberately or naively) misrepresent the research in order to support their own agenda/bias, and with all the Oh Noes running around whipping up public hysteria. But I don't think slowing or halting the progress of medical research is the way to solve the problem.

Linda
 
There's hardly any difference in the actual scores - the trends are significant, but almost all of the pairwise comparisons aren't.

Statements like that don't make sense, in light of the study, which clearly states there are significant differences.

One of the woo "natural medicines" is honey. You will often find suggestions to use it on wounds as an antiseptic, It does work, but only as well (or poorly) as refined sugar which has the advantage of being much less likely to cause an allergic reaction.

Not true. Sugar does work like honey, but not as well.
http://www.ncbi.nlm.nih.gov/sites/e...ez.Pubmed.Pubmed_ResultsPanel.Pubmed_RVDocSum


DO you think all medicinal claims about honey are woo, or that honey is given too much credit for its properties and bleeds into woo beliefs?

Medical research has found that for wounds, honey is an effective (and inexpensive) treatment. It is also very safe.
http://www.ncbi.nlm.nih.gov/sites/e...med.Pubmed_ResultsPanel.Pubmed_RVAbstractPlus
http://www.ncbi.nlm.nih.gov/sites/e...med.Pubmed_ResultsPanel.Pubmed_RVAbstractPlus
http://www.ncbi.nlm.nih.gov/sites/e...med.Pubmed_ResultsPanel.Pubmed_RVAbstractPlus
http://www.ncbi.nlm.nih.gov/sites/e...ez.Pubmed.Pubmed_ResultsPanel.Pubmed_RVDocSum
The techniques that modern medicine uses in order to separate the wheat from the chaff is laudable when their product is the wheat, but not when its the chaff.

One could make the same claim in reverse. In either case, evidence to support the claim is required.

Must admit, I (and most singers I know) swear by honey for a sore throat caused by overuse.

People who depend on their voice for a living are usually practical people. They use what works. If it doesn't work, it will not be used.

Of course, it provides ammo for the alt med folks.

Do you have any evidence for that claim? Or at least some logic and reason? Why would you say that?

They will consider, anything, no matter how weak, will be considered support.

In my experience, Alternative Medical opinions that work, eventually turn into mainstream medicine. Unless it can't be profited from, in which case people just continue to use remedies that work, despite what anyone claims.

Everything else will be ignored.
This may be true for some people, the ignorant and gullible often fall prey to every sort of scam and false hope. But people who are sick want solutions, not a war over what works or not. That debate, that war, is mostly a creation of those who stand to lose from an honest and open scientific look at reality.

This is true for both sides. While Dextromethorphan has been questioned in regards to actually working (it doesn't), it has still been sold as a cough remedy for over 50 years.
Cough medicines "have no benefit" BBC News: Health, Tuesday, July 6, 2004. .
http://news.bbc.co.uk/1/hi/health/3869379.stm
"Kids' cough medicine no better than placebo" San Francisco Chronicle, July 8, 2004


This make it quackery of course. And from the sales figures, quite profitable quackery. There are also these possible side effects, from what is a useless drug for cough.
dizziness
lightheadedness
drowsiness
nervousness
restlessness
upset stomach
vomiting
stomach pain
rash
high fever
persistent headache
difficulty breathing
mood changes
slurred speech

Is honey better than DM? Not if you want to get high, in which case DM is way better than honey. (Honey won't get you messed up, Dextromethorphan certainly will.)
http://www.cesar.umd.edu/cesar/drugs/dxm.asp

So to say "honey is better than DM" is just not a precise way of speaking.

Honey works better than DM for cough is valid. But DM is way better than honey for other uses. Which is why it is important to speak clearly, without weasel words or blanket statements when discussing stuff.

:D
 
Last edited:
No, that is what the study found: "Significant differences in symptom improvement were detected between treatment groups, with honey consistently scoring the best and no treatment scoring the worst." In other words, honey scored best, DM was in the middle, and no treatment was worst. However, while honey's advantage over no treatment was statistically significant at the 5% level, it's advantage over DM was not significant at that level. Similarly, DM's advantage over no treatment was not significant at that level. If you're arguing that the research does not support a finding that honey is better than DM, then it follows that the research does not support a finding that DM is better than no treatment.


It seems contradictory doesn't it?


HONEY is better than NOTHING.
DM is not better than NOTHING.

But...

HONEY is not better than DM


However, if you add "at the 95% confidence level" to each statement, it suddenly all becomes very clear.

Doesn't it? :cool:
 
So, the overall differences in improvement were: 1) Between honey and DM, 2.32 points; 2) Between DM and no treatment, 1.98 points; and 3) Between honey and no treatment, 4.30 points. Only the latter is statistically significant at the 5% level, but the other two differences in improvement should not be dismissed as if they didn't happen.


Neither should it be dismissed that these differences were not significant. ;)
 
Last edited:
Correct. However, if on a 20-question multiple choice test, I scored 95% and you scored 90%, would you not say I did better on the test?


But, could you say, with 95% confidence, that you are actually better than Robinson. :D
 
Last edited:
Statements like that don't make sense, in light of the study, which clearly states there are significant differences.

Rodney did a reasonable job of explaining this. For further reading, David Colquhoun's article may help you make sense of it.

One could make the same claim in reverse.

Really? Can you give me an example of alt med practitioners discovering, using their own techniques, that something they thought was effective was actually useless? Can you give me an example of alt med practitioners, using their own techniques, discovering that something they thought was safe was actually harmful?

This is true for both sides. While Dextromethorphan has been questioned in regards to actually working (it doesn't), it has still been sold as a cough remedy for over 50 years.

Interesting. The evidence in favour of DM as an effective cough suppressant is stronger than the evidence in favour of honey as effective in wound healing. Yet you are happy to conclude that honey is beneficial, while dismissing that possibility in DM.

This make it quackery of course.

So why is DM quackery, but honey is not, considering that the evidence for both is comparable?

So to say "honey is better than DM" is just not a precise way of speaking.

Honey works better than DM for cough is valid. But DM is way better than honey for other uses. Which is why it is important to speak clearly, without weasel words or blanket statements when discussing stuff.

:D

I see. When saying that honey is better than DM at providing relief from cough, if only the word 'better' is bolded, you are lost. You can see the bolding, but the rest of the sentence fades into oblivion. As you watch the words disappear from view, desperately you cry, "Better at what? Glueing roof tiles? Killing aphids?" As you wander through the wilderness, lonely, cold and disoriented, you wail, "if only that weasel hadn't run off with my blanket!"

Linda
 
Last edited:
Thanks. If I understand this right, the difference between nothing (the first night), and honey, (the second night), was a 67% improvement. Compared to placebo.
Both groups improved, but the improvement was 67% greater for the honey-treated group. However, no placebo was used in this study. Accordingly, the 67% greater improvement may reflect to some extent a placebo effect. But, if this 67% greater improvement reflected only a placebo effect, roughly the same percentage greater improvement would have been expected from using DM instead of no treatment. Instead, there was only a 31% greater improvement from using DM and -- in all five categories -- the improvement was less from using DM than it was from using honey.

And I understand this right, the difference between DM and honey, was a 28% improvement. Is that correct?
Again, both groups improved, but the improvement was 28% greater for the honey-treated group.
 
Thanks Rodney. In studies like these, what percent improvement is considered significant?
 
It seems contradictory doesn't it?

HONEY is better than NOTHING.
DM is not better than NOTHING.

But...

HONEY is not better than DM

However, if you add "at the 95% confidence level" to each statement, it suddenly all becomes very clear.

Doesn't it? :cool:
Absolutely. ;) The thing to understand here is that there is nothing magic about the 95% confidence level --it's just that is the generally accepted cutoff for accepting or rejecting a hypothesis. However, if Study 1 shows that Hypothesis 1 is barely accepted at the 5% level and Study 2 shows that Hypothesis 2 is barely rejected at the 5% level, it makes little sense to conclude that these two studies firmly establish the validity of Hypothesis I and the invalidity of Hypothesis 2.

Now, with respect to the recent honey/DM study, I think the most likely explanation is that honey does alleviate children's nighttime cough better than DM, but the evidence is suggestive, not conclusive. Accordingly, more studies are needed.
 
DM, at the doses given, I agree is likely not effective, as was born out by this study.

Honey, while representing an almost infintessimally small risk overall, does expose small children to potential ingestion of Clostridium botulinum spores, which can then cause potentially lethal acquired form of "floppy baby" syndrome.

http://www.cfsan.fda.gov/~ebam/bam-17.html

So, my thoughts: it was a "touchy-feely", ultimately crappy study with low clinical importance that looked at soft endpoints in subtherapeutic doses of an OTC agent that has been around for a long time. Nothing else to add here except pretty inane argument between fls and Robinson. And, that, personally, I wouldn't give my 2-year-old honey.

-Dr. Imago
 
Thanks Rodney. In studies like these, what percent improvement is considered significant?
It depends on the number of participants in the study -- the more participants, the smaller the percentage differences have to be to reach statistical significance. This study was relatively small; therefore, even though improvement for the honey-treated group of children was judged by the parents to be an average of 28% greater than for the DM-treated group, that difference is not statistically significant at the 95% confidence level. However, the 67% improvement for the honey-treated group relative to the untreated group is significant at that confidence level.
 
So, my thoughts: it was a "touchy-feely", ultimately crappy study with low clinical importance . . .
I disagree. I think that the study was done properly and is important. As it notes:

"Cough is the reason for nearly 3% of all outpatient visits in the United States, more than any other symptom, and it most commonly occurs in conjunction with an upper respiratory tract infection (URI). At night, it is particularly bothersome because it disrupts sleep. Despite the common occurrence of URIs and cough, there are no accepted therapies for this annoying symptom. The use of dextromethorphan (DM), the most common over-the-counter (OTC) antitussive, for treatment of cough in childhood is not supported by the American Academy of Pediatrics or the American College of Chest Physicians. Nonetheless, consumers spend billions of dollars per year on OTC medications for cough." (footnotes omitted)

Isn't it worthwhile to test the hypothesis that there is a safe, inexpensive alternative to DM?
 
I disagree. I think that the study was done properly and is important.

I disagree with your disagreement. This is a surrogate-type data collection methodology that requires the parents (the surrogate reporter) to report on the child's (study subject) symptomology, which by nature is qualitative. This type of study, often done in such "soft" pediatric studies, is rife with reporting bias, especially when unblinded. Secondly, the endpoint is, as mentioned, qualitative and doesn't really address any true effect on the disease process or associated symptoms. This study is far from robust, and no real meaningful conclusions can be drawn from it. Given the fact that honey has inherent risks in and of itself (C. botulinum, child with previously undiagnosed fructosuria or other related metabolic disorders, etc.), not addressed in this study, renders it also far from complete.

In other words, you can't make any meaningful clinical conclusions about (1) the lack of effectiveness of DM, or (2) the safety of honey, and therefore the study's clinical impact is essentially nil. Hell, fls and Robinson have already proven that with their semantics masturbation session.

-Dr. Imago
 
Last edited:

ISF - Join now!

Every member here is approved by hand. No bots, no spam, just people who care about evidence and honest debate.

Membership is free!

Create your free account

Back
Top Bottom