Homeopathic Cough Medicine

Did you read the paper that I referenced? It explains why the number of potential candidates for a homeopathic treatment is very important. If I want to test whether or not water that has come in contact with a specific chemical can help my cough, there are thousands of chemicals to be tested, and so I would be performing thousands of tests to try each one.
If you're talking about the Ioannidis article, it doesn't deal with homeopathy. If you're talking about some other article, which one?

Exactly. And how do we know if they work better than placebo (because there are always going to be differences between the treated and the untreated groups, especially if there's bias)? We look for a difference that is so large that we'd only expect to see it one time in twenty due to chance, in the absence of bias. We don't know for sure that it works, but there's only a 5% chance that it doesn't. Except that when we do a thousand tests, 50 of them are going to be labelled as "positive" due to chance.
This analysis makes perfect sense. :) So why do you contradict it below? :(

You have mixed up what are assumptions and what are conclusions. My assumptions were that any chemical is a potential candidate for effect (and there are at least 100,000 chemicals present on earth), and that any medical condition is a potential candidate for relief (and there are at least 100 different medical conditions in humans). What is unrealistc about those assumptions?
Nothing -- they just have no relevance to the issue under investigation, which is whether homeopathic medicines outperform placebos.

I simply applied a straightforward 2x2 analysis to those assumptions and reported the result. If you think the result is unrealistic, then what numbers would you use?
The whole analysis is inapplicable. You have confused an individual medical test with a controlled study. While many medical tests, such as mammograms, have a known high ratio of false positives to true positives, that is not true of a properly done controlled study, such as the study of the effectiveness of a homeopathic or non-homeopathic medicine. Therefore, your estimate that "there is a 0.15% chance that the positive study represents a true positive" is wildly off-base. Rather, as you seem to agree above, it's 95% (standard confidence interval), in the absence of bias.

No, I wasn't trying to find a comparable medical test and estimating the result from that.
But you erroneously assume there is an enormously high ratio of false positives to true positives in homeopathic trials.

That was the whole point of the exercise!!! How do we figure out how likely it is to have a false-positive? We calculate it using a 2x2 table. We don't just assume it's some arbitrary number.
But, in the absence of bias, we know that the odds of a false positive are no more than 5% in a controlled trial. You assume, with no basis, that it's vastly higher than that when a homeopathic medicine is studied.

No it doesn't. Whether or not my mammogram represents a true-positive or a false-positive has nothing to do with whether or not the woman ahead of me in the line has a negative mammogram.
Again, you're confusing an individual medical test with a controlled study. Our previous dialog went like this:

Rodney: "According to her, even if all 107 homeopathic trials had been positive, there would be only between a 1.5% (realistic) and 15% (unrealistic) possibility of a true positive."

Linda: "Yeah, I think that's part of why you're stuck. You're still looking at it as some kind of comparison between positive and negative studies. The negative studies don't matter; there don't even have to be any. Weird, huh?"

NO!!! The probability that it is an effective medicine depends upon the pre-test probability (in the form of odds) and the likelihood ratio. When you talk about the results of a clinical trial, all that it determines for you is the likelihood ratio. You cannot assume that the post-test probability is the same as the likelihood ratio!!! That is a meaningless assumption!! You are essentially saying that "a*b=b" no matter what the value of "a" is.
How is the "pre-test probability" determined for homeopathy studies, other than by making up a number?

The whole point of this post was that if you apply the results of the trial to the pre-test probability like you are supposed to do in order to make a valid conclusion, the post-test probability is dramatically different when you are looking at studies of homeopathic treatments. The reason that this isn't usually mentioned specifically in conventional medicine trials is because the pre-test probabilities are usually close to 1 - i.e. they represent a special case.
All that you have done in your analysis is assumed that homeopathic medicines are ineffective by using a miniscule "pre-test probability" and then derived a low post-test probability. If you think that this is a proper analysis, run it by a statistician and see what (s)he says.
 
Rodney,

It is clear from your responses that you do not have the foggiest idea what I am talking about. And my attempts to thwart ignorance seem to be having the opposite effect as you respond with statements that are increasingly wrong.

When the only appropriate response to each of your statements is something that would be quite inappropriate to say, it's time for me to stop.

Linda
 
Same over here until recently. They're now changing the rules to allow (after suitable training) Pharmacists to prescribe and dispense a large selection of POM items for a variety of common maladies. Helps take the workload of all to busy Doctors and saves the patient a trek to the surgery and back when they ask the Pharmacist for advice on common problems, Pharmacist knew how to treat but still had to send patient to the Doctor for a script.

Just for a bit of comparison...here in Australia the system is, much closer to the UK system.

The change happened a few years ago if I recall. The aim was to make it harder for meth labs to get there hands on pseudoephedrine by restricting and recording the sale of flu, cough and cold medicines containing them.
 
Rodney,

It is clear from your responses that you do not have the foggiest idea what I am talking about. And my attempts to thwart ignorance seem to be having the opposite effect as you respond with statements that are increasingly wrong.

When the only appropriate response to each of your statements is something that would be quite inappropriate to say, it's time for me to stop.

Linda

Well done Rodney. You've pushed away a person who was:

* Working in the relevant field
* Had relevant qualifications
* Had taken graduate courses in statistics
* Was PATIENT. Oh, SO patient

And now you will be left with a group of people who have tried to explain to you already the problems with your argument and with homeopathy, and who have watched as Linda did a better job than we ever could at explaining it to you.

To wit - the zoo keeper has just left the building, and you're a gazelle in a cage with hyenas.

Linda: Thankyou so much. I have learnt a great deal just from reading your posts, they were in-depth, informative, and (fairly) easy to grasp (I think that owes a great deal to your clarity in explanation).
 
Rodney, are you a chiropractor? That would explain a lot.
 
Well done Rodney. You've pushed away a person who was:

* Working in the relevant field
* Had relevant qualifications
* Had taken graduate courses in statistics
* Was PATIENT. Oh, SO patient

And now you will be left with a group of people who have tried to explain to you already the problems with your argument and with homeopathy, and who have watched as Linda did a better job than we ever could at explaining it to you.

To wit - the zoo keeper has just left the building, and you're a gazelle in a cage with hyenas.

Linda: Thankyou so much. I have learnt a great deal just from reading your posts, they were in-depth, informative, and (fairly) easy to grasp (I think that owes a great deal to your clarity in explanation).

I agree that Linda has made a major contribution to this thread; however, I find her statistical analysis of homeopathy studies invalid. If you think I'm wrong, see if you can find a statitistician who agrees with her.
 
Applicability of John Ioannidis's model

Anyone who is interested in references for further reading is welcome to PM me.

Linda
 
The whole point of this post was that if you apply the results of the trial to the pre-test probability like you are supposed to do in order to make a valid conclusion, the post-test probability is dramatically different when you are looking at studies of homeopathic treatments. The reason that this isn't usually mentioned specifically in conventional medicine trials is because the pre-test probabilities are usually close to 1 - i.e. they represent a special case.

The last line should read...

The reason that this isn't usually mentioned specifically in conventional medicine trials is because the pre-test odds are usually 1 or more - i.e. they represent a special case.

Linda
 
If you think I'm wrong, see if you can find a statitistician who agrees with her.
What's the point? Remember the "evaluating psychics' accuracy" thread? you asked for the opinions of some doctors. When we got them, they didn't agree with you, so you decided they weren't good enough.

If we get the opinion of a statistician who agrees with Linda, you'll just move the goalposts.
 
Meanwhile, do you have any comment on Edzard Ernst's systematic review, or any of the other meta analyses published over the last 15 years?

Have you found any evidence of the good quality work that the authors of the 1991 paper that you have repeatedly cited said was needed to find out whether homoeopathy actually works? Published trials, meta analysis discussing them, that sort of thing?

Do you have any comment on the failure of manufacturers of homoeopathic medicines to demonstrate efficacy of any homoeopathic medicine during the 20 years during which they couldn't be introduced to the UK market without demonstrating efficacy?
 
What's the point? Remember the "evaluating psychics' accuracy" thread? you asked for the opinions of some doctors. When we got them, they didn't agree with you, so you decided they weren't good enough.
But they didn't agree with each other, either. ;) Also, I'm still waiting for Huntsman's doctors to weigh in.

If we get the opinion of a statistician who agrees with Linda, you'll just move the goalposts.
First, let's get that opinion, and then we can talk about it.
 
Meanwhile, do you have any comment on Edzard Ernst's systematic review, or any of the other meta analyses published over the last 15 years?

Have you found any evidence of the good quality work that the authors of the 1991 paper that you have repeatedly cited said was needed to find out whether homoeopathy actually works? Published trials, meta analysis discussing them, that sort of thing?

Do you have any comment on the failure of manufacturers of homoeopathic medicines to demonstrate efficacy of any homoeopathic medicine during the 20 years during which they couldn't be introduced to the UK market without demonstrating efficacy?
My general comment is that the jury is still out on homeopathy. I also note Peter Fisher's comment on the 2005 Lancet study:


"The meta-analysis at the centre of the controversy is based on 110 placebo-controlled clinical trials of homeopathy and 110 clinical trials of allopathy (conventional medicine), which are said to be matched. These were reduced to 21 trials of homeopathy and 9 of conventional medicine of ‘higher quality’ and further reduced to 8 and 6 trials, respectively, which were ‘larger, higher quality’. The final analysis which concluded that ‘the clinical effects of homoeopathy are placebo effects’ was based on just the eight ‘larger, higher quality’ clinical trials of homeopathy. The Lancet's press release did not mention this, instead giving the impression that the conclusions were based on all 110 trials.

"The criteria for the matching of the homeopathic and conventional trials were not clearly stated, and it is evident from the numbers above that the clinical trials of homeopathy and conventional medicine were not, as claimed, well matched—the homeopathic trials were generally of better quality. And this is a crucial parameter [as Shang et al. acknowledge]; it is well established that high quality trials are less likely to be positive than those of lower quality. Because of the individualization involved, it is difficult to do large-scale trials of homeopathy (again this is evident from the figures above), so the final sample is unlikely to be representative of trials of homeopathy. An example is a study that may have been included in the final eight, which looked at the use of a homeopathic medicine for prophylaxis of influenza, an indication for which it is not recommended, and obscured the identity of the homeopathic medication. However, a Cochrane Review has concluded that it is probably effective for treatment (as opposed to prevention) of flu-like illnesses. A number of similar instances could be cited, but since we do not know which studies are under discussion, there is little point." See http://ecam.oxfordjournals.org/cgi/content/full/3/1/145
 
Holy Hannah! Stop the front page and rip out the presses, Rodney found a homeopath who disagrees with all the rational evidence against his quackery.

Rodney, show us one study that has elevated a homeopathic product to the category of "medicine." And be sure it can't be faulted for compounding a useful drug as the "homeopathic" remedy.
 
My general comment is that the jury is still out on homeopathy. I also note Peter Fisher's comment on the 2005 Lancet study:


"The meta-analysis at the centre of the controversy is based on 110 placebo-controlled clinical trials of homeopathy and 110 clinical trials of allopathy (conventional medicine), which are said to be matched. These were reduced to 21 trials of homeopathy and 9 of conventional medicine of ‘higher quality’ and further reduced to 8 and 6 trials, respectively, which were ‘larger, higher quality’. The final analysis which concluded that ‘the clinical effects of homoeopathy are placebo effects’ was based on just the eight ‘larger, higher quality’ clinical trials of homeopathy. The Lancet's press release did not mention this, instead giving the impression that the conclusions were based on all 110 trials.

"The criteria for the matching of the homeopathic and conventional trials were not clearly stated, and it is evident from the numbers above that the clinical trials of homeopathy and conventional medicine were not, as claimed, well matched—the homeopathic trials were generally of better quality. And this is a crucial parameter [as Shang et al. acknowledge]; it is well established that high quality trials are less likely to be positive than those of lower quality. Because of the individualization involved, it is difficult to do large-scale trials of homeopathy (again this is evident from the figures above), so the final sample is unlikely to be representative of trials of homeopathy. An example is a study that may have been included in the final eight, which looked at the use of a homeopathic medicine for prophylaxis of influenza, an indication for which it is not recommended, and obscured the identity of the homeopathic medication. However, a Cochrane Review has concluded that it is probably effective for treatment (as opposed to prevention) of flu-like illnesses. A number of similar instances could be cited, but since we do not know which studies are under discussion, there is little point." See http://ecam.oxfordjournals.org/cgi/content/full/3/1/145

Translated to English: If you include the piss-poor quality trials while making desperate excuses for their lack of results, pretend that other well-run trials with poor results would have been "good" if they hadn't stuck to accepted rules, and rapidly shift the goalposts to make a failed trial a barely ceded pass, homeopathy measures up.
 
My general comment is that the jury is still out on homeopathy.
You have repeatedly cited a fifteen year old study which concluded that "at the moment the evidence of clinical trials is positive but not sufficient to draw definitive conclusions because most trials are of low methodological quality and because of the unknown role of publication bias. This indicates that there is a legitimate case for further evaluation of homoeopathy, but only by means of well performed trials." Is there any sign that these "well performed trials" have been carried out, and that they have shown homoeopathy to be effective?

Hint: in the meantime, proponents of homoeopathy have taken to saying things like "it has been established beyond doubt and accepted by many researchers, that the placebo-controlled randomised controlled trial is not a fitting research tool with which to test homeopathy."
 
“Are the clinical effects of homoeopathy placebo effects? Comparative study of placebo-controlled trials of homoeopathy and allopathy.”
Lancet 2005 Aug 27-Sep 2;366(9487):726-32
Shang A, Huwiler-Muntener K, Nartey L, Juni P, Dorig S, Sterne JA, Pewsner D, Egger M

… We analysed trials of homoeopathy and conventional medicine and estimated treatment effects in trials least likely to be affected by bias. …
INTERPRETATION: Biases are present in placebo-controlled trials of both homoeopathy and conventional medicine. When account was taken for these biases in the analysis, there was weak evidence for a specific effect of homoeopathic remedies, but strong evidence for specific effects of conventional interventions. This finding is compatible with the notion that the clinical effects of homoeopathy are placebo effects.
This is hardly a recommendation for homeopathy, it means that most customers are merely wasting money in an allowed bunko scheme. And it doesn’t mean homeopathy is harmless:

One more reason homeopathy is not "harmless"
http://scienceblogs.com/insolence/2006/07/one_more_reason_homeopathy_is_not_harmle.php

British holidaymakers are putting their lives at risk by relying on homeopathy to protect them against malaria, doctors have warned. …
Worryingly, all of the homeopaths recommended they take alternative remedies over conventional anti-malaria pills.

Among the remedies, which ranged in price from £3.75 to £75, were Malaria officinalis (CORR) tablets. Also known as Malaria nosode, they are made from African swamp water, rotting plants and mosquito eggs and larvae.

The jury is not "out" on the subject of homeopathy; except in the minds of magical thinkers.

Oliver Wendell Holmes
Do you think I don't understand the hydrostatic paradox of controversy? If you had a bent tube, one arm of which was the size of a pipe-stem and the other big enough to hold the ocean, water would stand at the same height in one as in the other. Thus discussion equalizes fools and wise men in the same way, and the fools know it.
 
I agree that Linda has made a major contribution to this thread; however, I find her statistical analysis of homeopathy studies invalid. If you think I'm wrong, see if you can find a statitistician who agrees with her.
Burden of proof, Rodney.

If you think she's wrong, get a statistician who disagrees with her.

You won't, though, because, as I've repeatedly said, you're playing to the fence-sitting lurkers, and not to us at all.
 

ISF - Join now!

Every member here is approved by hand. No bots, no spam, just people who care about evidence and honest debate.

Membership is free!

Create your free account

Back
Top Bottom