Chris Haynes
Perfectly Poisonous Person
...
I don't know if your ignorance is feigned or real, but it is interesting to see how long you can drag this out.
Linda
....
Oh, it's real.![]()
Just sayin'.
...
I don't know if your ignorance is feigned or real, but it is interesting to see how long you can drag this out.
Linda
....
Oh, it's real.![]()
If you're talking about the Ioannidis article, it doesn't deal with homeopathy. If you're talking about some other article, which one?Did you read the paper that I referenced? It explains why the number of potential candidates for a homeopathic treatment is very important. If I want to test whether or not water that has come in contact with a specific chemical can help my cough, there are thousands of chemicals to be tested, and so I would be performing thousands of tests to try each one.
This analysis makes perfect sense.Exactly. And how do we know if they work better than placebo (because there are always going to be differences between the treated and the untreated groups, especially if there's bias)? We look for a difference that is so large that we'd only expect to see it one time in twenty due to chance, in the absence of bias. We don't know for sure that it works, but there's only a 5% chance that it doesn't. Except that when we do a thousand tests, 50 of them are going to be labelled as "positive" due to chance.
Nothing -- they just have no relevance to the issue under investigation, which is whether homeopathic medicines outperform placebos.You have mixed up what are assumptions and what are conclusions. My assumptions were that any chemical is a potential candidate for effect (and there are at least 100,000 chemicals present on earth), and that any medical condition is a potential candidate for relief (and there are at least 100 different medical conditions in humans). What is unrealistc about those assumptions?
The whole analysis is inapplicable. You have confused an individual medical test with a controlled study. While many medical tests, such as mammograms, have a known high ratio of false positives to true positives, that is not true of a properly done controlled study, such as the study of the effectiveness of a homeopathic or non-homeopathic medicine. Therefore, your estimate that "there is a 0.15% chance that the positive study represents a true positive" is wildly off-base. Rather, as you seem to agree above, it's 95% (standard confidence interval), in the absence of bias.I simply applied a straightforward 2x2 analysis to those assumptions and reported the result. If you think the result is unrealistic, then what numbers would you use?
But you erroneously assume there is an enormously high ratio of false positives to true positives in homeopathic trials.No, I wasn't trying to find a comparable medical test and estimating the result from that.
But, in the absence of bias, we know that the odds of a false positive are no more than 5% in a controlled trial. You assume, with no basis, that it's vastly higher than that when a homeopathic medicine is studied.That was the whole point of the exercise!!! How do we figure out how likely it is to have a false-positive? We calculate it using a 2x2 table. We don't just assume it's some arbitrary number.
Again, you're confusing an individual medical test with a controlled study. Our previous dialog went like this:No it doesn't. Whether or not my mammogram represents a true-positive or a false-positive has nothing to do with whether or not the woman ahead of me in the line has a negative mammogram.
How is the "pre-test probability" determined for homeopathy studies, other than by making up a number?NO!!! The probability that it is an effective medicine depends upon the pre-test probability (in the form of odds) and the likelihood ratio. When you talk about the results of a clinical trial, all that it determines for you is the likelihood ratio. You cannot assume that the post-test probability is the same as the likelihood ratio!!! That is a meaningless assumption!! You are essentially saying that "a*b=b" no matter what the value of "a" is.
All that you have done in your analysis is assumed that homeopathic medicines are ineffective by using a miniscule "pre-test probability" and then derived a low post-test probability. If you think that this is a proper analysis, run it by a statistician and see what (s)he says.The whole point of this post was that if you apply the results of the trial to the pre-test probability like you are supposed to do in order to make a valid conclusion, the post-test probability is dramatically different when you are looking at studies of homeopathic treatments. The reason that this isn't usually mentioned specifically in conventional medicine trials is because the pre-test probabilities are usually close to 1 - i.e. they represent a special case.
... it's time for me to stop.
Linda
Same over here until recently. They're now changing the rules to allow (after suitable training) Pharmacists to prescribe and dispense a large selection of POM items for a variety of common maladies. Helps take the workload of all to busy Doctors and saves the patient a trek to the surgery and back when they ask the Pharmacist for advice on common problems, Pharmacist knew how to treat but still had to send patient to the Doctor for a script.
Rodney,
It is clear from your responses that you do not have the foggiest idea what I am talking about. And my attempts to thwart ignorance seem to be having the opposite effect as you respond with statements that are increasingly wrong.
When the only appropriate response to each of your statements is something that would be quite inappropriate to say, it's time for me to stop.
Linda
Well done Rodney. You've pushed away a person who was:
* Working in the relevant field
* Had relevant qualifications
* Had taken graduate courses in statistics
* Was PATIENT. Oh, SO patient
And now you will be left with a group of people who have tried to explain to you already the problems with your argument and with homeopathy, and who have watched as Linda did a better job than we ever could at explaining it to you.
To wit - the zoo keeper has just left the building, and you're a gazelle in a cage with hyenas.
Linda: Thankyou so much. I have learnt a great deal just from reading your posts, they were in-depth, informative, and (fairly) easy to grasp (I think that owes a great deal to your clarity in explanation).
The whole point of this post was that if you apply the results of the trial to the pre-test probability like you are supposed to do in order to make a valid conclusion, the post-test probability is dramatically different when you are looking at studies of homeopathic treatments. The reason that this isn't usually mentioned specifically in conventional medicine trials is because the pre-test probabilities are usually close to 1 - i.e. they represent a special case.
What's the point? Remember the "evaluating psychics' accuracy" thread? you asked for the opinions of some doctors. When we got them, they didn't agree with you, so you decided they weren't good enough.If you think I'm wrong, see if you can find a statitistician who agrees with her.
But they didn't agree with each other, either.What's the point? Remember the "evaluating psychics' accuracy" thread? you asked for the opinions of some doctors. When we got them, they didn't agree with you, so you decided they weren't good enough.
First, let's get that opinion, and then we can talk about it.If we get the opinion of a statistician who agrees with Linda, you'll just move the goalposts.
My general comment is that the jury is still out on homeopathy. I also note Peter Fisher's comment on the 2005 Lancet study:Meanwhile, do you have any comment on Edzard Ernst's systematic review, or any of the other meta analyses published over the last 15 years?
Have you found any evidence of the good quality work that the authors of the 1991 paper that you have repeatedly cited said was needed to find out whether homoeopathy actually works? Published trials, meta analysis discussing them, that sort of thing?
Do you have any comment on the failure of manufacturers of homoeopathic medicines to demonstrate efficacy of any homoeopathic medicine during the 20 years during which they couldn't be introduced to the UK market without demonstrating efficacy?
My general comment is that the jury is still out on homeopathy. I also note Peter Fisher's comment on the 2005 Lancet study:
"The meta-analysis at the centre of the controversy is based on 110 placebo-controlled clinical trials of homeopathy and 110 clinical trials of allopathy (conventional medicine), which are said to be matched. These were reduced to 21 trials of homeopathy and 9 of conventional medicine of ‘higher quality’ and further reduced to 8 and 6 trials, respectively, which were ‘larger, higher quality’. The final analysis which concluded that ‘the clinical effects of homoeopathy are placebo effects’ was based on just the eight ‘larger, higher quality’ clinical trials of homeopathy. The Lancet's press release did not mention this, instead giving the impression that the conclusions were based on all 110 trials.
"The criteria for the matching of the homeopathic and conventional trials were not clearly stated, and it is evident from the numbers above that the clinical trials of homeopathy and conventional medicine were not, as claimed, well matched—the homeopathic trials were generally of better quality. And this is a crucial parameter [as Shang et al. acknowledge]; it is well established that high quality trials are less likely to be positive than those of lower quality. Because of the individualization involved, it is difficult to do large-scale trials of homeopathy (again this is evident from the figures above), so the final sample is unlikely to be representative of trials of homeopathy. An example is a study that may have been included in the final eight, which looked at the use of a homeopathic medicine for prophylaxis of influenza, an indication for which it is not recommended, and obscured the identity of the homeopathic medication. However, a Cochrane Review has concluded that it is probably effective for treatment (as opposed to prevention) of flu-like illnesses. A number of similar instances could be cited, but since we do not know which studies are under discussion, there is little point." See http://ecam.oxfordjournals.org/cgi/content/full/3/1/145
You have repeatedly cited a fifteen year old study which concluded that "at the moment the evidence of clinical trials is positive but not sufficient to draw definitive conclusions because most trials are of low methodological quality and because of the unknown role of publication bias. This indicates that there is a legitimate case for further evaluation of homoeopathy, but only by means of well performed trials." Is there any sign that these "well performed trials" have been carried out, and that they have shown homoeopathy to be effective?My general comment is that the jury is still out on homeopathy.
… We analysed trials of homoeopathy and conventional medicine and estimated treatment effects in trials least likely to be affected by bias. …
This is hardly a recommendation for homeopathy, it means that most customers are merely wasting money in an allowed bunko scheme. And it doesn’t mean homeopathy is harmless:INTERPRETATION: Biases are present in placebo-controlled trials of both homoeopathy and conventional medicine. When account was taken for these biases in the analysis, there was weak evidence for a specific effect of homoeopathic remedies, but strong evidence for specific effects of conventional interventions. This finding is compatible with the notion that the clinical effects of homoeopathy are placebo effects.
British holidaymakers are putting their lives at risk by relying on homeopathy to protect them against malaria, doctors have warned. …
Worryingly, all of the homeopaths recommended they take alternative remedies over conventional anti-malaria pills.
Among the remedies, which ranged in price from £3.75 to £75, were Malaria officinalis (CORR) tablets. Also known as Malaria nosode, they are made from African swamp water, rotting plants and mosquito eggs and larvae.
Do you think I don't understand the hydrostatic paradox of controversy? If you had a bent tube, one arm of which was the size of a pipe-stem and the other big enough to hold the ocean, water would stand at the same height in one as in the other. Thus discussion equalizes fools and wise men in the same way, and the fools know it.
Burden of proof, Rodney.I agree that Linda has made a major contribution to this thread; however, I find her statistical analysis of homeopathy studies invalid. If you think I'm wrong, see if you can find a statitistician who agrees with her.