Homeopathic Cough Medicine

Okay, thanks for the calculation, Linda. However, as I'm having trouble understanding the model, let me ask you this: If all 107 of the homeopathic trials discussed in the 1991 British Medical Journal article had been positive, what overall percentage of a true positive would the model calculate?

Well Rodney, no point in avoiding the real issue here.
I think what you have just found out, as explained by fls, is that there is a 1.1% chance that there is a real positive trial among those 81 listed. In other words, the chance of finding a true positive trial (i.e. one showing an actual effect above placebo taking place) is 1.1% of 81 trials.

Of course, I'm not sure if I'm allowed to make calculations with the numbers like that, but here goes:

1.1% of 81 is just under 0.9, in other words, we're not even sure that just one of those 81 positive trials may be for real.
And on top of that, even if we knew for certain that at least one trial was a true positive for sure, we don't know which one that might be.
So overall, it's far more likely to conclude that even that one potentially true positive trial is just as bogus as the rest of 'em, and just a result of dumb luck making it look like something's happening. Don't forget that the trials making publication are probably the best of a series of trials, so they're already selected because they look better than average.

How does this change your opinion on homeopathy though, Rodney?
 
Well Rodney, no point in avoiding the real issue here.
I think what you have just found out, as explained by fls, is that there is a 1.1% chance that there is a real positive trial among those 81 listed. In other words, the chance of finding a true positive trial (i.e. one showing an actual effect above placebo taking place) is 1.1% of 81 trials.

Of course, I'm not sure if I'm allowed to make calculations with the numbers like that, but here goes:

1.1% of 81 is just under 0.9, in other words, we're not even sure that just one of those 81 positive trials may be for real.
And on top of that, even if we knew for certain that at least one trial was a true positive for sure, we don't know which one that might be.
So overall, it's far more likely to conclude that even that one potentially true positive trial is just as bogus as the rest of 'em, and just a result of dumb luck making it look like something's happening. Don't forget that the trials making publication are probably the best of a series of trials, so they're already selected because they look better than average.

How does this change your opinion on homeopathy though, Rodney?
For the time being, not at all because Linda's calculated results make no sense to me. According to her, even if all 107 homeopathic trials had been positive, there would be only between a 1.5% (realistic) and 15% (unrealistic) possibility of a true positive. While I would be interested in hearing more from her as to how this could possibly be, I would suggest that we need to involve an unbiased statistician in the debate.
 
For the time being, not at all because Linda's calculated results make no sense to me. According to her, even if all 107 homeopathic trials had been positive, there would be only between a 1.5% (realistic) and 15% (unrealistic) possibility of a true positive. While I would be interested in hearing more from her as to how this could possibly be, I would suggest that we need to involve an unbiased statistician in the debate.

What it means Rodney, is that if you have a bunch of trials where, on average, for example, out of 10 sick people, about 5 get better after taking homeopathy, and only 3 people in the placebo group, then that's considered a "positive" trial. However, there's just as much chance that the numbers are reversed, and that 3 homeopathy people get better, and 5 placebo people.

There's more to the trials than just noting more people in one group got better compared to the other, there needs to be a sizable difference between both groups. This is the p value (being the value at which it is considered that the results are unlikely to be by chance).

Of the few homeopathy trials that actually DO come close to that specific value, most apparently don't come close enough to be considered a landslide success on their own. And since all the results are only positive by such an insignificant margin, the likelyhood that they're just the odd exception on the outer limits of chance is very, very high.

Specifically the fact that there's never any really remarkably impressive results is in itself a good indication that what DOES get published is just the best they could scrape together from a long list of failures.

But don't worry, I'm sure you'll eventually find an excuse, as you've done all throughout this thread, to dismiss all that you've learned and that has been made clear to you, and continue in your unshakable belief that there really might be something to homeopathy.
 
Last edited:
For the time being, not at all because Linda's calculated results make no sense to me.

Yeah, I knew they weren't going to make sense to you. The less you know, the more counter-intuitive it seems. And it's so exciting (I'm such a geek) to know this stuff and see how it all fits together, that I wish others could share my excitement. It's such a cool model.

According to her, even if all 107 homeopathic trials had been positive, there would be only between a 1.5% (realistic) and 15% (unrealistic) possibility of a true positive.

Yeah, I think that's part of why you're stuck. You're still looking at it as some kind of comparison between positive and negative studies. The negative studies don't matter; there don't even have to be any. Weird, huh?

While I would be interested in hearing more from her as to how this could possibly be, I would suggest that we need to involve an unbiased statistician in the debate.

You do realize that characterizing me as biased is based only on your desire for my information to be wrong, right?

Linda
 
Rodney is simply baiting us now by the simple tactic of gainsaying anything we write. It's Monty Python's Argument Sketch but in real life.

So can I suggest we simply ignore him from now on? To continue to "debate" him is only giving him the opportunity to continue this ridiculous farce.
 
Of the few homeopathy trials that actually DO come close to that specific value, most apparently don't come close enough to be considered a landslide success on their own. And since all the results are only positive by such an insignificant margin, the likelyhood that they're just the odd exception on the outer limits of chance is very, very high.

This isn't about weak studies and marginal effects. This is about the landslide studies. Even if you had 81 landslide studies, your PPV would only be something like 0.015 instead of 0.011. I realize that it seems to defy common sense. That's why I avoided bringing it up for so long, even though it's the most damning evidence against homeopathy.

The reason a bunch of landslide studies can't prove anything is that we don't know what we are looking for - the possibilities are unconstrained. Which means that we can't tell when we've found it and when we haven't found it.

Linda
 
For the time being, not at all because Linda's calculated results make no sense to me. According to her, even if all 107 homeopathic trials had been positive, there would be only between a 1.5% (realistic) and 15% (unrealistic) possibility of a true positive.

Yes, that is in fact what she's saying. It will be very difficult for you to understand this, however, without actually going and taking a class in advanced statistics. It is difficult for you to understand because it is counter-intuitive, but that doesn't make it wrong. It just makes it difficult to understand.

While I would be interested in hearing more from her as to how this could possibly be, I would suggest that we need to involve an unbiased statistician in the debate.

You do realise that Linda provided you with two sets of results to prove her point, right? That even the unrealistically high value she gave is too low to validate homeopathy?

An unbiased statistician probably wouldn't be so generous to you - they'd ONLY work with the realistic figures.

I'll try to explain this another way (Linda, please correct me if I'm wrong) - the reason the results are so low ISN'T because of the number of positive studies existing (or even the number of studies). It's because the thing being studied has no known way of working, so the value is INHERANTLY low.
 
I'll try to explain this another way (Linda, please correct me if I'm wrong) - the reason the results are so low ISN'T because of the number of positive studies existing (or even the number of studies). It's because the thing being studied has no known way of working, so the value is INHERANTLY low.

That's correct. And the key word is "known". One can assume that the thing being studied does work, but since there is no known way it could work, it would have to be by some unkown method. And because that method is unknown, we have no way of figuring out the details in advance - when does it work, when doesn't it work, what are the factors that influence how it works, etc?

Let's assume that there is a real effect. Water that has come in contact with a specific chemical in a particular manner, can have a curative effect on a specific condition. How can we discover this effect and understand it? We can start by testing a specific chemical in a specific condition. Which chemical for which condition? There's the rub. Since this could only work by some unknown method, we have no way of limiting our choices. As far as we know, any chemical could work on any condition. What is a key point to remember is that you cannot use the idea that you are testing (homeopathy) to constrain your choices if you are going to use the results as proof of your idea.

Let's say that there are 100,000 chemicals we could test (a very conservative number) against 100 different conditions (another conservative number). So there would be a total of 10,000,000 tests. And let's say that they are generally well done studies so that the bias is low and only 20% of the studies are positive due to chance and bias. So out of all those tests, 2,000,000 will be "positive". Now let's say that the number of true positives is 400 - for most conditions, there are several chemicals that have a curative effect. And using an average power, it is likely that we will pick up half of those true positives and miss the other half. So 200 of the 2,000,000 tests will be true positives. That means for every test that is a true positive, there will be 10,000 tests that are false positives. Since we have no way of telling which test is a true positive and which test is a false positive, the chance that a single test is correct is 0.01%

One way to figure out which are true positives is through reproducibility, right? So let's reproduce the 2,000,000 tests that were positive. Now 400,000 will be positive due to bias and chance. 200 of those tests were true positives and we will pick up 100 of those true positives the second time around. So now it means that when we reproduce the positive results, there will be 4,000 false positives for every true positive. So now we've improved our chance that a single test is correct to 0.025%

Is it starting to become clear why the positive results for homeopathy don't really tell us anything useful?

Linda
 
Last edited:
We should keep in mind that a small number of studies cannot validate all of homeopathy (or acupuncture or herbs). Proponents make thousands of claims, and each requires a full-blown (large number of patients), fully blinded and controlled, clinical study before it can be accepted. I will go out on a limb here, and suggest that none of the 81 (or 107) studies being discussed rises above the level of anecdote. After all, if one reliable study showed homeopathic efficacy, it would be front-page news, and the product would be known as medicine.

Note, every study of homeopathy (and herbs) needs to be independently analyzed to assure that the proponent has not added a clinically effective drug to the preparation.

So, instead of talking about a few score experiments, we should be weeding through them to see if one, or more, rises to the level of "evidence" rather than mere testimonial.
 
We should keep in mind that a small number of studies cannot validate all of homeopathy (or acupuncture or herbs). Proponents make thousands of claims, and each requires a full-blown (large number of patients), fully blinded and controlled, clinical study before it can be accepted. I will go out on a limb here, and suggest that none of the 81 (or 107) studies being discussed rises above the level of anecdote. After all, if one reliable study showed homeopathic efficacy, it would be front-page news, and the product would be known as medicine.

I think people often misunderstand the hierarchy of woo. Homeopathy is not a single claim, it is thousands of different ones. Even if one particular remedy is shown to work, this does not mean that every other one works as well, and in fact says very little about other remedies. It may be considered slightly more likely that other ones could work, since the principle would be proven, but every remedy would require its own testing.

Many new drugs are found by taking a known one and introducing random variations to it, then testing if the variants have any effect. If one variant is shown to work, this says nothing about whether the others work, they all require independant testing, although it does show that the method can work. Homeopathy is the same, with the important difference that so far there is no evidence that even a single homeopathic remedy does anything at all.
 
We should keep in mind that a small number of studies cannot validate all of homeopathy (or acupuncture or herbs). Proponents make thousands of claims, and each requires a full-blown (large number of patients), fully blinded and controlled, clinical study before it can be accepted. I will go out on a limb here, and suggest that none of the 81 (or 107) studies being discussed rises above the level of anecdote.

The 107 studies were the studies that rose above the level of anecdote. And of those 81 were positive.

After all, if one reliable study showed homeopathic efficacy, it would be front-page news, and the product would be known as medicine.

I agree that a fuss would be made about it, but it would be wrong to consider it medicine. If you look at my posts above, one reliable study has a less than one in a thousand chance of being true.

Note, every study of homeopathy (and herbs) needs to be independently analyzed to assure that the proponent has not added a clinically effective drug to the preparation.

Yes. This and other known methods (e.g. desentization) accounts for the bulk of the positive results in well-done trials.

So, instead of talking about a few score experiments, we should be weeding through them to see if one, or more, rises to the level of "evidence" rather than mere testimonial.

You did mention that you have not been following this thread. We have already gone through that issue in detail. At the risk of sounding immodest, to make it easier, if you just read my posts (excluding the ones dealing with non-homeopathic cough medicine), it should bring you up to speed on what we have already established.

If you did read through this thread, but feel that these points need to be re-made, then I apologize for my presumptuousness. <g>

Linda
 
The point, which you missed in spectacular fashion, is that Vicks Medinite is not, as far as I know, available as an over-the-counter medicine in the United States. I was therefore asking whether it is truly an OTC, as opposed to a prescription, medicine. The answer apparently is that, in the UK, it is somewhere in-between, being considered a controlled "Pharmacy Medicine."

As a quick clarification about the UK licenses:

Most of the pharmaceutical items that Joe Consumer will encounter fall under one of three categories.

GSL - General Sales License. Available pretty much everywhere including corner shops and supermarkets. This is the stuff that is hard to misuse or abuse or potentially low therapeutic value, pack size is normally restricted to 'not many'. Includes most cough medicines, Aspirin, paracetamol, Ibuprofen, basic indegestion remedies, some anti-histamines etc.

P - Pharmacy only. Must be provided under the supervision of a properly qualified Pharmacist. Stronger medication or larger pack sizes. Items that could cause problems if misused. Generally all this means is that you'll get asked if you've used this product before and a brief chat about usage, dosage, side effects etc if you haven't. Includes stronger pain killers (something + small codeine dose), hayfever remedies, mild sleep aids, PPIs etc

POM - Prescription Only Medicine. Pretty much what it says. The items here must have been prescribed by a qualified medical practitioner and dispensed under the supervision of a properly qualified pharmacist.

I'm not sure how the American system works as it sounds like an either\or proposition, either you can pick it up at your grocery store OR it's only available on prescription, so hesitate to venture to comparisons (even if it wouldn't derail the thread) about which is the better system.
 
I'm not sure how the American system works as it sounds like an either\or proposition, either you can pick it up at your grocery store OR it's only available on prescription, so hesitate to venture to comparisons (even if it wouldn't derail the thread) about which is the better system.
That is correct. Either it is Over-the-Counter (OTC) or it is prescription.

Pharmacists are a (underused) repository of information, but they have no prescription authority.
 
Yeah, I knew they weren't going to make sense to you. The less you know, the more counter-intuitive it seems. And it's so exciting (I'm such a geek) to know this stuff and see how it all fits together, that I wish others could share my excitement. It's such a cool model.
Do you have a degree in statistics, Linda?

Yeah, I think that's part of why you're stuck. You're still looking at it as some kind of comparison between positive and negative studies. The negative studies don't matter; there don't even have to be any. Weird, huh?
Yes, extremely so. In fact, I think there is a Nobel prize in this for someone -- IF it's truly a new cutting-edge model, as opposed to malarkey. ;)

You do realize that characterizing me as biased is based only on your desire for my information to be wrong, right?
I wasn't characterizing you -- I'm simply suggesting that we could benefit from the wisdom of a statistician who doesn't care one way or another whether there is any validity in homeopathy.
 
That is correct. Either it is Over-the-Counter (OTC) or it is prescription.

Pharmacists are a (underused) repository of information, but they have no prescription authority.

Same over here until recently. They're now changing the rules to allow (after suitable training) Pharmacists to prescribe and dispense a large selection of POM items for a variety of common maladies. Helps take the workload of all to busy Doctors and saves the patient a trek to the surgery and back when they ask the Pharmacist for advice on common problems, Pharmacist knew how to treat but still had to send patient to the Doctor for a script.
 
Yes, extremely so. In fact, I think there is a Nobel prize in this for someone -- IF it's truly a new cutting-edge model, as opposed to malarkey. ;)

No there isn't. Just because you don't understand it doesn't mean it's worth a Nobel prize. New maths and new models are thought up all the time in every branch of maths and science. No-one could expect to understand all of them, but the fact that you don't is not a valid reason to criticse them.

I wasn't characterizing you -- I'm simply suggesting that we could benefit from the wisdom of a statistician who doesn't care one way or another whether there is any validity in homeopathy.

Why do you imply that Linda is not one of these? Most people here don't actually care one way or the other, they simply see the evidence and come to the only valid conclusion. I believe Linda is a doctor, in which case it is in her interest to support any treatment that works. In this case it is clear that homeopathy doesn't work, and therefore she doesn't support it.
 
jjm said:
After all, if one reliable study showed homeopathic efficacy, it would be front-page news, and the product would be known as medicine.
I agree that a fuss would be made about it, but it would be wrong to consider it medicine. If you look at my posts above, one reliable study has a less than one in a thousand chance of being true.
I should have been more exact. By "reliable" I meant a phase III clinical study. I doubt we will ever see one for any homeopathic claim.
 
That is correct. Either it is Over-the-Counter (OTC) or it is prescription.

Pharmacists are a (underused) repository of information, but they have no prescription authority.

There is beginning to be an unofficial class of drugs similar to "Pharmacy only" in the US. Essentially the drugs are behind the pharmacy counter so there is contact with a pharmacist and not just some minimum-wage cashier. Currentlly, rememdies containing psuedoephedrine are being moved back behind the counter and the allergy remedy Claritin has been advertising that it's now behind the pharmacy counter because the manufacturer did not change the formulation to meet OTC regs.
 
The point, which you missed in spectacular fashion, is that Vicks Medinite is not, as far as I know, available as an over-the-counter medicine in the United States. I was therefore asking whether it is truly an OTC, as opposed to a prescription, medicine. The answer apparently is that, in the UK, it is somewhere in-between, being considered a controlled "Pharmacy Medicine."

You might acquaint yourself with the regulations of various countries. In Australia, for instance, "Pharmacy Only" means products so marked can only be sold in accredited pharmacies, by accredited pharmacists. The reason for this is that the products so marked usually contain powerful drugs that do have effects above placebo, such as opiates, etc.

These products do not require a prescription, but are regulated by the pharmacist.

True homeopathic products, on the other hand, can be sold at children's sweets counters -- reflecting their utter harmlessness and uselessness for treating any real ailment.

M.
 

ISF - Join now!

Every member here is approved by hand. No bots, no spam, just people who care about evidence and honest debate.

Membership is free!

Create your free account

Back
Top Bottom