Huh? A double blind placebo study on bronchial function isn't testing efficacy and effectiveness?
Right. "Double blind placebo study" describes the experimental design. Whether or not that experimental design is testing efficacy or whether it is testing something else depends upon the study population and what is being measured. The experimental design mostly affects internal validity - the extent to which the results reflect the effect of the intervention. The choice of population and what to measure affects external validity - the extent to which the results are relevant to the questions asked in the real world. In the case of efficacy and effectiveness, those questions are "does this intervention make me better", where better refers to clinically relevant outcomes - reduction in disease, clinically relevant improvements in symptoms, avoidance of death, prevention of disease and impairment, etc. In the case of allergic rhinitis, better means non-trivial improvement in symptoms and improvement in impairment (missed work, avoidance of triggers, etc.). For diabetes, symptoms are almost immaterial compared to reductions in heart and kidney disease.
Now, we don't always measure the outcome of interest. In the case of diabetes, waiting for kidney disease to show up (or not) is not only much more expensive and onerous (this would need a much longer and much bigger study) than monitoring blood sugar, it's also unethical. Instead, we look at whether an intervention leads to tight blood sugar control, even though elevated blood sugar by itself is not a clinically relevant outcome - it doesn't cause symptoms or in the short term lead to any sort of impairment. But what it is is a critical intermediary step in the process whereby diabetes leads to kidney disease. And because we have also shown that high blood sugar leads to kidney disease and that control of blood sugar prevents kidney disease, we can reasonably make assumptions about treatments for diabetes based on their effects on blood sugar. Even so, additional studies are often done in order to confirm that this process is intact - that we do actually go on to see reductions in kidney disease with the use of a drug which controls blood sugar.
The outcome of interest in an allergic rhinitis study on efficacy is whether symptoms and impairments are improved. It isn't the result of a blood test, or the result of a test measuring something unrelated to the perception of those symptoms. Some people with allergic rhinitis also demonstrate airway hyper-reactivity. But air way hyper-reactivity is not responsible for the manifestations of allergic rhinitis. So demonstrating some alterations in airway reactivity does not tell you whether you have made someone's allergic rhinitis better. On the other hand, look at the outcomes measured in the homeopathy study - symptom severity, degree of impairment - exactly the outcomes we need to know if we want to know whether someone has been made better.
That is why the homeopathy studies are efficacy/effectiveness studies and the vitamin C studies are not.
At a quick browse, none of those articles support the assertion that, for example, the study on vitamin c and bronchial function I cited has "low reliability and validity"
It would be the article on what studies are useful to assess interventions.
Who gets to define "feeling better in a way that is somewhat substantial"?
The person who has the condition. Nobody defines feeling better as "a 10 percent drop in my CRP level", for example.
I'd suggest it's the person feeling better, not you. (unless of course it is you in that particular case!)
Exactly. And that's how we know what to look for - people want to live longer, suffer less impairment, have their symptoms reduced to a tolerable level, etc. They don't care about blood test results which are unrelated to their level of impairment, or care about trivial changes in their symptoms. Who is satisfied with a pain-killer which moves your pain from "excruciating" to "somewhat excruciating"?
Oh come off it. You dismissed a quality study because there were other studies in the area that showed something similar and no effect, or something similar from something that should have no effect.
Do you really believe that "pretty much all of medicine" is based on science that has never had studies that were inconclusive or negative?
That's not what I said. Negative and inconclusive studies are as much a part of the picture as conclusive or positive studies.
Ignorance of the substances mostly. If you can show me stuff that
(a) may plausibly be beneficial to health
(b) has little or no evidence to indicate it is risky to health
(c) has some supporting science, even if equivocal, that it may be beneficial to health
(d) has minimal other risk or cost
(e) my personal experience indicates it's beneficial to me
Then yeah, I'll give it serious consideration!
PS (e) isn't even necessary, given the potential long term benefits eg something like resveratrol, or heck, olive oil
You obviously missed the Tumeric thread.
I could turn you into my parents. I haven't made a strict count, but they take about 40 or 50 supplements every morning on the basis of (a) to (e). And of course, the number would be much higher if Canada's Therapeutic Health Directorate wasn't watching out for them. Much as I cringe to watch them, at least their approach is consistent, as opposed to those who only pick out one or two on the basis of happenstance.
Linda
