Homeopathy: Rustum Roy drops the bomb

Can't contribute much to this discussion (though I have enjoyed reading it) - but I found a paper which defined envelope of differences for the purposes of their usage and I wondered if you could work out a definition from that?

http://www.riskmania.com/pdsdata/AMulti-factorStatisticalModelforInterestRates-ch4.pdf

Envelope of differences: the difference
between the position’s median Mark-to-
Future value and its potential future value at
the 97.5th or 2.5th percentile at each time step.​
​


Actually, although I find the context incomprehensible, the mention of 97.5th and 2.5th percentiles sounds as if somebody is using standard deviations in there. 2.5th to 97.5th percentiles is ± 2 standard deviations from the mean.

At a wild, semi-educated guess, this definition might simply be that the "envelope" is produced by joining up all the -2SD points below the means and the +2SD points above the means. Makes some sort of reasonable sense to me.

We know that Roy has not done this, because if he had, it would be impossible for the lines to cross. And some of them do. Also, the resulting lines would not be individual spectra at all, still less "representative" spectra. While in fact all the "representative spectra" traces are lines on the "envelope of differences" figure.

So I still think he just chose a couple of traces for each preparation and called them "envelope of differences". And also "representative spectra".

How is it possible to be this incompetent? And for the scrutineering to be this incompetent?

I mean, if you're going to obfuscate and wiggle and wave your hands like this, deliberately misrepresenting your data, why not just make the data up while you're about it? Then you could make it credible, too. And we'd actually have to try to repeat the experiment to show you'd invented the results, and you could just accuse us of being rubbish at doing the experiment, and we'd be here till Kingdom Come.

It's beyond me.

Rolfe.
 
OK, just for the record, here's the actual text that went in the envelope with the stamp stuck on it. It's not much changed from the draft above.

Wilsontown - do you think the people over at Bad Science would like to see it? I'd post it myself, but I never managed to register there and it's a while since the site has accepted unregistered comments.

27th August 2007.

Dr. Peter Fisher,
Editor, Homeopathy,
The Royal London Homoeopathic Hospital,
60 Great Ormond Street,
London, WC1N 3HR.

Dear Sir,

We wish to draw to your attention serious anomalies and incongruities in the UV absorption data presented in the paper by Rao et al., published in your July 2007 issue [1].

In a study of this nature, which in effect is examining multiple samples of ethanol, the over-riding concern must be absolute uniformity in the source of the solvent. For the data to be valid, it is essential that every drop of ethanol used must be sourced from the same stock bottle. However, the authors fail to make any mention of this point, and it is clear from the results presented that the source of ethanol in this investigation was most certainly not uniform.

The most striking anomaly is the UV spectrum presented for "plain ethanol", a single trace repeated three times in figure 3. The provenance of this sample is not recorded. This trace reveals extremely high absorbance (greater than 0.8 absorbance units) at 250nm, falling off steeply towards 400nm but still above 0.4 units by 350nm, and demonstrating an absorbance peak of 0.65 units with a l-max of about 330nm. It is simply impossible to represent this trace as being ethanol of any recognised degree of purity. Spectroscopic grade ethanol has an absorbance of less than 0.05 units between 250 and 400nm [2], and even USP/NF pharmaceutical grade ethanol has an absorbance of less than 0.3 units at 250nm, falling off to less than 0.1 units by 270nm [3]. If the substance measured by the authors as "plain ethanol" was indeed ethanol at all, it is clear that it contained extremely high levels of impurities, possibly including acetone.

In contrast, the spectra of the samples which were diluted and succussed (Nat mur, Nux vomica and the "succussed ethanol" with no mother tincture), and which were presumably all supplied by Hahnemann Laboratories as detailed on page 178, demonstrate substantially lower levels of impurities. While still not being spectroscopic grade ethanol, these samples could well represent ordinary pharmaceutical grade ethanol. The authors claim these samples are "different", however the evidence presented for this is weak to nonexistent.

Figure 1 presents one trace each for Nat mur and Nux vomica, each at 6C, 12C and 30C potencies. The traces are said to be "representative", however with no information on repeatability or how the "representative" traces were selected, it is impossible to say whether there is any real difference between any of the six spectra.

Figure 2 purports to address this point, but then fails to present the necessary data. The legend declares that 10 samples of each of the six remedy preparations were analysed. The accepted way to present such data would be as mean absorbance ± standard deviation for each wavelength point, or at least for a representative selection of wavelength points. Statistical analysis could then be used to demonstrate whether or not there was a real difference between any of the remedies or potencies. However, the authors have instead chosen to present only two traces for each preparation, as "envelopes of differences". The derivation of these traces is not explained, although we surmise that "extreme" high and low traces for each preparation were chosen to provide an impression of the range of results obtained. This is not an appropriate method of handling data of this nature, as most of the information is lost and statistical analysis is rendered impossible.

A further difficulty with figure 2 is that the upper (open circles) trace in the top graph of fig 2a (30C Nat mur) appears to be a duplicate of the upper (filled circles) trace in the top graph of fig 2b (30C Nux vom). Comparison with other traces of the two remedies indicates that this trace is really one of Nux vom, which has been duplicated into the Nat mur graph in error.

Paucity of data, ambiguity of presentation and lack of statistical analysis prevent any conclusions being drawn from the information in figure 2.
Comparison of figure 2 with figure 1 reveals that all six traces presented in figure 1 are taken from figure 2, in each case the filled-circles traces. If indeed the traces in figure 2 represent the extreme range of results obtained, this is startling, as the traces in figure 1 are stated to be "representative". In addition, while it does appear that the Nux vom samples tended to demonstrate higher absorbances than the Nat mur samples (excluding the obvious mistake noted above), in two out of the three potencies the higher Nux vom trace from fig 2 has been chosen for inclusion in fig 1, thus exaggerating the apparent difference.

Figure 3 (b and c) again repeats the same six traces as figure 1, this time grouped by remedy. Presented in this way, it is clear that there is absolutely no difference between the three potencies of Nat mur, and that while variation between the Nux vom potencies is a little more pronounced, again all three appear to come from the same population. The same is true of the three potencies of "succussed ethanol" presented in fig 3a.

On simple visual inspection it does appear that there may be genuine differences between the three remedies (although no statistics are presented to allow this to be tested), with the Nat mur showing the lowest absorbtion and the Nux vom the highest, with the succussed ethanol lying somewhere between. Nevertheless, these differences are entirely consistent with small differences in purity of the ethanol stock used for preparation of the three remedies - small, that is, relative to the very high level of impurity evident in the "plain ethanol" sample presented alongside. This degree of variation in UV absorbance is entirely to be expected between different batches of pharmaceutical grade ethanol, which is not prepared with spectroscopic analysis in mind. The authors make no mention of having stipulated to Hahnemann Laboratories that all material sent to them should be prepared from the same stock bottle, and the data presented indicate that the different remedies, possibly prepared at different times, simply came from different bottles of ethanol.

We hope you will agree that these are very serious points, and it is regrettable they were not identified by your own scrutineering process. It is clear that the data presented are wholly inadequate to support the authors’ assertion that UV spectroscopy can differentiate between the two remedies, and between different potencies of the remedies. If the authors wish to test their assertion so that it can be substantiated it will be necessary to repeat the work from the beginning, ensuring that all samples used in the study are sourced from the same bottle of stock solvent, that all duplicate preparations for precision assessment are separately prepared de novo from the mother tinctures, and that sufficient data are generated to allow robust and valid statistical analysis of the results.

Yours faithfully,

Rolfe
JJM
Wilsontown
Pipirr

References:
1. Rao, M. L., Roy, R., Bell, I. R. & Hoover, R. (2007) The defining role of structure (including epitaxy) in the plausibility of homeopathy. Homeopathy 96, 175-182.
2. Sigma Aldrich catalogue, ACS spectrophotometric grade ethanol 95.0%, at www.sigmaaldrich.com/catalog/search/ProductDetail/SIAL/493511
3. Sigma Aldrich catalogue, USP/NF grade ethanol 190 proof, at www.sigmaaldrich.com/catalog/search/ProductDetail/ALDRICH/493538


Rolfe.
 
I can post it for you, if you like, Rolfe. Do you want it in the blog (under the appropriate paper discussion), or in the forums, or both?
 
I was thinking about the "journal club" part of the blog, under the discussion of the paper. Someone else had some interesting (and scathing) comments on the Raman spectroscopy there too. But wherever you think it's most appropriate, really.

Rolfe.
 
Rolfe:

Again, congratulations on a job very well done. It will be very interesting to see what happens next...
 
Rolfe:

Again, congratulations on a job very well done. It will be very interesting to see what happens next...


If anything....

I've still to drop a copy off to Elsevier - I haven't written the "more in sorrow than in anger" covering letter yet. Tonight.

I don't suppose anyone will take a blind bit of notice. They don't want to test their hypotheses, all they want is "publications in a peer-reviewed journal" they can point to and say, look, there's real science behind this nonsense. This paper fulfils that need perfectly, and I imagine has been written for precisely that purpose.

However, at least we can say we've done our bit, and gone through the proper channels to draw attention to the abysmal academic standards of the thing.

Rolfe.
 
I don't suppose anyone will take a blind bit of notice.

You may well be right, but that in itself would tell us something about the standards employed at Homeopathy. Perhaps not anything we don't already know, admittedly.

As a suggestion: Rather than sending it to Peter Fisher as a letter, it might be worth submitting it to Homeopathy as an article, entitled 'Comment on “The defining role of structure (including epitaxy) in the plausibility of homeopathy”'. Then they would surely have to find an excuse not to publish it, which should be at least entertaining. The downside would be that Rao et al. would normally get a chance to respond, which would probably just further muddy the water.
 
Ah well, it's in the hands of the postman now. But that doesn't mean we can't re-submit it in the form you suggest if he ignores the letter.

Hey, anyone know what happened to typondis? He she or it is now showing up as a "guest", and has not posted since about 5th August. The "guest" designation on H'pathy Forums usually means you've been banned, but not here as far as I know, and I see no record of any disciplinary action taken against this poster.

Rolfe.
 
Hey, anyone know what happened to typondis? He she or it is now showing up as a "guest", and has not posted since about 5th August. The "guest" designation on H'pathy Forums usually means you've been banned, but not here as far as I know, and I see no record of any disciplinary action taken against this poster.


IIRC, Kumar asked to be voluntarily de-registered, and he shows up as a "guest".
 
IIRC, Kumar asked to be voluntarily de-registered, and he shows up as a "guest".


Hmmm. Joined 2nd August, made 19 posts, last post 5th August. Hardly seems worth it, does it?

And he accused me of being touchy!

Rolfe.
 
Oh, that's good! So Peter may be getting some more correspondence? I've heard not a syllable about our letter, needless to say.

Rolfe.
 
I just posted a copy of the letter on Philip Ball's blog. Seemed appropriate since Peter Fisher had already commented there. Maybe he should attend to his correspondence instead of adding comments to blogs?

Rolfe.
 
Bringing up Rustum Roy, he's been in the news again for salt water fuels

http://www.ctv.ca/servlet/ArticleNews/story/CTVNews/20070911/salt_water_070911/20070911/

Has this been discussed elsewhere? And do his findings have any merit to them WRT salt water? (I now have a very biased impression of his work after reading through these forums)

ETA : *I know this doesn't have to do with homeopathy, but it does seem to be another bomb that RR has dropped on us lately...
 

ISF - Join now!

Every member here is approved by hand. No bots, no spam, just people who care about evidence and honest debate.

Membership is free!

Create your free account

Back
Top Bottom