I'm afraid I consider this criticism to be totally unfounded.
The experiment used a before-and-after set of matched controls; the patients' performance on the test prior to meditation experiments was compared to their performance afterwards, and difference were found. Therefore, he concludes that meditation has a causal effect on attentional performance, instead of attentional performance having an effect on meditation. Prior studies, which looked only at meditational experts controlled with "normals" were only able to show a correlation between the two, but not a causal arrow.
Except that he has not present ALL the data. His conclusion is based ONLY on the results for spotting the second number "
if it appeared within half a second after the first target".
It smacks of data mining to get the desired result.
What is the scientific basis for excluding the other results? We don't know because it is not discussed.
What is the scientific significance of this 1/2 second period? We don't know because it is not discussed.
Does the other data show significant positive results for either of the groups? We don't know because it is not presented and not discussed.
I'm willing to concede that a non-meditation control group trained on the character recognition test for a similar period is not necessarilly a damning flaw in the experiment. I objected initially because it's exclusion undermines the experiment's ability to stand on it's own as supporting the conclusion WITHOUT the preceding experimental results to support the supposition.
I DO object that (seemingly) only supporting data has been presented in order to prove the hypothesis and conclusion.
My other objection was that part of the conclusion states, "
This shows that attention capabilities can be enhanced through learning."
This may well be quite valid but has not clearly been demonstrated
1. through his data mining of the results and
2. "learning" has not been investigated, only meditation. The conclusion IMPLIES that meditation is a superior learning technique for this particular test, but ALTERNATIVES are not investigated.
To me it the experiment really doesn't do much to promote the significance of meditation in learning because of these flaws.