I can't imagine experts conducting a study to be blind to what they are conducting the study about; how then are they going to design the study?
Eliminating bias is one of the hardest things to do. There may be some kinds of topics where I'm not sure it can be done.
Let me try and give an example in a nutshell of how hard the testing would be and things we would need to watch for.
First, we must
expect subject/observer bias and somehow account for it or eliminate it. In the US alone, well over 50% believe in the possibility of supernatural effects on a study. Additionally, there is a population who feel that such belief is a fundamental
good. Even if they did not experience any effect they might well choose to pursue that 'good' despite the evidence. So, we should expect measurement bias from testers
and participants.
We might think that the best way to test meditation is with some really experienced Buddhists, but that is probably not the case. Things like diet, culture, and social standing need to be eliminated, and a good Buddhist is not going to just meditate, they are going to eat well. (or we would study diet). They may live in a less industrialized society with different stresses etc.
That might be very interesting to study but let's say we want to only study the benefit of meditation.
A team of experts who knew what the study wanted to show would need to design some test questions that measure expected results - "enlightenment". this group cannot know anything about how the study will actually be done. These experts will not do any interviewing.
For the test group itself, what we'd really want is a large group who have little or no experience with meditation. They would need to be from similar socio economic background, and similar diets.
We then need a group of interviewers. These interviewers know nothing about anything but the questions before them. Each test group member is interviewed and scored by the 'blind' interviewers.
The test group would then be split into three or more subgroups:
1: One group does meditation (how do we verify that happens?)
2: One group does nothing (no sneaking in any side meditation)
3: But there needs to be a third group. What would they do? It would need to be something like a placebo that was like meditation but not meditation. Give them something like a pill and tell them it produces the effects of meditation like calmness and serenity.
The test subjects don't know what the study is really about. The interviewers don't know either.
It would be best if the experts knew nothing about the test protocols until the testing was over and everyone was scored. The people who handle managing the actual groups cannot be involved in the testing.
At the end of six months, the entire group is reinterviewed with the same questions. The testers know nothing about the methodology, and simply reinterview.
These interview questions would then be turned back over to the experts and evaluated. The experts should be able to identify which subjects meditated to more than chance. (To be determined).
Whew. ok, I think that is a triple blind study.
Even with all that, I can see places where bias might enter. Remember that both the test subjects and testers might want to believe or not. The experts could design poor questions, or include subtle clues about who was tested for meditation. The questions might not measure what I mentioned before - potential for harm.
There's a lot that can go wrong. A big question would be - could the study be duplicated with similar results just by following the protocols?