I'd recommend not complicating the evaluation with two trials, which could have conflicting outcomes and then it'd be grounds to say that the results were ambiguous.
A run of 10 should be sufficient. If you get a positive result, you can talk about doing another run later as a replication with other witnesses.
OR... use a run of 20. 14/20 is a p value below .05, which is a common threshold for social sciences, and 16/20 is a p value below .01, which is more strict threshold in the social sciences and an entry-level threshold in medical research.
If they're interested in demonstrating something that is allegedly a natural phenomenon more like a physical force, it should be in an experiment with p value below 10^-6. They'd need to obtain at least 19/20.
Thanks for your contribution blutoski.
Here are the current suggestions:
A: 1 trial with 10 runs.
B: 1 trial with 20 runs.
C: 2 separate trials with 10 runs each.
THE CLAIMANT feels and believes that she's dealing with a natural phenomenon, in practise, a stream of "energy" that can heal people. I think we should go through extra effort to make sure that she is comfortable with all of the test conditions, before and after each trial. The open test plays a big part in this. How big? Who knows. I guess it depends on how much she is willing or able to fool herself IF the results are not good enough for a pass.
A: this would be the simplest and fastest, what would you suggest for a pass to replication? I know she claimed a 100% success rate, but I'd also like to give her some room for error.
Replication: 9 or more hits out of 10.
B: for me, the biggest question mark here is the length, we have to reserve 2 minutes for every healing session, that's 40 minutes already. Then the communication and transition. That would be at least another 40 minutes. 1 hour 20 minutes is a long time wearing all the equipment and keeping the "channels open". Afterwards she could try to convince herself that she had to regulate her "sensitivity" or something like that. One of our main objectives is to give her a good and fair chance to prove her abilities to herself.
Pass: 16 or more hits out of 20.
C: the way I see it, the benefit of this over option
B is that she can rest in between the trials and we can use the open test both times to make sure she is feeling good about everything.
Pass: 8 or more hits out of 10 in both trials.
NOTE: Tapio just informed me that THE HEALER might need more time to "get in the mood" than 2 minutes. Well, well, our mistake for accepting THE CLAIMANTs word for that. We should have our second meeting thursday or friday. I will bring all these suggestions to the table. Thanks everyone, you've been very helpful.