That might work if the acceptance/rejection criteria were specified as part of the protocol and were clearly spelled out in such a manner that any observer could ascertain whether the protocol was being followed. Michel doesn't want to do that. He wants to accept or reject data based on the attitude of the source of the data. That's a complete no-no.
I don't think it's a
complete no-no as long as
all rejection takes place before Michel learns what answer was provided. That's where the last test went wrong, and even more so, the one before it. Once he knows what answer a person gave, we can no longer trust
him to be objective about their trustworthiness. Before that, though, he should have no particular reason to be biased for or against any given person.
That said, the fact that we're on the third go-round, and Michel *still* isn't offering an decent protocol—one where the results would be clear and unambiguous—suggests to me that he's scared of what a proper test might show.
I think he's suffering from cognitive dissonance. He desperately wants to prove he's right, but is still terrified that he might find out he's wrong, and as a result, is unable to consider proposing an unambiguous test. It doesn't matter
as much what the rest of us think (though he'd
like to convince us), as long as he's able to somehow convince
himself that the results were what he wanted. Which is basically what happened in the last test. And each time he manages to convince himself that he's won, he comes back suggesting the addition of the
smallest bit of extra rigor he can get away with, in the desperate hope that maybe it'll still work
and maybe this time he'll convince someone else too.
It's honestly all a little sad. And I don't mean that in a condescending way. I genuinely feel sorry for him.