I'm somewhat torn here. On the one hand, it does seem that Pavel's application has been rejected rather suddenly and unfairly, at a point where he was genuinely trying to negotiate and delays were due almost entirely to the JREF themselves. In addition, it appears to be due solely to a quick decision by Randi who has not been involved in the negotiation at all and presumably knows very little of the details. Indeed, I'm not even sure why Randi would be involved at all. While the challenge may have started as a personal one by him, it is now a challenge by the JREF foundation, and Randi is no longer in charge, Phil Plait is. Certainly Randi would be a valuable advisor, but I don't see why he has the power to overrule months, or even years, of negotiation, with apparently little thought put in to the statistics and their relevance to the claim.
On the other hand, the history makes it clear that the blame cannot be laid entirely at the JREF's door. The first thread discussing Pavel's claims was started in May 2007. That's over 2 years and 3 months ago. I'm not sure exactly when he applied for the challenge, but he was certainly involved in protocol negotiations by June 2008, 1 year and 2 months ago. By the end of August 2008, Jeff Wagg was already ready to throw in the towel due to the constant changes and complications added by Pavel to the test, as well as the apparent lack of knowledge of what he can actually do. In fact, even now he still cannot clearly state what he thinks his success rate actually is:
I don't believe.. I can tell you from my tests (whether some one believe in it or not) I have about 70% some times a bit more some times a bit less, though some times as I said I "guess" 9 photos right out of ten but I cant say I have 90% success rate. S So the 70% figure of success rate its comes out if I sum up the results and will not make this conclusion on 1-2 tests. I can see where is your number 67% come from.. well I claim 67 correct photos out of 100 just because that the minimum I can claim in order to enter preliminary test as 67 correct will cover 1000 odds demanded by JREF as minimum...
It might be 70% or 90% or 67%, except when it might be something else.
It's also interesting to look over how the claims have changed. The original claim that brought him to forum members' attention was Zener cards. In one of his first posts here he specifically said that coloured Zener cards were
easier than photos. A year later, it turns out that actually
photos are easier for him than Zener cards.
Then there's the time required, which appears to have been one of the major problems for the JREF. We go from:
it take from 10 second to 2 minutes..
to needing 8 hours for 100 sets. Even assuming the maximum time for every set, allowing for a short time between each one and maybe a break at some point, I'm struggling to see how this could take more than 4 hours.
In the end, it all comes back to what Jeff Wagg said, almost a year before this application was actually shut down:
This protocol has been going on forever. It seems like Pavel keeps trying things and then failing, and people are trying to modify the test so that he has a chance of winning. This is NOT what the challenge is about. The claimant should have a clear claim and confidence that he can accomplish what he claims before he applies.
When someone applies for the challenge, they need to say exactly what they can do, under what conditions, and with what success rate. Over two years after coming to this forum, Pavel still has not managed any of those. He probably has a success rate somewhere between 70-90% that varies depending on how he feels and what point of the test he is, that may or may not be affected by stress and that is either better with Zener cards or photos. This is not the point an application should be at after 2 years of negotiation. This is not the point an application should be at before it's sent to the JREF in the first place.
Sure, Pavel is much friendlier and more coherent than most applicants, but that does not excuse the fact that he simply hasn't done what he was required to do. It's a shame how it has ended, and I think it reflects badly on the JREF that the rejection came after months of delay on their part, and at a point where it appeared the negotiations were finally getting somewhere. However, have a look at the last paragraph of the same post by Jeff Wagg quoted above:
The JREF will accept one more full protocol from Pavel (with Startz's kind help, if he's willing) and then we will move on to another candidate.
That was last August. Can anyone really argue that Pavel has been treated unfairly when he was only rejected year after he was given a final chance?