Information on Protocol for Pavel Ziborov Applicant

Folks, I'm going to step in here.

This protocol has been going on forever. It seems like Pavel keeps trying things and then failing, and people are trying to modify the test so that he has a chance of winning. This is NOT what the challenge is about. The claimant should have a clear claim and confidence that he can accomplish what he claims before he applies.

RemieV recently went over a protocol with me that looked like it might be workable, and then I see here that ANOTHER one has been proposed and Pavel likes it. Now we're essentially back to square one.

It is now incumbent upon Pavel, who I admit seems sincere, to state what he can do and allow us to test it. It seems that he applied way before he was ready, and now the JREF is expending too many resources to try to make something work.

There are other applicants waiting.

The JREF will accept one more full protocol from Pavel (with Startz's kind help, if he's willing) and then we will move on to another candidate.

Jeff:

I am willing to help.

In fairness to Pavel, he has presented statistically sound protocols. JREF has been rather unresponsive as to what objections they have so that Pavel can revise them in accord with JREF's wishes.

Let me be more pointed than, as a fan of JREF, I wish were necessary. JREF has asked for communications to be done by email. When I have done as JREF has asked, JREF has not had the courtesy to return emails. If JREF were one of my PhD students, rather than an organization with a long, successful track record, I would say this in a less pleasant way.

Remie has sensibly pointed out that negotiations are better done by email than through this public forum. Following this wise advice, I have (on Pavel's behalf) sent in protocols by email (while posting informational copies to the forum). JREF's responses have been through the forum. There is no reason this could not have been settled in a week of back-and-forth email messages. Nearly all the delay time has been on JREF's end, not Pavel's

But in the interest of moving this forward, perhaps you could say what limit JREF has on the number of photos Pavel may use or how long the test can take, and whether JREF has objections to the specifics in previous proposals (those formally presented, not necessarily the side discussions here in the forum.)

While decisions are up to JREF and Pavel, if you find it helpful you should feel free to email me at the address I supplied to JREF when requested.

-Dick Startz
 
With all due respect to everyone trying to make this work.

Why not go back to Pavel's basic claim?

That was he can pick 1 from 2, or 1 from 3 photographs.
7 times out of 10 (actually 67% in 50 trials)
This is a most basic test, it only then requires JREF to come up with the required number of trials required.

One of Pavel's first posts here, before his application, was to ask JREF what was the required success rate to win the Challenge.

This post of mine has links to the above initial discussion with Pavel.
 
Jeff:

I am willing to help.

In fairness to Pavel, he has presented statistically sound protocols. JREF has been rather unresponsive as to what objections they have so that Pavel can revise them in accord with JREF's wishes.

Let me be more pointed than, as a fan of JREF, I wish were necessary. JREF has asked for communications to be done by email. When I have done as JREF has asked, JREF has not had the courtesy to return emails. If JREF were one of my PhD students, rather than an organization with a long, successful track record, I would say this in a less pleasant way.

Remie has sensibly pointed out that negotiations are better done by email than through this public forum. Following this wise advice, I have (on Pavel's behalf) sent in protocols by email (while posting informational copies to the forum). JREF's responses have been through the forum. There is no reason this could not have been settled in a week of back-and-forth email messages. Nearly all the delay time has been on JREF's end, not Pavel's

But in the interest of moving this forward, perhaps you could say what limit JREF has on the number of photos Pavel may use or how long the test can take, and whether JREF has objections to the specifics in previous proposals (those formally presented, not necessarily the side discussions here in the forum.)

While decisions are up to JREF and Pavel, if you find it helpful you should feel free to email me at the address I supplied to JREF when requested.

-Dick Startz


with all my respect to everyone.. the same was when I was trying to negotiate, sent propositions, asked questions regarding protocol, requirements etc... and there was not much result, first of all it is a weeks for a reply and second.. I have always answered every question that was asked or proposed by JREF (Remiev) and in my tern also posted question..and there was no reply...and as I have also written before, the replies would be really helpful in moving on with things.., yes JREF is busy, but to find out after weeks of waiting that the protocol is can not be accepted cause it is too complicated, and when I have asked like, why? what is the problem, what would be good enough etc.. nothing... so weeks was waisted.. and I was waiting in order not to waist myself and time of the others with the other protocols etc.. than have started to propose the other options hoping that one of them would suite.. again not knowing exactly what it should be suited in..a prat of time frame ( though I never asked for over 8 hours test) or the 1.000 odds to be covered for the first test.
 
Last edited:
For kicks, I wrote up a protocol:

Materials Required:

87 5" x 6" color photographs processed at a shop approved by both parties. 29 each of the images Ship, Pyramids, Earth provided by the applicant.
6 sheets of 1-1/4" x 1-3/4" permanent white labels. Labels are printed for 29 each of the words Ship, Pyramids, Earth in black ink on three sheets, and the same in red ink on the other three sheets.
84 opaque envelopes large enough to hold a 5" x 6" photograph
28 rubber bands large enough to fit around the envelopes
28 small post-it notes
One standard six-sided die
One room with blank walls
One video camera
Two pens
Two pieces of paper
Clipboard
One chair
Two tables
One cardboard box or other device suitable to display examples of the three different photographs

Environment Stipulations:

1. Other than provided by JREF and Testers, no chemicals or devices that emit light or otherwise detect or reveal electromagnetic fields that would compromise the opacity of the envelopes may be possessed or used, unless approved by JREF.

2. To as much extent as possible, the test room shall be adequately lit, of a comfortable temperature, and free of distracting sounds and odors. Phones and other communication devices must remain off or on silent. Talking during the tests must be kept to a minimum and in quite tones. Cameras, other than the video camera used by the Testers, are not permitted. All persons attending the test should wear neutral colors with no distracting prints or images. No signs or banners are permitted during the test.

3. If any of the above listed are violated during a test trial, the person violating the rules may be required to leave the test room and the Applicant may be granted an additional break up to three minutes and restart the trial or choose to postpone the trial until the end of the set and start a new trial.

4. The walls of the test room shall not have any pictures, images, or distracting designs, unless approved by the Applicant.

5. All persons in the room during Test Preparation are not permitted to be present in the room during the test or to communicate in any way to any person present in the test room during the test.
6. If there is a setup or technological problem, or if for any reason the test must be halted due to extenuating circumstances, as determined by JREF, the test may be conducted up to two additional times.

Test Preparation:

1. The 87 photographs are produced and provided to the Testers.
2. JREF or Tester print labels for 29 each of the words “Ship”, “Pyramids”, “Earth” in black ink on three sheets, and the same in red ink on the other three sheets. Labels are provided to the Testers.
3. Tester writes on 28 post-it notes, numbers 1 to 27 and “TEST”.
4. Tester places 27 of each type of photograph into envelopes and seal the envelopes completely so that the photograph inside cannot be seen in any way. The photographs will be placed with the image facing the front of the envelope and the top of the image toward the top of the envelope. The envelopes will be kept separate so that there are three piles consisting of 27 envelopes that all contain the same image. Each Tester fulfilling these duties will fill/seal an envelope for each of the three types of photographs before proceeding to the next to ensure that there is no consistency in the manner in which all photographs of the same image are filled or sealed. The envelopes will have no markings of any kind.
5. Tester now has three piles of 27 envelopes. The envelopes in each pile contain photographs of the same image. These will be considered, from left to right, as piles A, B, and C. Test will compile 27 packets. Tester will pull down an envelope from each pile. Tester will roll a six-sided die. Tester will place the envelopes into a separate pile, bottom to top, based on the die roll as follows:
1) ABC
2) ACB
3) BAC
4) BCA
5) CAB
6) CBA
6. Tester takes the three envelopes as a packet, turns the packet 90 degrees to the right, and taps them on the table to move the contents of each envelope down. Tester places a rubber band around the packet, and places post-it note on the packet with the packer number (1-27). The envelopes will have no markings of any kind.
7. Tester compiles an additional packet, exactly as above, but does not seal the envelopes.
8. Tester holds each envelope up to at least the brightest light in the test room to ensure that the image of the photograph cannot be seen.
9. Tester places a rubber band around the three unsealed envelopes and places a post-it note on the packet labeled “TEST”.
10. Tester places the 27 packets, in order, on the storage table in the test room.
11. Tester places the TEST packet on the test table.
12. Tester places the labels printed in black ink on the test table.
13. Tester places the cardboard box or other device on the test table and tapes each of the three types of photographs up so that the Applicant will easily see them. Labels for each photograph will placed immediately above or below each photograph. Testers (and/or JREF) will verify that the labels match the photographs.
14. A chair will be placed at the test table for use by the Applicant.
15. A pen and piece of paper will be placed on the test table for use by the Applicant.

Test Verification:

1. Applicant will have up to 30 minutes to verify the test conditions.
2. Applicant will verify that the example photos and labels can be seen clearly and that the labels match the photographs.
3. Applicant will verify that the environment is suitable.
4. Applicant will verify that he can place a label on an envelope without difficulty. Applicant may use one of each label, or more if permitted by Testers or JREF.
5. Applicant will verify that he can demonstrate his ability according to the established protocol and standards in the current environment. Applicant may use the “TEST” packet to test his ability. The test packet consists of three envelopes containing each photo, exactly the same as every other packet that will be used in the test, except that the envelopes are not sealed so that the Applicant can verify that his abilities are working correctly.
6. If the Applicant cannot verify any of the above, JREF and Testers will, within reasonably ability and without altering the protocol, attempt to resolve any conflicts. Otherwise, the test may be considered a failure.
7. Both the Applicant and the Tester/JREF will verify that the conditions for the test are adequate.

Test Protocol:

1. JREF Staff will videotape all activity at the storage and test tables. The video will be time-stamped. The camera will be left running for the entirety of the test.
2. Tester will take a packet (in packet order) from the test table, remove the rubber band and post-it note, and place the packet on the test table. Tester will start a time clock for three minutes.
3. Applicant may use the paper provided for notes and may write on the envelope, but may not puncture the envelope in any way.
4. Applicant will have up to three minutes to identify and label the contents of one, and only one, envelope. Applicant will identify the contents of one envelope by placing a label on the envelope. Placing a label on an envelope constitutes a final decision.
5. If the Applicant has not placed a label on an envelope within the required time, it will be considered a “skip” and the packet will be placed on the storage at the end of the packet order be tried again. The Applicant may, at any time, choose to voluntarily skip a packet. The Applicant may only skip a maximum of nine packets (either voluntarily or involuntarily). If the Applicant has already skipped nine packets and the time expires on a packet, the test shall be considered a failure for the Applicant.
6. After the Applicant has placed a label on an envelope, the Tester will control the envelopes and the Applicant may not touch, write on, or place labels on the envelopes.
7. Tester will write the trial number (1-27) on all three envelopes.
8. Tester will record on paper the trial number and label applied by the Applicant.
9. Tester will open the envelope labeled by the Applicant. This will be done in front of the applicant.
10. Tester will select the red-ink label corresponding to the photo in the envelope and apply it to the envelope. This will be done in front of the applicant.
11. Tester will record on paper the label of the actual contents of the envelope and whether or not it matches the Applicant’s prediction. The Applicant will be told if this was recorded as a success or failure. The Tester may also state how many more failures are needed to fail the challenge.
12. Tester will open the other two envelopes in front of the applicant and place red-ink labels corresponding to their contents to demonstrate that the test is fair. Tester will move the packet to the storage table.
13. In the event that the Applicant fails a trial and it is revealed that the packet did not actually contain the three photos, the trial will be disregarded and done over.
14. Tester will repeat these procedures until all trials have been completed or the Applicant has conclusively failed.
15. If the Applicant has failed enough trials to be excluded from the terms of success, the test will end immediately.
16. Applicant may take up to 60 minutes of break time during the test. Applicant may take a break at any time. Tester will record break times and notify Applicant of amount of break time recorded and amount of break time available.

What Will Constitute a Successful Test:

Applicant must succeed in 18 of the 27 trials. If the Applicant fails on 10 trials, the test ends immediately.

Time required:

Maximum: 2.8 hours.
 
This looks like some good envelopes for the project: Black "Euro Flap" 5-1/4 x 7-1/4" (A7) Envelope 100 Pack

Just $17.75 for the whole 100 pack.

Seems like a lot of protocol for something so small. Pavel doesn't even seem to have a good hold on what he can do. I expect that under controlled conditions, Pavels ability equals chance. So the test time could be much shorter. However, that doesn’t reduce the preparation time required by JREF.
 
Last edited:
I think I'm starting to see this as 8 hours JREF time to set all this up, and about 40 minutes for Pavel to fail. Maybe it's just me. It seems like a lot of work for someone who isn't real confident in his abilities.

I’m predicting total failure. If you can get better odds on it in Vegas, I’ll lay my money down. I’m not a gambling man, but I think I’d be willing to bet $1000 to any takers that Pavel can’t pass the protocol I posted.
 
I think I’d be willing to bet $1000 to any takers that Pavel can’t pass the protocol I posted.
Are you giving odds? The (random) probability of Pavel passing your protocol is 2456 to 1 against. And if he gets 17 of 27, is that a failure with no possibility of a re-test within one year? The odds against that are 648 to 1 against.
 
Are you giving odds? The (random) probability of Pavel passing your protocol is 2456 to 1 against. And if he gets 17 of 27, is that a failure with no possibility of a re-test within one year? The odds against that are 648 to 1 against.
So it seems pretty safe as a bet, doesn’t it? That is, unless something paranormal is going on and Pavel is really clairvoyant.

Someone else mentioned a claim that they can do long division and being tested with 100 questions with 4 multiple choice answers. I can do long division. I’m sure I can get at least 95 questions correct. What are the odds of that happening?

I understand that Pavel’s claim is that his ability is weak and doesn’t work 100%. I offered the above because it seemed to be the protocol that Pavel had last chosen to move forward with. Getting 18 out of 27 is the minimum about beyond 1 in 1000 odds and outside of 3 standard deviations. So the test would prove either that Pavel can do what he claims or he got extraordinarily lucky. 17 of 27 just seems very lucky. I don’t think there should be a do over for a close call (however if Pavel fails but comes close and wants to be retested in, say, 6 months, considering that the challenge will be ending soon, I think JREF should at least consider possibly bending the one year requirement a little.)

Personally, I think the whole thing should have stuck the original claim (at least I think it was) that Pavel can consistently get 7 out 10 picking from 2 images. I think you can get to 1 in 1000 odds in 6 sets of 10. You could just use 40 photos and start with 20 sets of envelopes and recycle the photos as the test goes on as needed. With 10 minutes between sets, 10 minutes break time per set, 3 minutes per trial with allowing a “skip-do later” for each trial, a set of 10 trials would take max 80 minutes, for max total test time of 8 hours. I would expect each set to actually take about 30 minutes, and that if Pavel was simply guessing that the test would be over within 2 hours. If Pavel was beating the odds well enough to keep going all the way through the test, I think JREF would want to keep putting together the envelope packages and stick out the potential 8 hours of testing.
 
I watched the video at YouTube videos.

I think the test could be very much simplified and quickened.

2 tests of 30 trials of 2 images. 60 photos. 2 minutes per trial (in the videos, Pavel made a determination in 4-20 seconds, so a full 2 minutes should be adequate). Pavel is allowed a maximum of 30 minutes break time during each test. Pavel may choose to “skip” up to 30 trials during each test-a “skip” trial moves to the end of the test and Pavel will have an additional 2 minutes to repeat the trial.

Maximum time for a test, therefore, is 2.5 hours.

Pavel must get 21 of 30 correct to pass a test. If Pavel passes the first test, the second test will be repeated exactly as the first.

Pavel must get 21 of 30 correct to pass the second test. If Pavel passes the second test, he will have passed the preliminary test.

I would expect that a test of 30 trials would actually take less than one hour. If Pavel is simply guessing and the odds play out at or less than the mean, the test would be over in less than an hour (or at most, 2.5 hours).

There is no heavy burden on JREF, unless Pavel succeeds. Considering Pavel’s claim and videos, it should not be difficult to achieve these results. If Pavel fails the first test because the things didn’t turn out right, that’s the way it goes. If Pavel gets all 30 right on the first test simply by guessing, that’s the way it goes.

Everyone wins. Simple test.
 
Last edited:
I normally read these to laugh at the applicants. Either when their proposal gets changed to avoid their cheating and they run away, or when they are simply delusional and ramble on about "energies" or "spirits" or whatever it is they think gives them the power to obey the laws of probabilities and guess things at chance. But I'm not laughing at this guy. I really want to see him get tested. Mind you, I don't think he has the abilities he claims to. But, I don't know that he doesn't. I don't think he is intentionally lying though. I wish they would get the preliminary underway.
 
I normally read these to laugh at the applicants. Either when their proposal gets changed to avoid their cheating and they run away, or when they are simply delusional and ramble on about "energies" or "spirits" or whatever it is they think gives them the power to obey the laws of probabilities and guess things at chance. But I'm not laughing at this guy. I really want to see him get tested. Mind you, I don't think he has the abilities he claims to. But, I don't know that he doesn't. I don't think he is intentionally lying though. I wish they would get the preliminary underway.

Welcome to the forum, Unlikab..., er, Unlike a Bull.

I feel the same way about Pavel. Hopefully he will proceed to a test.
 
Welcome to the forum, Unlikab..., er, Unlike a Bull.

I feel the same way about Pavel. Hopefully he will proceed to a test.

A news update is probably due.

Pavel has been working on a protocol that we think will satisfy JREF and have good properties in terms of the likelihood of both false positives and false negatives. I expect to have more specifics to report in the (relatively) near future.

I should also mention that Pavel has received a courteous inquiry about progress from the JREF staff, so they are upholding their end.
 
I normally read these to laugh at the applicants. Either when their proposal gets changed to avoid their cheating and they run away, or when they are simply delusional and ramble on about "energies" or "spirits" or whatever it is they think gives them the power to obey the laws of probabilities and guess things at chance. But I'm not laughing at this guy. I really want to see him get tested. Mind you, I don't think he has the abilities he claims to. But, I don't know that he doesn't. I don't think he is intentionally lying though. I wish they would get the preliminary underway.

I like the fact that you like to laugh at the applicants :)
 
No news on this I take it?

Pavel started out with a very strong "I can see images inside envelopes" claim, which was very promising and a stark change from other applicants who bang on about energy and have a complete inability to state what they can actually do.

Ever since then, Pavel has been winding down the extent of his abilities until it became "Given a 50-50 chance, I can occasionally get better than 50% right". It became obvious to everyone except Pavel that he does not have the ability he claims. There have been some excellent suggestions for protocols which would be a breeze for him if he did actually have the ability he claims (such as the one about having 9 blank photos and one with a picture on, and he has to find the real photo 7 times out of 10), but he makes up weird excuses for why he can't do this, for example, now instead of being able to see inside the envelopes he can see forward in time to opening the envelopes (why this excludes the mentioned protocol I don't know).

I think it's time to give up on this one. It would be good if Pavel had a moment of self realisation and started living his life, but instead he will probably spend the rest of his life trying to find a way to 'prove' his abilities to people and live in a state of permanent frustration.
 
No news on this I take it?

Pavel started out with a very strong "I can see images inside envelopes" claim, which was very promising and a stark change from other applicants who bang on about energy and have a complete inability to state what they can actually do.
...

I think it's time to give up on this one. It would be good if Pavel had a moment of self realisation and started living his life, but instead he will probably spend the rest of his life trying to find a way to 'prove' his abilities to people and live in a state of permanent frustration.

Pavel submitted a revised protocol on November 6.

Pavel had a completed new protocol at the beginning of October. I asked him to delay submission while I had the protocol reviewed by a statistician with experience in this area. We were fortunate to find a statistician who volunteered his services and was able to vet the new protocol.
 
No news on this I take it?

Pavel started out with a very strong "I can see images inside envelopes" claim, which was very promising and a stark change from other applicants who bang on about energy and have a complete inability to state what they can actually do.

Ever since then, Pavel has been winding down the extent of his abilities until it became "Given a 50-50 chance, I can occasionally get better than 50% right". It became obvious to everyone except Pavel that he does not have the ability he claims. There have been some excellent suggestions for protocols which would be a breeze for him if he did actually have the ability he claims (such as the one about having 9 blank photos and one with a picture on, and he has to find the real photo 7 times out of 10), but he makes up weird excuses for why he can't do this, for example, now instead of being able to see inside the envelopes he can see forward in time to opening the envelopes (why this excludes the mentioned protocol I don't know).

I think it's time to give up on this one. It would be good if Pavel had a moment of self realisation and started living his life, but instead he will probably spend the rest of his life trying to find a way to 'prove' his abilities to people and live in a state of permanent frustration.

Startz is right - Pavel has submitted a new protocol. Startz - I'm not sure if you got my response to that. I got an auto-response message back when I sent it.

Pavel's protocol is on the list for review, as soon as we work out the testing of Patricia Putt. Her protocol is complete, and all that remains is the test.
 

Back
Top Bottom