Split Thread How are MDC protocols designed and carried out? (Split from FAQ thread)

It seems to me that your issue is that the test needs hard numbers attached to it before the applicant has even applied. People have tried to point out to you why that isn't in the applicant's best interest, and perhaps you just don't see it.

On the contrary, I can fully appreciate that the "preliminary test" needs to have at least MODERATELY hard numbers, just to separate any truly gifted people from the slackers, liars, and thieves.

But, if you're interested, here are some threads on MDC statistics and probablility, and how they could be handled when an applicant realizes they aren't perfect.

http://www.internationalskeptics.com/forums/showthread.php?t=177657

http://www.internationalskeptics.com/forums/showthread.php?t=133513

http://www.internationalskeptics.com/forums/showthread.php?t=69495

http://www.internationalskeptics.com/forums/showthread.php?t=61257

In the last one of these, you were there pretty much asking the same question you are now, so none of this may be new to you.

Thanks for the links! I'll be sure to read those, when I have time! :)
 
I've repeated this over and over; I'll give this one last try to explain to you, and then give up: when I talk about "exact terms" like I did in that quotation above, I'm mostly referring to the EXACT ODDS OF WINNING (by a person with no special abilities). That would apply to mind-reading, dowsing, and card-guessing (not sure about telekinesis).

Yes, I understand this and have each time it has been stated. One thing you haven't made clear, though, is why you think this is at all important. The claimant's role in the Challenge is to perform some feat that seems paranormal in nature. The JREF's role is to eliminate mundane explanations for the feat. Sometime it may reduce to a game of chance, and sometimes not.

By the way, I have a paranormal ability. I can completely stop my heart on command for a period of 60 seconds then resume a normal heart-beat. For my test protocol, we shall have a registered nurse (selected by the JREF) take my pulse at my left wrist (the left arm having the stronger pulse than the right) and timing the period during which the pulse stops. 60 seconds or more, I win.

What shall we use for odds in this case? Is probability really a concern for this proposed protocol?
 
So, according to Bryan Shelton, and please correct me if I'm wrong, (I'm really not trying to be snarky) the JREF should state the exact odds of winning by chance alone. This must take into account a varied number of cards from a 52 card deck, a six-sided die, a random number generator a roulette wheel, etc., etc..

If something comes up where the number of trials cannot be divided to get the exact odds, applicants will be disqualified or they will be allowed to perform a third or half of a trial in order to get the exact odds.

And all of this applies, except where it doesn't, like claims of levitation, telekinesis, making people pee, etc..

Am I understaning the proposal correctly?

Ward
 
So, according to Bryan Shelton, and please correct me if I'm wrong, (I'm really not trying to be snarky) the JREF should state the exact odds of winning by chance alone. This must take into account a varied number of cards from a 52 card deck, a six-sided die, a random number generator a roulette wheel, etc., etc..

If something comes up where the number of trials cannot be divided to get the exact odds, applicants will be disqualified or they will be allowed to perform a third or half of a trial in order to get the exact odds.

And all of this applies, except where it doesn't, like claims of levitation, telekinesis, making people pee, etc..

Am I understaning the proposal correctly?

Ward

I believe he is looking for a statement in the MDC rules something like this: The test protocol must exclude the possibility of a successful performance on chance alone at a probability level of 1/1,000 in the preliminary test and 1/1,000,000 in the final.

He has not been clear as to why this is important.
 
I believe he is looking for a statement in the MDC rules something like this: The test protocol must exclude the possibility of a successful performance on chance alone at a probability level of 1/1,000 in the preliminary test and 1/1,000,000 in the final.

He has not been clear as to why this is important.

Or even possible.

Ward
 
I've repeated this over and over; I'll give this one last try to explain to you, and then give up: when I talk about "exact terms" like I did in that quotation above, I'm mostly referring to the EXACT ODDS OF WINNING (by a person with no special abilities). That would apply to mind-reading, dowsing, and card-guessing (not sure about telekinesis).
Why are are the odds of winning without ability important at all? The really interesting odds should be how likely you are at winning the challenge if you have the abilities. If I was going for the challenge, that would be my interest, or rather how are the odds of losing the challenge if you have the ability?
 
Putting too much emphasis on the odds would encourage gamblers who know they have no ability, but hope to get lucky and walk away with a million dollars. People routinely play the lottery at much longer odds.
 
Why are are the odds of winning without ability important at all? The really interesting odds should be how likely you are at winning the challenge if you have the abilities. If I was going for the challenge, that would be my interest, or rather how are the odds of losing the challenge if you have the ability?

Exactly.

The only reason to allow the possibility that a test could be passed by chance alone would be that it might be impossible or at least highly impractical to rule it out, especially if the claimed ability isn't claimed with a 100% success rate, too.

On the other hand, where applicants claim the impossible - there is no reason to be quite as strict, and certainly no reason to somehow increase their chances of winning by luck alone.

If I say i can make a brick levitate by the power of my mind from 2 meters away, even when the brick is sealed off in a glass box, etc. then there is no reason to demand i get it floating at once, or for an hour, or whatever.

all i have to do is get it off ground within a reasonable time frame - aka how ever long someone is willing to watch a brick - and for long enough to rule out a brick just being thrown or dropped.

On the other hand, i cannot easily imagine a test scenario where my random chances of winning would even be measurable.
 
It's actually in the applicant's favor... the question of chance odds is still on the table, rather than restricted. The only effect a prior restriction could possibly have would be to close the door to the challenge for some applicants.

In the end, it's whatever you can get the JREF to agree to.
 
I've repeated this over and over; I'll give this one last try to explain to you, and then give up: when I talk about "exact terms" like I did in that quotation above, I'm mostly referring to the EXACT ODDS OF WINNING (by a person with no special abilities). That would apply to mind-reading, dowsing, and card-guessing (not sure about telekinesis).

Bryan,

In order to quote the EXACT ODDS OF WINNING, the JREF would have to know the EXACT TEST DESIGN BEING USED. This is information they don't have until after the test is finished being designed... BY THE APPLICANT.
 
As far as I can see, the tests are almost always designed so that the odds of winning are 100%.

If course, that's only true if the claimed ability is real. If it's not, the odds should be 0%, but that's often an unattainable goal, so the JREF is willing to accept higher odds than that when necessary. How much higher should be of no concern to the candidate, though, who should only expect to win if he or she can actually demonstrate the ability. This is not a casino!
 
This is not a casino!

... even though I have long thought that the JREF should take a moderate sum - between 1$ and 10$ of each participant so that playing the lottery would be the better deal to further try and discourage the fakers.

To be fair, if possible, the exact odds of winning should be made public for each actual test if the concept applies. For science. And to make sure everybody knows they understand how the test works, i.e. if I work out the same probability I know i didn't overlook a step or anything. But that's clearly after a protocol has been agreed on.
 
I am of the opinion that the TV show tests cited previously should be completely ignored. I have no idea how old the TV show was but all tests designed in 2012 will have two exceptionally important things that may have not been present in the TV show.

1) The claimant will clearly state what his or her claim is AND how often he or she can successfully perform the task. Therefore, complaints about Randi setting impossibly high success rates are irrelevant. If the JREF responds to an applicant's claimed success rate by saying, "we will need to see a higher success rate as part of the MDC," then the applicant is free to walk away, to accept the higher number, to practice until he or she achieves that level of success, or to ask how and why the higher success rate was calculated. NONE of these options is unfair in any way.

2) The current protocols require that an applicant pass an open test before passing a closed test. If a psychic claims that she can handle five door keys and describe what types of buildings they unlock, the the testing procedure starts with the JREF representative giving five keys to the applicant AND saying, "this key is from a NYC condo, this key is from a Georgia high school, this key is from a Missouri farmhouse...." The psychic is then asked if she is able to detect the psychic vibrations from the clearly-identified keys in such a way as to constitute a success for the trial. Only if the psychic agrees that her psychic powers are working correctly will the second half of the test be performed: five unidentified keys are handed to the psychic.

Therefore it is inappropriate to claim that the success rate was set at too high of a level. The psychic must agree in writing that he or she can pass the test as agreed upon.

Also, therefore it is inappropriate to claim that the test made the applicant too nervous. The closed test occurs only if the psychic agrees that these conditions are acceptable and that this location is acceptable. The open test also prevents the psychic from later claiming (a) negative thoughts from the skeptics foiled my power (b) Ley lines or other geopsychic forces foiled my power, (c) the gold leaf on the cover of a nearby encyclopedia foiled my ability to dowse for precious metals. N.B. all these excuses have been used in past tests.
 
The open test also prevents the psychic from later claiming (a) negative thoughts from the skeptics foiled my power
Surely in the open tests, the sceptics expect the psychic to be successful, where as in the closed test they expect the psychic to be unsuccessful? Won't the negative psychic vibrations caused by the sceptics only impact the closed test? If I was a psychic, that's what I'd claim, anyway...
 
Surely in the open tests, the sceptics expect the psychic to be successful, where as in the closed test they expect the psychic to be unsuccessful? Won't the negative psychic vibrations caused by the sceptics only impact the closed test? If I was a psychic, that's what I'd claim, anyway...

No, strictly speaking, I do not expect the psychic to be successful in the open test.

Say I did the card-prediction thing, where I'd look at the back of a deck of playing cards and were asked to tell the order of the cards.

In the open test, I would be given a deck in a known order and I would be asked if i could see or sense etc. the cards that way. I'd fully expect the psychic to not be able to see that the first card is the ace of spades, even when they are told what it is.
 
The open test also prevents the psychic from later claiming (a) negative thoughts from the skeptics foiled my power (b) Ley lines or other geopsychic forces foiled my power, (c) the gold leaf on the cover of a nearby encyclopedia foiled my ability to dowse for precious metals. N.B. all these excuses have been used in past tests.

But wasn't the 'gold leaf' excuse used even after an open test?
 
But wasn't the 'gold leaf' excuse used even after an open test?

Indeed. When it was pointed out that the applicant said everything was working during the open test, the applicant came out with the classic line "I lied when I said everything was acceptable after the open test." :boggled:
 
There is one more reason to not complain about how the success statistics are calculated. Once the number is agreed upon, the JREF emphatically encourages the applicant to go home and practice to make sure that the applicant can hit that threshold. When the applicant arrives for the test, he or she is not surprised by a newly-calculated success threshold. The applicant has had as much time as he or she wants to ensure that he or she can perform at the agreed-upon level.
 
Look at it this way. Let’s say the person passes the MDC:

Chance that the person passed without having any paranormal ability is 1 in 1,000,000.
Chance that the person passed with a paranormal ability is 999,999 in 1,000,000.

Setting those odds even higher does not change the chance that a person with an actual ability can pass the test—it only makes harder for a person without an ability to pass the test BY CHANCE. There is no need for JREF to set a specific standard for the risk they are willing to take for the MDC to be passed by chance because it does not affect the chances of a person with an actual ability to pass the challenge.

For example, let’s say I can predict coin flips. I might claim to be able to predict the flips 100% or the time, or 70%, or 90% or 50.02%. It doesn’t matter. A test can be devised for any of those claims where the odds of winning by chance remain at 1 in 1,000,000.

Let’s say I claim to be able to predict coin flips correctly 70% of the time. Consider these protocols:

Protocol 1: I must predict flips correctly 70% of the time and there is a 1 in 5 chance that I could win by pure luck.

Protocol 2: I must predict flips correctly 70% of the time and there is a 1 in 1,000,000 chance that I could win by pure luck.

For me, both test are the same. If I can actually do what I claim, if I can actual predict flips correctly 70% of the time, I will pass the test with either protocol. If I can do what I claim I can do, I don’t care what the odds are of winning by chance because I will pass using my ability and have no intention of simply passing by luck. In fact, I would prefer protocol 2 because then when I win it will be more conclusive that I do have the ability that I claim to have and that I didn’t just pass by luck. Of course the difference in the protocols makes a difference to JREF because with protocol 1 they may well have to pay the $1 million to somebody who doesn’t actually have a paranormal ability. But that’s JREF’s risk and doesn’t affect a person with a paranormal power from being able to pass the test simply by doing what they claim they can do.

So there is no reason for JREF to set some standard for wining by luck. The only people who need to be concerned with such a standard are people without powers who want to win by luck, JREF, and the rest of us who might ponder whether somebody winning the MDC would be considered an actual demonstration of a paranormal power or a just a demonstration of lucky guessing. It does not affect an applicant with an actual ability (other than the number of trial the protocol may require) so there is no point in setting a standard.
 
As far as I can see, the tests are almost always designed so that the odds of winning are 100%.

If course, that's only true if the claimed ability is real. If it's not, the odds should be 0%, but that's often an unattainable goal, so the JREF is willing to accept higher odds than that when necessary. How much higher should be of no concern to the candidate, though, who should only expect to win if he or she can actually demonstrate the ability. This is not a casino!

Exactly. The applicant can either do what they claim they can do or they can. If the applicant has the ability they claim, they will pass the test. If the applicant DOES NOT have the ability they claim, they will either fail or pass by luck. For an applicant who has an actual ability, it doesn’t matter what the odds are of wining by luck because they will pass using their ability.
 

ISF - Join now!

Every member here is approved by hand. No bots, no spam, just people who care about evidence and honest debate.

Membership is free!

Create your free account

Back
Top Bottom