determining what constitutes a success

I find it very odd that they wouldn't explicitly state something as important as that right up front for everyone to see.

It's not as important as you seem to think, though.

The whole point of the MDC challenge is that if you have the claimed ability, your chance of succeeding is near-100%. If you do not have the claimed ability, your chance of succeeding is near 0%. The exact meaning of "near" isn't really that relevant. More important are the countermeasures that an experienced magician such as Randi takes to prevent explicit cheating. A conspiracy of genuinely random numbers is not the sort of thing that anyone really needs to worry about. A thousandth, a millionth, a billionth -- they're all pretty good operational definitions of "ain't gonna happen."
 
Probability isn't always relevant anyway. If someone claims to be able to levitate all they need to do is show that they can levitate in an environment where they can't be cheating. There is no possibility of this happening by chance, so this criteria (criterion?) wouldn't apply.

I understand that, but of course I'm referring to claims in which there IS a strong element of chance, like if someone were to claim that they can predict the outcome of coin tosses with a 60% accuracy.

I assume that since every claim is different Randi feels there is no point trying to fix the odds, as long as the possibility of a chance win is so small that it can be ignored.

Yes, but what is "small enough to be ignored"?? There still needs to be an acceptable level of risk that's clearly stated in advance. It should be the same for every test. I see no reason why it isn't right upfront for everyone to see.

Bryan
 
It's not as important as you seem to think, though.

The whole point of the MDC challenge is that if you have the claimed ability, your chance of succeeding is near-100%. If you do not have the claimed ability, your chance of succeeding is near 0%. The exact meaning of "near" isn't really that relevant.

Oh really?? What if I claim that I have a remarkable ability to predict the outcome of coin tosses with a 60% accuracy? That suddenly becomes a HIGHLY STATISTICAL claim, one requiring a great many trials to prove or disprove with a high degree of certainty.

More important are the countermeasures that an experienced magician such as Randi takes to prevent explicit cheating. A conspiracy of genuinely random numbers is not the sort of thing that anyone really needs to worry about. A thousandth, a millionth, a billionth -- they're all pretty good operational definitions of "ain't gonna happen."

Do you think Randi is going to risk a million bucks on a 1-in-1,000 shot? That's not the impression I've gotten here. Two or three others have said that for the Big Test, it's going to be 1-in-a-million.

Bryan
 
Yes, but what is "small enough to be ignored"?? There still needs to be an acceptable level of risk that's clearly stated in advance.

No, it need not be stated in advance. Since the "risk" involved is purely Randi's (it's the risk that he will pay out his money for a negative result), he can set it at his sole discretion, as long as the applicant agrees.

It should be the same for every test.

Again, no. Depending upon the type of test to be run, it may not be practical or cost-effective to adjust the risk that exactly.

As long as the risk is "acceptable" to Randi (and secondarily to the claimant, although there's little reason for the claimant to care), the test remains valid.
 
Oh really?? What if I claim that I have a remarkable ability to predict the outcome of coin tosses with a 60% accuracy? That suddenly becomes a HIGHLY STATISTICAL claim, one requiring a great many trials to prove or disprove with a high degree of certainty.

I can't tell if you're deliberately misreading or not. But you're confusing the odds named in the claim with the odds of passing.


Do you think Randi is going to risk a million bucks on a 1-in-1,000 shot?

He has. Or, at least, he's offered to. Sylvia didn't accept the claim (for obvious reasons -- a 1 in a 1,000 shot still leaves her with scarily high chance of being the Uri Geller of the early 21st century).
 
I can't tell if you're deliberately misreading or not. But you're confusing the odds named in the claim with the odds of passing.

What makes you think I'm confusing the two? I am not.

He has. Or, at least, he's offered to. Sylvia didn't accept the claim (for obvious reasons -- a 1 in a 1,000 shot still leaves her with scarily high chance of being the Uri Geller of the early 21st century).

Oh, I'm not all that surprised that he might do it on occasion with a very high-profile Sylvia Browne or a Uri Geller type. But he's not going to do it ROUTINELY with the average John Doe who walks in the door. As others have made clear in this thread, his requirements apparently snap right back to a much more stringent level for run-of-the-mill candidates.

Bryan
 
Oh, I'm not all that surprised that he might do it on occasion with a very high-profile Sylvia Browne or a Uri Geller type. But he's not going to do it ROUTINELY with the average John Doe who walks in the door. As others have made clear in this thread, his requirements apparently snap right back to a much more stringent level for run-of-the-mill candidates.

Bryan

Yup. This makes perfect sense, there's not a lot of risk in offering 1:1000 long shots to a couple of people who probably wont take it, but if you allow every crazed lunatic on the internet to have a go the odds would soon stack up against you.
 
Remember also that in order to win the prize, you have to perform the stunt twice. If the odds of winning by chance are 1 in 1000, there is a 1 in 1,000,000 chance that you will do in in both trials.

Or to look at it another way, in order for the there to be a 1 in 1000 chance to win, you chance in each trial has to be better than 1 in 32. You will not see these odds offered for a preliminary trial.

IXP
 
Remember also that in order to win the prize, you have to perform the stunt twice. If the odds of winning by chance are 1 in 1000, there is a 1 in 1,000,000 chance that you will do in in both trials.

Or to look at it another way, in order for the there to be a 1 in 1000 chance to win, you chance in each trial has to be better than 1 in 32. You will not see these odds offered for a preliminary trial.

Again, I'm not sure what the point you're trying to make is.

A better way of looking at it (in practical terms) is that to win the money, you need to perform twice. The probability (of passing by chance) is irrelevant; it's set low enough that you almost certainly can't do it once -- but if you can do what you claim, doing it once, twice, or fifty times is easy.

My "paranormal" power is the ability to burn anything in the kitchen. Even water. Even rocks. Even abstractions like the number seven, or heroism, or gravity. But my cooking skill is what it is -- if I can burn water once, I can burn it twice.
 
Also, I'm pretty sure you're confusing the 1/1000 1/1000000 chances for preliminary/final.

Each test, individually, has a 1 in 1000 chance. So the odds of passing both the preliminary and the final are 1 in 1,000,000 combined (this is my understanding). So when Randi made the offer to Sylvia, he was immediately giving her 1000 times the chance to win.
 
Each test, individually, has a 1 in 1000 chance. So the odds of passing both the preliminary and the final are 1 in 1,000,000 combined (this is my understanding).

My understanding differs somewhat. The target probability for the preliminary is 1:1000. The target probability for the final is a more stringent 1:1000000. So to win both requires a 1:1,000,000,000 (one in a b-for-billion) chance.
 
My understanding differs somewhat. The target probability for the preliminary is 1:1000. The target probability for the final is a more stringent 1:1000000. So to win both requires a 1:1,000,000,000 (one in a b-for-billion) chance.

Do you remember where those numbers came from? I recall coming across them, but I don't remember where, either :)
 
Do you remember where those numbers came from? I recall coming across them, but I don't remember where, either

Randi has mentioned them from time to time in his commentaries. However, as I pointed out upthread, they're not written in stone or part of the "official" challenge rules, partly for tactical reasons so that he can continue to yank Sylvia's chain....
 
Tai says that the claimant is really perfoming acceptably, because they were incorrect about their own assesment.

No, I am not saying that they are performing acceptably because they were incorrect about their own assessment. I am saying they are performing acceptably because they are performing above their real ability not their claimed/believed ability.

I claim I can view skullplates using xray vision,
but in fact can do no such thing.
(yes, in this example my belief is contrary to reality, same as all woos)
I state my expected success rate as 93.276%.
I can really perform at 0%.
When tested I have a success rate of around 10%.
I am performing acceptably!!!
Whould YOU say that I passed or failed?

It all depends on the specifics of course. If you can frame your test of skill in statistics, one could see if 10% is very statistically significant or not.
 
No, I am not saying that they are performing acceptably because they were incorrect about their own assessment. I am saying they are performing acceptably because they are performing above their real ability not their claimed/believed ability.



It all depends on the specifics of course. If you can frame your test of skill in statistics, one could see if 10% is very statistically significant or not.

Note that though the true reality is explicitly stated ("but in fact can do no such thing"), that is unimportant so long as you can find statistics to support a different conclusion.
 
Note that though the true reality is explicitly stated ("but in fact can do no such thing"), that is unimportant so long as you can find statistics to support a different conclusion.

If they "can do no such thing", but their performance (always the evidence!) says otherwise and is significantly beyond what chance dictates, then they win according to the challenge rules. I don't like that either, but that would be a fact.
 
My understanding differs somewhat. The target probability for the preliminary is 1:1000. The target probability for the final is a more stringent 1:1000000. So to win both requires a 1:1,000,000,000 (one in a b-for-billion) chance.

Good god (pardon the expression)! One person's "understanding" differs from another person's "understanding" by three orders of magnitude! :-)

I find it ironic that such uncertainty and lack of precision rears its ugly head on a site which ostensibly goes out of its way to be perfectly clear about the rules of the game in the Million Dollar Challenge. Once again, why in the blue blazes doesn't Randi simply state what the expected odds are going to be, in any test of a statistical nature? It's not like it's necessarily carved into stone tablets or anything...he could include a disclaimer to the effect that the odds _may_ be adjusted in certain cases, but they normally will be set to 1-in-a-million (or 1-in-a-billion, or whatever).

The more I hear about this apparent uncertainty, the more it leaves a rather bad taste in my mouth. If I personally wanted to submit myself for testing, I'd sure as heck want to know what was expected of me right up front, before going through even the early rounds of paperwork, negotiations, etc.

Bryan
 
I had understood that the preliminary and final tests were supposed to follow identical procedures. After all the contract defining that procedure only defines one procedure. I'm not aware of one that contains words like 'claimant will perform 10 trials in the preliminary and 100 trials in the final test'.

So that implies the odds of passing the preliminary *or* the final by chance alone can be 1/1000 and odds of passing the challenge *as a whole* is 1/1000,000.

There's some ambiguity in the statement 'passing the final challenge by chance is 1:1000000'. It can either mean 'getting to the end of the process having endured the preliminary and the final', or mean 'passing the final in its own right'. My understanding is that it is the former that is meant.
 
The more I hear about this apparent uncertainty, the more it leaves a rather bad taste in my mouth. If I personally wanted to submit myself for testing, I'd sure as heck want to know what was expected of me right up front, before going through even the early rounds of paperwork, negotiations, etc.

Bryan

You could easily e-mail Mr Randi and ask him.

Is applying for the challenge something you had contemplated doing?
 

ISF - Join now!

Every member here is approved by hand. No bots, no spam, just people who care about evidence and honest debate.

Membership is free!

Create your free account

Back
Top Bottom