The Amazing Test makes me hopeless

You seriously think that a chance of 1 in 24 would be sufficient enough to bet a million dollars on? Assuming that is is your million dollars and that you gain nothing but can lose it all?

At those odds, I'd *instantly* apply for the MDC myself. I am allowed to re-take a failed test at yearly intervals. At that rate, I'll be rich before I hit 60...

I think, for fairness sake, whatever paranormal challenge gives statistically significant results should be eligible for one million dollars. We already went to extreme lengths to make sure there's no foul play.

Now coming to hypothetical scenario, where one person does try to take advantage of time being on his side, protocols could be modified to take care of it. Because this way either its not Paranormal.

[P.S: Rasmus, your reply made me made me think a lot. I sincerely thank you for it. Very discussions are as insightful as this.]
 
Last edited:
I think, for fairness sake, whatever paranormal challenge gives statistically significant results should be eligible for one million dollars. We already went to extreme lengths to make sure there's no foul play.

No. why should they?

And what does that have to do with fairness, even?

Here's what happens in a nutshell:
Applicant: "I can do x, even though it should not be possible for anyone under any conditions to do x."

Randi: "Well, I bet you a million dollars that you cannot do x."

The only fair thing then is for the applicant to demonstrate that he can actually do x.

Why should it matter to the applicant how difficult it would be for anyone to pass the test who isn't able to do x?

Example:

Applicant: "I can speak Chinese!"

Randi: "Really? Well, listen to this Chinese audio-book and then tell me the following things:

Is it a love story, a thriller, a whodunnit or a comedy?
Is the female lead character between 10 and 20 years, 21 and 30 years or between 31 and 40 years?
The book mentions a painting. Is it of a dog, a windmill or a woman?
Does the grandmother get married?
Where/how does the milk man die? An accident while mountain climbing, a car crash on the motorway, in hospital due to kidney failure, ran out of oxygen diving or parachute failure?
What colour is the airplane - blue, red, yellow, green or white?


You can listen to it as much as you like, and you can rewind or fast forward as much as you please. If you answer all these questions correctly, I'll give you a million dollars."

Applicant: "But that's not fair. I only have a chance of 1 in 1800. Why does it have to be so difficult? Wouldn't it be just as good if I got half the questions right? Whaaaaaaaaaaaaaaaaaaa!"

-> It doesn't matter, and it is not unfair. If the applicant is actually able to speak Chinese, then getting every question right could not possibly be a more trivial task.

We're not doing the test to see if it is likely or possible that the applicant maybe speaks Chinese. We just want fairly reasonable proof.

We could discuss the chances of getting an answer wrong accidentally. To compensate, we could add three or four more questions and allow for one or possibly two answers to be incorrect. The basic facts would remain the same: It will be almost impossible to pass the test unless you actually speak Chinese. And it will be trivially easy to pass the test, if you do.

How is it unfair that someone unable to speak Chinese would have a very hard time passing the test?

And why should it be any different for paranormal claims?
 
I think, for fairness sake, whatever paranormal challenge gives statistically significant results should be eligible for one million dollars. We already went to extreme lengths to make sure there's no foul play.


Not really, random chance is a real thing and 'significance' the p value is not an end all be all. You can have a great p value that has no real meaning.

The protocol would be cumbersome if it involved repeated trial but that would actually be the best.

And again the 'extreme lengths' are not that extreme as the ability to cheat now a days is rather advanced,as pointed out earlier cel phones, binoculars and the internet can get you an amazing amount of information.
 
And what does that have to do with fairness, even?
I didn't get what you meant by this one. A test for a challenge is supposed to be fair, otherwise theres really no point of having it. That's why we introduce double blind procedure, to keep out biases. (If you were addressing some other point, please let me know)

Applicant: "I can speak Chinese!"

Randi: "Really? Well, listen to this Chinese audio-book and then tell me the following things:

Is it a love story, a thriller, a whodunnit or a comedy?
Is the female lead character between 10 and 20 years, 21 and 30 years or between 31 and 40 years?
The book mentions a painting. Is it of a dog, a windmill or a woman?
Does the grandmother get married?
Where/how does the milk man die? An accident while mountain climbing, a car crash on the motorway, in hospital due to kidney failure, ran out of oxygen diving or parachute failure?
What colour is the airplane - blue, red, yellow, green or white?


You can listen to it as much as you like, and you can rewind or fast forward as much as you please. If you answer all these questions correctly, I'll give you a million dollars."
Firstly, since the test is a mutually agreed upon one... Hypothetically the claimant does get a chance to point out his problems with the protocol.

First problem with the test is 'There's absolutely no room for error'. For instance, the guy may speak Chinese (Cantonese or Mandarin), but may not be discerning enough to write the specific answer which depends on technicality. Consider the scenario that audio book is say, some kind of Chinese version of 'Silence of the lambs' . Its difficult to point out one answer for a layman, because of similar elements they have. There is a room for error.

Even for physics major, there's a room for error that he might have overlooked a simple variable in equation. It happens.

Now how much room should be given for error, thats where statistics come in (or so i think). and therefore some lower limit of marks that should be crossed. In India, we colloquially call it 'Passing Marks'[continued..]
 
Last edited:
All I say is, we should devise the test fairly, and shouldn't raise difficulty level beyond reasonable. [I believe theres some reason for that 5 out of 7 condition, if only someone could point it out]

P.S: I assume that adequate measures to ensure that no cheating has been done is taken.
 
Dancing David:... and 'significance' the p value is not an end all be all. You can have a great p value that has no real meaning.
I'm not sure if I get it completely. Please, elaborate. Thanks in advance.

Dancing David:And again the 'extreme lengths' are not that extreme as the ability to cheat now a days is rather advanced,as pointed out earlier cel phones, binoculars and the internet can get you an amazing amount of information.

Here, I was talking about protocol of Eileen Mckusick's MDC application. In my opinion, the precautionary measures were sufficient enough (plus they were video taping it for further scrutiny). Again, as I said its only my opinion. Could you point out any place where they were lacking and illustrate how?
 
Last edited:
I didn't get what you meant by this one. A test for a challenge is supposed to be fair, otherwise theres really no point of having it. That's why we introduce double blind procedure, to keep out biases. (If you were addressing some other point, please let me know)

Applicants that make claims the test would be unfair usually complain about how difficult the test is and ignore that it's really only difficult if they cannot do what they claim to be able to do.


Firstly, since the test is a mutually agreed upon one... Hypothetically the claimant does get a chance to point out his problems with the protocol.

First problem with the test is 'There's absolutely no room for error'.

I did address this, did I not?

For instance, the guy may speak Chinese (Cantonese or Mandarin), but may not be discerning enough to write the specific answer which depends on technicality. Consider the scenario that audio book is say, some kind of Chinese version of 'Silence of the lambs' . Its difficult to point out one answer for a layman, because of similar elements they have. There is a room for error.

It was, what we in technical terms call an example. :D You'll find that not every book ever written mentions air planes, either.

You would have to pick questions that have non-ambiguous answers, of course. Yes, there is no room for error: that is a good thing, though: Every test must be designed in a way that it is obvious whether the applicant passed or not. (If you read the actual protocl threads you will find that this is a big problem: Fortune tellers are usually very vague so that they can easily find some real event that they can claim matches their predictions.)

Even for physics major, there's a room for error that he might have overlooked a simple variable in equation. It happens.

Tough.

But how is it unfair or a problem?

Does Who wants to be a millionaire? leave much room for error? No, it does not. The players have to get every single answer absolutely right. There are 15 questions to be answered - getting all of these rights by mere chance alone is highly unlikely. (1 : 1,073,741,824)

Does this make the game unfair?

Now how much room should be given for error, thats where statistics come in (or so i think). and therefore some lower limit of marks that should be crossed. In India, we colloquially call it 'Passing Marks'[continued..]

We are not talking about school, we are talking about a million dollars.

But, yes, I agree: There should be room for error or the odd, honest mistake. You will find that many protocols do not demand perfect results. (Some do, and whilst others may disagree I consider that to be a mistake.)

But even if you want to allow the applicants to make a mistake it does not follow that you have to make it significantly easier to pass the test by mere chance.

It is practically impossible to win Who wants to be a Millionaire? by chance alone. The game actually allows players to win even if they do not know every single answer: There are the various life lines and the options to end the game prematurely and secure a smaller price at any time.

But even with the life lines, winning the game by chance alone is extremely difficult. International rules vary. In Germany, you can call a friend, let the studio audience vote, eliminate 2 wrong answers and ask one member of the studio audience for advise. (the latter option can be elected prior to the game, but the player sacrifices the guarantee to keep the winnings at level 10 should he answer a later question incorrectly.)

Under ideal circumstances, that still leaves you with chances of 1 : 2,097,152 - assuming that you always get correct and unambiguous answers from all of your life lines. (i.e. you call your friend, he knows the answer and you trust him.)

The game may be difficult to win, but it is not unfair.

Likewise, the MDC is not unfair. One major reason here is that the applicant is not taking any significant risks! The JREF is offering a million dollars - I see absolutely nothing unfair in it, if they insist to tie that to their conditions. (Yes, I would much prefer if they just gave the money to me instead. I doubt it's gonna happen anytime soon. This is also not unfair.)
 
Does Who wants to be a millionaire? leave much room for error? No, it does not. The players have to get every single answer absolutely right. There are 15 questions to be answered - getting all of these rights by mere chance alone is highly unlikely. (1 : 1,073,741,824)

Does this make the game unfair?



We are not talking about school, we are talking about a million dollars.

But, yes, I agree: There should be room for error or the odd, honest mistake. You will find that many protocols do not demand perfect results. (Some do, and whilst others may disagree I consider that to be a mistake.)

But even if you want to allow the applicants to make a mistake it does not follow that you have to make it significantly easier to pass the test by mere chance.

It is practically impossible to win Who wants to be a Millionaire? by chance alone. The game actually allows players to win even if they do not know every single answer: There are the various life lines and the options to end the game prematurely and secure a smaller price at any time.

But even with the life lines, winning the game by chance alone is extremely difficult. International rules vary. In Germany, you can call a friend, let the studio audience vote, eliminate 2 wrong answers and ask one member of the studio audience for advise. (the latter option can be elected prior to the game, but the player sacrifices the guarantee to keep the winnings at level 10 should he answer a later question incorrectly.)

Under ideal circumstances, that still leaves you with chances of 1 : 2,097,152 - assuming that you always get correct and unambiguous answers from all of your life lines. (i.e. you call your friend, he knows the answer and you trust him.)

The game may be difficult to win, but it is not unfair.

Likewise, the MDC is not unfair. One major reason here is that the applicant is not taking any significant risks! The JREF is offering a million dollars - I see absolutely nothing unfair in it, if they insist to tie that to their conditions. (Yes, I would much prefer if they just gave the money to me instead. I doubt it's gonna happen anytime soon. This is also not unfair.)



But, um... (peeks head in)

Doesn't WWtBaM really have very little to do with chance? Or am I missing something (entirely possible)? WWtBaM, like Jeopardy, depends on memorization and recall of previous knowledge (and quite honestly, I think that the questions are insultingly easy). How can that really be equated with the JREF challenge?
 
Last edited:
But, um... (peeks head in)

Doesn't WWtBaM really have very little to do with chance? Or am I missing something (entirely possible)? WWtBaM, like Jeopardy, depends on memorization and recall of previous knowledge (and quite honestly, I think that the questions are insultingly easy). How can that really be equated with the JREF challenge?

Your right! That game show can not be equated to the MDC.
The MDC should be a far easier way to get a million big ones than the game show.

A person says they can do something that no one else has ever been able to do or prove to do.

Let's say I tell Randi I have the amazing ability to walk up a flight of steps.
Security measures are taken. Protocols are drawn up. Video equipment is up and running.
Now it just comes down to whether I can make it up the steps or not.

If I can do what I told Randi I could do then up I go no problem.
But if I stand at the bottom of the stairs and complain that the stairs are made from pine and not oak and how that changes everything and how unfair and difficult the entire test is then I couldn't really climb the flight of steps like I said I could to begin with.

Either they can do it and it's the easiest million ever made or they can't.

Fair, unfair, difficult, easy should never even enter the million buck give away.
 
But, um... (peeks head in)

Doesn't WWtBaM really have very little to do with chance?

I thought that was my entire point.

Neither WWtBaM nor the MDC are about chances. It is almost impossible - in both cases - to win by chance alone. But you're not supposed to win by chance alone in either case, anyway.

Or am I missing something (entirely possible)? WWtBaM, like Jeopardy, depends on memorization and recall of previous knowledge

and the MDC depends on the applicants alleged abilities to perform paranormal acts.

The difference is that in the MDC there is disagreement on whether it is at all possible to perform. (We know that people have walked away from the game show as milli9onaires, after all.)

(and quite honestly, I think that the questions are insultingly easy). How can that really be equated with the JREF challenge?

You do? Have you ever applied to play? Me, I don't think I would be smart enough to get much further than 16 or 32k. /derail.

To get back on topic: The MDC is also insultingly easy, though. Any applicant who can really do what they claim to be capable of would simply walk away from the test with a big, fat check. the JREF is not making it difficult to pass at all, or are they?

To keep up the comparison:It's as if you'd be allowed to bring your own questions to WWtbaM.

(But I really didn't mean to compare the two, I only wanted to address the issue that random chances aren't important when addressing fairness.)
 
Personally I think the OP has a yet unstated agenda and is fishing for a back door inside the MDC love shack.
 
But, um... (peeks head in)

Doesn't WWtBaM really have very little to do with chance? Or am I missing something (entirely possible)? WWtBaM, like Jeopardy, depends on memorization and recall of previous knowledge (and quite honestly, I think that the questions are insultingly easy). How can that really be equated with the JREF challenge?

Who Wants to Be a Millionaire can be won by chance since it's a multiple choice game. And the likelyhood of winning by chance alone can be determined ahead of time. With Jeopardy, there is no multiple choice. You either know it or you don't. I don't know how one would determine the odds of winning Jeopardy by guessing alone. There are a lot more questions and no multiple choice. I'd much rather take my chances on Millionaire than on Jeopardy if I had to guess. But I'd rather play Guess Which Hand Is Holding A Penny than either of the other two. At least my chances would be 50/50.

Ward
 
Personally I think the OP has a yet unstated agenda and is fishing for a back door inside the MDC love shack.
You got me. 'By my presence alone' I make people go "hmm...there's something fishy" about me.

Me: I claim Million Dollars.
Randi: There's something fishy.
Me: I win. Now, where are the million dollars? I'll take them in 20's. Thank you.


I'm just a clumsy skeptic. Assume Uri Geller was still a phenomenon, and I knew about his techniques... ratcheting and related stuff, and I decide to educate people about it by demonstration. Now, I am bad at making concise statements and worse at misdirection, people will catch me bending keys each and every time. I'll just end up strengthening their faith.

I'm here to hone skills critical to be a Skeptic. Here's the tentative list of unstated agenda:
1.Have a better understanding of scientific method . Eg: I didn't know how peer-reviewed scientific journals worked, especially with CAM. Now I know it... partially.
2.Be more knowledgeable of trickery, test design, arguments,etc.,
3.To be able to successfully demonstrate it.
4. Not to tell awful jokes involving Randi.
 
I'm not sure if I get it completely. Please, elaborate. Thanks in advance.

In simple the p value only has meaning in context
http://en.wikipedia.org/wiki/P-value
In statistical hypothesis testing, the p-value is the probability of obtaining a test statistic at least as extreme as the one that was actually observed, assuming that the null hypothesis is true.
...

Now here is the important thing a p-value of .01 means a 1% chance, a p-value of .001 means a .1% (1/1000) , now this is where it gets tricky.

You want to have a short term test for 'paranormal' activity, ideally it would involve a set of multiple tests, but that would be hard on teh claimant.

So say we chose a p value of .05 (by the claimant) they are saying that they would be comfortable if the expected result was 1/20. Now here is the thing that would be great if they agreed to ten trails. If over ten trials, one each trial you got the 1/20, it would be statistically possible but very unlikely.

But if the trial is only one trial there it is likely to be just random chance.

The meaning of the p value has streth after repeated trial, not single trials.

So say that some one says that they can name the rank order of a card chosen from a deck of playing cards arough p-value of .07 (it actually is little more complex in common usage in statistics)

That means there is a seven percent chance that it would occur just randomly

So lets us see some random number and guess the same rank value each trial

In this case the trial will be of ten tries: the claimant just says '7'
(random.org)
Trial one:
2 3 9 8 12
9 8 4 13 10
two
12 9 11 7 2
3 12 13 11 4
three
8 6 1 9 7
11 7 4 10 6
four
6 8 12 1 5
6 6 9 12 11


So far so good, we have forty events and 3 correct hits! Which is about what you would expect.

Now here is where significance comes in

If a claimant wanted to undergo repeated trial and get the events up in the thousands then I would accept anything near 21%, that would really show that there was something other than random chance. If over a thousand trials they were able to correctly name 210 of the cards, that would be pretty good, it could still be random chance. But the p-value would be really good like way beyond .0000001

Ideally I would want to see ten trials of a thousand numbers, the statistical chance of getting 21% right over ten thousand events is very low.

But for there to be a trial for the MDC, that is up to the JREF.
 

ISF - Join now!

Every member here is approved by hand. No bots, no spam, just people who care about evidence and honest debate.

Membership is free!

Create your free account

Back
Top Bottom