datta_godbole
Student
- Joined
- May 15, 2010
- Messages
- 38
Correction: Thanks Dancing David.Thanks David, it will take time for me grasp everything. I appreciate your effort.
Correction: Thanks Dancing David.Thanks David, it will take time for me grasp everything. I appreciate your effort.
No. why should they?
And what does that have to do with fairness, even?
Here's what happens in a nutshell:
Applicant: "I can do x, even though it should not be possible for anyone under any conditions to do x."
Randi: "Well, I bet you a million dollars that you cannot do x."
The only fair thing then is for the applicant to demonstrate that he can actually do x.
Why should it matter to the applicant how difficult it would be for anyone to pass the test who isn't able to do x?
Example:
Applicant: "I can speak Chinese!"
Randi: "Really? Well, listen to this Chinese audio-book and then tell me the following things:
Is it a love story, a thriller, a whodunnit or a comedy?
Is the female lead character between 10 and 20 years, 21 and 30 years or between 31 and 40 years?
The book mentions a painting. Is it of a dog, a windmill or a woman?
Does the grandmother get married?
Where/how does the milk man die? An accident while mountain climbing, a car crash on the motorway, in hospital due to kidney failure, ran out of oxygen diving or parachute failure?
What colour is the airplane - blue, red, yellow, green or white?
You can listen to it as much as you like, and you can rewind or fast forward as much as you please. If you answer all these questions correctly, I'll give you a million dollars."
Applicant: "But that's not fair. I only have a chance of 1 in 1800. Why does it have to be so difficult? Wouldn't it be just as good if I got half the questions right? Whaaaaaaaaaaaaaaaaaaa!"
-> It doesn't matter, and it is not unfair. If the applicant is actually able to speak Chinese, then getting every question right could not possibly be a more trivial task.
We're not doing the test to see if it is likely or possible that the applicant maybe speaks Chinese. We just want fairly reasonable proof.
We could discuss the chances of getting an answer wrong accidentally. To compensate, we could add three or four more questions and allow for one or possibly two answers to be incorrect. The basic facts would remain the same: It will be almost impossible to pass the test unless you actually speak Chinese. And it will be trivially easy to pass the test, if you do.
How is it unfair that someone unable to speak Chinese would have a very hard time passing the test?
And why should it be any different for paranormal claims?
This misses the obvious objection that psi powers may not work with 100% accuracy. That doesn't mean they don't exist. Getting 70 out of 200 Zener cards correct is not even 40% accurate, but someone who could do that should win the challenge.
This misses the obvious objection that psi powers may not work with 100% accuracy. That doesn't mean they don't exist. Getting 70 out of 200 Zener cards correct is not even 40% accurate, but someone who could do that should win the challenge.
We could discuss the chances of getting an answer wrong accidentally. To compensate, we could add three or four more questions and allow for one or possibly two answers to be incorrect. The basic facts would remain the same: It will be almost impossible to pass the test unless you actually speak Chinese. And it will be trivially easy to pass the test, if you do.
Correction: Thanks Dancing David.
This misses the obvious objection that psi powers may not work with 100% accuracy. That doesn't mean they don't exist. Getting 70 out of 200 Zener cards correct is not even 40% accurate, but someone who could do that should win the challenge.
No it doesn't. If 35%, 15% above chance, is what a claimant says they can do, then that is what will be tested. You can test for lower success rates, but to make certain it's not just chance, you need to increase the number of tests. IIRC, the preliminary test needs only to be one in 10,000 to win by chance, and thankfully, claimants very often make bold claims. Otherwise it could get very tedious.
No it doesn't. If 35%, 15% above chance, is what a claimant says they can do, then that is what will be tested. You can test for lower success rates, but to make certain it's not just chance, you need to increase the number of tests. IIRC, the preliminary test needs only to be one in 10,000 to win by chance, and thankfully, claimants very often make bold claims. Otherwise it could get very tedious.
It is about 1 in a million; I suspect Dancing David was eyeballing it and not expecting it to be that difficult. This is heading down a path we've taken before about ability vs. chance and the guy who can predict coin flips with 50.00001% accuracy.
Ultimately, it boils down to the fact that the JREF has a hard success number, which is 0.001 for the preliminary test*, and a soft requirement on how long the test will take. For the zener card example, JREF would likely consider 10 out of 20 to be a successful preliminary test. If I can predict the card 95% of the time, I'm virtually guaranteed to succeed. If I can predict the card 50% of the time, I'm going to lose by chance almost 60% of the time! I can protect myself by increasing the number of trials.
If I go to 200 trials, and have to hit 58, I'm again >99.999% chance to succeed if I can predict 50% of the cards. But what if I'm only good to 25%. That's still better than chance, right! At that rate, I lose the 200 trial test >90% of the time due to random chance!
So if i'm at 25%, I might ask for 2000 trials, to show I can get 456 right. That I can do almost 99% of the time. But now the trials are getting longer to execute. Ultimately, if I'm only just above chance, how useful is my ability anyway?
*generally speaking. I remember a dowsing test in which the candidates were given a 1/150ish chance of success!
So let's say the person makes the claim that they have some low-grade psi ability that allows them to score higher than random chance on a Zener card test. The preliminary test is given, and they get 35 out of 100 right. Very low odds of that happening. So the person is tested again: they get 30 out of 100. Again, they beat the odds, though not as much as the first time. Now, if that were a drug trial, the pharma company would be breaking out the champagne. So does the guy get the million?
But the test is to prove the existence of the paranormal, correct? Getting 70+ out of 200 Zener cards is either extremely lucky or proof of some psi ability. It is well above the 5% statisitical significance level usually used in clinical trials. The odds are about 1 in a million? Unless the online calc I'm using is totally off base.
Dancing David said:So let's say the person makes the claim that they have some low-grade psi ability that allows them to score higher than random chance on a Zener card test. The preliminary test is given, and they get 35 out of 100 right. Very low odds of that happening. So the person is tested again: they get 30 out of 100. Again, they beat the odds, though not as much as the first time. Now, if that were a drug trial, the pharma company would be breaking out the champagne. So does the guy get the million?
What evidence do you have for your claim that a pharma would break out the champagne for a 10% and 5% above the mean result?
Seriously, data please?
If one looks at the odds it always depends.
70/200=.35=35% , so only tem percent above the mean.
So my idea would be two trials of ten thousand by lot of 200 (don't worry a computer will do it).
One program the machine just says card 'stars' and then it measures the results for each of the fifty trials of 200 cards.
Another program generates a random card choice and measures the results for each of the fifty trials of 200 cards.
Then you have two control samples of 50 trials of 200 card runs. This allows you to generate a mean, mode and standard deviation.
then i would randomly chose ten subject and have them randomly paired as rearedr and sender. Each pair would do 200 cards for 50 trials. Then you can again get a mean, mode and standard deviation.
Now, we can seriously take a stab , given the limited control samples, at determining what the occurrence of 70/200 cards it compared to the three control groups. If it falls within one standard deviation, that is not very remarkable as 68% of the population falls in one standard deviation, if it is two standard deviations, then that is more remarkable at 28% of the population, and so on.
Now it is two standard deviations away and they can do it on 5 runs of 200 cards each (at 35% each of 5 runs), I would give them the million.
One program the machine just says card 'stars' and then it measures the results for each of the fifty trials of 200 cards.
Another program generates a random card choice and measures the results for each of the fifty trials of 200 cards.