The "Process" of John Edward

This bears repeating...


So Bill, how exactly did you calculate the mean for the Poisson in your "J" example? If I recall you took 0.1336*85 and arrived at 11.356. Hmm? Is that correct? Let me input the variable names for the formula you used. p*N


Lurker
 
In Bill's own words:

BillHoyt said:


...According to the US census data presented earlier, "J" surnames are 13.36% of the total population.
In this analysis of 85 JE name guesses, I counted 18 "J" names. I calculated the expected number of "J"s (formally, the "expectation function") as 11.05.

I used the Poisson function to model the population. With an expected mean of 11.05, ...[/B]

Mea culpa. I used mean instead of Bill terms, "expected number" or "expected mean".

Now, how did you avoid using N here? I specifically see you getting the expected mean of 11.05 by multiplying 85*0.13. We'll ignore your roundoff. Isn't N*p being used here? Show me where I am wrong.

Lurker
 


ROTFLMAO! You flaming ignoramous! Holy sh**. I don't believe it. Holy sh**.

Oh, wow. You've just proven Poisson doesn't work for anything! Wow! Why that idiot french guy invent it? BTW, fool, did you find any pairs of n and p for which this doesn't happen? What do you make of that?


No, I showed it does not work in all cases. What is so hard to understand about that? And yes, if we integrate the Poisson Distribution from one above the sample size to infinity and call that value A, as A approaches zero I would contend that the Poisson Distribution is getting more accurate.



Tell me where n appears in the Poisson equation. Hmm. Why not?



Um, in N*p to arrive at the expected mean which IS in the equation and which is exactly what you used in your "J" example.


Holy sh**. What a stooge. You don't understand the difference between a pdf and an expectation function, do you? Holy sh**! No wonder this has gone on for pages. Holy sh**. You haven't even bothered to educate yourself. You've simply searched for bits that help support your argument. You never truly considered that you needed to learn something! Holy sh**.

Drink heavily this weekend. You're going to need it.

I'm done with you. If you don't think you need to rethink this, then be my guest. But, as far as I'm concerned, go away.


Your name calling is merely avoiding the inevitable. First off, why is the example I provided inaccurate? You refuted nothing yet.

Evidence, it is about evidence, Bill. Not personalities.

Lurker
 
BillHoyt said:

ROTFLMAO! You flaming ignoramous! Holy sh**. I don't believe it. Holy sh**.

Oh, wow. You've just proven Poisson doesn't work for anything! Wow! Why that idiot french guy invent it? BTW, fool, did you find any pairs of n and p for which this doesn't happen? What do you make of that?

Tell me where n appears in the Poisson equation. Hmm. Why not?

Holy sh**. What a stooge. You don't understand the difference between a pdf and an expectation function, do you? Holy sh**! No wonder this has gone on for pages. Holy sh**. You haven't even bothered to educate yourself. You've simply searched for bits that help support your argument. You never truly considered that you needed to learn something! Holy sh**.

Drink heavily this weekend. You're going to need it.

I'm done with you. If you don't think you need to rethink this, then be my guest. But, as far as I'm concerned, go away.

So much for just offering the idea that someone could be incorrect in their reasoning. :roll:
 
Bill:

From http://www.computer.org/cise/cs2001/c3078abs.htm

"We scientists and engineers often use Poisson's probability distribution to characterize the statistics of rare events whose average number is small. Using it correctly is crucial if we are to validate claims of discovery of new phenomena, such as a new fundamental particle (few candidate collision events among millions), a remote galaxy (few photons in the telescope among the billions emitted), or brain damage from using cell phones (few tumors among millions of users). In risk assessment, such as estimating the chance of dying from a horse kick if you're in the Prussian army or from suicide (two of its early uses), it plays a crucial role, which should interest actuaries as well as morticians. I've noticed that the Poisson distribution is often misunderstood and misapplied, so in this column I'll describe some of its interesting and relevant properties."

Bill, I am not saying you misapplied it. I just wonder if you can justify it mathematically for us.

Thanks!

Lurker
 
T'ai Chi said:


So much for just offering the idea that someone could be incorrect in their reasoning. :roll:

Yeah. I really just expected Bill to reply with something along the lines of:

"You know, you may have a point there but I feel that the p was still sufficiently small as to justify a Poisson Distribution."

I mean, I was only making a suggestion, a minor quibble if you will. Now Bill is calling into question my knowledge of stats, which I agree is not a whole lot. I do respect Bill for having some knowledge of stats, more than I do. But I don't uderstand why he is retreating into his shell here.

Lurker
 
So, after some homework, Bill what do you have to say:

1. Is the Poisson always a good approximation?

2. When is it not?

Lurker
 
T'ai Chi said:
So much for just offering the idea that someone could be incorrect in their reasoning. :roll:
T'ai Chi,

I already have grave reservations about you. Please don't increase them. The "offer" that I may be "incorrect" has absolutely nothing to do with my outburst. Lurker has made a laughingstock of himself. He is suggesting that Poisson is flawed based on a complete misread of his cited source. (Read it, please), an apparent misunderstanding of Poisson as "Binomial lite", and a whacky interpretation of Poisson's cdf.

You're hopping on board his bus is doing you no good. But your response to this question will help me immensely: Do you understand the flaws in what Lurker said about the Poisson cdf. Please explain where either Lurker or I am wrong.
 
BillHoyt said:

T'ai Chi,

I already have grave reservations about you. Please don't increase them. The "offer" that I may be "incorrect" has absolutely nothing to do with my outburst. Lurker has made a laughingstock of himself. He is suggesting that Poisson is flawed based on a complete misread of his cited source. (Read it, please), an apparent misunderstanding of Poisson as "Binomial lite", and a whacky interpretation of Poisson's cdf.

You're hopping on board his bus is doing you no good. But your response to this question will help me immensely: Do you understand the flaws in what Lurker said about the Poisson cdf. Please explain where either Lurker or I am wrong.

Bill, this is about a particular analysis and everything that goes into that. I don't particularly care about your, or anybody else's agendas. Your "reservations" are irrelevant here- we are talking about science. I'm not "hopping on board" with anyones' particular analyses except my own. I have just asked very specific questions about the applicability of the Poisson in this case. Considering I do statistics for a living and have had two degrees in that area, I'm curious about the fine points. Thanks.
 
Lurker said:
So, after some homework, Bill what do you have to say:

1. Is the Poisson always a good approximation?

2. When is it not?

Lurker
Lurker,

You claim to be a skeptic. And yet, here you are, taking up the mantle of another "avowed skeptic" who persistently takes up the mantle of clear woos, who also claim to be skeptics.

I would dearly love to accept you, Thanz, Clancie and the rest of all of you "skeptics" into the fold, but I have some serious problems. First, with you, of course, is one of your earlier posts where you described Randi's column in Skeptical Inquirer as one of the chief motivations for your coming aboard JREF. That would be nice, except that Randi didn't write "Twis Brilling" for SI, he wrote it for Skeptic. That would be Shermer's rag. And your mistake would group you in the good company, unfortunately, of Clancie, who can't tell that Shermer isn't part of CSICOP, and that O'Neill emailed Randi, and not Shermer and not CSICOP. I dunno. Chalk that up to woo racism. All us skeptics must look alike to you white-as-the-ghosts-you-believe-in folk.

I've been around the internet (and its predecessors) for many years. Don't ask how many. I've debated with many "avowed skeptics" who were really "shills". Now I don't want quite yet to classify you as a "shill", but they clearly exist. Along with the doctor (who thought i was a bouncer) telling me all about how little we understood anaesthesia, and whom I lived to watch flame out and abandon that board as I drove evidence between her and her idiotic claims. And the "biologist" who wrote about how wrong I was for expressing disbelief over a claim that a vaccine had killed two litters of puppies and who nearly got dragged into court by both the manufacturer and the distributor she named. And the constant flood of "net experts" (they really aren't experts but they play them on the net), who either flame out or keep on going and going like deranged energizer bunnies.

I tire of it. I tire of the game. I tire of the attempt to work from within skeptical groups and undermine their efforts. This is why one of my missions is to identify such idiots, root them out and make sure they dry up, if necessary. My other mission, though, is to bring more people into the light and forestall this attempt to drag us back into the dark ages.

It is my continued, though waning, hope that you and T'ai Chi are not examples of these types of irrational, dark-age people. That is why I am giving you one more shot at this.

Re-read your source. With understanding, please. That is not a description of the conditions under which Poisson is valid. Neither is it a description of Poisson as "Binomial lite". If you have real trouble understanding this, I will help you. That is an honest offer, if you approach this honestly. Unfortunately, your approach is part of the problem for me.

Now let me give you an exercise from Hogg & Craig's Introduction to Mathematical Statistics, third edition. It is from page 98. If you don't have a copy, just ask anyone who's been through Cherry's Stat 231 course here at _____'s exotic dance bar. She used to hold it late in the evenings, or early morning's, depending on your perspective.

"3.23 Let X have a Poisson distribution with mu=100. Use Chebyshev's inequality to determine a lower bound for Pr(75 < X < 125)."

Poisson with mu=100? What justifies that?

Wake up before you get branded a laughingstock. Last chance before heckling mode.
 
T'ai Chi said:


Bill, this is about a particular analysis and everything that goes into that. I don't particularly care about your, or anybody else's agendas. Your "reservations" are irrelevant here- we are talking about science. I'm not "hopping on board" with anyones' particular analyses except my own. I have just asked very specific questions about the applicability of the Poisson in this case. Considering I do statistics for a living and have had two degrees in that area, I'm curious about the fine points. Thanks.
Fascinating, T'ai. A mere week ago you said you were about to be employed as a geophysicist/statistician. Now you're doing stat for a living and have two stat degrees. Is that a total of 3? Or ? I dunno.

Whatever.

So let's exercise all that training. Read what Lurker wrote; what I responded to. There is an abundance of clear errors there. You'll have a field day. And you may understand why he is just shy of becoming a laughingstock.

I'm willing to give anybody a chance. I'm willing to give multiple chances. And I trust everybody. But I make them all cut the cards. Your turn. Read the source Lurker cited, and the things he said leading up to my post. Then explain them to us all.

Also, BTW, and on a side issue. You really have to explain why everybody has to be tested to conclude nobody has superpowers. You have, particularly, to explain that in the context of your claim to have scientific training. Just how does science make progress when everything must be tested to draw a conclusion. Is atomic theory wrong? Or have we tested every atom? Cite references, please.
 
BillHoyt said:
Fascinating, T'ai. A mere week ago you said you were about to be employed as a geophysicist/statistician. Now you're doing stat for a living and have two stat degrees. Is that a total of 3? Or ? I dunno.


About to be employed doesn't mean that I wasn't in a job or that I am not currently in a job...

Oops, sorry, I wrote that like I have two degrees in statistics, I don't. I have a BS in mathematics, and a MS in statistics, my bad.

I have read what Lurker, and everybody else in the thread, wrote. I tried to ignore anything that didn't have to do with the analysis of JE's hits, such as the whole part on 'when can we compare percentages', etc. I'm solely interested in the methods of analyzing JE's letter counts and comparing them to what we'd expect.

Your turn. Read the source Lurker cited, and the things he said leading up to my post. Then explain them to us all.


As I understand it, the main content of this thread is about trying to find an appropriate statistical analysis to analyze JE's letter counts, not seeing if I can answer your off-topic questions (superpowers, atomic theory, you want to me to critique Lurker's approach, etc.) for your pleasure. I'm sticking to trying to find an appropriate analysis, regardless of where this thread may get steered.
 
T'ai Chi said:
About to be employed doesn't mean that I wasn't in a job or that I am not currently in a job...[/b]
No, but the second claim that you do "statistics for a living" stands a bit in contrast with your first claim that you were "about to be employed" as a "geophysicist/statistician". One wonders why you didn't say "i'm about to change jobs from being a statistician to being a geophysicist/statistician.

One also has to wonder about someone who proposes chi-square over the entire histogram when n=85, and there are, perforce, 26 intervals. Seems bound and determined to run into the minimum of 5 problem. But that's just me.

So is this new position in the oilfield?

I have read what Lurker, and everybody else in the thread, wrote. I tried to ignore anything that didn't have to do with the analysis of JE's hits, such as the whole part on 'when can we compare percentages', etc. I'm solely interested in the methods of analyzing JE's letter counts and comparing them to what we'd expect.

As I understand it, the main content of this thread is about trying to find an appropriate statistical analysis to analyze JE's letter counts, not seeing if I can answer your off-topic questions (superpowers, atomic theory, you want to me to critique Lurker's approach, etc.) for your pleasure. I'm sticking to trying to find an appropriate analysis, regardless of where this thread may get steered.
I'm a bit puzzled why you don't see the relevance of Lurker's percentage comparison. Also that you didn't pick up on its inappropriateness as a tool. I'm also puzzled that you don't see the relevance of the superpowers comment to the topic at hand. It is, in fact, essential, I think, to further correspondence with you.

If you demand 100% testing to determine the existence of superpowers, what is the probitive value of all your inferential statistics? Why bother with the null hypothesis, sampling and attempting to refute the null? It matters not, it seems, in your putative epistemology.

Can you help me undrstand these issues?

I extend to you the same offer extended to Lurker. I welcome you into the skeptical fold if you really want to be here.
 
Posted by Bill Hoyt

I would dearly love to accept you, Thanz, Clancie and the rest of all of you "skeptics" into the fold, but I have some serious problems.

First, with you, of course....That would be nice, except that Randi didn't write "Twis Brilling" for SI, he wrote it for Skeptic. That would be Shermer's rag. And your mistake would group you in the good company, unfortunately, of Clancie, who can't tell that Shermer isn't part of CSICOP, and that O'Neill emailed Randi, and not Shermer and not CSICOP.

That's true, as far as what I said is concerned. I went by my memory (of Steve's post--not necessarily remembered correctly) rather than looking in JE's book, "Crossing Over" which gives your version. (So, Bill, you're in the "good company" of JE).

But what does my mistake have to do with Lurker? :confused: Lurker confused Skeptic and Skeptical Inquirer. So what? I think its a very unpleasant tactic to somehow interject me (a "woo woo") into the mix and use my goof to somehow impugn someone else's credibility as a skeptic for a much less significant error--one totally unrelated to mine in any way.

Really, tarring someone with the taint of so-called "woo-wooism" just for being confused about which skeptic magazine he saw a Randi article in...I don't like my name used that way, Bill. What a cheap shot. :(
 
I don't see what we can proove with this statistical test.

If J is the most common initial, it makes sense for a cold reader to litter his guesses with the initial J. It would also make sense that, if he were a medium, that the ghost's contacting him would most likely the initial J.

If he never guesses Asian names (I'm an X, like Xhizen or ...) it could be because:
1. As a cold reader he notices few Asians in his audience.
2. As a medium, Asian ghosts don't contact him because they go to the same mediums that Aisans go to.
3. Asian ghosts attend the taping, but remain quiet when they don't see they buddies there.

Can somebody propose a result to a statistical analysis of his guesses (not hits and misses) that would be indicticative of cold reading vs. mediumship.

The method of cold reading that yields the highest number of hits is to guess the most common initial everytime. The reason cold readers don't use this tactic is because it would be to obvious to the audience. So they try to pepper they guesses with other letters as well to through them off.

Walt
 
The short history of the matter is that at one time, long long ago both Randi and Shermer were esteemed members of CSICOP.
However these two parted company with CSICOP and went on their own: Shermer, Randi's friend, to establish the Skeptic Society and the magazine The Skeptic and Randi to Florida to establish JREF. Randi writes (e.g. works) for Shermer supplying him with a regular column feature.

O'Neill did indeed send e-mail to Randi and Randi FIRST wrote about it in a magazine called, what do you know, The Skeptic where he has a regular column. He also gave the O'Neill quotes to Jaroff who used it in his TIME column bashing JE since he had no one other than Randi (who has never set foot in JE's TV studio) to back up his assertions of hidden mics, ringers, and over-attentive staff latching on to every audience member's conversation while telling them to keep very quiet. After the TIME article appeared, Shermer, in his own editorial in The Skeptic bragged how it first appeared in his magazine. Perhaps this is what Clanci remembers.

Shermer also used the O'Neill comments it in his regular monthly column in Scientific American, crediting Randi with having received the e-mail.

Neither Shermer nor Jaroff, nor Randi for that matter, have ever mentioned O'Neill again, did any follow-up with him nor did they (Jaroff and Shermer) say they checked out O'Neill for themselves.
It would appear, therefore, that if anyone wants to, they can e-mail anything they want to Randi including unsubstantiated observations and so long as it fits with Randi's agenda it will never ever be questionned. They may even get quoted in TIME magazine!
 
BillHoyt said:
No, but the second claim that you do "statistics for a living" stands a bit in contrast with your first claim that you were "about to be employed" as a "geophysicist/statistician". One wonders why you didn't say "i'm about to change jobs from being a statistician to being a geophysicist/statistician.


I worded it in a way that you think could have been worded better, even though there is no contradiction. That's great. Now that that is settled, could you please get back on topic here.


One also has to wonder about someone who proposes chi-square over the entire histogram when n=85, and there are, perforce, 26 intervals. Seems bound and determined to run into the minimum of 5 problem. But that's just me.


I've stated several times to only consider the high frequency letters for a chi-square analysis. That leaves about 6 "intervals". I defined high frequency to mean letters where n*frequency of that letter > 5, to avoid the minimum of 5 problem. I wrote that a few pages back, at least twice.

Whenever I ask for a rational for choosing the Poisson, all I get is that we are studying counts. How do we know that J counts are distributed as a Poisson? What does just examining the J counts tell us? Aren't there other letters that are important? As you know, there are statistical problems with doing that single-letter test many times. Are you interested in other letters, or just the J? You don't have to answer these or take these personal. These are just some questions about your analysis that spring to mind.


I'm a bit puzzled why you don't see the relevance of Lurker's percentage comparison. Also that you didn't pick up on its inappropriateness as a tool. I'm also puzzled that you don't see the relevance of the superpowers comment to the topic at hand. It is, in fact, essential, I think, to further correspondence with you.


I am interested in ways to analyze JE's letter counts. I'm not interested in questions that get this thread away from that specfic topic. I already know under what conditions percentages can be compared, etc. If answers to those questions are essential, to you, for further correspondence with me, then you don't have to reply to me, but I will keep finding a way to analyze JE's letter counts.
 

Back
Top Bottom