iSixSigma

Significance Testing for Poisson Data

Six Sigma – iSixSigma › Forums › Old Forums › General › Significance Testing for Poisson Data

Viewing 11 posts - 1 through 11 (of 11 total)
  • Author
    Posts
  • October 22, 2009 at 1:55 pm #52820

    Ken Feldman
    ★ 10 Years ★
    Participant

    I have three sets of Poisson data and I need to test whether there is a significant difference between the three sets. The data is clearly Poisson so using a normal approximation is out of the question. Any thoughts on doing an “ANOVA” type analysis but with the severely skewed count data….93% of the counts are 0 just to give you an idea. Thanks.

    0
    October 22, 2009 at 10:10 pm #186325

    Ken Feldman
    ★ 10 Years ★
    Participant

    Hey stop fooling around and somebody please answer this question. Thanks.

    0
    October 23, 2009 at 3:05 pm #186340

    Xgames
    ★ 10 Years ★
    Member

    With lots of data (greater than 25 or 30), the central limit theorem takes cares of things (when checking for differences between the means).

    ANOVA is pretty robust to normality, though….the assumption in the model is for the residuals to be normal.  If they’re grossly skewed, then will most likely need to do a transformation on the data.

    0
    October 23, 2009 at 5:55 pm #186343

    Lee
    ★ 10 Years ★
    Participant

    A bit rich for my blood at this time, but look at http://www-stat.wharton.upenn.edu/~lzhao/papers/newtest.pdf
     

    0
    October 23, 2009 at 6:01 pm #186344

    newbie
    ★ 10 Years ★
    Participant

    Hey Doc,
    I assume you transformed it and/or ran the ANOVA / Moods Median for the helluva it….anything interesting result?
    With 93% of the data being zero, I assume your data is counting  occurances of some event in a given time period/sample area  (ie 93% of the time, there is no occurance of a given event).  
    If so, would it be practical/useful to translate your poisson data into a continuous format, such as a MTBF or ‘Mean Time Betweeen Events’ in this case?  
    Just a thought….good luck.

    0
    October 23, 2009 at 6:30 pm #186347

    Mikel
    ★ 10 Years ★
    Member

    Wrong

    0
    October 23, 2009 at 6:31 pm #186348

    Mikel
    ★ 10 Years ★
    Member

    Wrong

    0
    October 23, 2009 at 7:27 pm #186349

    Xgames
    ★ 10 Years ★
    Member

    Please enlighten me Stan…..

    0
    October 23, 2009 at 8:24 pm #186351

    Taylor
    ★ 10 Years ★
    Participant

    Doc
    You should be able to perform ANOVA and get Some kind of a result. Have you tried performing standard deviation of runs?
     

    0
    October 23, 2009 at 10:31 pm #186352

    Ken Feldman
    ★ 10 Years ★
    Participant

    Xgames, thanks for trying to provide input but as Stan said, you are a bit off.I said the data was counts/Poisson which is discrete data. The Central Limit Theorem has little to with discrete data let along hypothesis testing.While it is true that ANOVA is pretty robust with respect to the assumption of normality again I was clear that the data was significantly skewed which occurs with the Poisson especially for small counts.The issue of normality of residuals is in regards to regression not hypothesis testing, especially for non continuous data.There is occasion when counts are large that the Poisson can be approximated by the normal distribution and the analysis becomes easy. That is not the case here. The counts are small and as I described a lot of zeros. Transformation will not work.Thanks anyway.

    0
    October 26, 2009 at 1:57 pm #186373

    Dreemr
    ★ 10 Years ★
    Participant

    I think the most appropriate test may be the Chi-Square Goodness of Fit.  In the end it is count data it just is not proportional.

    0
  • Author
    Posts
Viewing 11 posts - 1 through 11 (of 11 total)

The forum ‘General’ is closed to new topics and replies.