THURSDAY, OCTOBER 23, 2014
Font Size
Topic Interpretation of P value of Constant in Regression

Interpretation of P value of Constant in Regression

Home Forums Old Forums General Interpretation of P value of Constant in Regression

This topic contains 2 replies, has 1 voice, and was last updated by Profile photo of Remi Remi 5 years, 11 months ago.

Viewing 3 posts - 1 through 3 (of 3 total)
  • Author
    Posts
  • #152603

    I am doing multiple regression analysis. I was looking for help in interpreting a special case of output. In my regression, the overall p value for the test is less than 0.05 and the variables are also significant. But the P value for the constant is not significant and is above 0.05.
    How does this condition impact the interpretation of results. The residual analysis also does not indicate much issue.

    #152607
    Profile photo of Robert Butler
    Butler
    Member
    Reputation - 0
    Rank - Aluminum

      The p values in the regression refer to the significance of the terms in the regression model.  For any particular X a lack of significance with respect to Y means that the slope of the regression line relating that X and Y has not tested as being significantly different from 0.  For the constant an insignificant p-value means the interecept is not significantly different from 0. 
      To see this run the following regression
      X1  Y1
      0     .005
      0      0
      0     .01
      .5    .5
      .5    .51
      .5    .49
       1     1
       1     1.01
       1     .99
      Now run the regression again only add 2 to every value of Y. 
       In the first case you will have a p value of .36 for the intercept and in the second case you will have a p value of <.0001
      As for impacting the rest of the regression – not much – look at the various summary statistics for the above to examples – no changes in R2 or RMSE and, as you noted, no changes in the residual patterns.
      Given that we are talking about significance of intercepts and not significance of slopes this really isn’t too surprising.

    #152610

    Hai Sinha,
    in layman terms: the regression multi-plane is calculated to meet Y=Constant on location (0,…,0) for the X’s. But that Constant is calculated from the data from the sample. The high p-value for Constant means that the Confidence Interval of that Constant contains 0 so that it is possible that the multi-plane goes through the origin (Y=0) instead of through Y=Constant.
    The high p-value for Constant happens often when the area of interest fr the X’s is ‘far from the origin’ (for example: temperatures are varied from 400-660 C, then the prediction of the model for 0 C has a large Confidence Interval).
     
     

Viewing 3 posts - 1 through 3 (of 3 total)

The forum ‘General’ is closed to new topics and replies.

Login Form