Linear Regression and Correlation: Testing the Significance of the Correlation Coefficient is a part of Collaborative Statistics collection (col10522) by Barbara Illowsky and Susan Dean. The title has been changed from Facts About the Correlation Coefficient for Linear Regression. Roberta Bloom has made major contributions to this module.
Testing the significance of the correlation coefficient
The correlation coefficient,
, tells us about the strength of the linear relationship between
and
. However, the reliability of the linear model also depends on how many observed data points are in the sample. We need to look at both the value of the correlation coefficient
and the sample size
, together.
We perform a hypothesis test of the
"significance of the correlation coefficient" to decide whether the linear relationship in the sample data is strong enough to use to model the relationship in the population.
The sample data is used to compute
, the correlation coefficient for the sample. If we had data for the entire population, we could find the population correlation coefficient. But because we only have sample data, we can not calculate the population correlation coefficient. The sample correlation coefficient,
, is our estimate of the unknown population correlation coefficient.
- The symbol for the population correlation coefficient is
, the Greek letter "rho".
-
= population correlation coefficient (unknown)
-
= sample correlation coefficient (known; calculated from sample data)
The hypothesis test lets us decide whether the value of the population correlation coefficient
is "close to 0" or "significantly different from 0". We decide this based on the sample correlation coefficient
and the sample size
.
If the test concludes that the correlation coefficient is significantly different from 0, we say that the correlation coefficient is "significant".
- Conclusion: "There is sufficient evidence to conclude that there is a significant linear relationship between
and
because the correlation coefficient is significantly different from 0."
- What the conclusion means:
There is a significant linear relationship between
and
.
We can use the regression line to model the linear relationship between
and
in the population.
If the test concludes that the correlation coefficient is not significantly different from 0 (it is close to 0), we say that correlation coefficient is "not significant".
- Conclusion: "There is insufficient evidence to conclude that there is a significant linear relationship between
and
because the correlation coefficient is not significantly different from 0."
- What the conclusion means:
There is not a significant linear relationship between
and
.
Therefore we can NOT use the regression line to model a linear relationship between
and
in the population.
- If
is significant and the scatter plot shows a linear trend, the line can be used to predict the value of
for values of
that are within the domain of observed
values.
- If
is not significant OR if the scatter plot does not show a linear trend, the line should not be used for prediction.
- If
is significant and if the scatter plot shows a linear trend, the line may NOT be appropriate or reliable for prediction OUTSIDE the domain of observed
values in the data.
