11.4 Testing the Significance of the Correlation Coefficient
SLO 2
Identify appropriate graphs and summary statistics for variables and relationships between them and correctly interpret information from graphs and summary statistics.
SLO 4
Demonstrate an understanding of, and ability to use, basic ideas of statistical processes, including hypothesis tests and confidence interval estimation.
Learning Objectives
By the end of this section, you will be able to:
- explain why the sample size matters as much as the value of \(r\);
- state the null and alternative hypotheses for a test of the significance of the correlation coefficient, in symbols and in words;
- decide significance using the p-value method and using the table of critical values;
- state what a significant \(r\) does and does not license you to do with the regression line;
- list the assumptions the test requires.
Section 11.3 gave you a correlation coefficient and a line. It did not answer the question that decides whether either is worth anything: is this relationship real, or could a sample this small produce an \(r\) this large by chance? A correlation of 0.8 computed from four points is not the same evidence as a correlation of 0.8 computed from four hundred. This section tests exactly that.
11.4.1 Why the Sample Size Matters Too
The symbol for the population correlation coefficient is \(\rho\), the Greek letter "rho."
- \(\rho\) = population correlation coefficient (unknown)
- \(r\) = sample correlation coefficient (known; calculated from sample data)
A sample statistic estimates an unknown population parameter, and the test asks whether the estimate is far enough from a null value to be worth believing. Here the statistic is \(r\), the parameter is \(\rho\), and the null value is zero. Once you see that, the only genuinely new content in this section is the critical-value table and the specific wording of the conclusion.
Definition 11.4.1 — Rho and r: The test uses r and n together to decide whether ρ is close to zero or significantly different from zero.
The hypothesis test lets us decide whether the value of the population correlation coefficient \(\rho\) is "close to zero" or "significantly different from zero." We decide this based on the sample correlation coefficient \(r\) and the sample size \(n\).
The correlation coefficient, \(r\), tells us about the strength and direction of the linear relationship between \(x\) and \(y\). However, the reliability of the linear model also depends on how many observed data points are in the sample. We need to look at both the value of the correlation coefficient \(r\) and the sample size \(n\), together.
We perform a hypothesis test of the "significance of the correlation coefficient" to decide whether the linear relationship in the sample data is strong enough to use to model the relationship in the population.
The sample data are used to compute \(r\), the correlation coefficient for the sample. If we had data for the entire population, we could find the population correlation coefficient. But because we have only sample data, we cannot calculate the population correlation coefficient. The sample correlation coefficient, \(r\), is our estimate of the unknown population correlation coefficient.
Two studies each report a correlation of \(r = 0.70\). The first used \(n = 5\) observations, the second \(n = 50\). Explain why these are not equally strong evidence of a relationship in the population, without doing any calculation.
Solution — the same r from different sample sizes
Step 1 — Recall what \(r\) alone reports. It measures the strength and direction of the linear association in the sample that was collected.
Step 2 — Ask what a small sample can do by chance. With only five points, a fairly high correlation can appear by accident even when \(x\) and \(y\) are unrelated in the population — there are few points to constrain the pattern.
Step 3 — Ask what a large sample can do by chance. With fifty points, an accidental \(r\) of 0.70 is far less likely. Chance patterns tend to wash out as observations accumulate.
Step 4 — State the conclusion. The second study provides much stronger evidence about \(\rho\), even though both report the identical sample value. This is precisely why the test uses \(r\) and \(n\) together rather than \(r\) alone.
Answer: The same \(r\) is much more convincing from 50 points than from 5, because a small sample can produce a high correlation by chance.
11.4.2 The Hypotheses
Performing the hypothesis test:
$$ H_{0}: \rho = 0 \qquad H_{a}: \rho \neq 0 $$What the hypotheses mean in words:
- Null hypothesis \(H_{0}\): The population correlation coefficient IS NOT significantly different from zero. There IS NOT a significant linear relationship (correlation) between \(x\) and \(y\) in the population.
- Alternate hypothesis \(H_{a}\): The population correlation coefficient IS significantly DIFFERENT FROM zero. There IS A SIGNIFICANT LINEAR RELATIONSHIP (correlation) between \(x\) and \(y\) in the population.
There are two methods of making the decision. The two methods are equivalent and give the same result:
- Method 1: Using the p-value
- Method 2: Using a table of critical values
In this chapter we will always use a significance level of 5%, \(\alpha = 0.05\).
Using the p-value method, you could choose any appropriate significance level you want; you are not limited to using \(\alpha = 0.05\). But the table of critical values provided in this textbook assumes a significance level of 5%. Using a different significance level with the critical-value method would require different tables, which are not provided — so the two methods stay equivalent only at \(\alpha = 0.05\).
Write the null and alternative hypotheses for a test of the significance of the correlation coefficient, in symbols and in words, for a study relating hours of sleep to reaction time.
Solution — the hypotheses in both forms
Step 1 — Write the symbols.
$$ H_{0}: \rho = 0 \qquad H_{a}: \rho \neq 0 $$Step 2 — Write \(H_{0}\) in words for this study. There is not a significant linear relationship between hours of sleep and reaction time in the population; the population correlation coefficient is not significantly different from zero.
Step 3 — Write \(H_{a}\) in words. There is a significant linear relationship between hours of sleep and reaction time in the population; the population correlation coefficient is significantly different from zero.
Step 4 — Note what the hypotheses are about. Both are statements about \(\rho\), the population coefficient — not about \(r\), which is already known exactly from the sample.
Answer: \(H_{0}: \rho = 0\) (no significant linear relationship in the population) and \(H_{a}: \rho \neq 0\) (there is one).
11.4.3 Method 1: Using a p-value
If the p-value is less than the significance level \((\alpha = 0.05)\):
- Decision: Reject the null hypothesis.
- Conclusion: "There is sufficient evidence to conclude that there is a significant linear relationship between \(x\) and \(y\) because the correlation coefficient is significantly different from zero."
If the p-value is NOT less than the significance level \((\alpha = 0.05)\):
- Decision: DO NOT REJECT the null hypothesis.
- Conclusion: "There is insufficient evidence to conclude that there is a significant linear relationship between \(x\) and \(y\) because the correlation coefficient is NOT significantly different from zero."
Calculation notes. You will use technology to calculate the p-value. The p-value is calculated using a t-distribution with \(n - 2\) degrees of freedom, and the formula for the test statistic is
$$ t = \frac{r\sqrt{n - 2}}{\sqrt{1 - r^{2}}} $$The value of the test statistic \(t\) is shown in the calculator output along with the p-value, and \(t\) has the same sign as the correlation coefficient \(r\). The p-value is the combined area in both tails.
Using the TI-83, 83+, 84, 84+ Calculator
To calculate the p-value using LinRegTTest: on the input screen, at the line prompt for \(\beta\) or \(\rho\), highlight "\(\neq 0\)". The output screen shows the p-value on the line that reads p =. An alternative way to calculate the p-value given by LinRegTTest is the command 2*tcdf(abs(t), 1099, n-2) in 2nd DISTR.
For the third-exam/final-exam data, \(r = 0.6631\) and \(n = 11\). Compute the test statistic \(t\), state its degrees of freedom, and explain why the p-value doubles a one-tail area.
Solution — computing t by hand
Step 1 — Find the degrees of freedom. \(df = n - 2 = 11 - 2 = 9\).
Step 2 — Compute \(1 - r^{2}\). With \(r = 0.6631\), \(r^{2} \approx 0.4397\), so \(1 - r^{2} \approx 0.5603\).
Step 3 — Substitute into the formula.
$$ t = \frac{r\sqrt{n-2}}{\sqrt{1-r^{2}}} = \frac{0.6631\sqrt{9}}{\sqrt{0.5603}} = \frac{(0.6631)(3)}{0.7485} \approx 2.658 $$Step 4 — Check the sign. The test statistic has the same sign as \(r\). Both are positive here.
Step 5 — Explain the doubling. The alternative hypothesis is \(\rho \neq 0\), which is two-tailed: a correlation far from zero in either direction counts as evidence. The p-value is therefore the combined area in both tails, which is why the calculator command doubles tcdf.
Answer: \(t \approx 2.658\) with \(df = 9\); the p-value is two-tailed because \(H_{a}\) is \(\rho \neq 0\).
Consider the third exam/final exam example. The line of best fit is \(\hat{y} = -173.51 + 4.83x\) with \(r = 0.6631\) and \(n = 11\) data points. Can the regression line be used for prediction?
Solution — a complete test using the p-value method
Step 1 — Set out what you are testing, and the risk you accept.
$$ H_{0}: \rho = 0 \qquad H_{a}: \rho \neq 0 \qquad \alpha = 0.05 $$Step 2 — Obtain the p-value. The p-value is 0.026, from LinRegTTest on your calculator or from computer software.
Step 3 — Compare with \(\alpha\). The p-value, 0.026, is less than the significance level of \(\alpha = 0.05\).
Step 4 — Make the decision. Reject the null hypothesis \(H_{0}\).
Step 5 — Write the conclusion. There is sufficient evidence to conclude that there is a significant linear relationship between the third exam score \((x)\) and the final exam score \((y)\) because the correlation coefficient is significantly different from zero.
Step 6 — Say what follows. Because \(r\) is significant and the scatter plot shows a linear trend, the regression line can be used to predict final exam scores.
Answer: Reject \(H_{0}\); the correlation is significant and the line may be used for prediction within the observed range of third exam scores.
11.4.4 Method 2: Using a Table of Critical Values
If \(r\) is not between the positive and negative critical values, then the correlation coefficient is significant. If \(r\) is significant, then you may want to use the line for prediction.
Equivalently: \(r\) is significant when \(r <\) the negative critical value or \(r >\) the positive critical value, and not significant when it falls between them.
Definition 11.4.2 — The Critical-Value Rule: A horizontal number line from −1 to +1.
The 95% Critical Values of the Sample Correlation Coefficient Table can be used to give you a good idea of whether the computed value of \(r\) is significant or not. Compare \(r\) to the appropriate critical value in the table, using \(df = n - 2\).
Decide significance in each case, and say whether the line can be used for prediction.
a. \(r = 0.6501\) with \(n = 12\); the critical value is 0.576.
b. \(r = 0.5204\) with \(n = 9\); the critical value is 0.666.
c. \(r = -0.7204\) with \(n = 8\); the critical value is 0.707.
Solution — comparing r against both critical values
Step 1 — Handle part a. The critical values are \(-0.576\) and \(+0.576\). Since \(0.6501 > 0.576\), \(r\) lies outside the interval, so \(r\) is significant and the line can be used for prediction.
Step 2 — Handle part b. The critical values are \(-0.666\) and \(+0.666\). Since \(-0.666 < 0.5204 < 0.666\), \(r\) lies between them, so \(r\) is not significant and the line should not be used for prediction.
Step 3 — Handle part c. The critical values are \(-0.707\) and \(+0.707\). Since \(-0.7204 < -0.707\), \(r\) lies outside the interval, so \(r\) is significant and the line can be used for prediction.
Step 4 — Note the pattern. Only the magnitude of \(r\) relative to the critical value decides significance; the sign decides direction. In part c a negative correlation is significant for exactly the same reason a positive one would be.
Answer: (a) significant, may be used; (b) not significant, should not be used; (c) significant, may be used.
Suppose you computed \(r = 0.801\) using \(n = 10\) data points. Is \(r\) significant?
Solution — finding df, then comparing
Step 1 — Find the degrees of freedom. \(df = n - 2 = 10 - 2 = 8\).
Step 2 — Look up the critical values. The critical values associated with \(df = 8\) are \(-0.632\) and \(+0.632\).
Step 3 — Apply the rule. If \(r <\) the negative critical value or \(r >\) the positive critical value, then \(r\) is significant. Here \(r = 0.801\) and \(0.801 > 0.632\).
Step 4 — Conclude. \(r\) is significant and the line may be used for prediction. Picturing a number line running from \(-1\) to \(+1\) with marks at \(\pm 0.632\) makes it clear that 0.801 sits outside the middle band.
Answer: Significant; the line may be used for prediction.
For a given line of best fit, you compute \(r = 0\) using \(n = 100\) data points. Can the line be used for prediction? Why or why not?
Solution — a large sample cannot rescue a zero correlation
Step 1 — Find the degrees of freedom. \(df = 100 - 2 = 98\), which is large, so the critical values are small in magnitude.
Step 2 — Apply the rule anyway. Whatever those critical values are, they are a negative number and its positive counterpart, and they straddle zero.
Step 3 — Locate \(r\). \(r = 0\) lies strictly between them.
Step 4 — Conclude. \(r\) is not significant, so the line cannot be used for prediction.
Step 5 — Say why the large sample does not help. A big sample makes it easier to detect a small relationship. It cannot manufacture evidence for a relationship of exactly zero — here the sample has measured no linear association at all, very precisely.
Answer: No. \(r = 0\) falls between the critical values at any sample size, so the correlation is not significant and the line must not be used for prediction.
Suppose you computed \(r = -0.624\) with 14 data points. Is \(r\) significant?
Solution — a negative r outside the band
Step 1 — Find the degrees of freedom. \(df = 14 - 2 = 12\).
Step 2 — Look up the critical values. They are \(-0.532\) and \(0.532\).
Step 3 — Compare. Since \(-0.624 < -0.532\), \(r\) falls below the negative critical value.
Step 4 — Conclude. \(r\) is significant and the line can be used for prediction.
Answer: Significant; a negative correlation far enough from zero is just as strong evidence as a positive one.
Suppose you computed \(r = 0.776\) and \(n = 6\). Is \(r\) significant?
Solution — a large r that a tiny sample cannot support
Step 1 — Find the degrees of freedom. \(df = 6 - 2 = 4\).
Step 2 — Look up the critical values. They are \(-0.811\) and \(0.811\).
Step 3 — Compare. Since \(-0.811 < 0.776 < 0.811\), \(r\) lies between the critical values.
Step 4 — Conclude. \(r\) is not significant, and the line should not be used for prediction.
Step 5 — Note why this is the instructive case. An \(r\) of 0.776 is a strong-looking correlation, and it still fails — because with only six points the critical value is pushed all the way out to 0.811. This is the sample-size effect from the start of the section, made concrete.
Answer: Not significant. With \(n = 6\), even \(r = 0.776\) is inside the band, and the line should not be used for prediction.
For each, determine whether \(r\) is significant and whether the associated line of best fit can be used to predict a \(y\) value.
a. \(r = -0.567\), \(n = 19\) b. \(r = 0.708\), \(n = 9\) c. \(r = 0.134\), \(n = 14\) d. \(r = 0\), \(n = 5\)
Solution — four applications of one rule
Step 1 — Handle a. \(df = n - 2 = 17\), and the critical value is \(-0.456\). Since \(-0.567 < -0.456\), \(r\) is significant.
Step 2 — Handle b. \(df = n - 2 = 7\), and the critical value is 0.666. Since \(0.708 > 0.666\), \(r\) is significant.
Step 3 — Handle c. \(df = 14 - 2 = 12\), and the critical value is 0.532. Since 0.134 is between \(-0.532\) and 0.532, \(r\) is not significant.
Step 4 — Handle d. \(r = 0\) and \(n = 5\). No matter what the degrees of freedom are, \(r = 0\) is between the two critical values, so \(r\) is not significant.
Step 5 — Note what d establishes. Because the critical values always straddle zero, an \(r\) of exactly 0 can never be significant — at any sample size whatsoever.
Answer: (a) and (b) are significant and their lines may be used; (c) and (d) are not significant and their lines may not.
11.4.5 What "Significant" Does and Does Not License
If the test concludes that the correlation coefficient is significantly different from zero, we say that the correlation coefficient is "significant."
- Conclusion: There is sufficient evidence to conclude that there is a significant linear relationship between \(x\) and \(y\) because the correlation coefficient is significantly different from zero.
- What the conclusion means: There is a significant linear relationship between \(x\) and \(y\). We can use the regression line to model the linear relationship between \(x\) and \(y\) in the population.
If the test concludes that the correlation coefficient is not significantly different from zero (it is close to zero), we say that the correlation coefficient is "not significant."
- Conclusion: There is insufficient evidence to conclude that there is a significant linear relationship between \(x\) and \(y\) because the correlation coefficient is not significantly different from zero.
- What the conclusion means: There is not a significant linear relationship between \(x\) and \(y\). Therefore, we CANNOT use the regression line to model a linear relationship between \(x\) and \(y\) in the population.
Three rules govern what you may do next:
- If \(r\) is significant and the scatter plot shows a linear trend, the line can be used to predict the value of \(y\) for values of \(x\) that are within the domain of observed \(x\) values.
- If \(r\) is not significant OR if the scatter plot does not show a linear trend, the line should not be used for prediction.
- If \(r\) is significant and the scatter plot shows a linear trend, the line may NOT be appropriate or reliable for prediction OUTSIDE the domain of observed \(x\) values in the data.
Read the third rule carefully — it survives even a significant result. Passing this test tells you the relationship is unlikely to be an accident of sampling. It says nothing about what happens beyond the x-values you actually observed, and it does not repeal the domain warning from Section 11.3. A significant \(r\) plus a linear scatter plot buys you predictions inside the data's range, and nothing more.
A study finds \(r\) significant at \(\alpha = 0.05\), and its scatter plot is clearly linear over x-values from 10 to 40. A colleague wants to use the line to predict \(y\) at \(x = 60\), arguing that the significance test justifies it. Explain what is wrong.
Solution — two separate questions
Step 1 — Say what the test established. The significance test concluded that \(\rho\) is significantly different from zero — the linear relationship seen in the sample is unlikely to be a chance artefact.
Step 2 — Say what it did not establish. It said nothing about the range over which the relationship holds. The test was computed from x-values between 10 and 40 and contains no information about \(x = 60\).
Step 3 — Cite the governing rule. Even when \(r\) is significant and the scatter plot shows a linear trend, the line may not be appropriate or reliable for prediction outside the domain of observed \(x\) values.
Step 4 — State the correct position. Predictions at \(x = 60\) are unjustified regardless of how small the p-value was.
Answer: The colleague is conflating two questions. Significance addresses whether the relationship is real, not how far it extends; the domain restriction applies unchanged.
11.4.6 Assumptions Behind the Test
Testing the significance of the correlation coefficient requires that certain assumptions about the data are satisfied. The premise of this test is that the data are a sample of observed points taken from a larger population. We are examining the sample to draw a conclusion about whether the linear relationship we see between \(x\) and \(y\) in the sample data provides strong enough evidence to conclude that there is a linear relationship between \(x\) and \(y\) in the population.
The regression line equation calculated from the sample data gives the best-fit line for our particular sample. We want to use this best-fit line for the sample as an estimate of the best-fit line for the population. Examining the scatterplot and testing the significance of the correlation coefficient helps us determine if it is appropriate to do this.
The assumptions underlying the test of significance are:
- The relationship between the variables being correlated should be linear. The data points should fall along an approximate straight-line pattern when plotted as \((x, y)\) data points on a scatter plot.
- The \(y\) values for any particular \(x\) value are normally distributed about the line. This implies that there are more \(y\) values scattered closer to the line than are scattered farther away. Assumption 1 implies that these normal distributions are centred on the line: the means of these normal distributions of \(y\) values lie on the line.
- The standard deviations of the population \(y\) values about the line are equal for each value of \(x\). In other words, each of these normal distributions of \(y\) values has the same shape and spread about the line.
- The residual errors are mutually independent (no pattern).
- The data are produced from a well-designed, random sample or randomized experiment.
The residuals plot in Section 11.3 is how both are checked. "Constant error variance" — residuals that do not fan out as \(x\) increases — is assumption 3. "No pattern" in the residuals plot is assumption 4. That is why the residuals plot is worth drawing every time rather than treated as an optional extra: it is the working check on two of the five assumptions this test depends on.
Problem Set 11.4
Problem 1. State the symbols for the population and sample correlation coefficients, and say which one is known.
Solution
Step 1 — Identify the population coefficient. The population correlation coefficient is denoted \(\rho\) (the Greek letter "rho"), and it is unknown because we almost never have data for the entire population.
Step 2 — Identify the sample coefficient. The sample correlation coefficient is \(r\), computed directly from the sample data, so it is known.
Step 3 — State the relationship between them. Because \(\rho\) is unknown, \(r\) serves as our estimate of it, and the hypothesis test uses \(r\) together with the sample size \(n\) to decide whether \(\rho\) is significantly different from zero.
Answer: \(\rho\) is the population correlation coefficient (unknown); \(r\) is the sample correlation coefficient (known), and \(r\) estimates \(\rho\).
Problem 2. Write \(H_{0}\) and \(H_{a}\) for a test of the significance of the correlation coefficient, in symbols and in words.
Solution
Step 1 — Write the hypotheses in symbols.
$$ H_{0}: \rho = 0 \qquad H_{a}: \rho eq 0 $$Step 2 — State \(H_{0}\) in words. The population correlation coefficient IS NOT significantly different from zero; there IS NOT a significant linear relationship (correlation) between \(x\) and \(y\) in the population.
Step 3 — State \(H_{a}\) in words. The population correlation coefficient IS significantly DIFFERENT FROM zero; there IS a significant linear relationship (correlation) between \(x\) and \(y\) in the population.
Step 4 — Note what the hypotheses concern. Both statements are about \(\rho\), the population parameter — not about \(r\), which is already known exactly from the sample.
Answer: \(H_{0}: \rho = 0\) (no significant linear relationship in the population); \(H_{a}: \rho eq 0\) (there is a significant linear relationship in the population).
Problem 3. Explain why two studies reporting the same \(r\) can differ in how convincing they are.
Solution
Step 1 — Recall what \(r\) measures. It reports the strength and direction of the linear association in the sample that was collected — nothing more.
Step 2 — Consider small samples. With few observations, chance alone can produce a fairly high correlation even when \(x\) and \(y\) are unrelated in the population; there are too few points to constrain the pattern.
Step 3 — Consider large samples. With many observations, accidental patterns tend to wash out, so the same value of \(r\) is far less likely to be a fluke.
Step 4 — Draw the conclusion. Two studies reporting identical values of \(r\) can differ greatly in how convincing they are, which is why the test always uses \(r\) and \(n\) together, never \(r\) alone.
Answer: The same \(r\) is more convincing from a larger sample, because a small sample can produce a high correlation by chance while a large one rarely can.
Problem 4. Give the formula for the test statistic \(t\) and state its degrees of freedom.
Solution
Step 1 — Write the formula for the test statistic.
$$ t = \frac{r\sqrt{n - 2}}{\sqrt{1 - r^{2}}} $$Step 2 — State the degrees of freedom. The test statistic follows a t-distribution with
$$ df = n - 2 $$degrees of freedom, where \(n\) is the number of observed data points.
Step 3 — Note two extra facts worth remembering. The statistic \(t\) has the same sign as \(r\), and the p-value is the combined area in both tails of the t-distribution (because \(H_a\) is two-sided).
Answer: \(t = \dfrac{r\sqrt{n-2}}{\sqrt{1-r^{2}}}\), with \(df = n - 2\).
Problem 5. A test gives a p-value of 0.018 at \(\alpha = 0.05\). State the decision and write the conclusion.
Solution
Step 1 — Compare the p-value with \(\alpha\). The p-value is 0.018 and the significance level is \(\alpha = 0.05\). Since \(0.018 < 0.05\), the p-value is less than \(\alpha\).
Step 2 — Make the decision. When the p-value < \(\alpha\), we reject the null hypothesis \(H_{0}: \rho = 0\).
Step 3 — Write the conclusion. There is sufficient evidence to conclude that there is a significant linear relationship between \(x\) and \(y\) because the correlation coefficient is significantly different from zero.
Step 4 — Note what this licenses. If the scatter plot also shows a linear trend, the regression line may be used to model the relationship and predict \(y\) within the domain of observed \(x\) values.
Answer: Reject \(H_{0}\): there is sufficient evidence that the correlation is significantly different from zero, so a significant linear relationship exists.
Problem 6. A test gives a p-value of 0.214 at \(\alpha = 0.05\). State the decision and say what it means for using the line.
Solution
Step 1 — Compare the p-value with \(\alpha\). The p-value is 0.214 and \(\alpha = 0.05\). Since \(0.214 > 0.05\), the p-value is NOT less than \(\alpha\).
Step 2 — Make the decision. Do NOT reject the null hypothesis \(H_{0}: \rho = 0\).
Step 3 — Interpret the result. There is insufficient evidence to conclude that there is a significant linear relationship between \(x\) and \(y\), because the correlation coefficient is not significantly different from zero.
Step 4 — Say what this means for the line. Since \(r\) is not significant, the regression line should NOT be used to model the relationship or to predict \(y\) values.
Answer: Do not reject \(H_{0}\); the correlation is not significant, so the regression line cannot be used for prediction.
Problem 7. \(r = 0.44\) with \(n = 22\) and a critical value of 0.423. Is \(r\) significant?
Solution
Step 1 — Find the degrees of freedom. \(df = n - 2 = 22 - 2 = 20\).
Step 2 — Set up the critical values. With critical value 0.423, the band is from \(-0.423\) to \(+0.423\).
Step 3 — Apply the rule. \(r\) is significant if it lies outside the band. Here \(r = 0.44 > 0.423\), so \(r\) falls outside the interval.
Step 4 — Conclude. \(r\) is significant, and the line may be used for prediction (assuming the scatter plot shows a linear trend).
Answer: Yes — since \(0.44 > 0.423\), \(r\) is significant.
Problem 8. \(r = -0.39\) with \(n = 16\) and a critical value of 0.497. Is \(r\) significant?
Solution
Step 1 — Find the degrees of freedom. \(df = n - 2 = 16 - 2 = 14\).
Step 2 — Set up the critical values. With critical value 0.497, the band runs from \(-0.497\) to \(+0.497\).
Step 3 — Apply the rule. \(r\) is significant only if it lies outside the band. Here \(-0.497 < -0.39 < 0.497\), so \(r\) lies between the critical values.
Step 4 — Conclude. \(r\) is not significant, and the line should not be used for prediction.
Answer: No — since \(-0.39\) lies between \(-0.497\) and \(0.497\), \(r\) is not significant.
Problem 9. Explain why \(r = 0\) can never be significant, at any sample size.
Solution
Step 1 — Recall how the critical values are positioned. For every degrees-of-freedom row in the table, the critical values come as a matched pair: a negative number and its positive counterpart, e.g. \(-c\) and \(+c\).
Step 2 — Locate zero relative to them. Any pair \(-c\) and \(+c\) straddles zero, so \(r = 0\) always lies strictly between the two critical values.
Step 3 — Apply the rule. The rule says \(r\) is significant only when it lies outside the pair. A value of exactly 0 can never satisfy that condition, no matter how large \(n\) is.
Step 4 — Interpret the result. This makes sense substantively as well: \(r = 0\) means the sample detected no linear association at all, and no amount of extra data turns "no association" into evidence of one.
Answer: \(r = 0\) always falls between the negative and positive critical values, so it can never be significant at any sample size.
Problem 10. A correlation is significant and the scatter plot is linear over x from 5 to 25. Explain whether the line may be used to predict \(y\) at \(x = 30\).
Solution
Step 1 — Recall what significance establishes. The test shows the linear relationship is unlikely to be a chance artefact of sampling — but it says nothing about the range of \(x\) over which the relationship holds.
Step 2 — Compare the target x-value with the observed domain. The data cover \(x\) from 5 to 25, and \(x = 30\) lies outside that range.
Step 3 — Cite the governing rule. Even when \(r\) is significant and the scatter plot shows a linear trend, the line may NOT be appropriate or reliable for prediction OUTSIDE the domain of observed \(x\) values.
Step 4 — Conclude. Predicting \(y\) at \(x = 30\) would be extrapolation and is not justified by the significance test.
Answer: No — although the correlation is significant, \(x = 30\) lies outside the observed domain (5 to 25), so the line may not reliably be used to predict at that point.
Problem 11. List the five assumptions underlying the test of significance.
Solution
Step 1 — Assumption 1: linearity. The relationship between the variables being correlated should be linear; the data points should fall along an approximate straight-line pattern on the scatter plot.
Step 2 — Assumption 2: normality of y about the line. The \(y\) values for any particular \(x\) are normally distributed about the line, with more \(y\) values close to the line than far away; these normal distributions are centred on the line.
Step 3 — Assumption 3: equal standard deviations. The standard deviations of the population \(y\) values about the line are equal for each value of \(x\) — every normal distribution has the same shape and spread about the line.
Step 4 — Assumption 4: independent residuals. The residual errors are mutually independent, showing no pattern.
Step 5 — Assumption 5: random data collection. The data come from a well-designed, random sample or randomized experiment.
Answer: (1) linearity; (2) y-values normally distributed about the line; (3) equal standard deviations of y about the line for all x; (4) mutually independent residual errors; (5) data from a well-designed random sample or randomized experiment.
Problem 12. Name the two assumptions that a residuals plot checks, and say how each one shows up in the plot.
Solution
Step 1 — Name assumption 3 and its check. The residuals plot checks the assumption of equal standard deviations of the \(y\) values about the line (constant error variance). In the plot, this assumption holds when the vertical spread of the residuals stays roughly constant across all values of \(x\); it fails when the residuals fan out (spread widens or narrows) as \(x\) increases.
Step 2 — Name assumption 4 and its check. The residuals plot also checks the assumption that residual errors are mutually independent. This shows up as a plot with no discernible pattern — the points should look randomly scattered above and below zero. A visible pattern (curves, waves, trends) signals dependence and a violated assumption.
Step 3 — Note why this matters. These two assumptions underpin the validity of the significance test, which is why drawing the residuals plot should be routine rather than optional.
Answer: A residuals plot checks assumption 3 (equal spread of y about the line — shown by constant vertical scatter across x) and assumption 4 (independent residuals — shown by no pattern in the plot).
Key Terms
population correlation coefficient (\(\rho\)) — the unknown correlation in the whole population; the parameter this test is about.
sample correlation coefficient (\(r\)) — the correlation computed from the sample; known exactly, and used as the estimate of \(\rho\).
significant correlation coefficient — one significantly different from zero; the regression line may then be used to model the relationship in the population.
not significant — close enough to zero that the evidence is insufficient; the regression line CANNOT be used to model a population relationship.
test statistic — \(t = \frac{r\sqrt{n-2}}{\sqrt{1-r^{2}}}\), evaluated against a t-distribution with \(n - 2\) degrees of freedom, with the same sign as \(r\).
critical-value rule — \(r\) is significant when it lies outside the two critical values for \(df = n - 2\), and not significant when it lies between them.
domain restriction — the rule that survives even a significant result: the line may not be reliable for prediction outside the observed range of \(x\).