Q1. A study examined a new study routine where 6 subjects improved their test scores by an average of 1.2 points out of 100. Statistical testing indicates that if the routine had no effect, there is a 45% chance of getting these results by random chance. Which statement correctly evaluates statistical significance?

Background

Topic: Statistical Significance

This question tests your understanding of what it means for a result to be statistically significant, specifically in terms of interpreting p-values and the likelihood of results occurring by chance.

Key Terms and Concepts:

• Statistical Significance: Achieved when the probability (p-value) of obtaining the observed result by random chance is very small (typically ≤ 0.05).

• p-value: The probability of observing results as extreme as those measured, assuming the null hypothesis is true.

Step-by-Step Guidance

1. Identify the reported probability (p-value) for the observed improvement: 45% (or 0.45).

2. Recall the standard threshold for statistical significance: (5%).

3. Compare the reported p-value to the threshold: Is 0.45 less than or equal to 0.05?

4. Think about what it means if the p-value is much larger than 0.05 in terms of likelihood of results occurring by chance.

Try solving on your own before revealing the answer!

Q2. Which of the following represents a voluntary response sample?

Background

Topic: Sampling Methods – Voluntary Response

This question tests your ability to identify voluntary response samples and understand why they are problematic in statistics.

Key Terms:

• Voluntary Response Sample: A sample in which participants self-select to participate, often leading to bias.

• Selection Bias: When the sample is not representative of the population due to the way participants are chosen.

Step-by-Step Guidance

1. Review each answer choice and determine how the sample is selected.

2. Look for the option where individuals choose themselves to participate (e.g., online polls, call-in surveys).

3. Recall that voluntary response samples are not random and are subject to bias.

Try solving on your own before revealing the answer!

Q3. An advertisement for a household cleaner claims that it "reduces kitchen bacteria by 150%." Why is this statement mathematically flawed?

Background

Topic: Misleading Percentages

This question tests your understanding of how percentages work, especially in the context of reductions and why certain claims are mathematically impossible.

Key Terms and Concepts:

• Percentage Reduction: The percent decrease from an original value.

• Logical Limits: You cannot reduce a quantity by more than 100% of its original value.

Step-by-Step Guidance

1. Recall that a 100% reduction means the quantity is reduced to zero.

2. Consider what a reduction greater than 100% would imply (e.g., negative bacteria).

3. Evaluate which answer choice correctly identifies the mathematical flaw in the claim.

Try solving on your own before revealing the answer!

Q4. A statistical study evaluated a medication and found that the likelihood of observing the improvement by chance was 0.002 (0.2%). What does this indicate?

Background

Topic: Statistical Significance and p-values

This question tests your ability to interpret p-values and determine whether a result is statistically significant.

Key Terms and Concepts:

• p-value: Probability of obtaining results as extreme as those observed, assuming the null hypothesis is true.

• Statistical Significance Threshold: Typically (5%).

Step-by-Step Guidance

1. Identify the reported p-value: 0.002 (0.2%).

2. Recall the standard threshold for statistical significance: .

3. Compare the p-value to the threshold to determine if the result is statistically significant.

4. Consider what a very small p-value means in terms of the likelihood of the result occurring by chance.

Try solving on your own before revealing the answer!

Q5. In a clinical trial of a daily supplement, 10,000 participants were evaluated over 5 years. Participants taking the supplement lost an average of 0.4 pounds compared to the control group. Statistical tests yielded a p-value of 0.001 (0.1% chance by random fluctuation). How should these findings be interpreted regarding statistical and practical significance?

Background

Topic: Statistical vs. Practical Significance

This question tests your ability to distinguish between statistical significance (p-value) and practical significance (real-world importance of the effect size).

Key Terms and Concepts:

• Statistical Significance: Determined by p-value (here, 0.001).

• Practical Significance: Whether the observed effect is large enough to matter in real-world terms (here, 0.4 lbs over 5 years).

Step-by-Step Guidance

1. Evaluate the p-value (0.001) in relation to the statistical significance threshold (0.05).

2. Assess the magnitude of the effect (0.4 lbs lost over 5 years) for practical importance.

3. Determine if the result is statistically significant, practically significant, both, or neither.

4. Consider whether a small effect size can be statistically significant in a large sample.

Try solving on your own before revealing the answer!