Sampling and Survey Methods on the Digital SAT

Quick Answer: Sampling and survey methods on the Digital SAT test your ability to determine if a sample is representative of a population and how to interpret margins of error. Always check if the sample was selected at random; if it wasn't, the results cannot be generalized to the entire population.

graph TD
    A[Read Survey Description] --> B{Is the sample random?}
    B -->|No| C[Results only apply to the sampled group]
    B -->|Yes| D{What is the target population?}
    D --> E[Results generalize ONLY to that specific population]
    E --> F["Apply Margin of Error: Estimate ± Margin"]

What Is Sampling and Survey Methods?

On the Digital SAT, Sampling and Survey Methods questions evaluate your understanding of how data is collected and what conclusions can logically be drawn from that data. The College Board heavily emphasizes data literacy in the Problem-Solving & Data Analysis domain. You are not expected to calculate complex standard deviations from scratch, but you must understand the concepts of random sampling, target populations, and margin of error.

A core concept to master is that you can only make generalizations about a population if the sample was chosen at random from that exact population. If a researcher wants to know the favorite food of all students in a high school but only surveys students in the cafeteria during first lunch, the sample is biased. The results only represent students who eat during first lunch.

Additionally, these questions often ask you to scale up results. Just as you might use /sat/math/proportions-cross-multiplication to predict outcomes based on a ratio, you can use sample percentages to estimate population totals, provided you account for the margin of error.

Step-by-Step Method

1. Step 1: Identify the sample — Determine exactly who or what was surveyed or tested in the problem.
2. Step 2: Check for randomness — Look for the word "random." If the sample wasn't randomly selected, you cannot generalize the results.
3. Step 3: Identify the target population — Determine the broader group the sample was pulled from. The conclusions can only apply to this specific group.
4. Step 4: Apply the margin of error — If the question provides a mean or percentage and a margin of error, calculate the plausible range by subtracting and adding the margin of error to the estimate.
5. Step 5: Eliminate extreme answers — Rule out answer choices that use absolute words like "all," "none," or "exactly," as statistical surveys only provide estimates, not guarantees.

Desmos Shortcut

While survey logic questions are highly conceptual, you can use the Desmos Calculator to quickly handle the arithmetic for margin of error bounds or population scaling. If a survey finds that $43\%$ of a $5,000$-person town supports a new law with a $4\%$ margin of error, you can quickly type 0.39 * 5000 and 0.47 * 5000 into Desmos to find the exact minimum and maximum number of supporters without risking mental math errors.

Worked Example

Question: A researcher wants to know the average number of hours students at a large university spend studying per week. She randomly selects 200 students from the university's engineering department. The mean study time is 18 hours, with a margin of error of 1.5 hours. Which of the following is the most appropriate conclusion?

A) The true mean study time for all students at the university is between 16.5 and 19.5 hours. B) The true mean study time for all engineering students at the university is between 16.5 and 19.5 hours. C) All engineering students at the university study exactly 18 hours per week. D) The margin of error would increase if the researcher surveyed 500 engineering students.

Solution:

Let's break down the survey using our steps:

• Sample: 200 engineering students.
• Randomness: Yes, they were randomly selected.
• Population: Because they were only selected from the engineering department, the results only apply to engineering students, not all students at the university. This eliminates A.
• Margin of Error: The plausible range for the true mean is the sample mean plus or minus the margin of error:

$18 - 1.5 = 16.5$

$18 + 1.5 = 19.5$

Statistical estimates give us a range of plausible values, not an exact guarantee for every individual. This eliminates C. Furthermore, increasing the sample size (from 200 to 500) gives us more data, which decreases the margin of error, making D incorrect.

Therefore, the most appropriate conclusion is that the true mean for all engineering students is likely between 16.5 and 19.5 hours.

The correct answer is B.

Common Traps

1. Misinterpreting Margin of Error — Based on Lumist student data, 15% of errors on Problem-Solving & Data Analysis questions involve misinterpreting "margin of error" as the total range. If the mean is 50 and the margin of error is 5, the range is 45 to 55 (a total spread of 10), not a total spread of 5.

2. Overgeneralizing the Population — Students frequently apply survey results to a broader group than the sample represents. If you survey randomly selected dog owners, you can only make conclusions about dog owners, not all pet owners. Always match the conclusion perfectly to the group that was sampled.

3. Ignoring Sample Size Effects — Another common mistake is forgetting the relationship between sample size and margin of error. Remember: more data equals less uncertainty. A larger random sample will always result in a smaller margin of error, assuming the confidence level remains the same. Similar to how understanding /sat/math/direct-and-inverse-variation helps you track relationships, remember that sample size and margin of error have an inverse relationship.