Statistical Questioning and Bias
Lesson: Statistical Questioning and Bias
In statistics, we often use data to learn about a group of people, objects, or events. But before we collect data, we need to ask a good question and choose a fair way to gather information.
This lesson will help you understand statistical questions, variability, sampling, and bias. These ideas are important because bad questions or unfair samples can lead to misleading results.
1. What is a statistical question?
A statistical question is a question that expects different answers from different people or situations. In other words, it allows for variability.
Variability means that the data values are not all the same. They can vary, or change, from one person or item to another.
For example, the question "How many minutes do 7th graders spend on homework each night?" is a statistical question. Different students will give different answers, so the data will vary.
The question "How many days are in a week?" is not a statistical question. There is only one correct answer: 7. There is no variability.
Ask yourself: Does this question expect many possible answers, or just one fixed answer?
- Statistical question: "How tall are the students in our class?"
- Not statistical: "How tall is the door?"
- Statistical question: "How many books do students read in a month?"
- Not statistical: "What is the title of our math book?"
2. Why does variability matter?
Statistics is about studying data that changes. If every answer were exactly the same, there would not be much to analyze.
When we ask a statistical question, we expect the answers to spread out. Some answers may be small, some large, and many may be somewhere in the middle.
For example, if you ask, "How many pets do students in our grade have?", some students may have 0 pets, some may have 1 or 2, and a few may have more. That spread in answers is variability.
3. Population and sample
In statistics, the population is the whole group you want to learn about.
A sample is a smaller group taken from the population.
For example, if you want to know how students in your school feel about school lunch:
- The population is all students in the school.
- The sample might be 50 students who are asked to answer a survey.
We usually study a sample because asking every person in a population can take too much time.
4. What makes a sample representative?
A sample is representative if it fairly reflects the population. That means the sample should include different types of people or items from the whole group, not just one small part of it.
For example, if a school has students from grades 6, 7, and 8, a representative sample about school lunch should include students from all three grades, not only 8th graders.
If the sample is not representative, the results may not match the population very well.
5. Sampling methods
Different ways of choosing a sample can affect how fair the results are.
Good sampling method: random sampling
In a random sample, each member of the population has a fair chance of being chosen.
Examples of random sampling:
- Putting all student names in a container and drawing some names
- Using a random number generator to choose survey participants
Random sampling helps reduce unfairness and gives a better chance of getting a representative sample.
Less fair sampling methods
- Convenience sample: choosing people who are easiest to reach
- Voluntary response sample: only people who choose to respond are counted
These methods can lead to bias because they may leave out important parts of the population.
6. What is bias?
Bias is anything in a study that makes the results unfairly favor one outcome over another.
Bias can happen in different ways, but in 7th Grade statistics, two important kinds are:
- Sampling bias
- Question wording bias
7. Sampling bias
Sampling bias happens when the sample does not fairly represent the population.
Example: A student wants to know whether students at school like reading. She surveys only students in the library.
This sample is biased because students in the library may like reading more than other students. The sample does not represent the whole school fairly.
Another example: A survey asks students whether they play sports, but it is given only to students at basketball practice. That sample is likely to overestimate how many students play sports.
8. Question wording bias
Question wording bias happens when the way a question is asked pushes people toward a certain answer.
For example, look at this question:
"Don't you agree that our school should have a longer lunch period?"
This question is biased because it suggests that agreeing is the expected answer.
A better version would be:
"Do you think the lunch period should be longer, shorter, or stay the same?"
This version is more neutral. It does not pressure people to answer in one direction.
9. How to write a good statistical question
A good statistical question should:
- Ask about a group, not just one person or one object
- Expect different answers
- Be clear and neutral
- Match the population you want to study
Here is a simple checklist:
- Does the question involve data from many people or items?
- Will the answers vary?
- Is the wording fair?
- Is the sample chosen in a fair way?
Worked Example 1: Is it a statistical question?
Question: "What time do students in our class go to bed on school nights?"
Step 1: Does it ask about a group? Yes, it asks about students in the class.
Step 2: Will the answers vary? Yes. Different students go to bed at different times.
Conclusion: This is a statistical question.
Now compare it to: "What time does our school start?"
There is one set answer, so it is not a statistical question.
Worked Example 2: Identify sampling bias
A student wants to know how many hours 7th graders spend on video games each week. He surveys 20 students in the gaming club.
Step 1: What is the population? All 7th graders.
Step 2: Who is in the sample? Only students in the gaming club.
Step 3: Is the sample representative? Probably not. Students in the gaming club may play more video games than other 7th graders.
Conclusion: The study has sampling bias.
A better method would be to randomly choose 20 students from all 7th graders.
Worked Example 3: Improve a biased question
Original question: "Why is the new school rule unfair?"
This question is biased because it assumes the rule is unfair.
A better question would be:
"What do you think about the new school rule?"
Or, if you want choices:
"Do you think the new school rule is fair, unfair, or are you unsure?"
These revised questions are more neutral.
Worked Example 4: Choose the better study
A school wants to know whether students want more after-school clubs.
Study A: Survey students who are already staying after school for clubs.
Study B: Randomly survey students from different grades during lunch.
Step 1: Which sample is more representative of the whole school?
Answer: Study B.
Step 2: Why?
Study A is biased because students already in clubs may be more likely to want more clubs. Study B includes a wider range of students and uses a more fair method.
10. Watch out for common mistakes
- Thinking every question about data is statistical. It must expect variability.
- Surveying only friends or nearby people and assuming the sample is fair.
- Using questions that sound like they want a certain answer.
- Forgetting to match the sample to the population.
11. Quick comparison table
- Statistical question: expects different answers
- Non-statistical question: expects one definite answer
- Representative sample: fairly reflects the population
- Biased sample: unfairly leaves out or overuses part of the population
- Neutral wording: does not push toward one answer
- Biased wording: suggests how someone should answer
12. How this connects to real data
Once data is collected, students often find measures like the mean, median, or range, or make graphs such as dot plots and box plots. But these summaries are only useful if the data came from a good statistical question and a fair sample.
If the question is biased or the sample is unfair, then even careful calculations may lead to poor conclusions.
Summary
A statistical question is a question that expects varied answers. To answer it fairly, you need a representative sample, which often comes from random sampling.
Bias can happen when the sample is unfair or when the question is worded in a way that pushes people toward a certain answer. Good statistical studies use clear, neutral questions and fair sampling methods.
When you look at a survey or design your own, always ask: Does the question allow for variability? Is the sample representative? Is the wording unbiased?
Put what you read to the test
You've worked through Statistical Questioning and Bias. Try answering a few questions to see what stuck — and what might deserve a quick reread before you move on.