Multiple testing

What Multiple testing is

Multiple testing, also known as multiple hypothesis testing or multiple comparisons, is the process of performing multiple statistical tests on a single dataset in order to draw conclusions about the data. This is generally done when there is a large number of hypotheses to be tested and the data is complex.

The steps for multiple testing are as follows:

  1. Define the research question or hypothesis
  2. Identify the variables to be studied
  3. Determine the number of tests to be performed
  4. Select the appropriate statistical test(s)
  5. Calculate the individual test statistics
  6. Adjust the individual test statistics for multiple comparisons
  7. Interpret the results of the multiple tests

Examples

  1. Multiple testing is a statistical technique used to analyze data from multiple experiments to determine which results are significant. It is commonly used in drug research to determine which drugs produce the desired effects.

  2. Multiple testing is also used in marketing research to identify which variables have the most influence on consumer purchasing decisions.

  3. Multiple testing is often used in medical research to identify which treatments are the most effective for a particular condition.

  4. In genetics, multiple testing is used to identify which genes are associated with a particular trait.