File:Multiple binomial testing.svg

Original file(SVG file, nominally 890 × 890 pixels, file size: 340 KB)

Summary

Description
English: Non language-specific illustration of the small p-values that can appear when performing multiple hypothesis testing.

30 samples of 10 dots of random color (blue or red) are observed. On each sample, a two-tailed binomial test of the null hypothesis that blue and red are equally probable is performed. The possible p-values for this test are shown on the first row as a function of the number of blue and red dots in the sample.

Although the 30 samples were all simulated under the null, one of the resulting p-values is very small (p = 0.0215) which would produce a false rejection (an incorrect conclusion that red is more probable than blue) at the typical level 0.05 in the absence of correction.

This is a similar story to xkcd comic "Significant".
Date
Source Own work
Author GrandEscogriffe

Licensing

I, the copyright holder of this work, hereby publish it under the following license:
w:en:Creative Commons
attribution share alike
This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
You are free:
  • to share – to copy, distribute and transmit the work
  • to remix – to adapt the work
Under the following conditions:
  • attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  • share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.

Captions

Add a one-line explanation of what this file represents

30 September 2023

image/svg+xml

File history

Click on a date/time to view the file as it appeared at that time.

Date/TimeThumbnailDimensionsUserComment
current14:47, 29 March 2024Thumbnail for version as of 14:47, 29 March 2024890 × 890 (340 KB)GrandEscogriffeUploaded own work with UploadWizard
The following pages on the English Wikipedia use this file (pages on other projects are not listed):

Global file usage

The following other wikis use this file:

Metadata