Skip to content

Commit

Permalink
Merge pull request #69 from egap/multiple-comparisons
Browse files Browse the repository at this point in the history
adding link to PAP guide
  • Loading branch information
jwbowers authored Aug 14, 2024
2 parents 52ad6c2 + 1fa40f6 commit 16974d7
Show file tree
Hide file tree
Showing 2 changed files with 75 additions and 57 deletions.
2 changes: 1 addition & 1 deletion multiple-comparisons/multiple-comparisons.Rmd
Original file line number Diff line number Diff line change
Expand Up @@ -455,7 +455,7 @@ knitr::kable(table, digits = 3)
10: Use Design Based approaches
==

There are also two design based approaches for thinking about this problem. One is to use pre-analysis plans to describe in advance which comparisons will be made; the number of tests implicated in a Bonferroni or Bonferroni-style correction is specified before any data analysis is conducted. A pre-analysis plan, among its many benefits, helps to clarify the multiple comparisons problem.
There are also two design based approaches for thinking about this problem. One is to use pre-analysis plans to describe in advance which comparisons will be made; the number of tests implicated in a Bonferroni or Bonferroni-style correction is specified before any data analysis is conducted. A pre-analysis plan, among its many benefits, helps to clarify the multiple comparisons problem. (See our guide [10 Things to Know About Pre-Analysis Plans](https://egap.org/resource/10-things-to-know-about-pre-analysis-plans/) for general information on pre-analysis plans.)

A good example is this pre-analysis plan by [Gwyneth McClendon and Rachel Beatty Riedl](https://egap.org/registration/651). The authors specify 24 individual tests they plan to conduct and state ahead of time that they will employ both the Bonferroni and Benjamini-Hochberg corrections. The authors do not state beforehand how they will handle a situation in which the corrections disagree; presumably it will be a matter of judgment for both the authors and the readers of their study.

Expand Down
Loading

0 comments on commit 16974d7

Please sign in to comment.