Why Is Post Hoc Analysis Bad
When Conclusions Are Made from Post-Hoc Analyses, There Is an Inherent Bias, as We Are Able to Test the Data in Any Way That Produces a Favorable Result. in...
When conclusions are made from post-hoc analyses, there is an inherent bias, as we are able to test the data in any way that produces a favorable result. In many cases, this leads to data dredging or in the worst cases, p-hacking.
Is post hoc bad?
In our opinion, post-hoc analysis is inherently risky and spurious and should be viewed with extreme caution. History is replete with examples of bad post hoc analyses. Two examples in today’s market come from Oncothyreon (ONTY) and Celsion (NASDAQ:CLSN).
Should you do a post hoc power analysis?
Post hoc power is the retrospective power of an observed effect based on the sample size and parameter estimates derived from a given data set. Many scientists recommend using post hoc power as a follow-up analysis, especially if a finding is nonsignificant.