Skip to main content

We should not draw conclusions from statistically insignificant results and people don’t have an intuitive understanding of statistical significance, so we need to rely on objective numbers such as the p-value, to guide our decisions. I’m personally always surprised by how many users need to join an experiment, for the results to become statistically significant.

The p-value can be computed from the numbers displayed on the experiment page, but since everyone should do it, it would be better to include it by default for everyone.

Firebase does this in its experiment module:

 

 

Hi! Thank you for sharing this feedback! I have passed your message along internally to the appropriate team. We don’t have a current ETA for adding something like this yet, but the team will take a look at prioritizing the addition of it. 


Thank you, looking forward to it!