P-value
What is it for?
A p-value is the “probability that a difference in means at least as large as the one observed can be
generated from random samples if the [independent variable/condition] does not affect the mean
[dependent variable/measurable factor]” (Nature Methods, 2017).
The standard threshold is 0.05.
If p ≥ 0.05 it can be concluded that the two means are NOT statistically significantly different. The
results could have / likely occurred by chance alone.
If p < 0.05 it can be concluded that the two means ARE statistically significantly different. The results
are unlikely to have occurred by chance alone.
The size of the p-value relative to the threshold of 0.05 can be given as a reason for drawing a
conclusion regarding a p-value and thereby the effect of an independent variable / condition on the
dependent variable / measurable factor.
The conclusion can be used to make a statement about the effect of one condition relative to another
(or a control condition).
Sometimes p-values can also be used to compare the strength of an effect – a smaller p-value typically
indicates are more significant difference and therefore a stronger effect.
A t-test requires all of the raw data from two
conditions so that the test can calculate the means
and compare the spread of the data to determine
statistically whether the means are likely to be as
different as they are due to chance or a real effect.
Interpretation of the p-value – What to say in the data analysis
An appropriate way to interpret a p-value:
The p-value of 0.002 indicates that there is a statistically significant difference between the means as the
value is less than the threshold of 0.05. The average time taken for acid to fully diffuse into an 8cm3 cube
of agar is significantly longer than the average time taken for acid to fully diffuse into a 1cm3 cube of
agar.
An inappropriate way to talk about a p-value:
“The p-value of 0.001 indicates that the data is significant.” This fails to differentiate between the two
conditions and recognise that the means are being compared and is therefore a meaningless statement.
Referring to the ‘null-hypothesis’ and rejecting it is a very relevant in Psychology and not often used in Biology. Don’t do it.
Sources:
Altman, N. and Krzywinski (2017) Interpreting p-values. Nature Methods. https://www.nature.com/articles/nmeth.4210