When conducting multiple comparisons, such as in your SPM analysis, it is common to adjust the alpha level to account for the increased probability of obtaining false positives. One common adjustment method is the Bonferroni correction, which divides the desired alpha level by the number of comparisons being made. In your case, you mentioned setting the alpha value to 0.0083, presumably after applying the Bonferroni correction. However, it's important to note that statistical significance is not an all-or-nothing concept. Just because a p-value is slightly above the adjusted alpha level doesn't automatically make the result insignificant. The choice of alpha is somewhat arbitrary and depends on the specific study and field of research. In your example, you mentioned observing p-values of 0.010 and 0.014, which are slightly higher than your adjusted alpha of 0.0083. While these values do not meet the strict criterion for statistical significance based on your chosen alpha, they still suggest a relatively small probability of observing such results by chance alone. Therefore, it's worth considering these findings as potentially meaningful or deserving of further investigation.
Additionally, it's important to interpret statistical significance in the context of effect size, sample size, and the specific research question. A small effect size or a small sample size can make it more challenging to achieve statistical significance, even if the observed results are practically important. So, while statistical significance is typically determined using an alpha level, it's important to consider the specific context, effect size, and other factors when interpreting the results. Statistical significance should not be the sole criterion for determining the importance or relevance of findings in a study.
However, I think we need to know more details to answer this situation.
Announcement
Collapse
No announcement yet.
Question about SPM result... am I missing something?
Collapse
X
-
Question about SPM result... am I missing something?
SPM results.png
I am confused about this (and other similar) result from an SPM analysis I am running. I set the alpha value to 0.0083 to account for multiple comparisons, but I see two points at 77% and 96% of the stride being marked as exceeding the threshold with p=0.010 and p=0.014... shouldn't the values exceed the threshold (be statistically significant) only if p < alpha? What am I missing?
I am using spm1d downloaded from http://www.spm1d.org/ and running it on Matlab.
Happy to provide the code or any other info if it helps!
Thank you.
Tags: None
Leave a comment: