Dear @Byron_JMP, thanks for asking
Sidak correction gets me nothing. yet, when requested by an anonymous reviewer in an academic peer reviewed journal I had no other choice....
I think that fundamentally, this is a case I come across occasionally where similar (or even identical) statistical tools are used commonly in different disciplines or just named differently. Such as VIF Vs. tolerance, constant Vs. intercept, Beta Vs. standardized coefficients and so on.
on the other hand, while we are on the topic, could you please let me know if there is any other way adjusting for Bonferroni apart from "manually" setting the alfa level in the fit model platform and then running a student's t test?
The issue is that with a few factors, each with a different number of categories, I need to run the model several times, each time with a different specified alfa. wouldn't it be better for the alfa setting to be per factor rather than for the whole model?
What i currently do is run the model with the post hoc test i want, save the script and then tweek the script to have different alfas for each factor.
Another point for anyone using this method - when setting a different alfa level than 0.05 pay attention that the connecting letters report is adjusted while the default formatting of pvalues (colors and stars) in the ordered difference or the detailed report is not adjusted!
Anyone willing to share his experience on the topic is welcome.