Hi all,
I'm new to statistic & really need your help here.
My question is: Is that ok or not OK if I do equivalence test several times to find the equivalent limit that has 2 p-values < 5%.
I have 2 groups data like below & I want to test if they are equal or different.
![Justin_Bui_0-1667441965228.png Justin_Bui_0-1667441965228.png](https://community.jmp.com/t5/image/serverpage/image-id/46843i2BBC540FEFD7D81E/image-size/medium?v=v2&px=400)
1st step I did a t-test & Pvalue> 5% mean I failed to reject H0 (Test= ref). Not really help much to define my next actions.
So I do an equivalence test with the equivalent limit of +/-0.1 as a practical range
But again the result is not really good. I just can conclude that my Test group is higher then REF 0.1 unit or lower.
Still not a useful enough result for next actions
![Justin_Bui_1-1667442200244.png Justin_Bui_1-1667442200244.png](https://community.jmp.com/t5/image/serverpage/image-id/46844iE49BA0559364E908/image-size/medium?v=v2&px=400)
So I increase several time until reach the equivalent limit 0.16 unit & have 2 P-value <5%
Which I can interpret result as 2 group is equal in 0.16 unit range.
Meaning that My TEST group can higher/ lower than REF +/- 0.16 unit. (or could be equal too)
![Justin_Bui_0-1667443880792.png Justin_Bui_0-1667443880792.png](https://community.jmp.com/t5/image/serverpage/image-id/46845iEFC14E6957B26CC1/image-size/medium?v=v2&px=400)
So I can estimate the best case if this 0.16 unit higher or lower the current is OK for my next action.
Is my conclusion correct? & Is that possible for me to do that? or Am I P-hacking?
Just a newbie in statistic need your help.
Thanks all