how to check for Common Method Bias

[#1]

Please let me know step by step method to perform Common Method Bias in JMP Pro 18

[#2]

I'm not previously familiar with common method bias, but some quick reading about it shows that there are multiple techniques for assessing it. The simplest appears to be Harman's single factor "test" (not actually a null hypothesis test), which is just exploratory factor analysis in which you determine if a single factor can account for more than 50% of the variance in your observed variables.

You can do Harman's test easily with Analyze > Multivariate Methods > Factor Analysis. See the documentation for the Factor Analysis platform for general instructions. Specifically for this analysis, you'll want to set the number of factors extracted to 1, then run the model and look at the Variance Explained by Each Factor section. If the Percent value is greater than 50, then according to this method, you have evidence of common method bias. 

However, my quick reading suggests that many researchers consider Harman's method to be inferior to methods based on confirmatory factor analysis, which is available in JMP Pro 18's Structural Equation Modeling platform if you want to go that route instead. This example in the documentation demonstrates how to set up a CFA model in the SEM platform.

[#3]

Dear Ross,

I did get this very option as suggested by you. However, there is a method of finding the VIF (Variance Inflation Factor), which in SEM is not available. To find VIF, you right click on the parameter estimates, go to Columns, column selection & you should be having the VIF option there. However, in my JMP Pro 18 version the same is not available. I just wanted to know whether this option is unavailable because it is a free academic version? Have a look at what I am saying. 

[#4]

This isn't a limitation of the academic version (JMP Student Edition). Fit Model can report VIFs in the Parameter Estimates table using the right click menu, but the same option is not present in the SEM platform.

[#5]

Dear Ross,

Please refer to the attached image, obtained from Google Search. It clearly specifies that when we right click on parameter estimates, & select column - column estimates, the option of VIF is available. Either the Google information is incorrect or I am making a mistake. Do note that my requirement of identifying (& rectifying) the common method bias is more than adequately addressed. I have used the Harman's single factor approach for the same.

If you please consider the above & let me know whether in some version the VIF option is available. I had in fact seen a video where the VIF option while doing CFA in SEM was clearly seen. When I went to perform the same in JMP Pro 18, that option was not available.

[#6]

Hi Ross,

When I tried the single factor EFA, the explained variance is around 55%, which is more than the threshold 50% indicating Common Method Bais. However, when I performed SEM, I got RMSEA 0.092, which being higher than 0.08 indicated SEM is not working. Is there some way that CMB can be reduced?

[#7]

@Pradeep_Pai, assessing and remediating CMB in SEM is outside my area of expertise. I'm tagging @LauraCS to see if she has any thoughts.

[#8]

Hello @Pradeep_Pai 

As Ross mentioned, there are some alternatives for checking for common method bias. In SEM, you can specify your common factors (latent variables) and then also specify a source of common method bias as another latent variable. The path diagram below is an example of how that would be properly specified:

Here, the scale of the latent variables is set by fixing their variance to 1. In the case of the method latent variable, we also set equality constraints across all its loadings. In this example, we're assuming there's common method across all the observed variables--if you only expect this to happen across a subset of variables, then the loadings can be restricted to just the hypothesized subset. Please see the link that Ross shared for a step-by-step example for how to specify the latent variables.

After estimation, you can square the value of the method loadings to obtain an estimate of common method variance in each observed variable. Relatedly, if the loadings are statistically significant, then you have evidence for common method variance that's not ignorable.

HTH,

~Laura

[#9]

Dear M/s Laura,

Thanks for your reply. As mentioned early in my post, I did perform Common Method Bias test & could bring the value below 50%.

In case you wish to know how the CMB can be reduced, please let me know. The only option (mostly) for researchers to collect primary data is survey questionnaire. If the steps, i have identified can be applied then the possibility of CMB is much reduced. All my PhD scholars have to follow these instructions.

Best,

[#10]

Glad you found Harman's test useful! And would love to learn more about the approach you use to handle CMB. I bet others reading this discussion could benefit from it too. I usually try to identify multiple methods of measurement (in surveys, maybe multiple reporters) to deal with this issue. However, that's not always possible.

Best,

~Laura