topic Re: How to analyze unbalanced data which three of independent factors are unbalanced levels? in Discussions

How to analyze unbalanced data which three of independent factors are unbalanced levels?

Shad — Fri, 18 Jan 2019 17:13:12 GMT

Hello,

I have a data set which has four predictors: three of the predictors including time, distance, and power are unbalanced and one balance predictor. Do you have any idea what is the best way to analyze such data? And how I can analyze them? I do appreciate any help.

Re: How to analyze unbalanced data which three of independent factors are unbalanced levels?

Peter_Bartell — Fri, 18 Jan 2019 18:01:54 GMT

Every analysis 'how to' question should start with an articulation of the practical problem you are trying to answer. You haven't shared that with the Community. Please do.

Then a thorough evaluation of the means by which the data was collected. A designed experiment? Happenstance data? Historical data in time series? And what do you know about the measurement system and it's variability?

Are there are any issues associated with that process which make subsequent analysis problematic. Missingness, outliers, nonsense values. What about correlation of predictor variables? Then embark on analysis...at the highest level I have three thoughts for you:

1. Plot the data.

2. Plot The Data.

3. PLOT THE DATA...and this is where JMP shines.

Re: How to analyze unbalanced data which three of independent factors are unbalanced levels?

Shad — Fri, 18 Jan 2019 18:17:29 GMT

Hi Peter,

Thanks for your prompt response. Here is the problem articulation:

The experiment is a designed experiment. The objectives of this study were to determine the suitable combinations of IR heating duration, Gap distance, and intensity, followed by tempering treatments to maximize inactivation mold spores. I did plot the data and since it is not a balanced design there are some missing values. When I did the full factorial analysis the effect summary is not showing any values.

I was reading the same issue stated from other people: I found that I need to analyze using mixed model but I am not sure which variables should be considered as fixed and which as random?

BTW, how I can share my questions with the community now?

Re: How to analyze unbalanced data which three of independent factors are unbalanced levels?

Chris_Kirchberg — Fri, 18 Jan 2019 18:36:09 GMT

Thanks for the screen shot @Shad,

Based on the image, you have 15 terms in the model. IF it is a DOE with 4 effects and a full factorial design, then that would mean you have 16 runs. Is that correct? If so, you would not have enough degrees of freedom to estimate any of the effects/terms in the model (not enough data). You might want to start with stepwise regression to add terms in a forward stepwise fashion. Otherwise, remove terms that are most likely not going to have an impact (4th degree polynomial for example).

Hope that helps.

Chris

Re: How to analyze unbalanced data which three of independent factors are unbalanced levels?

Dan_Obermiller — Fri, 18 Jan 2019 18:44:42 GMT

Another possible approach rather than going forward is to specify a model with only main effects and two-way interactions. Remove the three-way and four-way interactions.

Re: How to analyze unbalanced data which three of independent factors are unbalanced levels?

Shad — Fri, 18 Jan 2019 22:19:01 GMT

Thank you, Chris.

I have 4 main effects in total but each effect has different levels. For example, the time has 6 levels, Gap has 3 levels and so on. I attached a screen of my distribution analysis. Another thing is that when I did multiple regression, some variables are correlated. And also by doing full factorial, VIF showed high values. I am wondering are these VIF value true since I am not sure the full factorial is right? As I said some of the parameter estimates are missing.

Re: How to analyze unbalanced data which three of independent factors are unbalanced levels?

Chris_Kirchberg — Fri, 18 Jan 2019 23:23:10 GMT

Thanks @Shad,

It looks like you have 78 runs total according to image. Full Factoral DOE would need 108 runs for 4 categorical factors each with the levels you have specified (6x3x3x2).

I would follow @Dan_Obermiller advice and only analyze the main effects and two way interactions at this time. Otherwise you will not get any values for parameter estimates (not enought data to fit the model you are trying to fit due to all factors being categorical).

Chris

Re: How to analyze unbalanced data which three of independent factors are unbalanced levels?

Shad — Wed, 23 Jan 2019 14:49:35 GMT

Dear Chris,

Thanks for the help and sorry for my delayed response. I had issues with my account access.

if I just consider the main effects and two ways interactions, I still have some missing values. For example if you notice to my data distribution, not all levels of my predictors have the same data numbers. Because it was not possible to apply all the predictors combinition to my experiment. How about if I do mixed model, put the predictors with uneven values under random effects? Do you have any idea?

Best,

Re: How to analyze unbalanced data which three of independent factors are unbalanced levels?

Chris_Kirchberg — Wed, 23 Jan 2019 15:02:13 GMT

Hi @Shad,

Ah, yes, some interactions will not work becuase there is no data. Another post had a simillar issues:

https://community.jmp.com/t5/Discussions/How-to-do-three-way-Full-Factorial-ANOVA-with-unbalanced-data/td-p/34078

Mixed Model is not needed, One would have to exclude those interactions that do not have data like what was done with the above post. Looking at Distribution like you have to figure out which combinations do not have data should help wiht chosing which interactions to include in mixed model.

Does that help?

Chris

Re: How to analyze unbalanced data which three of independent factors are unbalanced levels?

Shad — Wed, 23 Jan 2019 15:32:08 GMT

Thank you very much for the link.

In case if I remove the interactions that have missing values, I would have to remove most of interactions. Could you please suggest the best way of analysis if I am interested in knowing the interactions of "intensity by time", "intensity by Gap" and "time by Gap"?

Appreciated again all your help.

Re: How to analyze unbalanced data which three of independent factors are unbalanced levels?

Chris_Kirchberg — Fri, 25 Jan 2019 23:59:34 GMT

Hi @Shad ,

How about trying Stepwise regression with forward selection? That way you will only include interactions that have data. Unbalanced is OK, but if there is missing data for a factor in an interaction, then you cannot use it. there is nothing one can estimate because the data is not there. If you have too many model effects and not enough data, then you cannot estimate all of the effects.

Stepwise with forward selection can help in these cases. Same with Decision trees.

Hope that helps.

Chris

Re: How to analyze unbalanced data which three of independent factors are unbalanced levels?

Shad — Sat, 26 Jan 2019 18:51:51 GMT

I did the stepwise with forwardn selection and minimum BIC rule. Now it ended up with some significant factors. If I want to compare each factor level or their interaction means, how I can do that? I want to see if there is any significant differences in response among predictors levels or their interaction combinations.

Re: How to analyze unbalanced data which three of independent factors are unbalanced levels?

Chris_Kirchberg — Mon, 28 Jan 2019 13:58:30 GMT

Hi @Shad ,

Once the terms are selected, there is a button that says make model. For categorical models, you can add the whole effects and then the interaction terms and remove the parameterized effects.

Here is a link regarding Stepwise Regression that should help.

https://www.jmp.com/support/help/14/stepwise-regression-models.shtml#

Best,

Chris