<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Re: How to Model Heteroscedastic Data with Linear Relationship Between Standard Error Magnitude and Predicted Value in Discussions</title>
    <link>https://community.jmp.com/t5/Discussions/How-to-Model-Heteroscedastic-Data-with-Linear-Relationship/m-p/984528#M110776</link>
    <description>&lt;P&gt;Thank you for the suggestion. I think the real question I've been working around all day is just...&lt;BR /&gt;&lt;BR /&gt;I have all these models that proport to handle heteroscedasticity, and they all give me similar estimations of the predicted outcome. However, they all disagree quite a lot on the model variance, and therefore they report different significant model terms. How do I actually select a "best" model to use here? What qualities should I be looking for?&lt;/P&gt;</description>
    <pubDate>Thu, 19 Nov 2026 18:45:27 GMT</pubDate>
    <dc:creator>TimCarrWPI</dc:creator>
    <dc:date>2026-11-19T18:45:27Z</dc:date>
    <item>
      <title>How to Model Heteroscedastic Data with Linear Relationship Between Standard Error Magnitude and Predicted Value</title>
      <link>https://community.jmp.com/t5/Discussions/How-to-Model-Heteroscedastic-Data-with-Linear-Relationship/m-p/984321#M110768</link>
      <description>&lt;P&gt;Hello,&lt;BR /&gt;&lt;BR /&gt;I've collected data measuring the 'adhesion strength' of a 3D printed part to a plastic substrate as a function of several printing parameters. I have limited terms in my model (compared to a full 2nd order response surface design), as these are the terms found significant in a screening experiment.&lt;BR /&gt;&lt;BR /&gt;When I model my data with standard least squares, my residual by predicted plot shows a clear expanding bell trend. However, when I divide the residuals by the predicted value, I get a very well-behaved set of residuals. I believe this implies that I can model standard error as a linear function of the predicted adhesion strength, but I'm not sure how to implement this.&lt;BR /&gt;&lt;BR /&gt;Loglinear variance modeling might work, but it also calls for model terms for the variance when I think all I want to do is use the expected value of the mean. I've been suggested weighted least squares by Google results, but this doesn't look like something that's default implemented in JMP. What does the community suggest here? I've attached my data table.&lt;BR /&gt;&lt;BR /&gt;Thank you,&lt;/P&gt;
&lt;P&gt;Tim&lt;/P&gt;</description>
      <pubDate>Thu, 19 Nov 2026 03:59:51 GMT</pubDate>
      <guid>https://community.jmp.com/t5/Discussions/How-to-Model-Heteroscedastic-Data-with-Linear-Relationship/m-p/984321#M110768</guid>
      <dc:creator>TimCarrWPI</dc:creator>
      <dc:date>2026-11-19T03:59:51Z</dc:date>
    </item>
    <item>
      <title>Re: How to Model Heteroscedastic Data with Linear Relationship Between Standard Error Magnitude and Predicted Value</title>
      <link>https://community.jmp.com/t5/Discussions/How-to-Model-Heteroscedastic-Data-with-Linear-Relationship/m-p/984454#M110772</link>
      <description>&lt;P&gt;Hi&amp;nbsp;&lt;a href="https://community.jmp.com/t5/user/viewprofilepage/user-id/116557"&gt;@TimCarrWPI&lt;/a&gt;&amp;nbsp;: Good info here.&lt;/P&gt;
&lt;P&gt;&lt;A href="https://online.stat.psu.edu/stat462/node/186/" target="_blank" rel="noopener"&gt;https://online.stat.psu.edu/stat462/node/186/&lt;/A&gt;&lt;/P&gt;
&lt;P&gt;Often, a variance stabalizing transformation (e.g., ln[Y]) is all that is needed in such cases. And for the weighted least squares (WLS)&amp;nbsp; opion...once you have a column of weights, just put weight in the "Weight" role on the Fit Model platform dialog.&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Thu, 19 Nov 2026 12:20:48 GMT</pubDate>
      <guid>https://community.jmp.com/t5/Discussions/How-to-Model-Heteroscedastic-Data-with-Linear-Relationship/m-p/984454#M110772</guid>
      <dc:creator>MRB3855</dc:creator>
      <dc:date>2026-11-19T12:20:48Z</dc:date>
    </item>
    <item>
      <title>Re: How to Model Heteroscedastic Data with Linear Relationship Between Standard Error Magnitude and Predicted Value</title>
      <link>https://community.jmp.com/t5/Discussions/How-to-Model-Heteroscedastic-Data-with-Linear-Relationship/m-p/984515#M110773</link>
      <description>&lt;P&gt;Thank you for the source!&lt;/P&gt;
&lt;P&gt;Taking the natural log of my response variable seems to work, but it also converts all my units, and I'd like to show graphs in used units rather than ln(kN). I could just convert back obviously, but keeping analysis in the same units throughout would be nice (in my mind at least).&lt;/P&gt;
&lt;P&gt;I tried using WLS, but found that it didn't help much. I'm not sure if I've implemented it wrong. I've done the following:&lt;/P&gt;
&lt;UL&gt;
&lt;LI&gt;Save predicted adhesion strength (Y) and residual adhesion strength from SLS model&lt;/LI&gt;
&lt;LI&gt;Calculate abs(residual)&lt;/LI&gt;
&lt;LI&gt;Fit Y by X to get a LoBF and use that line's equation to calculated a "fit abs(residual)", which I believe is proportional to&amp;nbsp;σ_i&lt;/LI&gt;
&lt;LI&gt;Calculate weights as&amp;nbsp;σ_i^2&lt;/LI&gt;
&lt;LI&gt;Re-run SLS with weights (WLS)&lt;/LI&gt;
&lt;/UL&gt;
&lt;P&gt;Now here is where I'm encountering an issue. My WLS analysis shows a residual graph that doesn't look much better than my SLS analysis. The Penn State source says that I need to plot standardized residuals, but JMP doesn't have a built-in option for this. I see other JMP forum posts suggesting to calculate standardized residuals as:&amp;nbsp;residuals / Col Std Dev(residuals), but this would just scale my bad-looking residual graph and doesn't actually incorporate weights in any way. It seems to me that this estimate of standardized residuals relies on the assumption that variance is constant, which isn't true here right?&lt;BR /&gt;&lt;BR /&gt;How do I actually get standardized residuals here?&lt;BR /&gt;&lt;BR /&gt;Best,&lt;/P&gt;
&lt;P&gt;Tim&lt;/P&gt;</description>
      <pubDate>Thu, 19 Nov 2026 16:40:27 GMT</pubDate>
      <guid>https://community.jmp.com/t5/Discussions/How-to-Model-Heteroscedastic-Data-with-Linear-Relationship/m-p/984515#M110773</guid>
      <dc:creator>TimCarrWPI</dc:creator>
      <dc:date>2026-11-19T16:40:27Z</dc:date>
    </item>
    <item>
      <title>Re: How to Model Heteroscedastic Data with Linear Relationship Between Standard Error Magnitude and Predicted Value</title>
      <link>https://community.jmp.com/t5/Discussions/How-to-Model-Heteroscedastic-Data-with-Linear-Relationship/m-p/984527#M110775</link>
      <description>&lt;P&gt;Hey&amp;nbsp;&lt;a href="https://community.jmp.com/t5/user/viewprofilepage/user-id/116557"&gt;@TimCarrWPI&lt;/a&gt;&amp;nbsp;,&lt;/P&gt;
&lt;P&gt;Try using the box-cox Y transformation in Fit model under the Factor profiling menu option.&amp;nbsp; It will keep all the units in a non-transformed state.&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;P&gt;Steve&lt;/P&gt;</description>
      <pubDate>Thu, 19 Nov 2026 18:35:51 GMT</pubDate>
      <guid>https://community.jmp.com/t5/Discussions/How-to-Model-Heteroscedastic-Data-with-Linear-Relationship/m-p/984527#M110775</guid>
      <dc:creator>shampton82</dc:creator>
      <dc:date>2026-11-19T18:35:51Z</dc:date>
    </item>
    <item>
      <title>Re: How to Model Heteroscedastic Data with Linear Relationship Between Standard Error Magnitude and Predicted Value</title>
      <link>https://community.jmp.com/t5/Discussions/How-to-Model-Heteroscedastic-Data-with-Linear-Relationship/m-p/984528#M110776</link>
      <description>&lt;P&gt;Thank you for the suggestion. I think the real question I've been working around all day is just...&lt;BR /&gt;&lt;BR /&gt;I have all these models that proport to handle heteroscedasticity, and they all give me similar estimations of the predicted outcome. However, they all disagree quite a lot on the model variance, and therefore they report different significant model terms. How do I actually select a "best" model to use here? What qualities should I be looking for?&lt;/P&gt;</description>
      <pubDate>Thu, 19 Nov 2026 18:45:27 GMT</pubDate>
      <guid>https://community.jmp.com/t5/Discussions/How-to-Model-Heteroscedastic-Data-with-Linear-Relationship/m-p/984528#M110776</guid>
      <dc:creator>TimCarrWPI</dc:creator>
      <dc:date>2026-11-19T18:45:27Z</dc:date>
    </item>
    <item>
      <title>Re: How to Model Heteroscedastic Data with Linear Relationship Between Standard Error Magnitude and Predicted Value</title>
      <link>https://community.jmp.com/t5/Discussions/How-to-Model-Heteroscedastic-Data-with-Linear-Relationship/m-p/984537#M110777</link>
      <description>&lt;P&gt;I'm a big fan of letting the models vote, generally a true effect will show up the most on average across a bunch of different models.&amp;nbsp; If you save the prediction formula from the models, then make a formula column that takes their average you can then use the Ave formula column in the "Profiler" graph and expand intermediate formulas to see the relationships from the model averages:&lt;/P&gt;
&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="shampton82_0-1795135231952.png" style="width: 400px;"&gt;&lt;img src="https://community.jmp.com/t5/image/serverpage/image-id/126214iB9EB6FA6EBA8D566/image-size/medium?v=v2&amp;amp;px=400" role="button" title="shampton82_0-1795135231952.png" alt="shampton82_0-1795135231952.png" /&gt;&lt;/span&gt;&lt;/P&gt;
&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="shampton82_1-1795135394873.png" style="width: 400px;"&gt;&lt;img src="https://community.jmp.com/t5/image/serverpage/image-id/126215i7AC15A0CAC109570/image-size/medium?v=v2&amp;amp;px=400" role="button" title="shampton82_1-1795135394873.png" alt="shampton82_1-1795135394873.png" /&gt;&lt;/span&gt;&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Fri, 20 Nov 2026 00:43:34 GMT</pubDate>
      <guid>https://community.jmp.com/t5/Discussions/How-to-Model-Heteroscedastic-Data-with-Linear-Relationship/m-p/984537#M110777</guid>
      <dc:creator>shampton82</dc:creator>
      <dc:date>2026-11-20T00:43:34Z</dc:date>
    </item>
    <item>
      <title>Re: How to Model Heteroscedastic Data with Linear Relationship Between Standard Error Magnitude and Predicted Value</title>
      <link>https://community.jmp.com/t5/Discussions/How-to-Model-Heteroscedastic-Data-with-Linear-Relationship/m-p/984597#M110778</link>
      <description>&lt;P&gt;To complete the suggestion from&amp;nbsp;&lt;a href="https://community.jmp.com/t5/user/viewprofilepage/user-id/16391"&gt;@shampton82&lt;/a&gt;, you can compare the performances of different models using the platfrom&amp;nbsp;&lt;A href="https://www.jmp.com/support/help/en/19.1/#page/jmp/model-comparison.shtml?_gl=1*1vf8kia*_up*MQ..*_ga*NzQ1OTE5NDAyLjE3OTUxNjE0NjI.*_ga_BRNVBEC1RS*czE3OTUxNjE0NjEkbzEkZzAkdDE3OTUxNjE0NjEkajYwJGwwJGgw#" target="_blank"&gt;Model Comparison&lt;/A&gt;. This way, no matter how or with which estimation methods the models have been built, you can compare them with the same metrics (example here with standard least squares, standard least squares with box-cox transformation, loglinear variance model and Generalized regression model with Normal Pruned Forward estimation method):&lt;/P&gt;
&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Victor_G_0-1795162718332.png" style="width: 400px;"&gt;&lt;img src="https://community.jmp.com/t5/image/serverpage/image-id/126271iBF6BD52F20CD2B3D/image-size/medium?v=v2&amp;amp;px=400" role="button" title="Victor_G_0-1795162718332.png" alt="Victor_G_0-1795162718332.png" /&gt;&lt;/span&gt;&lt;/P&gt;
&lt;P&gt;As you already pointed out, if you're only interested about the mean response, these models are very close to each others in terms of performances. In this platform, you can use the option "Model averaging" to see if this model averaging can have better performances than individual models (but here it's not the case):&lt;/P&gt;
&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Victor_G_1-1795162844045.png" style="width: 400px;"&gt;&lt;img src="https://community.jmp.com/t5/image/serverpage/image-id/126273i19A646E1B05530DD/image-size/medium?v=v2&amp;amp;px=400" role="button" title="Victor_G_1-1795162844045.png" alt="Victor_G_1-1795162844045.png" /&gt;&lt;/span&gt;&lt;/P&gt;
&lt;P&gt;You can also compare the magnitude of the residuals between the models (but again, they are very close between models).&lt;/P&gt;
&lt;P&gt;When using the Profiler in this platform, you can also use the option&amp;nbsp;&lt;A href="https://www.jmp.com/support/help/en/19.1/#page/jmp/assess-variable-importance.shtml" target="_blank"&gt;Assess Variable Importance&lt;/A&gt;&amp;nbsp;(Independant uniform Inputs as your data comes from a DOE without any specific constraints) to better compare how the different models evaluate the importance of the factors. You can right-click on the results provided, Make into Combined datatable, and then use Graph Builder to better visualize the results with a heatmap for example:&lt;/P&gt;
&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Victor_G_2-1795163471374.png" style="width: 400px;"&gt;&lt;img src="https://community.jmp.com/t5/image/serverpage/image-id/126274i77BF85A42D3658C5/image-size/medium?v=v2&amp;amp;px=400" role="button" title="Victor_G_2-1795163471374.png" alt="Victor_G_2-1795163471374.png" /&gt;&lt;/span&gt;&lt;/P&gt;
&lt;P&gt;Again, no matter the type of model and estimation method, all the models seem to find the same root causes and impact of your factors on the response. If you are only interested about the mean response, then the model choice can be quite open. If you're also interested about the variance, loglinear variance model is in my opinion the best option to model both mean responsa and variance response.&lt;/P&gt;
&lt;P&gt;Please find attached the completed file with two added scripts based on what has been shown in this answer.&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Fri, 20 Nov 2026 08:34:16 GMT</pubDate>
      <guid>https://community.jmp.com/t5/Discussions/How-to-Model-Heteroscedastic-Data-with-Linear-Relationship/m-p/984597#M110778</guid>
      <dc:creator>Victor_G</dc:creator>
      <dc:date>2026-11-20T08:34:16Z</dc:date>
    </item>
  </channel>
</rss>

