topic Re: What do you do with your models after you build them in JMP? in Discussions

What do you do with your models after you build them in JMP?

Jeff_Perkinson — Wed, 19 Oct 2016 02:07:13 GMT

As we continue to improve JMP we need to know how you exploit the models you build in JMP. Today, JMP let's you save models as prediction formulas in new columns. JMP can also output SAS DATA step code.

We want to know what you do with models you build in JMP.

Do you deploy models built with JMP or JMP Pro into production? And if so where do those models go? Which systems do you use?
Do you use JMP models as-is or do you re-program them into other languages? If so what languages?
If there was one thing that JMP could do to make it easier to take a model built in JMP and put it into a production system, what would that be?

Re: What do you do with your models after you build them in JMP?

paul_auclair_th — Thu, 10 Mar 2016 14:36:02 GMT

Jeff, thank you for posting your timely question on the JMP Community site. It would help if the SAS Data Step code was:

a compiled executable that a package like Dakota (Design Analysis Kit for Optimization and Terascale Applications), DaVinci, or Galaxy could call.
in an Excel format .

Not being a developer, options like those mentioned above would allow creating a model in JMP and easily using it in readily accessible environments.

Re: What do you do with your models after you build them in JMP?

ron_horne — Sun, 13 Mar 2016 17:07:23 GMT

I find it very useful exporting the prediction profiler to flash format. In order to do so I extract the model formula and use it in the profiler platform. Unfortunately, this is not available for nominal or ordinal logistic regression.

In addition, the logistic regression takes too long to calculate odds ratios and confidence intervals when medium size files are involved.

For example, this thing takes quite a few minutes while indicating - not responding:

(Before running this script save and close all other JMP windows since it tends to get stuck)

// get data table

dt = Open( "$SAMPLE_DATA/Hurricanes.jmp" );

// run the model

obj = Fit Model(

Y( :Storm Category ),

Effects( :Latitude, :Longitude, :Latitude * :Longitude ),

Personality( Nominal Logistic ),

Run( Likelihood Ratio Tests( 0 ), Wald Tests( 0 ) )

);

// get the confidence intervals for the estimates

obj << Confidence Intervals( 0.05 );

Re: What do you do with your models after you build them in JMP?

KarenC — Mon, 14 Mar 2016 14:50:59 GMT

Jeff,

When in "working mode" I will end up with a number of models saved to a data table all with similar column names that I have to go and rename (or deal with predicted, predicted 2, predicted 3, etc.). It would be nice to have a "Save Prediction Formula with Name" option such that you could enter a model name in a dialog that would populate the resulting saved column name(s) in an appropriate manner.

Karen

Re: What do you do with your models after you build them in JMP?

Peter_Bartell — Wed, 16 Mar 2016 12:14:54 GMT

Jeff:

I've got one customer that deploys the predictive models they build, validate and test in JMP Pro into their internal data warehouses for marketing intelligence purposes. These models are then in production within their warehouse business intelligence systems, predicting customer behaviors (retention probability, lifetime spend, market segmentation, and on and on). So basically they build, validate, and test the models in JMP Pro, then put them into production in the business intelligence architecture. Then when the existing BI models are no longer useful, well, back to JMP Pro for repairs, modification etc. Always testing out new BI initiatives with JMP Pro...but the heavy production lifting occurs in their BI systems external to JMP Pro.

Re: What do you do with your models after you build them in JMP?

elie_maricau — Tue, 22 Mar 2016 09:42:40 GMT

Jeff,

We develop models maily for two reasons:

- To study the relationships and effects of model parameters on the predicted parameter. In this case the model development and analysis is done mainly in JMP and prediction formula's are only used to evaluate the modelling accuracy and predictive power (in graph builder), to compare different models (in model comparison tool) or even nested models. In some cases the model is then also exported to Excel.

- To develop a model for online implementation (monitoring or prediction). In this case the model equation is either used in our PIMS (production information management system) or in AspenIQ. AspenIQ is an Aspentech software tool that is commonly used as part of an advanced process control solution to automated a prodocution process. Our current toolset is limited to the use of linear models. We are however interested in deploying more advanced models (e.g. bootstrap forest, PLS, NN, ...). Currently, exporting these kind of models from JMP is not so straightforward (reprogramming them in another tool or language requires much more work).

Re: What do you do with your models after you build them in JMP?

ron_horne — Wed, 23 Mar 2016 23:49:46 GMT

Jeff,

If I run a model with a nominal factor that has many categories I take note of the Least Squares Means Table and rank the categories. Then I set the value ordering of that variable and change modeling type to ordinal. When I re-run the model I get a more meaningful interpretation of the coefficients, their significance and the prediction profiler is visually more informative.

It would be nice if there was an option in the model platform or the output to re run the model with categorical factors ordered in this post-hoc manner.

This also saves many custom test in order to contrast the many categories.

Thanks!

Re: What do you do with your models after you build them in JMP?

kschnelle_dow_c — Thu, 24 Mar 2016 13:19:22 GMT

Saving the prediction equation into a JMP column is a great feature. We use it all the time.

For common usage in the future, we also cut and paste it into Excel 9and then edit). So Save Excel format option would be great. 99% of our internal clients who do not use JMP use Excel as their default data tool... (like it or not, ugh)

Re: What do you do with your models after you build them in JMP?

markschahl — Thu, 24 Mar 2016 13:19:30 GMT

Jeff:

I use JMP to build models for controlling petrochemical processes: analyze process data fetched from a data historian (typically Honeywell PHD); build model; give equation(s) to process control engineers who then use them in code for distributed control systems (typically Honeywell). Having good models allows us to make smart control algorithms.

This is similar to what ellie.maricou is doing.

Re: What do you do with your models after you build them in JMP?

mbohley — Thu, 24 Mar 2016 13:43:19 GMT

Jeff,

I translate the equation into SQL code and add to a pre-existing extract of customers at time 0 and then look at those same customers intermittently going forward to see if they behave consistently with the model (e.g. increase/decrease an account). I guess you would call this a "tentative non-deployment."

Thanks.

Martin

Re: What do you do with your models after you build them in JMP?

David_Burnham — Tue, 29 Mar 2016 21:11:20 GMT

I transform the formula to javascript for web deployment:

http://pega-analytics.co.uk/model-viewer/html/body-measurements.html

Re: What do you do with your models after you build them in JMP?

jenkins_macedo — Wed, 30 Mar 2016 18:25:36 GMT

This is a very relevant post as it applies directly to my job. As I respond to this post, I am about to complete my fifth models all developed in JMP Pro 12 using variety of data types. Once the model has been developed in JMP, I used the model to score customers who have similar historical context as those customers whose data that were used to develop the model. Once I the scoring process is done to those customers and I than retrieved their responses from whatever products/services they were promoted with in the past and using the predicted scores from the scored data table plus their actual responses, I sort the predicted scores from largest to smallest and rank the customers into decile of 10.

For example, the most targeted customers would be those in the decile 1, follow by decile 2, 3, 4, etc computing other stats in JMP such as their # of Customers, Response Rate (RR%), Actual # Enrollments, Gains %, Surplus ($), $/Piece, Average $ Amount, etc. Using these stats, we make business decisions which customers to target and who we shouldn't.

We use this process to also assess how well the model is performing in predicting reality by including the actual responses and using the curvature of the decile, which monetarily should decile from 1-10. This extract assessment process is purely exclusive of the internal JMP model validation process. Once we are all good with the model performance and the curvature of the curve of the decile depth chart.

The next step in the process is to deploy the model. Right now,I just download the Customer IDs along with other essential data fields such as the Model Score, Model Decile, Model Name into a text file, we than gets loaded into the data warehouse, which then becomes available to the marketing department for campaign segmentation, campaign analysis, targeted marketing formulation. In the near future, plan is to work internally to use JMP open database connectivity platform to load model tables directly to the marketing data warehouse.@Jeff Perkinson

Re: What do you do with your models after you build them in JMP?

jenkins_macedo — Wed, 30 Mar 2016 18:30:35 GMT

Same as here Peter. You kind of summarize my previous post.

Re: What do you do with your models after you build them in JMP?

jenkins_macedo — Wed, 30 Mar 2016 18:40:07 GMT

The only difference with what I do vs. what this customer does is that, after the model development, which is tested and validated in JMP using the Model Validation under utilities prior to the development of the model and making sure that the essential stats in the validation platform make sense closer to the model itself. We assess the model after going through the processes listed above by using the model to score other customers with similar historical context/data and grab their response and graph predicted scores vs. actual relative to where each of these customers stand within their respective decile along with other business analytical units/stats. Once we are please with the assessment, the model is launch into deployment, which goes as you described either MicroStrategy. Business Objects, IBM UNICA, Salesforce, etc. There the model is available for a wide range of stakeholders who uses it for campaigns, prospecting, reactivation, segmentation for targeted campaign, etc/. So, apart from JMP's internal test and validation, it is always very essential to assess the model prior to deployment into production as that allows you to see, if at all anything needs to be added and removed or if the model needs additional improvement. No model is perfect!

Re: What do you do with your models after you build them in JMP?

dr_winfried_koc — Fri, 01 Apr 2016 14:22:43 GMT

To my Clients who are JMP users, I usually deliver a data table with the model fit saved as a script customized as far as possible. To non-JMP users I deliver in Excel the model fit as a grid table as it can be generated e.g. by "Output grid table" under the red button of the prediction profiler.

I would be much interested at an easy solution to make model equations available at the internet.

Re: What do you do with your models after you build them in JMP?

wilkap — Fri, 15 Apr 2016 23:48:26 GMT

I use the models in many ways, but the feature that would be most helpful is for calibration models. If inverse regression would work for quadratic models it would save a lot of effort.

Re: What do you do with your models after you build them in JMP?

josh_markwordt — Thu, 28 Apr 2016 14:51:09 GMT

David, the link you posted looks very similar to the profiler we added in JMP 12 (here is a blog I wrote where I describe some of the features for any users who might not be familiar with it: Using the Interactive HTML Profiler in JMP 12 ). Can I ask what advantages your JavaScript implementation has over the built-in Interactive HTML version? If it isn't meeting your needs, this could be an opportunity for us to find out how to improve it in the future.

Re: What do you do with your models after you build them in JMP?

edinglidstrab — Mon, 31 Jul 2017 23:42:23 GMT

I would like to export models to Excel, especially neural networks

Re: What do you do with your models after you build them in JMP?

Jeff_Perkinson — Wed, 13 Sep 2017 14:52:28 GMT

Thanks for all the input. This was useful in developing the Formula Depot in JMP Pro.

Please continue to respond here to suggest additional destinations for models exported from the Formula Depot.