topic Re: How to create an CDF plot in Graph Builder in Discussions

How to create an CDF plot in Graph Builder

Thomas1 — Fri, 22 Feb 2019 15:15:39 GMT

What would be the best way to create a CDF plot in Graph Builder, comparable to Fit Y by X (CDF / CumProb), but with the functionality of Graph Builder like Overlay, Group, Color etc.?

Re: How to create an CDF plot in Graph Builder

cwillden — Fri, 22 Feb 2019 16:48:36 GMT

Here's an example using repeated sequences of probabilities, and quantiles of those probabilities for different distributions:

Here's the script for the table I made to illustrate:

New Table( "Untitled",
	Add Rows( 8040 ),
	New Script(
		"Normal CDFs",
		Graph Builder(
			Size( 526, 452 ),
			Show Control Panel( 0 ),
			Variables( X( :Quantile ), Y( :Probability ), Overlay( :Distribution ) ),
			Elements( Line( X, Y, Legend( 18 ) ) )
		)
	),
	New Column( "Probability",
		Numeric,
		"Continuous",
		Format( "Best", 12 ),
		Formula( 1 / (1 + Exp( -Sequence( -10, 10, 0.1, 1 ) )) )
	),
	New Column( "Quantile",
		Numeric,
		"Continuous",
		Format( "Best", 12 ),
		Formula( Normal Quantile( :Probability, :mu, :sigma ) )
	),
	New Column( "mu",
		Numeric,
		"Continuous",
		Format( "Best", 12 ),
		Formula( Sequence( 1, 10, 1, 402 ) )
	),
	New Column( "sigma",
		Numeric,
		"Continuous",
		Format( "Best", 12 ),
		Formula( Sequence( 2, 2.5, 0.5, 402 ) )
	),
	New Column( "Distribution",
		Character,
		"Nominal",
		Formula( "Normal(" || Char( :mu ) || ", " || Char( :sigma ) || ")" ),
		Set Selected
	)
)

Re: How to create an CDF plot in Graph Builder

Mark_Bailey — Fri, 22 Feb 2019 18:03:48 GMT

Use the Distribution platform to get the probabilities. Click the red triangle for the variable in Distribution and select Save > Prob Scores. Now use this new data column in the Y role in Graph Builder and the original data column in the X role.

Re: How to create an CDF plot in Graph Builder

Thomas1 — Fri, 22 Feb 2019 19:33:19 GMT

Thanks for your support. I did try the Prob Score method. However I got different result for the zero potion of the attached file. The Distribution and the CDF Plot from the Y by X Platform are delivering a zero portion of 60.4 %.

Graph builder and Prob Score are delivering a 30 % for the zero portion.

Re: How to create an CDF plot in Graph Builder

Thomas1 — Fri, 22 Feb 2019 19:44:12 GMT

Thanks for fast reply and interesting samples Cameron. What must be done to create a CDF Plot in Graph Builder the attached Data similar to the CDF plot result from the Y bx X platform?

Re: How to create an CDF plot in Graph Builder

Mark_Bailey — Fri, 22 Feb 2019 21:25:40 GMT

Sorry. I did not notice the discrepency before. JMP Help says:

For N nonmissing scores, the probability score of a value is computed as the averaged rank of that value divided by N + 1. This column is similar to the empirical cumulative distribution function.

So they are not the same. I can't find a substitute.

Re: How to create an CDF plot in Graph Builder

cwillden — Fri, 22 Feb 2019 21:50:41 GMT

Here's an example with 4 Poisson distributions:

New Table( "Poisson CDF Example",
	Add Rows( 200 ),
	New Script(
		"Poisson CDF Comparison",
		Graph Builder(
			Size( 526, 452 ),
			Show Control Panel( 0 ),
			Variables( X( :X ), Y( :Probability ), Overlay( :Distribution ) ),
			Elements( Line( X, Y, Legend( 19 ), Connection( "Step" ) ) ),
			SendToReport(
				Dispatch(
					{},
					"X",
					ScaleBox,
					{Min( -1 ), Max( 12 ), Inc( 10 ), Minor Ticks( 1 )}
				)
			)
		)
	),
	New Column( "Distribution",
		Character,
		"Nominal",
		Formula( "Pois(" || Char( :Lambda ) || ")" )
	),
	New Column( "Lambda",
		Numeric,
		"Continuous",
		Format( "Best", 12 ),
		Formula( If( Row() < 51, 0.5, Row() < 101, 2, Row() < 151, 4, 1.25 ) )
	),
	New Column( "X",
		Numeric,
		"Continuous",
		Format( "Best", 12 ),
		Formula( Sequence( -1, 48, 1, 1 ) )
	),
	New Column( "Probability",
		Numeric,
		"Continuous",
		Format( "Best", 12 ),
		Formula( Poisson Distribution( :Lambda, :X ) ),
		Set Selected
	)
)

The key with a step function CDF is to turn off the smoother line in Graph Builder, and connect the points using Line. Then change Connection in the control panel to "Step".

Re: How to create an CDF plot in Graph Builder

Thomas1 — Fri, 22 Feb 2019 23:27:28 GMT

Thanks Cameron for providing solutions for the Poisson distribution and the hint for connection the points step wise. I did use the Poisson numbers only to generate the data.

What would be the way for a given data set without knowing how they are distributed to create a CDF plot?

Re: How to create an CDF plot in Graph Builder

cwillden — Mon, 25 Feb 2019 15:37:41 GMT

Would you fit a parametric distribution to them or would you use something like Kaplan-Meier to fit the CDF to the data?

Also, if you don’t have tons of data for each group, just putting the fitted CDF values for your data against the actual data values will probably leave some gaps in the plotted CDF. That’s why I created a sequence of values to plot so I make sure I fill in the whole range.

This makes it a 2 step process. 1. fit distributions to each group of data and get the distribution parameter estimates. 2. Create a data table to plot the CDF probabilities (computed with column formulas) against a sequence of values that covers the range.

This is a laborious process, but would be ok if you don’t have tons of groups and only need to do it once. If you need something robust, you probably need a scripted solution

Re: How to create an CDF plot in Graph Builder

ezorlo — Sun, 26 Jul 2020 13:30:30 GMT

This is a very nice chart. It would help if you can give the same example using counts and not probability. I suppose calculating the probability is frequency/total? the problem is binning the counts...

Thanks

Re: How to create an CDF plot in Graph Builder

hogi — Tue, 27 Jun 2023 18:57:59 GMT

Concerning CDF plot in Graph Builder, please refer to

Re: How to create an CDF plot in Graph Builder

hogi — Sun, 12 Nov 2023 16:10:35 GMT

And here is a wish from 2022 to directly by @BHarris .

Re: How to create an CDF plot in Graph Builder

hogi — Wed, 04 Sep 2024 05:42:01 GMT

From the discussion there:

dt = Open( "$DOWNLOADS/CDF_Data.jmp" );
new column("one_Nr", formula(1));


dt << Graph Builder(
	Variables(
		X( :Data ),
		Y( :"Cumulative Probability[Data]"n ),
		Y( :one_Nr, Position( 1 ) ),
		//Y( :Prob DataX, Position( 1 ) ) // enable after saving the data to the table
	),
	Elements(
		Points( X, Y( 1 ), Y( 3 ), Legend( 11 ) ),
		Points( X, Y( 2 ), Legend( 2 ), Summary Statistic( "Cumulative Percent" ) ),
		Line(
			X,
			Legend( 3 ),
			Connection( "Step" ),
			Summary Statistic( "Cumulative Percent" ),
			Interval Style( "Band" )
		)
	),
	SendToReport(
		Dispatch( {}, "400", ScaleBox,
			{Legend Model(
				11,
				Properties(
					1,
					{Marker( "FilledCircle" ), Marker Size( 6 )},
					Item ID( "Prob Data", 1 )
				)
			), Legend Model(
				2,
				Properties( 0, {Marker Size( 10 )}, Item ID( "Sum %(one_Nr)", 1 ) )
			), Legend Model(
				3,
				Properties( 0, {Line Color( 8 )}, Item ID( "Count", 1 ) )
			)}
		)
	)
);

If the missing horizontal line and first step from the left edge at 0 to the first point's x-value and up (link ) is OK for you,
the approach via "Line" + "Cumulative Percent" (purple line) is a nice shortcut.