topic Re: Filtering row values that are not within a given range (JSL) in Discussions

Filtering row values that are not within a given range (JSL)

FN — Mon, 20 May 2019 09:45:12 GMT

I am trying to automate some data cleaning. I have lower and high limit values that are considered valid per column and I want to remove verything else having at the end empty values instead. I am missing:

How to clear row values once there is a selection.
How to reference a column name
If there is a better way to do it.

Names Default To Here( 1 );

dt = Current Data Table();

lower_limit = 69.636;
higher_limit = 71.482;

sel = dt << Select Where( :my_column_name>= lower_limit &
	 :my_column_name<= higher_limit  );
	 
sel <<  Invert Row Selection;

// clear rows (sel)??



/*
// Here I am trying to do the same but referencing the column. Yet it does not work.
mycol = Column("my_column_name"); // this does not work
mycol = :my_column_name; //  this does not work either

sel = dt << Select Where( mycol >= lower_limit &
	 mycol <= higher_limit  );

*/

Re: Filtering row values that are not within a given range (JSL)

gzmorgan0 — Mon, 20 May 2019 10:14:04 GMT

You should look up the Function As Column(). If you want to use column values, the syntax is ref_name[], that is, left bracket, right bracket. Try the syntax below.

sel = dt << Select Where( mycol[] >= lower_limit &
	 mycol[] <= higher_limit  );

Re: Filtering row values that are not within a given range (JSL)

FN — Mon, 20 May 2019 10:23:20 GMT

Excellent, how can I then remove the values of that specific selection (rows and column)?

Re: Filtering row values that are not within a given range (JSL)

gzmorgan0 — Mon, 20 May 2019 10:34:16 GMT

Did you wnat to replace the values in that column to empty, or do you wnat to delete the rows?

Names Default To Here( 1 );

dt = Open("$sample_data/big class.jmp");

lower_limit = 70;
higher_limit = 150;
mycol = Column("weight");

sel = dt << Get Rows Where ( mycol[] < lower_limit |
	 mycol[] > higher_limit  );
	 
mycol[sel]= empty();

//to delete rows use
// dt << delete rows(sel);

Re: Filtering row values that are not within a given range (JSL)

FN — Mon, 20 May 2019 10:55:01 GMT

Thanks, this is what I was looking for.

I have this message in my table, though: Attempt to assign to a locked column mycol.