topic Re: Delete Duplicate rows in Discussions

Delete Duplicate rows

rshehadah — Mon, 15 Oct 2018 20:28:04 GMT

Hi,

I have a datable that I want to delete rows on a duplicate value in a col.

Thank you,

Rami

Re: Delete Duplicate rows

txnelson — Mon, 15 Oct 2018 20:45:53 GMT

Select Duplicat Rows() function will highlight rows for a specified column(s)

Names Default To Here( 1 );
dt = Open( "$SAMPLE_DATA/Big Class.jmp" );
dt <<
Select duplicate rows( Match( :name ) );
xx=dt<<get selected rows;
if(n rows(xx)>0,
	dt<<delete rows;	
);

Re: Delete Duplicate rows

Bill_Worley — Tue, 16 Oct 2018 17:53:10 GMT

Hi Rami,

Jim's script is a nice option, but if you have JMP 14 you can also select duplicate rows in a column by point and click.

Highlight the column of interest, go to the Rows dropdown or red hot spot. Rows > Row Selection > Select Duplicate Rows. All of the duplicate values will be highlighted in by row number. Right click anywhere in the blue region and select delete.

HTH

Bill

Re: Delete Duplicate rows

lwx228 — Wed, 17 Oct 2018 14:38:28 GMT

It is recommended that JMP continue to improve to enable all automation with JSL.Thank you very much!

Re: Delete Duplicate rows

ENTHU — Wed, 22 Jul 2020 01:19:24 GMT

I have a data table which has column called Part_number.I need to remove duplicate part_numbers.The delete duplicate rows options suggested above deosnt work as in no rows get selected.The column is character,nominal type.I'm using JMP12.

Any other options that I can try?

Also does this function retain the first row and delete the repititions as in Excel?

Thanks

Re: Delete Duplicate rows

txnelson — Wed, 22 Jul 2020 03:04:36 GMT

The Select Duplicate Rows() function was not in JMP 12. The below code should do what you want

Names Default To Here( 1 );
dt = Open( "$SAMPLE_DATA\Big Class.JMP" );

dt << sort( by( :Part_number ), order( ascending ), Replace Table( 1 ) );
dt << New Column( "dup",
	formula(
		If(
			Row() == 1, value = 1,
			:Part_number != Lag( :Part_number ), value = 1,
			value
			++);
			value;
	)
);

dt << select where( :dup > 1);

dt << delete rows;

dt << delete column( "dup" );

Re: Delete Duplicate rows

CanhKhong — Thu, 08 Oct 2020 18:24:34 GMT

Thanks Bill for the tip/trick.

I sometimes have duplicate rows but struggle how to delete them. Just thinking about JMP Community and it helps to solve the issue.

Re: Delete Duplicate rows

Thomas_Kilmer — Tue, 15 Oct 2024 14:00:16 GMT

Hi txnelson!

I just wanted to say, I keep seeing your solutions whenever I look up JMP help, and I really appreciate all the work you've done helping people out. You've saved me a ton of time and helped me understand this software better, and it's really appreciated.

Thanks!

A happy JMP user