topic Re: split data table without including excluded data in Discussions

split data table without including excluded data

Anonymous — Thu, 21 Jun 2018 16:07:57 GMT

Hello all,

I am trying to split a data table that has some bad data in it. I have exleded those bad data in the original table, but I don't know why those data are showling up in split table.

My script is bellow:

dt_daily << New Column( "Outliers Exclusion", Numeric, Continuous, Formula( If( :Mahal. Distances > 1.96, 0, 1 ) ), eval formula );

dt_daily << select where( :Outliers Exclusion == 0 ) << exclude;
Wait( 0 );
dt_dailysplit = dt_daily << Split( Split By( :EquipmentName ), Split( :Energy % from Controls ), Remaining Columns( drop all ) );
Wait( 0 );

dt_daily is the original table, you can see that I did some exculsion over there.

dt_dailysplit is the new split data table

Re: split data table without including excluded data

txnelson — Thu, 21 Jun 2018 16:27:26 GMT

The Split platform appears to not support the "Excluded" state. You will need to either delete the rows, or select the nonexcluded rows and then subset them to a new data table, and then split that data table.

Re: split data table without including excluded data

Anonymous — Thu, 21 Jun 2018 17:11:03 GMT

Thank you for your prompt reply Jim. I will follow your suggestion.

Re: split data table without including excluded data

Anonymous — Thu, 21 Jun 2018 17:27:08 GMT

Hello Jim,

I don't want to delete these data and am tring to subset them into a new table. Could you please give me some help on script part for select ing nonexcluded rows and then subset them to a new data table?

Thanks you so much!

Winnie

Re: split data table without including excluded data

txnelson — Thu, 21 Jun 2018 17:47:37 GMT

Here is a simple example:

Names Default To Here( 1 );
dt = Current Data Table();

dt << select where( Excluded( Row State() ) == 0 );

dtSub = dt << subset( selected rows( 1 ), selected columns( 0 ) );

To learn about how to set and use the various RowState capabilites, see the secion on Row States in the Scripting Guide

Help==>Books==>Scripting Guide

Re: split data table without including excluded data

Anonymous — Thu, 21 Jun 2018 17:49:00 GMT

It is super helpful for me! Thanks again!

Re: split data table without including excluded data

hogi — Tue, 27 Jun 2023 07:41:12 GMT

Related wish:

@MShroff wrote:
When using the Table-processing commands, it would be helpful to provide checkboxes in the dialog to determine how to handle hidden / excluded rows or columns. In particular, this is problematic with splitting tables.