topic Re: How to get new column to populate cycles in large data set for multiple cycles on the same sample? in Discussions

How to get new column to populate cycles in large data set for multiple cycles on the same sample?

WeightedMarten3 — Mon, 12 May 2025 18:28:26 GMT

Hello,

I have some very large data sets (>1million rows) of numerous samples that have been tested in a cyclical fashion. The same sample has gone through 100's of cycles and I'm hoping to find a way to quickly add the cycles to my data table.

The test starts at zero displacement and then runs to a peak force (varies depending on which cycle it is) and then returns back to a zero/near-zero value. I'd like a way to add in the cycle without having to manually scroll through millions of rows of data adding cycles.

Re: How to get new column to populate cycles in large data set for multiple cycles on the same sample?

jthi — Mon, 12 May 2025 18:50:23 GMT

In your data it seems like you could just use Sample to determine the cycle?

Re: How to get new column to populate cycles in large data set for multiple cycles on the same sample?

WeightedMarten3 — Mon, 12 May 2025 22:21:43 GMT

Hello,

Each sample has numerous cycles of compression/decompression in them (100's) and I'm hoping to find a way to break down each Sample # into each cycle within that sample.

Re: How to get new column to populate cycles in large data set for multiple cycles on the same sample?

txnelson — Tue, 13 May 2025 01:50:56 GMT

I added this formula to the Cycles column. It increments the Cycle number each time it detects a change from decreasing values, to increasing values.

As Constant( x = 1 );
If( :Sample != Lag( :Sample ),
	x = 1
);
If( Lag( :Compression ) > :Compression & Lag( :Compression, -1 ) > :Compression,
	x = x + 1
);
x;

Below is a graph where I have created a local data filter, which is set to only display cycles 3,4 and 5 from sample 3. I believe this is what you are looking for

Re: How to get new column to populate cycles in large data set for multiple cycles on the same sample?

WeightedMarten3 — Tue, 13 May 2025 11:53:38 GMT

Thank you so much Jim!