topic Re: How to walk a directory with many sub-folders to fetch specific files? in Discussions

How to walk a directory with many sub-folders to fetch specific files?

rverma — Thu, 27 Feb 2020 23:07:47 GMT

Hello,

I have a folder/directory with many sub folders. In each of the subfolder there are bunch of csv files. Each csv file has a unique ID in the filename. My question is that if I have a list of IDs then how can I traverse the directory to fetch those specific csv files and concatenate them in a jmp table? Is there a way to do it with a script (JSL)? I will appreciate any guidance. CSV file name is similar to "Y123456_File_27A7Z123456.csv". String after File_ is the unique id.

Thanks

Re: How to walk a directory with many sub-folders to fetch specific files?

txnelson — Fri, 28 Feb 2020 01:08:03 GMT

The Files in Directory() function has a recursive option that returns the full path to each of the files found.

See

Help=>Scripting Index=>Files in Directory

Re: How to walk a directory with many sub-folders to fetch specific files?

Craige_Hales — Fri, 28 Feb 2020 15:31:19 GMT

also take a look at multiple file import. It may be exactly what you need.

Re: How to walk a directory with many sub-folders to fetch specific files?

rverma — Mon, 02 Mar 2020 23:04:17 GMT

Thank you. I was able to achieve what I wanted by saving all filenames in the directory into a list.

filelist=Files In Directory( path1, recursive);

Then I created another list of the unique IDs.

unitIDlist = {"AA", "AB","AC"};

Finally I used Nested For loop to find the files that contains unique IDs in the filename and open and concatenate them to the first file.