MFI column filename with empty lines

[#1]

Hello,

I have a problem with Multiple File Import. I am importing a large number of .csv files using the MFI and I have activated the option to create a column with the name of the file. Subsequently I concatenate all the tables created in a large table. I automated this whole process through a script. At the end of the execution of the script I end up with lines whose File Name column is empty. This gives me a big problem because the filename lets me know which product my data corresponds to and without this filename I have test data that doesn't make sense because I can't relate it to any reference. 

Do you have any idea where this problem comes from? 

Thank you in advance for your answers.

Elise B.

[#2]

Can you show the import script and the concatenate script?

Can you tell which files might have produced a blank file name?

Is the missing name an occasional single row, or a run of rows?

Any log messages?

My guess is: you are doing more than one MFI, and one of them left out the option for filename (misspelling perhaps.)

[#3]

The script is attached to this post!

I'm not sure which files might have produced an empty filename as I import a lot of files and their data is relatively similar and there is no column besides the filename that clearly allows me to identify it. I also can't tell if these lines with empty filename come from the same file or not ...

I have no message in the log, the scripts run to the end without error ...

[#4 · Accepted solution]

My next guess is

	dt_list[i] <<  Select Columns( all );
	dt_list[i] << Compress Selected Columns();

is compressing the filename column in a way that won't work with concatenate. Try leaving it out. If you need to compress columns, it will be better to wait until all the concatenations are finished. Some of the compression techniques depend on knowing all the possible values.

[#5]

Cela a fonctionné en enlevant les lignes de compression ! Merci beaucoup pour votre aide !