cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
  • See how to interactively organize and restructure data for analysis. Register for May 29 webinar, 2pm US ET.

Discussions

Solve problems, and share tips and tricks with other JMP users.
Choose Language Hide Translation Bar

Methods for compressing a CSV or TSV file with jmp compression to save as .jmp table without having to open the csv in JSL first?

I have access to both JMP12 and JMP14, so a solution for either would work. What I am trying to achieve is saving very large text files (csv,tab,tsv,etc.) with JMP compression such that I get a compressed .jmp file as the result. By large I mean 2-6gb files. Currently I use something like this:

 

MyDataFile = open(filename,Private);
MyDataFile << Compress File When Saved;
MyDataFile << save(filetosave);

This does work but has a very high memory demand since I have to open the file first. I have also tried using gzip compression on the text files when they are generated and then using GZIPUnCompress() in JMP14 and opening the file. I have not been able to figure out a way to open an externally gzipped file directly without having to unzip it, but I am under the impression that the compression jmp uses is also gz, so I am hoping there is a better way to handle this, such that I could either compress the files in jmp format more efficiently or ideally open a .csv.gz, .tsv.gz, .tab.gz etc. file type in JMP through a JSL code.

0 REPLIES 0

Recommended Articles