cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

Discussions

Solve problems, and share tips and tricks with other JMP users.
%3CLINGO-SUB%20id%3D%22lingo-sub-556364%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%E4%BD%BF%E7%94%A8%20jmp%20%E5%8E%8B%E7%BC%A9%E6%9D%A5%E5%8E%8B%E7%BC%A9%20CSV%20%E6%88%96%20TSV%20%E6%96%87%E4%BB%B6%E4%BB%A5%E4%BF%9D%E5%AD%98%E4%B8%BA%20.jmp%20%E8%A1%A8%E7%9A%84%E6%96%B9%E6%B3%95%EF%BC%8C%E8%80%8C%E6%97%A0%E9%9C%80%E5%85%88%E5%9C%A8%20JSL%20%E4%B8%AD%E6%89%93%E5%BC%80%20csv%EF%BC%9F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-556364%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%3CP%3E%E6%88%91%E5%8F%AF%E4%BB%A5%E8%AE%BF%E9%97%AE%20JMP12%20%E5%92%8C%20JMP14%EF%BC%8C%E5%9B%A0%E6%AD%A4%E4%B8%A4%E8%80%85%E7%9A%84%E8%A7%A3%E5%86%B3%E6%96%B9%E6%A1%88%E9%83%BD%E5%8F%AF%E4%BB%A5%E3%80%82%E6%88%91%E8%AF%95%E5%9B%BE%E5%AE%9E%E7%8E%B0%E7%9A%84%E6%98%AF%E4%BD%BF%E7%94%A8%20JMP%20%E5%8E%8B%E7%BC%A9%E4%BF%9D%E5%AD%98%E9%9D%9E%E5%B8%B8%E5%A4%A7%E7%9A%84%E6%96%87%E6%9C%AC%E6%96%87%E4%BB%B6%EF%BC%88csv%E3%80%81tab%E3%80%81tsv%20%E7%AD%89%EF%BC%89%EF%BC%8C%E8%BF%99%E6%A0%B7%E6%88%91%E5%B0%B1%E4%BC%9A%E5%BE%97%E5%88%B0%E4%B8%80%E4%B8%AA%E5%8E%8B%E7%BC%A9%E7%9A%84%20.jmp%20%E6%96%87%E4%BB%B6%E3%80%82%E6%88%91%E8%AF%B4%E7%9A%84%E5%A4%A7%E6%96%87%E4%BB%B6%E6%98%AF%E6%8C%87%202-6gb%20%E7%9A%84%E6%96%87%E4%BB%B6%E3%80%82%E7%9B%AE%E5%89%8D%E6%88%91%E4%BD%BF%E7%94%A8%E7%B1%BB%E4%BC%BC%E8%BF%99%E6%A0%B7%E7%9A%84%E6%96%B9%E6%B3%95%EF%BC%9A%3C%2FP%3E%3CP%3E%20%3C%2FP%3E%3CPRE%3E%3CCODE%20class%3D%22%20language-jsl%22%3EMyDataFile%20%3D%20open(filename%2CPrivate)%3B%0AMyDataFile%20%26lt%3B%26lt%3B%20Compress%20File%20When%20Saved%3B%0AMyDataFile%20%26lt%3B%26lt%3B%20save(filetosave)%3B%3C%2FCODE%3E%3C%2FPRE%3E%3CP%3E%E8%BF%99%E7%A1%AE%E5%AE%9E%E6%9C%89%E6%95%88%EF%BC%8C%E4%BD%86%E5%AF%B9%E5%86%85%E5%AD%98%E7%9A%84%E9%9C%80%E6%B1%82%E9%9D%9E%E5%B8%B8%E9%AB%98%EF%BC%8C%E5%9B%A0%E4%B8%BA%E6%88%91%E5%BF%85%E9%A1%BB%E5%85%88%E6%89%93%E5%BC%80%E6%96%87%E4%BB%B6%E3%80%82%E6%88%91%E8%BF%98%E5%B0%9D%E8%AF%95%E5%9C%A8%E7%94%9F%E6%88%90%E6%96%87%E6%9C%AC%E6%96%87%E4%BB%B6%E6%97%B6%E5%AF%B9%E5%85%B6%E8%BF%9B%E8%A1%8C%20gzip%20%E5%8E%8B%E7%BC%A9%EF%BC%8C%E7%84%B6%E5%90%8E%E5%9C%A8%20JMP14%20%E4%B8%AD%E4%BD%BF%E7%94%A8%20GZIPUnCompress()%20%E5%B9%B6%E6%89%93%E5%BC%80%E6%96%87%E4%BB%B6%E3%80%82%E6%88%91%E6%97%A0%E6%B3%95%E6%89%BE%E5%88%B0%E4%B8%80%E7%A7%8D%E6%96%B9%E6%B3%95%E6%9D%A5%E7%9B%B4%E6%8E%A5%E6%89%93%E5%BC%80%E5%A4%96%E9%83%A8%20gzip%20%E6%96%87%E4%BB%B6%E8%80%8C%E6%97%A0%E9%9C%80%E8%A7%A3%E5%8E%8B%E7%BC%A9%E5%AE%83%EF%BC%8C%E4%BD%86%E6%88%91%E8%AE%A4%E4%B8%BA%20jmp%20%E4%BD%BF%E7%94%A8%E7%9A%84%E5%8E%8B%E7%BC%A9%E4%B9%9F%E6%98%AF%20gz%EF%BC%8C%E6%89%80%E4%BB%A5%E6%88%91%E5%B8%8C%E6%9C%9B%E6%9C%89%E6%9B%B4%E5%A5%BD%E7%9A%84%E6%96%B9%E6%B3%95%E6%9D%A5%E5%A4%84%E7%90%86%E8%BF%99%E4%B8%AA%E9%97%AE%E9%A2%98%EF%BC%8C%E8%BF%99%E6%A0%B7%E6%88%91%E5%B0%B1%E5%8F%AF%E4%BB%A5%E6%9B%B4%E6%9C%89%E6%95%88%E5%9C%B0%E5%8E%8B%E7%BC%A9%20jmp%20%E6%A0%BC%E5%BC%8F%E7%9A%84%E6%96%87%E4%BB%B6%EF%BC%8C%E6%88%96%E8%80%85%E7%90%86%E6%83%B3%E6%83%85%E5%86%B5%E4%B8%8B%E9%80%9A%E8%BF%87%20JSL%20%E4%BB%A3%E7%A0%81%E5%9C%A8%20JMP%20%E4%B8%AD%E6%89%93%E5%BC%80%20.csv.gz%E3%80%81.tsv.gz%E3%80%81.tab.gz%20%E7%AD%89%E6%96%87%E4%BB%B6%E7%B1%BB%E5%9E%8B%E3%80%82%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-556364%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%3CLINGO-LABEL%3E%E6%95%B0%E6%8D%AE%E8%AE%BF%E9%97%AE%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3E%E8%A7%86%E7%AA%97%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Choose Language Hide Translation Bar

Methods for compressing a CSV or TSV file with jmp compression to save as .jmp table without having to open the csv in JSL first?

I have access to both JMP12 and JMP14, so a solution for either would work. What I am trying to achieve is saving very large text files (csv,tab,tsv,etc.) with JMP compression such that I get a compressed .jmp file as the result. By large I mean 2-6gb files. Currently I use something like this:

 

MyDataFile = open(filename,Private);
MyDataFile << Compress File When Saved;
MyDataFile << save(filetosave);

This does work but has a very high memory demand since I have to open the file first. I have also tried using gzip compression on the text files when they are generated and then using GZIPUnCompress() in JMP14 and opening the file. I have not been able to figure out a way to open an externally gzipped file directly without having to unzip it, but I am under the impression that the compression jmp uses is also gz, so I am hoping there is a better way to handle this, such that I could either compress the files in jmp format more efficiently or ideally open a .csv.gz, .tsv.gz, .tab.gz etc. file type in JMP through a JSL code.

0 REPLIES 0

Recommended Articles