topic Re: JSL: Save data table with Compression in Discussions

JSL: Save data table with Compression

hellind — Wed, 07 Mar 2012 10:06:19 GMT

current data table() << save("\\fssg52\VIEW21_CHECKLIST.sas7bdat", SAS);

I use the above code to save the JMP data table to SAS data sets. But without compression the data table is very big. How do I put the SAS equivalent of '(Compress=yes)' in JSL?

JSL: Save data table with Compression

mattf — Wed, 07 Mar 2012 17:55:20 GMT

Hi:

If you also have access to SAS (either local or remote), one work-around might be to comress the file after transferring to SAS with a little post-processing via the SAS Submit command.

e.g.

dt = Open("$SAMPLE_DATA\Big Class.jmp");

dt << Save As("C:\temp\BigClass.sas7bdat", SAS);

// or

dt << SAS Export Data( dt, temp, BigClass, Replace Existing);

// then

SAS Submit("

libname temp "C:\temp";

data temp.BigClass(compress=yes);

set temp.BisClass;

run;

proc contents data=temp.BigClass;

run;

");

Best regards,

-Matt

Re: JSL: Save data table with Compression

Wed, 07 Mar 2012 18:19:26 GMT

How about using the OS file compression? In Windows NTFS file system, the compression that is built in does a better job of compression than the SAS dataset option.

See http://en.wikipedia.org/wiki/NTFS#File_compression .

Doc Muhlbaier

Duke

JSL: Save data table with Compression

hellind — Thu, 08 Mar 2012 02:47:53 GMT

Doc@Duke,

Do you mean compression to ZIP? I save the file in a shared folder to be used by the team.

Re: JSL: Save data table with Compression

Thu, 08 Mar 2012 02:55:25 GMT

No, in windows XP and later, the NTFS file system supports data compression at the OS level. In XP, right click on a file or directory and select properties, click "Advanced" and you get the choice to compress. You can set it up at the directory level, so all files and subdirectories will be compressed as well.

See http://en.wikipedia.org/wiki/NTFS#File_compression

Re: JSL: Save data table with Compression

hellind — Fri, 09 Mar 2012 03:29:59 GMT

I see. I learned something new. I can set compression=on on my local folder.

But because I am saving the datatables as SAS Datasets to a shared folder, controlled my IT, I don't have the option to right click on the shared folder.

My workplace is a corporate with tight security.