cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
  • Sign-in to the JMP Community will be unavailable intermittently Dec. 6-7 due to a system update. Thank you for your understanding!
  • We’re retiring the File Exchange at the end of this year. The JMP Marketplace is now your destination for add-ins and extensions.
  • JMP 19 is here! Learn more about the new features.

Discussions

Solve problems, and share tips and tricks with other JMP users.
Choose Language Hide Translation Bar
swelish
Level II

Is there a way to save JMP table as UTF-8 encoded csv without BOM?

I use JSL to extract and transform a variety of data sources into one consolidated csv file that I output to our BI platform. I found this week that the latest csv output didn't work and the BI platform is indicating it is an encoding issue. Opening previous versions of the csv files in Notepad++ I can see they are encoded using UTF-8. However, the newer csv file is encoded as UTF-8-BOM. I don't know why it changed and is there a way to specify saving a JMP table as a csv without the BOM?

1 ACCEPTED SOLUTION

Accepted Solutions
Craige_Hales
Super User

Re: Is there a way to save JMP table as UTF-8 encoded csv without BOM?

Jump adds the BOM, (bite order mark ), because there is a character outside of the 7-bit ASCII range. That means you have a unicode character in one of your strings. One way to remove the bite order mark would be to load the file into a blob, remove the first three bytes with blobpeek, and then rewrite the file from the blob. Load/save textfile() is the function you need, look for the blob option.

Edit textile->textfile

Craige

View solution in original post

3 REPLIES 3
Craige_Hales
Super User

Re: Is there a way to save JMP table as UTF-8 encoded csv without BOM?

Jump adds the BOM, (bite order mark ), because there is a character outside of the 7-bit ASCII range. That means you have a unicode character in one of your strings. One way to remove the bite order mark would be to load the file into a blob, remove the first three bytes with blobpeek, and then rewrite the file from the blob. Load/save textfile() is the function you need, look for the blob option.

Edit textile->textfile

Craige
swelish
Level II

Re: Is there a way to save JMP table as UTF-8 encoded csv without BOM?

Thank you, Craige. That worked. I didn't need to use the Blob Peek function as the Load Text File included the option to skip the first three bytes: 

Load text file( myFilePath , BLOB(ReadOffsetFromBegin(3) ))

Craige_Hales
Super User

Re: Is there a way to save JMP table as UTF-8 encoded csv without BOM?

Looking back, I just realized speech to text doesn't handle "byte" correctly. Glad you got something working.
Craige

Recommended Articles