cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Check out the JMP® Marketplace featured Capability Explorer add-in
Choose Language Hide Translation Bar
Miof
Level II

Issue dealing with char to num

Hi Everyone
I am manipulating data, long strings of numbers stored as characters. I was able to break them down to the single numbers in their own column but something I cannot fix is happening.
Some numbers remain the same others are changing. An example of change is -8.7 turning into -8.6999999999999992894572642, this is screwing up the calculation and the comparison down the line. Round did not work.

Fact is when I save the data in CSV or TXT, these numbers are like they should be but when I am importing the file, the numbers in the table are ruined, This means JMP is doing something "wrong" by default.

Any idea how to fix that?

Thanks

1 ACCEPTED SOLUTION
4 REPLIES 4
jthi
Super User

Re: Issue dealing with char to num

Most likely issue with Floating Point Math (https://0.30000000000000004.com/) .

 

To what are you importing the files to and from where (which file type)?

-Jarmo
Miof
Level II

Re: Issue dealing with char to num

I think I got the .... point. :)) .

That so the script needs to structured in a different way.
Ty

Miof
Level II

Re: Issue dealing with char to num

It is a csv but it happens with txt too.