cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Have your say in shaping JMP's future by participating in the new JMP Wish List Prioritization Survey
Choose Language Hide Translation Bar
Miof
Level II

Issue dealing with char to num

Hi Everyone
I am manipulating data, long strings of numbers stored as characters. I was able to break them down to the single numbers in their own column but something I cannot fix is happening.
Some numbers remain the same others are changing. An example of change is -8.7 turning into -8.6999999999999992894572642, this is screwing up the calculation and the comparison down the line. Round did not work.

Fact is when I save the data in CSV or TXT, these numbers are like they should be but when I am importing the file, the numbers in the table are ruined, This means JMP is doing something "wrong" by default.

Any idea how to fix that?

Thanks

1 ACCEPTED SOLUTION
4 REPLIES 4
jthi
Super User

Re: Issue dealing with char to num

Most likely issue with Floating Point Math (https://0.30000000000000004.com/) .

 

To what are you importing the files to and from where (which file type)?

-Jarmo
Miof
Level II

Re: Issue dealing with char to num

I think I got the .... point. :)) .

That so the script needs to structured in a different way.
Ty

Miof
Level II

Re: Issue dealing with char to num

It is a csv but it happens with txt too.