cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
  • Learn how to build custom Python data connectors and further customize JMP’s Data Connector Framework with the Python Data Connector Demo, available now in the JMP Marketplace!
  • See how to use Accelerated Life Testing (ALT) to evaluate reliability. Register for June 5 webinar, 2pm US Eastern Time.

Discussions

Solve problems, and share tips and tricks with other JMP users.
Choose Language Hide Translation Bar
Miof
Level II

Issue dealing with char to num

Hi Everyone
I am manipulating data, long strings of numbers stored as characters. I was able to break them down to the single numbers in their own column but something I cannot fix is happening.
Some numbers remain the same others are changing. An example of change is -8.7 turning into -8.6999999999999992894572642, this is screwing up the calculation and the comparison down the line. Round did not work.

Fact is when I save the data in CSV or TXT, these numbers are like they should be but when I am importing the file, the numbers in the table are ruined, This means JMP is doing something "wrong" by default.

Any idea how to fix that?

Thanks

1 ACCEPTED SOLUTION

Accepted Solutions
Craige_Hales
Super User

Re: Issue dealing with char to num

4 REPLIES 4
jthi
Super User

Re: Issue dealing with char to num

Most likely issue with Floating Point Math (https://0.30000000000000004.com/) .

 

To what are you importing the files to and from where (which file type)?

-Jarmo
Craige_Hales
Super User

Re: Issue dealing with char to num

Miof
Level II

Re: Issue dealing with char to num

I think I got the .... point. :)) .

That so the script needs to structured in a different way.
Ty

Miof
Level II

Re: Issue dealing with char to num

It is a csv but it happens with txt too.

Recommended Articles