Announcements
Attention for Customers without Multi-Factor Authentication or Single Sign-On - OTP Verification rolls out April 2025. Read all about it here.

Why do my iLogic rule returns with 14 decimals

BRLMCHKD
Advocate

Why do my iLogic rule returns with 14 decimals

BRLMCHKD
Advocate
Advocate

Hi there Smiley Happy

 

I got a simple rule which returns 'Facit' in Equation field with 14 decimals, why does it do so? Smiley Surprised

 

Someone got an answer to that?

 

Kind Regards

BRLMCHKD

14 decimals_05.09.2018.png 

 

 

0 Likes
Reply
Accepted solutions (1)
319 Views
1 Reply
Reply (1)

clutsa
Collaborator
Collaborator
Accepted solution

If my memory serves (and it may not) this is not an issue with Inventor, but with all computers. When using binary (1's and 0's as all current commercially available computers do) to do math with decimals it gets tricky because some numbers can't truly be represented. If you run the same math in another software (say Excel) and show the the number to the 14th decimal you'll find the same number. Google "floating point rounding error" if you need proof (that's my why of saying I don't truly understand it but have accepted it as true.)

If I've helped you, please help me by supporting this idea.
Mass Override for Each Model State

Custom Glyph Icon for iMates