Announcements
Attention for Customers without Multi-Factor Authentication or Single Sign-On - OTP Verification rolls out April 2025. Read all about it here.
BRLMCHKD
319 Views, 1 Reply

Why do my iLogic rule returns with 14 decimals

Hi there Smiley Happy

 

I got a simple rule which returns 'Facit' in Equation field with 14 decimals, why does it do so? Smiley Surprised

 

Someone got an answer to that?

 

Kind Regards

BRLMCHKD

14 decimals_05.09.2018.png 

 

 

clutsa
in reply to: BRLMCHKD

If my memory serves (and it may not) this is not an issue with Inventor, but with all computers. When using binary (1's and 0's as all current commercially available computers do) to do math with decimals it gets tricky because some numbers can't truly be represented. If you run the same math in another software (say Excel) and show the the number to the 14th decimal you'll find the same number. Google "floating point rounding error" if you need proof (that's my why of saying I don't truly understand it but have accepted it as true.)

If I've helped you, please help me by supporting this idea.
Mass Override for Each Model State

Custom Glyph Icon for iMates