As shown in the model, after running the user command "aa" for many times, param (1) should be an integer multiple of 0.2, but it is not. Why函数精度问题_1.fsm
As shown in the model, after running the user command "aa" for many times, param (1) should be an integer multiple of 0.2, but it is not. Why函数精度问题_1.fsm
Doubles only store up to 16 decimal digits accurately although in practice the last digit often suffers rounding inaccuracy. The local variable window is showing sixteen digits, so you're seeing the affect of the inaccuracy and some rounding on that last digit which accumulates over many calculations and starts affecting the 15th and earlier digits. Most applications don't need that level of precision on large numbers, and those that do probably use a multiple precision arithmetic library to overcome the machine level limitations.
16 People are following this question.
FlexSim can help you understand and improve any system or process. Transform your existing data into accurate predictions.
FlexSim is a fully 3D simulation software environment. FlexSim can be used to simulate any process in any industry.
FlexSim®, FlexSim Healthcare™, Problem Solved.®, the FlexSim logo, the FlexSim X-mark, and the FlexSim Healthcare logo with stylized Caduceus mark are trademarks of FlexSim Software Products, Inc. All rights reserved.
Privacy | Do not sell or share my personal information | Cookie preferences | Report noncompliance | Terms of use | Legal | © Autodesk Inc. All rights reserved