FIX: Optimized Code Incorrectly Compares Floating Point Numbers (257496)
The information in this article applies to:
- Microsoft Visual Basic Professional Edition for Windows 5.0
- Microsoft Visual Basic Professional Edition for Windows 6.0
- Microsoft Visual Basic Enterprise Edition for Windows 5.0
- Microsoft Visual Basic Enterprise Edition for Windows 6.0
This article was previously published under Q257496 SYMPTOMS
When running an application as a compiled EXE and a comparison of numeric data types is evaluated, incorrect results may be returned when the comparison involves numbers of the data type Single or Double and the application was compiled with optimizations.
CAUSE
This bug is caused by a problem in the way the compiler creates optimized code for floating point comparisons. However, the problem does not always occur just by simply comparing one floating point value to another. It is affected by the additional code that surrounds the actual code that performs the calculation. For example, in the Steps to Reproduce Behavior in the "More Information" section of this article, it is the combination of the following that produces the incorrect results:
-
A comparison is performed involving values of the Single or Double data type.
-
The compiler is set to use compiler optimizations.
-
The comparison occurs in a called sub-routine.
-
An array is referenced.
-
An IF..THEN..ELSEIF code construct is used.
Other conditions can lead to the miscalculation, such as the use of a SELECT..CASE statement instead of IF..THEN..ELSEIF.
RESOLUTION
There are two possible means to solve this issue. The recommended way is to install the latest service pack for Visual Studio 6.0. An alternative way is to recompile the executable with no compiler optimizations.
STATUSMicrosoft has confirmed that this is a bug in the Microsoft products that are listed at the beginning of this article. This bug was corrected in the latest service pack for Visual Studio 6.0. For additional information about Visual Studio service packs, click the following article numbers to view the articles in the Microsoft Knowledge Base: 194022 INFO: Visual Studio 6.0 Service Packs, What, Where, Why
194295 HOWTO: Tell That a Visual Studio Service Pack Is Installed To download the latest Visual Studio service pack, visit the following Microsoft Web site:
Modification Type: | Minor | Last Reviewed: | 12/12/2005 |
---|
Keywords: | kbBug kbCompiler kbfix kbVS600sp4fix kbVS600sp5fix KB257496 |
---|
|