FIX: Math Problem with INT() Function (131578)

The information in this article applies to:

Microsoft Visual FoxPro for Windows 3.0
Microsoft Visual FoxPro for Windows 3.0b

This article was previously published under Q131578

SYMPTOMS

The INT(nExpression) Function evaluates a numeric expression and returns incorrect values.

RESOLUTION

To work around this problem, change the SET DECIMAL setting to a larger more appropriate value such as 10 (the default is 2).

STATUS

Microsoft has confirmed this to be a problem in the Microsoft products listed at the beginning of this article. This problem has been fixed in Visual FoxPro 5.0 for Windows.

MORE INFORMATION

Steps to Reproduce Problem

Run the following code in Visual FoxPro:

   pnum1 = 1000000
   pnum2 = 999999

   SET DECI TO 2       && this is default

   ? int(pnum2/pnum1)  && result is 1 it should be 0

   SET DECI TO 10

   ? int(pnum2/pnum1)  && result is 0, which is correct

Modification Type:	Major	Last Reviewed:	9/30/2003
Keywords:	kbBug kbfix kbvfp500fix KB131578