Math Coprocessor May Use Different Level of Precision (57298)


The information in this article applies to:

  • Microsoft Excel for Windows 95
  • Microsoft Excel for Windows 5.0c
  • Microsoft Excel for Windows 4.0c
  • Microsoft Excel for Windows 3.0a
  • Microsoft Excel for Windows 2.10d
  • Microsoft Excel for Windows 2.1
  • Microsoft Excel for Windows 2.01
  • Microsoft Excel for Windows 2.0
This article was previously published under Q57298

SUMMARY

In Microsoft Excel, when you perform calculations using numbers that contain decimals, you may receive slightly different (more accurate) results with a math coprocessor present.

MORE INFORMATION

If a math coprocessor is not present, Microsoft Excel uses math coprocessor emulation for its calculations. Calculations using a math coprocessor may use higher precision and therefore may return a slightly different number than the same calculation using the emulation.

The difference between emulation and coprocessor is that emulation is done entirely with double precision floats (8 bytes). The coprocessor may convert to a higher precision format (extended precision floats (10 bytes)) internally, but we always interface with it with double precision floats.

Therefore although a math coprocessor may give slightly higher precision, it doesn't always do so. Emulation always gives at least double precision accuracy.

For additional information, please see the following article(s) in the Microsoft Knowledge Base:

78113 : Excel: Floating-Point Arithmetic May Give Inaccurate Results

Modification Type:MinorLast Reviewed:8/15/2005
Keywords:KB57298
©2004 Microsoft Corporation. All rights reserved.