WD98: Table Sum Rounds Incorrectly on Large Numbers (177893)
The information in this article applies to:
- Microsoft Word 98 Macintosh Edition
This article was previously published under Q177893 SYMPTOMS
When you sum a number in a table that is greater than 15 decimal places,
the number is rounded to the nearest 10.
For example, the following 16 digit number rounds to the nearest 10th.
6553565535655351 + 1 = 6553565535655350
CAUSE
This is a limitation of the floating-point processor. The exact behavior of
a floating-point calculation is hardware dependent.
| Modification Type: | Major | Last Reviewed: | 10/4/2002 |
|---|
| Keywords: | kbprb kbtable KB177893 |
|---|
|