XL2000: CONVERT Function Returns Incorrect Calculation for Liters and Quarts (283695)



The information in this article applies to:

  • Microsoft Excel 2000

This article was previously published under Q283695

SYMPTOMS

When you use the CONVERT function from the Analysis Toolpak to convert liters to quarts, or quarts to liters, the result is incorrect beyond the third decimal place.

CAUSE

The Analysis Toolpak converts 1 liter to 1.056458333 quarts, but it should convert to 1.056689266 quarts.

The Analysis Toolpak converts 1 quart to 0.946558864 liters, but it should convert to 0.946352 liters.

WORKAROUND

To work around this problem, use the following formulas to change between liters and quarts:

Quarts = Liters*.946352
Liters = Quarts/.946352

STATUS

Microsoft has confirmed that this is a problem in the Microsoft products that are listed at the beginning of this article.

REFERENCES

Based on the "Weights and Measures" table in the standard HA Webster's New Collegiate Dictionary:

1 gill = 4 fluidounces = 118.294 milliliters (ml)

1 quart = 32 fluidounces = 8 gills = 8 x 118.294 ml = 946.352 ml = 0.946352 liters (divide by 1,000 to convert ml to liters)

Therefore, 0.946352 liters = 1 quart.

Or, after you divide both sides by 0.946352:
1 liter = 1.056689 quarts.

This figure agrees with all commonly used conversion tables.


Modification Type:MajorLast Reviewed:9/25/2003
Keywords:kbbug kbpending KB283695