PRB: Floating Point Values Do Not Seem Accurate (328301)



The information in this article applies to:

  • Microsoft BizTalk Server 2000
  • Microsoft BizTalk Server 2000 SP1
  • Microsoft BizTalk Server 2000 SP1a
  • Microsoft BizTalk Server 2000 SP2
  • Microsoft BizTalk Server 2002

This article was previously published under Q328301

SYMPTOMS

When you use a built-in mathematical functoid in the BizTalk Mapper tool to return a float value, the floating point value that is returned may not seem to be accurate.

CAUSE

A binary floating-point system can represent only a finite number of floating-point values in exact form. All other values must be approximated by the closest representable value. The Institute of Electrical and Electronics Engineers, Inc. (IEEE) standard specifies the method for rounding values to the closest representable value, and the returns from the BizTalk Mapper mathematical functoid comply with the standard.

RESOLUTION

To work around this problem, write a custom BizTalk Server script function to do any mathematical calculations that require a consistent and specific degree of precision.

STATUS

This behavior is by design.

REFERENCES

For additional information, click the article number below to view the article in the Microsoft Knowledge Base:

42980 (Complete) Tutorial to Understand IEEE Floating-Point Errors


Modification Type:MajorLast Reviewed:5/23/2003
Keywords:kbprb KB328301