Re: more aggregate tests

On Sep 18, 2010, at 9:17 AM, Andy Seaborne wrote:

> :mixed2 is the sum of "2.2"^^xsd:decimal and "2e-1"^^xsd:double.  So the decimal is converted to a double and the result added together but ARQ gets 2.4000000000000004e0 - there is one bit of low end noise introduced by the addition being done on doubles of different exponent (this is Java double+double doing that step).  xsd:float, not double, works.


Will float work consistently? If so, I can update the test to use it. If not, any thoughts on how we might test the execution of sum with datatype promotion in a portable manner?

.greg

Received on Monday, 20 September 2010 03:41:15 UTC