W3C home > Mailing lists > Public > public-qt-comments@w3.org > September 2006

[Bug 3666] Wrong number of decimal places in numeric divide tests

From: <bugzilla@wiggum.w3.org>
Date: Thu, 07 Sep 2006 23:24:19 +0000
To: public-qt-comments@w3.org
Message-Id: <E1GLTEJ-0004Ds-BT@wiggum.w3.org>


------- Comment #5 from davidc@nag.co.uk  2006-09-07 23:24 -------
>A conformant implementation can return 3.3 as the result of 10 div 3
By the same reasoning it can presumably also return 42.

I admit that you probably don't want to get into specifying exact numerical
behaviour (as seen recently with overflow behaviour for average, it's hard to
tie these things down) but I think that any natural reading of the spec would
lead one to assume that div does do division to the accuracy supported by the
underlying datatype, which in this case is at least 18 digits. Otherwise you
are saying that (apart from market forces and the common sense of implementors)
there is no guarantee that it does division at all: 0 places of accuracy being
conformant behaviour, so as long as I return some number so it type checks,
that is OK.
Received on Thursday, 7 September 2006 23:24:31 UTC

This archive was generated by hypermail 2.4.0 : Friday, 17 January 2020 16:57:14 UTC