[Bug 3248] Numeric precision

http://www.w3.org/Bugs/Public/show_bug.cgi?id=3248

           Summary: Numeric precision
           Product: XML Schema
           Version: 1.1 only
          Platform: PC
        OS/Version: Windows XP
            Status: NEW
          Severity: normal
          Priority: P2
         Component: Datatypes: XSD Part 2
        AssignedTo: cmsmcq@w3.org
        ReportedBy: mike@saxonica.com
         QAContact: www-xml-schema-comments@w3.org


QT approved comment

In 3.3.4, it's not clear what the sentence "Precision is sometimes given in
absolute, sometimes in relative terms" means. Is it referring to the way
precision is defined in this specification, or is this background information
about the big bad world? I'm also confused by the definition of "arithmetic
precision". It has just been stated that precisionDecimal "closely corresponds"
to a floating point decimal datatype. So what is meant by "[digits] to the
right of the decimal point"? Is this decimal point a fixed one or a floating
one? To clarify, perhaps you could state what is the arithmetic precision of
1E6 and 1E-6. The definition of the minScale and maxScale facets seem to
suggest that it is a floating decimal point that is intended; but in that case,
do 1E-1 and .1E0 have the same scale or different scale?

Received on Tuesday, 9 May 2006 10:50:32 UTC