Re: DOM Level 2 TS results from Curt Arnold on 2002-08-22 (www-dom-ts@w3.org from August 2002)

From: Curt Arnold <carnold@houston.rr.com>
Date: Wed, 21 Aug 2002 23:47:13 -0500
To: "Rick Rivello" <richard.rivello@nist.gov>
Cc: <www-dom-ts@w3.org>
Message-ID: <004901c24996$fbce5280$a800a8c0@CurtMicron>
DOM Level 2 HTML test resultsSome quick observations on Rick's tests.


****************************************************************************
****************************************************************************
**
RESULTS FROM MOZILLA

Tests with problems (9 total) - JsUnit

1.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLDocument08.html:HTMLDocument08 failed

"lengthLink"
Expected 4 (number) but was 2 (number)

[CA] The recommendation says that document.applet contains all applets and
objects elements.  The Mozilla implementation only contains the applet
elements.

2.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLInputElement13.html:HTMLInputElement13 failed

"size"
Expected 25 (number) but was 25 (string)

[CA] Returning DOMString per DOM L1 spec and not unsigned long per DOM L2

3.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLIsIndexElement01.html:HTMLIsIndexElement01 failed

"formNotNull"
Expected not to be null

[CA] isindex.html was not valid, it claimed to be strict when it was
transitional and had already been changed in the files for DOM L1 HTML.
I've changed that in the CVS.  However, that did not affect the results of
the test.

4.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableElement31.html:HTMLTableElement31 failed

"Asize2"
Expected 1 (number) but was 0 (number)

[CA] This test seems like two distinct tests that were fused.

Part one (which Mozilla fails) checks
that HTMLTableElement.tBodies returns an one element list for a table
element with no explicit
tbody child element.  I can't justify that as a conformance requirement
since the description of
tBodies explicitly mentioned "defined table bodies" and does not discuss
"implied table bodies".
The second part tests whether insertRow adds a tbody when inserted in an
empty table
which is a clearly stated requirement.

I've modified the test and commented out the debatable parts.  If there is a
conformance requirement
on the proper length of tbodies when there is no explicit tbody element, it
should be added as
a distinct test.


5.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableSectionElement25.html:HTMLTableSectionElement25
failed
...
9.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableSectionElement29.html:HTMLTableSectionElement29
failed

[CA] See Brad Pettit's message

----------------------------------------------------------------------------
----------------------------------------------------------------------------
----------------------------------------------------------------------------
---------------

RESULTS FROM IE6

****************************************************************************
****************************************************************************
**
Tests with problems (49 total) - JsUnit

Dropping out all the type mismatches


3.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLAppletElement11.html:HTMLAppletElement11 failed
"objectLink"
Expected org/w3c/domts/DOMTSApplet.class (string) but was  (object)

[CA] I think this test comes from a misreading of the spec.  The spec
mentions that value of the object attribute containing the serialized form
of a class would contain the classname the classname, however it would also
contain the serialization of member variables.  However, this test expects
it to be exactly the classname.  Plus, there does not appear to be any
compulsion that accessing the object property would force an immediate
serialization of the applet to provide the content.  In fact, the
recommendation suggests stopping the applet before serialization, which
would suggest that evaluating object should not imply a serialization.

If this test is to be salvaged, I would create another applet file that
specifies a value for the object attribute.


5.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLButtonElement08.html:HTMLButtonElement08 failed


"valueLink"
Expected Reset Disabled Button (string) but was Reset (string)


6.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLDocument04.html:HTMLDocument04 failed


"URLLink"
Expected document (string) but was
C:\cygwin\home\Administrator\2001\DOM-Test-Suite\build\level2\html\ecmascrip
t\tests\document (string)

[CA] HTMLDocument.URL is returning a UNC, not a URL for local files.

--------------------

More tomorrow

-------------------



7.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLFrameElement09.html:HTMLFrameElement09 had an error


Error message is:
"'title' is null or not an object"

8.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLIFrameElement11.html:HTMLIFrameElement11 had an error


Error message is:
"'title' is null or not an object"



10.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLInputElement06.html:HTMLInputElement06 failed


"alignLink"
Expected bottom (string) but was  (string)

11.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLIsIndexElement01.html:HTMLIsIndexElement01 failed


"Asize"
Expected 2 (number) but was 1 (number)


12.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLIsIndexElement02.html:HTMLIsIndexElement02 failed


"notnull"
Expected not to be null


13.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLIsIndexElement03.html:HTMLIsIndexElement03 failed


"Asize"
Expected 2 (number) but was 1 (number)



16.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLObjectElement19.html:HTMLObjectElement19 had an error


Error message is:
"'title' is null or not an object"


18.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableCellElement11.html:HTMLTableCellElement11 failed
"chLink"
Expected : (string) but was  (string)
19.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableCellElement12.html:HTMLTableCellElement12 failed
"chLink"
Expected : (string) but was  (string)
20.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableCellElement13.html:HTMLTableCellElement13 failed
"chOffLink"
Expected 1 (string) but was  (string)
21.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableCellElement14.html:HTMLTableCellElement14 failed
"chOffLink"
Expected 1 (string) but was  (string)
22.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableColElement03.html:HTMLTableColElement03 failed
"chLink"
Expected * (string) but was  (string)
23.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableColElement04.html:HTMLTableColElement04 failed
"chLink"
Expected $ (string) but was  (string)
24.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableColElement05.html:HTMLTableColElement05 failed
"chLink"
Expected 20 (string) but was  (string)
25.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableColElement06.html:HTMLTableColElement06 failed
"chLink"
Expected 15 (string) but was  (string)

26.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableElement34.html:HTMLTableElement34 failed


"HTMLTableElement34"
Call to assertTrue(boolean) with false

Stack trace follows:
> JsUnitException
> _assert
> assertTrue
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


27.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableElement35.html:HTMLTableElement35 failed


"HTMLTableElement35"
Call to assertTrue(boolean) with false

Stack trace follows:
> JsUnitException
> _assert
> assertTrue
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


28.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableElement36.html:HTMLTableElement36 failed


"HTMLTableElement36"
Call to assertTrue(boolean) with false

Stack trace follows:
> JsUnitException
> _assert
> assertTrue
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


29.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableElement37.html:HTMLTableElement37 failed


"HTMLTableElement37"
Call to assertTrue(boolean) with false

Stack trace follows:
> JsUnitException
> _assert
> assertTrue
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


30.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableElement38.html:HTMLTableElement38 failed


"HTMLTableElement38"
Call to assertTrue(boolean) with false

Stack trace follows:
> JsUnitException
> _assert
> assertTrue
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


31.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableRowElement08.html:HTMLTableRowElement08 failed


"chLink"
Expected * (string) but was  (string)

Stack trace follows:
> JsUnitException
> _assert
> assertEquals
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


32.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableRowElement09.html:HTMLTableRowElement09 failed


"charOffLink"
Expected 1 (string) but was  (string)

Stack trace follows:
> JsUnitException
> _assert
> assertEquals
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


33.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableRowElement15.html:HTMLTableRowElement15 failed


"HTMLTableRowElement15"
Call to assertTrue(boolean) with false

Stack trace follows:
> JsUnitException
> _assert
> assertTrue
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


34.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableRowElement16.html:HTMLTableRowElement16 failed


"HTMLTableRowElement16"
Call to assertTrue(boolean) with false

Stack trace follows:
> JsUnitException
> _assert
> assertTrue
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


35.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableRowElement17.html:HTMLTableRowElement17 failed


"HTMLTableRowElement17"
Call to assertTrue(boolean) with false

Stack trace follows:
> JsUnitException
> _assert
> assertTrue
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


36.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableRowElement18.html:HTMLTableRowElement18 failed


"HTMLTableRowElement18"
Call to assertTrue(boolean) with false

Stack trace follows:
> JsUnitException
> _assert
> assertTrue
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


37.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableRowElement19.html:HTMLTableRowElement19 failed


"HTMLTableRowElement19"
Call to assertTrue(boolean) with false

Stack trace follows:
> JsUnitException
> _assert
> assertTrue
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


38.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableSectionElement04.html:HTMLTableSectionElement04
failed


"chLink"
Expected * (string) but was  (string)

Stack trace follows:
> JsUnitException
> _assert
> assertEquals
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


39.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableSectionElement05.html:HTMLTableSectionElement05
failed


"chLink"
Expected + (string) but was  (string)

Stack trace follows:
> JsUnitException
> _assert
> assertEquals
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


40.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableSectionElement06.html:HTMLTableSectionElement06
failed


"chLink"
Expected $ (string) but was  (string)

Stack trace follows:
> JsUnitException
> _assert
> assertEquals
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


41.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableSectionElement07.html:HTMLTableSectionElement07
failed


"chOffLink"
Expected 1 (string) but was  (string)

Stack trace follows:
> JsUnitException
> _assert
> assertEquals
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


42.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableSectionElement08.html:HTMLTableSectionElement08
failed


"chOffLink"
Expected 2 (string) but was  (string)

Stack trace follows:
> JsUnitException
> _assert
> assertEquals
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


43.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableSectionElement09.html:HTMLTableSectionElement09
failed


"chOffLink"
Expected 3 (string) but was  (string)

Stack trace follows:
> JsUnitException
> _assert
> assertEquals
> anonymous
> anonymous
> anonymous
> anonymous
> anonymous


44.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableSectionElement21.html:HTMLTableSectionElement21 had
an error


Error message is:
"Invalid argument."

45.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableSectionElement25.html:HTMLTableSectionElement25
failed
46.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableSectionElement26.html:HTMLTableSectionElement26
failed
47.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableSectionElement27.html:HTMLTableSectionElement27
failed
48.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableSectionElement28.html:HTMLTableSectionElement28
failed
49.
file:///C:/cygwin/home/Administrator/2001/DOM-Test-Suite/build/level2/html/e
cmascript/tests/HTMLTableSectionElement29.html:HTMLTableSectionElement29
failed

[CA] See Brad's message
Received on Thursday, 22 August 2002 00:47:22 UTC