Re: [dom-tests] DOM: Incorrect test expectation (#5622)

*This report has been truncated because the total content is 465993 characters in length, which is in excess of GitHub.com's limit for comments (65536 characters).

 [View the complete job log.](https://travis-ci.org/w3c/web-platform-tests/jobs/223983226)

# Firefox (nightly channel) #
Testing web-platform-tests at revision 4bb3e83db89c3cb18b6fabe56a77fbdb1b5b0d36
Using browser at version BuildID 20170420100256; SourceStamp 27311156637f9b5d4504373967e01c4241902ae7
Starting 10 test iterations
All results were stable
## All results ##
<details>
<summary>2 tests ran</summary>
<details>
<summary><a href="http://w3c-test.org/submissions/5622/dom/nodes/DOMImplementation-createDocument.html">/dom/nodes/DOMImplementation-createDocument.html</a></summary>


|                                                                             Subtest                                                                             | Results |                                                                                                                                                                         Messages                                                                                                                                                                         |
|-----------------------------------------------------------------------------------------------------------------------------------------------------------------|---------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|                                                                                                                                                                 | OK      |                                                                                                                                                                                                                                                                                                                                                          |
| `DOMImplementation.createDocument(namespace, qualifiedName, doctype)`                                                                                           | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,null,null,null`                                                                                                                      | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for null,null,null`                                                                                                              | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for null,null,null`                                                                                                  | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,undefined,null,null`                                                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for null,undefined,null`                                                                                                         | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for null,undefined,null`                                                                                             | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"foo",null,null`                                                                                                                     | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for null,"foo",null`                                                                                                             | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for null,"foo",null`                                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"1foo",null,"INVALID_CHARACTER_ERR"`                                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"f1oo",null,null`                                                                                                                    | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for null,"f1oo",null`                                                                                                            | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for null,"f1oo",null`                                                                                                | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"foo1",null,null`                                                                                                                    | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for null,"foo1",null`                                                                                                            | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for null,"foo1",null`                                                                                                | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"ெfoo",null,"INVALID_CHARACTER_ERR"`                                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"}foo",null,"INVALID_CHARACTER_ERR"`                                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"f}oo",null,"INVALID_CHARACTER_ERR"`                                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"foo}",null,"INVALID_CHARACTER_ERR"`                                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"\ufffffoo",null,"INVALID_CHARACTER_ERR"`                                                                                            | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"f\uffffoo",null,"INVALID_CHARACTER_ERR"`                                                                                            | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"foo\uffff",null,"INVALID_CHARACTER_ERR"`                                                                                            | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"<foo",null,"INVALID_CHARACTER_ERR"`                                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"foo>",null,"INVALID_CHARACTER_ERR"`                                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"<foo>",null,"INVALID_CHARACTER_ERR"`                                                                                                | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"f<oo",null,"INVALID_CHARACTER_ERR"`                                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"^^",null,"INVALID_CHARACTER_ERR"`                                                                                                   | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"fo o",null,"INVALID_CHARACTER_ERR"`                                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"-foo",null,"INVALID_CHARACTER_ERR"`                                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,".foo",null,"INVALID_CHARACTER_ERR"`                                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,":foo",null,"INVALID_CHARACTER_ERR"`                                                                                                 | FAIL    | `assert_throws: function "function() { document.implementation.createDocument(namespace, qualifiedName, doctype) }" threw object "NamespaceError: An attempt was made to create or change an object in a way which is incorrect with regard to namespaces" that is not a DOMException INVALID_CHARACTER_ERR: property "code" is equal to 14, expected 5` |
| `createDocument test: null,"f:oo",null,"NAMESPACE_ERR"`                                                                                                         | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"foo:",null,"INVALID_CHARACTER_ERR"`                                                                                                 | FAIL    | `assert_throws: function "function() { document.implementation.createDocument(namespace, qualifiedName, doctype) }" threw object "NamespaceError: An attempt was made to create or change an object in a way which is incorrect with regard to namespaces" that is not a DOMException INVALID_CHARACTER_ERR: property "code" is equal to 14, expected 5` |
| `createDocument test: null,"f:o:o",null,"INVALID_CHARACTER_ERR"`                                                                                                | FAIL    | `assert_throws: function "function() { document.implementation.createDocument(namespace, qualifiedName, doctype) }" threw object "NamespaceError: An attempt was made to create or change an object in a way which is incorrect with regard to namespaces" that is not a DOMException INVALID_CHARACTER_ERR: property "code" is equal to 14, expected 5` |
| `createDocument test: null,":",null,"INVALID_CHARACTER_ERR"`                                                                                                    | FAIL    | `assert_throws: function "function() { document.implementation.createDocument(namespace, qualifiedName, doctype) }" threw object "NamespaceError: An attempt was made to create or change an object in a way which is incorrect with regard to namespaces" that is not a DOMException INVALID_CHARACTER_ERR: property "code" is equal to 14, expected 5` |
| `createDocument test: null,"xml",null,null`                                                                                                                     | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for null,"xml",null`                                                                                                             | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for null,"xml",null`                                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"xmlns",null,"NAMESPACE_ERR"`                                                                                                        | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"xmlfoo",null,null`                                                                                                                  | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for null,"xmlfoo",null`                                                                                                          | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for null,"xmlfoo",null`                                                                                              | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"xml:foo",null,"NAMESPACE_ERR"`                                                                                                      | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"xmlns:foo",null,"NAMESPACE_ERR"`                                                                                                    | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"xmlfoo:bar",null,"NAMESPACE_ERR"`                                                                                                   | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: null,"null:xml",null,"NAMESPACE_ERR"`                                                                                                     | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "",null,null,null`                                                                                                                        | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for "",null,null`                                                                                                                | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for "",null,null`                                                                                                    | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "",":foo",null,"INVALID_CHARACTER_ERR"`                                                                                                   | FAIL    | `assert_throws: function "function() { document.implementation.createDocument(namespace, qualifiedName, doctype) }" threw object "NamespaceError: An attempt was made to create or change an object in a way which is incorrect with regard to namespaces" that is not a DOMException INVALID_CHARACTER_ERR: property "code" is equal to 14, expected 5` |
| `createDocument test: "","f:oo",null,"NAMESPACE_ERR"`                                                                                                           | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "","foo:",null,"INVALID_CHARACTER_ERR"`                                                                                                   | FAIL    | `assert_throws: function "function() { document.implementation.createDocument(namespace, qualifiedName, doctype) }" threw object "NamespaceError: An attempt was made to create or change an object in a way which is incorrect with regard to namespaces" that is not a DOMException INVALID_CHARACTER_ERR: property "code" is equal to 14, expected 5` |
| `createDocument test: undefined,null,null,null`                                                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for undefined,null,null`                                                                                                         | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for undefined,null,null`                                                                                             | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: undefined,undefined,null,null`                                                                                                            | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for undefined,undefined,null`                                                                                                    | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for undefined,undefined,null`                                                                                        | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: undefined,"foo",null,null`                                                                                                                | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for undefined,"foo",null`                                                                                                        | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for undefined,"foo",null`                                                                                            | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: undefined,"1foo",null,"INVALID_CHARACTER_ERR"`                                                                                            | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: undefined,"f1oo",null,null`                                                                                                               | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for undefined,"f1oo",null`                                                                                                       | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for undefined,"f1oo",null`                                                                                           | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: undefined,"foo1",null,null`                                                                                                               | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for undefined,"foo1",null`                                                                                                       | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for undefined,"foo1",null`                                                                                           | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: undefined,":foo",null,"INVALID_CHARACTER_ERR"`                                                                                            | FAIL    | `assert_throws: function "function() { document.implementation.createDocument(namespace, qualifiedName, doctype) }" threw object "NamespaceError: An attempt was made to create or change an object in a way which is incorrect with regard to namespaces" that is not a DOMException INVALID_CHARACTER_ERR: property "code" is equal to 14, expected 5` |
| `createDocument test: undefined,"f:oo",null,"NAMESPACE_ERR"`                                                                                                    | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: undefined,"foo:",null,"INVALID_CHARACTER_ERR"`                                                                                            | FAIL    | `assert_throws: function "function() { document.implementation.createDocument(namespace, qualifiedName, doctype) }" threw object "NamespaceError: An attempt was made to create or change an object in a way which is incorrect with regard to namespaces" that is not a DOMException INVALID_CHARACTER_ERR: property "code" is equal to 14, expected 5` |
| `createDocument test: undefined,"f::oo",null,"INVALID_CHARACTER_ERR"`                                                                                           | FAIL    | `assert_throws: function "function() { document.implementation.createDocument(namespace, qualifiedName, doctype) }" threw object "NamespaceError: An attempt was made to create or change an object in a way which is incorrect with regard to namespaces" that is not a DOMException INVALID_CHARACTER_ERR: property "code" is equal to 14, expected 5` |
| `createDocument test: undefined,"xml",null,null`                                                                                                                | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for undefined,"xml",null`                                                                                                        | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for undefined,"xml",null`                                                                                            | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: undefined,"xmlns",null,"NAMESPACE_ERR"`                                                                                                   | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: undefined,"xmlfoo",null,null`                                                                                                             | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for undefined,"xmlfoo",null`                                                                                                     | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for undefined,"xmlfoo",null`                                                                                         | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: undefined,"xml:foo",null,"NAMESPACE_ERR"`                                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: undefined,"xmlns:foo",null,"NAMESPACE_ERR"`                                                                                               | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: undefined,"xmlfoo:bar",null,"NAMESPACE_ERR"`                                                                                              | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/","foo",null,null`                                                                                                    | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for "http://example.com/","foo",null`                                                                                            | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for "http://example.com/","foo",null`                                                                                | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/","1foo",null,"INVALID_CHARACTER_ERR"`                                                                                | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/","<foo>",null,"INVALID_CHARACTER_ERR"`                                                                               | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/","fo<o",null,"INVALID_CHARACTER_ERR"`                                                                                | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/","-foo",null,"INVALID_CHARACTER_ERR"`                                                                                | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/",".foo",null,"INVALID_CHARACTER_ERR"`                                                                                | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/","f1oo",null,null`                                                                                                   | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for "http://example.com/","f1oo",null`                                                                                           | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for "http://example.com/","f1oo",null`                                                                               | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/","foo1",null,null`                                                                                                   | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for "http://example.com/","foo1",null`                                                                                           | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for "http://example.com/","foo1",null`                                                                               | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/",":foo",null,"INVALID_CHARACTER_ERR"`                                                                                | FAIL    | `assert_throws: function "function() { document.implementation.createDocument(namespace, qualifiedName, doctype) }" threw object "NamespaceError: An attempt was made to create or change an object in a way which is incorrect with regard to namespaces" that is not a DOMException INVALID_CHARACTER_ERR: property "code" is equal to 14, expected 5` |
| `createDocument test: "http://example.com/","f:oo",null,null`                                                                                                   | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for "http://example.com/","f:oo",null`                                                                                           | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for "http://example.com/","f:oo",null`                                                                               | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/","f:o:o",null,"INVALID_CHARACTER_ERR"`                                                                               | FAIL    | `assert_throws: function "function() { document.implementation.createDocument(namespace, qualifiedName, doctype) }" threw object "NamespaceError: An attempt was made to create or change an object in a way which is incorrect with regard to namespaces" that is not a DOMException INVALID_CHARACTER_ERR: property "code" is equal to 14, expected 5` |
| `createDocument test: "http://example.com/","foo:",null,"INVALID_CHARACTER_ERR"`                                                                                | FAIL    | `assert_throws: function "function() { document.implementation.createDocument(namespace, qualifiedName, doctype) }" threw object "NamespaceError: An attempt was made to create or change an object in a way which is incorrect with regard to namespaces" that is not a DOMException INVALID_CHARACTER_ERR: property "code" is equal to 14, expected 5` |
| `createDocument test: "http://example.com/","f::oo",null,"INVALID_CHARACTER_ERR"`                                                                               | FAIL    | `assert_throws: function "function() { document.implementation.createDocument(namespace, qualifiedName, doctype) }" threw object "NamespaceError: An attempt was made to create or change an object in a way which is incorrect with regard to namespaces" that is not a DOMException INVALID_CHARACTER_ERR: property "code" is equal to 14, expected 5` |
| `createDocument test: "http://example.com/","a:0",null,"INVALID_CHARACTER_ERR"`                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/","0:a",null,"INVALID_CHARACTER_ERR"`                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/","a:_",null,null`                                                                                                    | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for "http://example.com/","a:_",null`                                                                                            | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for "http://example.com/","a:_",null`                                                                                | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/","a:ெ",null,"INVALID_CHARACTER_ERR"`                                                                                 | FAIL    | `assert_throws: function "function() { document.implementation.createDocument(namespace, qualifiedName, doctype) }" threw object "NamespaceError: An attempt was made to create or change an object in a way which is incorrect with regard to namespaces" that is not a DOMException INVALID_CHARACTER_ERR: property "code" is equal to 14, expected 5` |
| `createDocument test: "http://example.com/","ெ:a",null,"INVALID_CHARACTER_ERR"`                                                                                 | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/","a:aெ",null,null`                                                                                                   | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for "http://example.com/","a:aெ",null`                                                                                           | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for "http://example.com/","a:aெ",null`                                                                               | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/","aெ:a",null,null`                                                                                                   | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for "http://example.com/","aெ:a",null`                                                                                           | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: characterSet aliases for "http://example.com/","aெ:a",null`                                                                               | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/","xml:test",null,"NAMESPACE_ERR"`                                                                                    | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/","xmlns:test",null,"NAMESPACE_ERR"`                                                                                  | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: "http://example.com/","test:xmlns",null,null`                                                                                             | PASS    |                                                                                                                                                                                                                                                                                                                                                          |
| `createDocument test: metadata for "http://example.com/","test:xmlns",null`                                                                              

View on GitHub: https://github.com/w3c/web-platform-tests/pull/5622#issuecomment-295764425

Received on Thursday, 20 April 2017 14:48:58 UTC