I downloaded tests with remarks (such as 'incorrect test', 'not yet integrated', etc.) and ran the MS SML validator against the entire set of tests. Although I downloaded the tests on 1/15, I verified that the relevant tests have not changed on 1/19. Some observations: n Incorrect tests: I re-added 'incorrect test' remarks to the tests that have not been corrected as on 1/19 in the cosmos cvs repository. When a test is incorrect, the result returned by an implementation cannot really be trusted. I have changed the 'MS' column value from NA to I in such cases. I did not change the 'cosmos' column in this way. n 'ms: needs investigation' tests: Investigated and updated results for the following tests. o base64\Base64InvalidSML.xml o references\InValidSchemeResult.xml o targetRequired\InValidMissingReference.xml n 'ms: needs investigation' tests: Some of the tests in this category got converted to 'incorrect test' category: o InValidConstraintRefKey.xml o InValidDuplicateKeyConstraintName.xml o rules\invalid.xml o rules\InValidRuleType.xml o rules\InValidRuleTypeExtension.xml o rules\InValidRuleTypeRestriction.xml n I also added all of the 'ms: need to get test' set of tests (total 11). n new tests integrated o acyclic\ValidateDefinition.xml o acyclic\ValidDerivation.xml None of the newly added tests (rows 144 ~ 152) are present in cosmos (http://wiki.eclipse.org/COSMOS_SML_Test_Plan#Test_Suite) they were not run against the ms validator. I have checked in the updated xlsx file into cvs. Nonetheless, here is a copy for quick reference.
This archive was generated by hypermail 2.2.0+W3C-0.50 : Tuesday, 20 January 2009 08:23:10 GMT