results of MS validator run against cosmos tests downloaded on 1/15/09

I downloaded tests with remarks (such as 'incorrect test', 'not yet integrated', etc.) and ran the MS SML validator against the entire set of tests. Although I downloaded the tests on 1/15, I verified that the relevant tests have not changed on 1/19.

Some observations:


n  Incorrect tests: I re-added 'incorrect test' remarks to the tests that have not been corrected as on 1/19 in the cosmos cvs repository. When a test is incorrect, the result returned by an implementation cannot really be trusted. I have changed the 'MS' column value from NA to I in such cases. I did not change the 'cosmos' column in this way.

n  'ms: needs investigation' tests: Investigated and updated results for the following tests.

o    base64\Base64InvalidSML.xml

o    references\InValidSchemeResult.xml

o    targetRequired\InValidMissingReference.xml

n  'ms: needs investigation' tests: Some of the tests in this category got converted to 'incorrect test' category:

o    InValidConstraintRefKey.xml

o    InValidDuplicateKeyConstraintName.xml

o    rules\invalid.xml

o    rules\InValidRuleType.xml

o    rules\InValidRuleTypeExtension.xml

o    rules\InValidRuleTypeRestriction.xml

n  I also added all of the 'ms: need to get test' set of tests (total 11).

n  new tests integrated

o    acyclic\ValidateDefinition.xml

o    acyclic\ValidDerivation.xml

None of the newly added tests (rows 144 ~ 152) are present in cosmos (http://wiki.eclipse.org/COSMOS_SML_Test_Plan#Test_Suite) they were not run against the ms validator.

I have checked in the updated xlsx file into cvs. Nonetheless, here is a copy for quick reference.