<from Michael Cooper> <snip> Therefore I think we need a requirement for ourselves that our testability assertions themselves be tested prior to finalization of the guidelines. We need to obtain comprehensive sets of test cases for each guideline, subject them to human testing, and measure the inter-rater reliability. If the measurement meets a threshold we set, we define the guideline as testable, otherwise we define it as untestable and take action from there (e.g., change or remove the guideline). </snip> <comment> Completely agree. This way we can define those guidelines that are untestable and determine whether it is actually *possible* to test them. I still don't think it is viable to remove a guideline *just because* it is not testable. Gian </comment>
Received on Wednesday, 12 May 2004 05:18:30 UTC