Step 1.e: Define the Techniques to be used

Dear All, 

"Step 1.e: Define the Techniques to be used" - could we consider making this step non-optional?

The first reason being that we really need to check their implementation of the techniques (W3C, their own code of best practice or whatever) they say they use.
 
For example: 

- Case 1) If they have done something by using technique A, and we evaluate using technique B there could be an issue (they might fail B);
- Case 2) If they have done something by using technique A, and we evaluate using technique A and B there still could be an issue (they might fail B); 
- Case 3) If they have done something by using technique A, and we evaluate using technique A - it seems to work.

The second reason being that testing seems only to be really replicable if we know what the techniques were they said they implemented - otherwise, two different teams could easily get two different results based on the cases above.

I would be interested to hear your thoughts.

Very best regards

Alistair

Received on Thursday, 10 May 2012 08:49:20 UTC