RE: Test suites for System Applications Specs

Hi Zhiqiang,
I agree with Marcos, I believe we should create test suite on our repo before we push it to w3c since we might want to change it after internal review. I believe it would be better to create it and check internally before we push it to w3c since people can just take it from there and treat as stable.

If you agree with that, please push your tests in folder with spec name under: https://github.com/sysapps/testsuites

Best regards,
Marta



-----Original Message-----
From: Marcos Caceres [mailto:w3c@marcosc.com] 
Sent: Tuesday, September 03, 2013 7:28 PM
To: Zhang, Zhiqiang
Cc: public-sysapps@w3.org; Yu, Ling L; Fan, Yugang
Subject: Re: Test suites for System Applications Specs




On Wednesday, August 28, 2013 at 8:45 AM, Zhang, Zhiqiang wrote:

> Hi folks,
>  
> Glad to know the WG is calling for test suites for the current specifications in [1], and I would like to contribute some.  

Great! :)  
  
> Before that, I would like to confirm with your for the test repo, as questioned by [2], do we (SysApps) want to opt into W3C central repository [3] or do we want to maintain our own [4]?


Up to you (as a person writing tests)… but I worry that if we put stuff prematurely into the W3C repo, we are sending the wrong message. However, we can overcome that by clearly marking all test suites as extremely unstable.  

I will again emphasize that trying to do a test suite before LC will lead to a lot of tests being discarded (hence a waste of time and money). It is better to do prototype reference implementations instead to refine the API, which in turn can generate unit tests, which can then become the basis for a test suite.   

--  
Marcos Caceres

Received on Wednesday, 4 September 2013 08:00:27 UTC