Re: ReSpec 3.2

On 21/10/2013 15:10 , Tobie Langel wrote:
> How come the tests didn't pick that up, though?

Several reasons. One is that we currently don't have tests that test all 
the features together, so bugs that come from interactions between 
features aren't caught. Also, there are no UI test (of the kind that 
emulate a user interacting with the system dynamically). We'd likely 
have to start using WebDriver for that.

In this case few people are using MD and this was a release with a much 
stronger-than-usual risk of breaking things, so I'm not surprised at 
this specific small glitch. (Other than that the roll out seems to have 
worked pretty well, considering.)

Overall the quality of the test suite is "okay" but it can certainly be 
improved a lot. Part of the problem is that writing tests is IMHO still 
too heavy, suggestions on ways to simplify this are welcome. It also 
doesn't help that the CI system is reporting false-negatives for reasons 
I can't quite fathom at this point.

-- 
Robin Berjon - http://berjon.com/ - @robinberjon

Received on Monday, 21 October 2013 13:25:23 UTC