I got into work this morning, and was looking at some CI Builds, and had a thought that it might be useful to have a bug raised automatically (through an API) when a test that is running on CI failed.... I tweeted about it to get peoples opinion(s)... I got a few responses on twitter, and one which made me rethink why this might be a good idea and that was: It could easily lead to and incredible amount of noise if we are raising bugs against every failed test, and also 1 failed test case != 1 bug, in that if 3 automated tests on CI fail then we don't necessarily need 3 bugs. It could also potentially (as my reply states) devalue what a bug actually is, meaning that if a tester raises a bug then it might get ignored/lost in all the noise. I also asked our internal QA Slack channel, responses were informative, and again helped lead me away from this potentially noisy and crazy idea. Both of these points are extremely valid, and if you make it the number...
Documenting my thoughts on life in the world of Testing