Skip to main content

Unit Tests? Integration Tests? Acceptance Tests? What do they mean?

I'm currently working with a new team who haven't really worked in an Agile way before, nor do they have much experience of what types of testing you can do on an application, so in preparation I tried to come up with simple definitions on the above types of tests.

I thought it would make a good blog post, as it's somethign that I would undoubtedly find useful at a future point... So here goes:

To define a Unit Test it's a simple test that tests a single piece of code/logic. When it fails it will tell you what piece of code is broken.

An Integration Test is a test that tests the combination of different pieces of an application, when it fails it will tell you that your system(s) are not working together as you thought they would.

An Acceptance Test is a test that tests the software does what is expected by the customer/user of the software. When it fails it tells you that your application is not doing what the customer/user thought it would do or even what it should do.

These are quick, simple and dirty definitions of the different types of testing you might come across in a project, there are more, but these are the ones that I am going through with the team, so these are the ones that have made it into this blog post!

Feel free to agree/disagree/add more...

Comments

  1. Your definitions are, more or less, what I would have said. But there is a key distinction that needs to be identified, I think, between Acceptance Testing, and all the rest.

    Instead of the traditional testing "pyramid", think instead, of a modern rail or vehicle bridge.

    All the "lower" forms of testing cover the "vertical" stacks: unit, functional, and even some forms of integration, basically are the tests that insure that the pillars or pylons of the bridge are sound.

    Acceptance Testing, however, covers the "horizontal plane". It is designed to be sure of one basic goal: can the user cross the bridge? Can he get from point A to point B, consistently?

    Why is this distinction important? Well, because it helps to better understand what we mean when we say something is "covered".

    Staying with the metaphor, I can write a Gherkin spec covering a user journey across that bridge that passes consistently for months. What does that tell us with any certainty about the underlying bridge supports? Only that they managed to keep the bridge up while I crossed it.

    But without unit, functional, and integration tests, the Gherkin specs can't know if any particular pillar has hairline cracks in the concrete, or that a faulty girder bolt has sheered and is putting extra stress on the suspension cables, or that debris is building up around the base, which will eventually rot the connecting beams.

    And why is all this important? Because a lot of people point to that old testing "pyramid" and complain about "duplication of effort", not realizing that you're testing *two different things*. The user journey, and the application, are fundamentally two different things. And the testing must reflect that. So yes, it's possible that some unit tests are exercising the same piece of code as a Gherkin spec, but they're doing it *under different conditions*, in different contexts, with different goals in mind. What those folks who complain about duplication are missing, is that testing is not a linear activity, and that product quality is not one-dimensional.

    ReplyDelete

Post a Comment

Popular posts from this blog

Delusions of Testing

So I've got in touch with my old QA friend, Richard Lee and we spoke about guest blogging on each others blogs... Richard is an IT Professional for a FinTech based company in London. His activities vary from Release Manager, Build Manager, Database Administrator. Working in a Microsoft workshop, his expertise lies in MSBuild/Workflow/Powershell/SSAS/SSIS/SSRS/SQL, basically whatever isn’t anyone elses’ problem is Richard's problem! When not solving other peoples problems he can be found blogging at redphoenix.me , and jogging to and from home, where he lives with his heavily pregnant wife. Hello, my name is Richard, and I am a former tester. Like most people and their careers, I fell into testing; I first got into testing about 6 years ago, after I had graduated. I went to a university where the attitude was that you should try to get on a graduate scheme with one of the big companies. If you weren’t interested in that, well, good luck with getting any support from ...

QA is Awesome!

No real point to this post other than I have had the song stuck in my head and figured I could change it slightly and quite easily make QA is Awesome! Oh and I haven't even seen the movie all the way through! But for some reason that song is incredibly catchy! Not much point to this post in fact, just thought I'd put it out there :)

Treating Test Code as Production Code

It's important when writing automated tests to remember that the code you write should be up to production standards, meaning any conventions that you have in place should be adhered to and that it should follow good design patterns. Too many people often say why does it have to be as good as production code, it's "Only" a test, so long as it passes then that's fine... To answer this we need to look at why we want our tests to be written in such a structured and efficient manner: - Maintainability - by making the test code structured and efficient, it becomes far easier to maintain and in doing so changes in the future can happen quickly as the test isn't linked to anything that it shouldn't be and it's easy to understand for a new set of eyes. - Durability - Again by making the tests structured they should be resistant to changes, if you change a variable name for instance then it shouldn't effect the unit test unless it absolutely has to....