Skip to main content

Performance Testing 101

So one of my objectives is to be able to offer more in regards to Performance Testing.

Whilst I understand the basics, I figured I'd write them down and start a series of blog posts hopefully detailing my findings and explaining why performance testing is important, and the different types of performance testing.

In order to understand why performance testing is important, it will be good to know some of the more popular types of performance testing are....

Load Testing
This is testing a system to understand and analyse the behaviour of a system under a specific expected load. This is probably the most common form of performance testing, it is useful in identifying any bottlenecks in a piece of software. 

Stress Testing
This is testing a system to breaking point, so that you can understand the point at which the system fails and under what load.

Endurance Testing
Similar to load testing, but this will be load under a prolonged period of time, in order to gain confidence that the system can perform under loads for a long period and measuring the performance of the system.

Spike Testing
This is achieved by a sudden increase in load against a system, to make sure that it can handle the sudden increase in users, an example would be of a new system going into production that suddenly has to deal with a huge influx of users.

When might you use one of the above?
Now you have a basic understanding of some of the different types of performance testing, we can now look at where they may be useful, and when you might consider doing one of the above.

Load Testing is possibly one of the more well known and what often gets confused as Performance Testing full stop, when someone mentions performance testing, it is often assumed that they are talking about load testing, however, unless we dig deeper, assuming something like that can make an ass out of you and me...

Anyway, I digress, Load Testing would be useful when there is a change to the system that can cause there to be an increased amount of load, for instance we recently changed data types from VARCHAR to NVARCHAR, this meant there was double the amount of data being stored in databases and being used in any database call, so we decided its important to do some forms of load testing on the front end, as well as the back end on the SPROCs themselves.

Stress Testing is useful to identify what your system is able to cope with, for example, if you were expecting X number of visitors during a certain period of time, if you know what your break point is, with regards to stress testing, you can safely say that the system can perform under the expected load and then some.

Endurance Testing is useful in identifying memory leaks in a system, if you expect the system to be under heavy loads for a prolonged period of time, it is essential to perform endurance testing to identify any problems that may arise.

Spike Testing as mentioned above is useful when putting a new service live, as you expect a sudden increase in traffic once it goes into production and will be hit with a sudden influx of load.

So, there you have it, some basics about the different types of performance testing, and why it might be important in your project.... Going forward we'll investigate different toolsets for performing the above and when is the best time to do performance testing in an Agile project.

Comments

Popular posts from this blog

Testers: Be more like a Super-Villain!

Who doesn't love a Super Hero? Talk to my son, and he'll tell you how much he loves them, talk to many adults and they'll say the same! Deep down, we all love to be the Super Hero, we all want to save the day! However, I want to talk about the flip side of Super Heroes, the Super Villains... I often play Imaginext with my son, and I (unfortunately?) am nearly always the Super Villain! Be it Lex Luthor, Joker, Two Face, Mr Freeze or The Riddler! These are all great characters and great Super Villains, but why would I want to write about Super Villains? A while ago where I worked, we had a few Super Heroes, people who would be able to come in and "fix" things that had broken and help deliver projects on time. We then shifted, we decided to do away with the Super Hero culture and try and prevent from being in that position in the first place, whilst we didn't go as far as wanting to hire Super Villains, it's definitely a story that has stuck with me and t...

Value in QA Courses/Qualifications?

I have in the past questioned the value in getting certifications/going on courses for the sake of getting a certificate in testing. Whilst I do still question the worth of such an issue, I have recently read some articles which has shown me there is more value in these courses/certificates than I previously gave them credit for. The main positive that I can think of, upon completing a course like an ISEB Foundation, is that it ensures that testers are on the same page when it comes to communicating. A bug is a bug, or if I'm speaking to someone about Integration testing, they know exactly what I am talking about and won't get confused. I think in ensuring that everybody is on the same page when it comes to discussing testing issues/testing activities, it helps in gaining respect and confidence from other teams and other team members, as we are all singing from the same hymn sheet.  It isn't just about communication in the term of words however, it is impor...

Measuring QA Key Skills and Competencies

I have been thinking about how I can help encourage self improvement within my team, as I understand it, everyone wants to improve, it's just that often there are a number of things that hold people back. I believe one of these things that hold people back are around identifying skills that they are perhaps weak in or that they could/should improve on. So I thought about how I can help tackle that problem. One solution that I want to try with people is to identify the key skills for a QA, what key skills should every QA have, or at least what key skills make up a good QA? If I can identify these then I can start helping people identify if they are lacking in an area. Sure there is a competency matrix that we have, but it has things like "An excellent understanding of XXX", it's often very difficult to quantify what an excellent understanding actually is. So I sat down and came up with the following key skills: OOP Test Documentation Manual Testing Automated...