Skip to main content

Performance Testing 101

So one of my objectives is to be able to offer more in regards to Performance Testing.

Whilst I understand the basics, I figured I'd write them down and start a series of blog posts hopefully detailing my findings and explaining why performance testing is important, and the different types of performance testing.

In order to understand why performance testing is important, it will be good to know some of the more popular types of performance testing are....

Load Testing
This is testing a system to understand and analyse the behaviour of a system under a specific expected load. This is probably the most common form of performance testing, it is useful in identifying any bottlenecks in a piece of software. 

Stress Testing
This is testing a system to breaking point, so that you can understand the point at which the system fails and under what load.

Endurance Testing
Similar to load testing, but this will be load under a prolonged period of time, in order to gain confidence that the system can perform under loads for a long period and measuring the performance of the system.

Spike Testing
This is achieved by a sudden increase in load against a system, to make sure that it can handle the sudden increase in users, an example would be of a new system going into production that suddenly has to deal with a huge influx of users.

When might you use one of the above?
Now you have a basic understanding of some of the different types of performance testing, we can now look at where they may be useful, and when you might consider doing one of the above.

Load Testing is possibly one of the more well known and what often gets confused as Performance Testing full stop, when someone mentions performance testing, it is often assumed that they are talking about load testing, however, unless we dig deeper, assuming something like that can make an ass out of you and me...

Anyway, I digress, Load Testing would be useful when there is a change to the system that can cause there to be an increased amount of load, for instance we recently changed data types from VARCHAR to NVARCHAR, this meant there was double the amount of data being stored in databases and being used in any database call, so we decided its important to do some forms of load testing on the front end, as well as the back end on the SPROCs themselves.

Stress Testing is useful to identify what your system is able to cope with, for example, if you were expecting X number of visitors during a certain period of time, if you know what your break point is, with regards to stress testing, you can safely say that the system can perform under the expected load and then some.

Endurance Testing is useful in identifying memory leaks in a system, if you expect the system to be under heavy loads for a prolonged period of time, it is essential to perform endurance testing to identify any problems that may arise.

Spike Testing as mentioned above is useful when putting a new service live, as you expect a sudden increase in traffic once it goes into production and will be hit with a sudden influx of load.

So, there you have it, some basics about the different types of performance testing, and why it might be important in your project.... Going forward we'll investigate different toolsets for performing the above and when is the best time to do performance testing in an Agile project.

Comments

Popular posts from this blog

Coding something simple.... or not! Taking a screenshot on error using Selenium WebDriver

I recently wrote a little function that takes a screenshot at the end of a test if it has errored. What sounded very simple at the start turned out to be quite a bit of work, and quite a few lines of code to handle certain scenarios! It's now over 50 lines of code! I'll start with what I had at the beginning, this was to simply take a screenshot in the working directory, we are using SpecFlow and Selenium to run the tests, so we are going to check if the ScenarioContext.Current.TestError isn't null, if it is, then using Selenium, take a screenshot (note the below code is a simplified version of what I had at the beginning). [AfterScenario]         public static void TakeScreenShotOnError()         {             if (ScenarioContext.Current.TestError == null) return;             var screenshotDriver = Driver as ITakesScreenshot;             if (screenshotD...

How to manage resources within new teams?

Working where I work we are constantly spinning up new teams to take on new workloads as business come up with new demands and new features they want developed and tested. The problem with this is how do we ensure the work of the newly spun up team is of sufficient quality. One method is by taking people from other established teams and placing them on the new team. This works great for the new team, but unfortunately it will oftenl eave the established team lacking in a resource whilst they try and fill the gap left by the person who has left. We are seeing this often with our offshore teams, it can be damaging to the team structure and the teams velocity, but try as I might, I can't think of another way around it. It's far easier to take 1 person from a team that is established than it is to build a whole new team from scratch. At least by leaving the core of a team in place, you should be guaranteeing that the new team are aware of any coding standards or any QA standard...

Considerations when creating automated tests

We recently released to a number of teams our automated regression pack that has been worked on over the past few months. This regression pack tests legacy code, but contains a large number of tests.  As a bit of background, a number of teams are working on new solutions whilst some are still working on legacy code. With this in mind we constructed an email with a list of guidelines when creating new tests that need to be added to this regression pack.  I figured that these can be quite broad so should apply for any organisation, so thought it would make an interesting blog post...  So here goes,  when creating automated tests, it's important to consider and adhere to the following: - Think about data . The tests need to retrieve or set the data they need without any manual intervention - This should help them be more robust and easier to run without manual intervention. - The tests need to be idempotent - By making it so that each test is standalone and does...