A load test, when conducted before a web site goes live, helps in detecting and responding to scalability and performance problems much before the user is aware of such issues. Executing a load test from the cloud offers the following benefits:
1. Zero administration costs that would have otherwise incurred due to setting up an infrastructure for performance monitoring and load test generation.
2. A sub optimal performance infrastructure skews the results of a load test. However, when using cloud test tools, such issues don’t arise.
3. Measure the perceived end user’s response time of the application across DSL, cable, dial up, 3G and T1/T3 connections.
The Tools
SOASTA CloudTest provides load testing as a service. CloudTest is available in two forms a) as a service and b) as an appliance. Both these offerings can be used to test an application hosted in an enterprise behind a firewall or a web application hosted in a cloud (such as Amazon EC2).
Monitoring is done in two modes, using an agent or in agent-less mode. In agent mode, an installation of the agent (called a conductor in CloudTest Terminology) on the target server is required which would collect the data and transfer to the CloudTest Appliance or Service over HTTPS connection. While CloudTest enables easy creation and execution of load tests, it also provides visually appealing reports of the test results. The test results can be searched by message or error or by value, simplifying the post mortem analysis on performance bottlenecks. If your web application is hosted in San Francisco area how do you know what is the response time perceived by a user accessing in Beijing, China? CloudTest does not help in such situations. Here’s where testing tools from Keynote Systems help.
Keynote Systems has various products that are offered as a Service, from generation of tests, monitoring, diagnosing transactions to reliable alerting. Keynote Systems provides visually appealing reports, easy creation and tear down of load tests. However the value proposition is from their unique offerings,
1. The ability to execute a load test on a web application from a location in their global network which, includes approximately 240 cities across the globe with more than 2400 computers, obviously such a test would paint a real picture of the end user’s experience across various geographic locations.
2. Combine the above with the ability to measure application response time across various connection channels such DSL, 3G and T1/T3 among others, provides a comprehensive coverage of the end user’s experience across various channels.
Keynote KITE offers a free version that will allow you to execute tests from five different cities. However, testing from more locations would involve licensing.
Other articles of possible interest:
The Platform as a Service (PaaS) landscape
What does Oracle cloud offering mean to the enterprise
A list of on demand message queue (MQ) providers
ServiceNow, a SaaS offering of ITIL