Ask Us
SandStorm Cloud offers performance testing from cloud. It provides a web-based management console to design, execute and analyze performance tests. It leverages cloud to provision load generation environment at runtime and execute performance tests.
How It Works
The above image depicts how the solution works. The solution has two major components:
1. Recorder
- Deployed locally in user's network
- Used for test script development
- Locally developed scripts are uploaded to cloud platform
2. SandStorm Cloud platform
- Web application to design, execute and analyze tests
- Simulate geographies including US, Europe, APAC etc.
- Provisions load generation hardware at runtime
Salient Features
Generate realistic load
- Scale from 50 virtual users up to 1 Million with zero hardware infrastructure
- Test from multiple geographical locations
- Browser and cache emulation
Get insightful reports
- Real-time dashboards
- Over 20 reports and graphs including transactions, web, system resources statistics
- Superimposition of graphs for cross analysis
- Export raw results in excel for custom analysis
Accelerate performance bottleneck identification
- Integrated system and application monitoring for popular app, database, OS etc
- AppDynamics plug-in to identify slow methods and queries from performance test results
Reduce scripting time
- Record and playback
- User interface for dynamic parameter handling
- Automated cookie handling
- Automatic and Manual correlation
Achieve continuous performance management
- Jenkins plug-in for continuous performance testing for release builds
Easy to setup and get started
- No load generation environment
- Single click Recorder installation
- Install Recorder on multiple machines for Free
FAQ
The licensing is available in following two options. The cost depends on the test duration and number of concurrent virtual users per hour.
Monthly subscription: This is limited to 40 hrs of test time with max of 20 scenario runs with each run limited to 2 hrs.
Pay-as-you-go (On demand): There is no limitation in test time, number of scenarios and execution time in On-Demand model
Monthly subscription: This is limited to 40 hrs of test time with max of 20 scenario runs with each run limited to 2 hrs.
Pay-as-you-go (On demand): There is no limitation in test time, number of scenarios and execution time in On-Demand model
Every partial hour is charged as the full hour. So, if a test exceeds an hour the charge for the next hour is also applied.
No, there are no hidden costs besides per hour cost for test execution. If there are any professional services that are involved like test script creation, parameterization, scenario design and execution, result analysis then professional services charges are applicable separately.
The test scripts are stored on the machine where they are recorded. For execution, the test scripts are uploaded on the platform. All the test data and results are stored in the application and the user can access it via the SandStorm web interface.
Test data and results are stored in the application after the test is over.
Yes, Test scripts & test results can be downloaded from the application.
We retain test assets for a month in our application. In case of requirements for keeping the data for longer period, please get in touch with us.
Test assets, data and results for 1 user cannot be accessed by other users. We have proper authorization mechanism and the users have access to their data only.
The users can share the feedback using the Feedback option on the application. Also, you can send your suggestions, issues to sandstorm@impetus.com
The evaluation credentials are valid for 1 month. Once the user starts using the application commercially, the credentials are renewed every 15 days.
If there are any test failures during the execution and it does not get complete, you will still be able to recover test results up to the point of failure
There are 2 possible ways of performance testing applications behind the firewall from a cloud platform
- Port forwarding: Expose the internal URL to public access using port forwarding. The external link will be mapped internally to the application
- Allow firewall exclusions to the load generators that will be accessing your application.
Yes, you can select the geographies from which you wish to generate the load during scenario design. The current geographies that are available for load generation include US, Europe, Asia Pacific & Australia.
Yes, the cloud edition has a feature to allow user to monitor resources during test execution.
SandStorm On-premise is an enterprise performance testing tools that is installed in a user's network. It has different components that help in developing test scripts, design and execute test scenarios. The user can install different components in a heterogeneous manner as per the requirement.
How It Works
The above image depicts how the solution works. The solution has four major components:
1. Recorder
- Used for test script development
- Simulate end user workflows
- Parameterization and script editing
2. Controller
- Design realistic test scenarios
- Provide test configurations
- Monitor and SLA configurations
3. Command Launcher
- Distributed load generation
- Provides runtime environment to virtual users
4. Analyzer
- Comprehensive test result analysis
- Multiple report formats
- Export raw results
Salient Features
Generate realistic load
- Browser and cache emulation
- Emulate different network conditions like 3G, 4G etc.
Get insightful reports
- Real-time dashboards
- Over 20 reports and graphs including transactions, web, system resources statistics
- Superimposition of graphs for cross analysis
- Automatic generation of PDF summary report
Accelerate performance bottleneck identification
- Integrated system and application monitoring for popular app, database, OS etc
- AppDynamics plug-in to identify slow methods and queries from performance test results
Reduce scripting time
- Record and playback
- User interface for dynamic parameter handling
- Automated cookie handling
- Automatic and Manual correlation
Achieve continuous performance management
- Automated performance testing using command line interface
Leverage cloud for scalability testing
- Re-use test scripts for scale testing using SandStorm Cloud
FAQ
For SandStorm on-Premise edition there are two licensing options:
Rental:Based on the number of virtual users and duration. The minimum duration is 1 month.
Lifetime: Based on the number of virtual users
Rental:Based on the number of virtual users and duration. The minimum duration is 1 month.
Lifetime: Based on the number of virtual users
Yes, SandStorm can be used to test the server side performance of mobile applications. Please visit Solutions > Mobile performance testing for more details.
Yes, SandStorm can be used to directly record the traffic from a mobile device. We need to set the proxy on the mobile device and make sure that it runs of WIFI. The device and the SandStorm Recorder must be in case subnet.
Yes, SandStorm can be used to record http traffic via the corporate proxy servers
A valid licence is required for running the Controller. Recorder and Analyzer can be used even after the license is expired.
SandStorm Recorder uses port "8000" to capture the http traffic and create test script.
Yes, SandStorm can be installed on 64 bit operating systems. These installers can be made available on demand as per the request.
Result aggregation is used to aggregate results every few seconds for a high concurrent scenario. The details for each and every transaction are not captured.
Yes, the percentile value can be specified while opening the result file. The graphs and reports are then generated accordingly.
Yes, scenario execution can be triggered from a CI tool like Jenkins. The SandStorm command line interfaces can be used for this purpose.
This depends on the complexity and size of the test script. Usually, for a test script with 5-7 transactions, we can generate 1200-1500 virtual users from a 2 GB RAM machine with dual core processor.
Yes, SandStorm supports all the browsers on which we can set the proxy. For Mozilla and IE, SandStorm provides automated proxy configuration from the Recorder. For the others, we need to configure the proxy manually.
In such situations where a firewall exists between controller and load generators, the port for communication between the two has to be allowed for communication.
Analyzer reports are by default generated in HTML. They can be exported to CSV, PDF and XML.
No, SandStorm doesn't currently support importing of external data into the results.
Yes, SandStorm can be used to emulate different browsers during the load test.
Yes, SandStorm has in built monitoring capabilities for most of the popular OS, Web, App and DB servers.
Yes, SandStorm supports AJAX, FLEX, Silverlight and other RIA technologies.
In order to upgrade to a new version of SandStorm, you need to uninstall the previous version and then install the new one. Before uninstalling the previous version, please take a back of all the test assets.
Yes, automated e-mail notifications can be configured during scenario execution for transaction and monitor SLA.
No, there is no need to install complete SandStorm on the load generators. We can only install the load generator component on these machines.