In this chapter, we will learn how to run the test case that we created in Chapter 6: Create Test Case.
But before we begin, please make sure that you have gone through the previous chapters 1 through 5 i.e. “Testsigma Sample Application”, “Create a Project”, “Create UI Identifiers” and “Create Test Case”.
To run a test case, you will need a test machine. Testsigma allows you to run a test case on one of the following Test Labs/Device Vendors:
Third party IaaS Providers - BrowserStack, Saucelabs
To know more about these test lab types, read What are the Test Lab Types available to execute tests in Testsigma?
You can configure your local machine as your test machine and run your test case there. For this approach, refer to the document Setup TestSigma Agent on your device for Hybrid Test Execution. In this chapter, we will run the test on a test machine from Testsigma Lab, which is a test lab on the cloud with 700+ unique test machine configurations with a unique operating system, browser, version, and resolution combinations.
Run the Test Case
Login to your Testsigma account.
2. On the dashboard, go to the “Test Development” section and click on it.
On the Test Cases page that opens, click on the test case you created.
Once the Test case is open, the page should look something like this:
5. Click on the ‘Run Test Case’ button on the top right corner of the test case. Below window should appear:
On this window, you will see that ‘Testsigma Lab’ under ‘Test Lab Type’ is already selected. The OS ‘Windows’ is selected by default. And the browser ‘Google Chrome’ is selected. This means that the test case will run on chrome browser on Windows on Testsigma Lab.
There are other conditions also that are already selected:
OS Version(Android) - the version of the Android system on which the test case will be executed
Version - Version of the browser
Screen Resolution - the resolution of the screen on which the test case will be executed.
Capture Screenshots - for what steps should Testsigma capture screenshots, the options are: “Failed Steps”, “Mandatory”, “All steps”, “None”
Environments - are different testing environments like staging, development, production. You will need to configure them to add values
Page load timeout - The maximum time to wait for a page to load, these can also be configured in the test steps.
Element timeout - The maximum time to wait for an element(on a webpage) to load, these can also be configured in the test steps.
Mandatory steps only - some steps could be marked mandatory and if this is selected, only those test steps will be run while test execution.
Desired capabilities - if you have multiple servers like staging, dev, pre-prod for testing, then these can be configured here.
To run the test case, click on the button “Create and Run” on the bottom right.
View Test Run Results
Test execution starts on clicking on the “Create and Run” button. This creates a test run and executes the test. After the text execution completes, the test result page opens which looks like below:
In the above screenshot, a complete green circle means all the test steps executed successfully. Colors are also decoded on the side. And below there are options “Watch Video”, “Test Step Result”, “Attachments” and “Download Screenshots”.
In the Test result, along with the time and environment of test execution - test priority, test case type, data drive, and message are also displayed. It also shows the user that executed the test case:
To help the tester debug any failures, a test execution video can be accessed under the “Watch Video” tab. As can also be seen in the screenshot below:
Results corresponding to each test step can be accessed under “Test step results” as can also be seen in the screenshot below:
Execution logs can be accessed from the section “Logs” besides the “Test Step Results”. These can be downloaded by clicking on the “Download Logs” button on the right.
Screenshots can also be downloaded from the “Download screenshots” button on the top right of the test steps section, as also can be seen in the screenshot below:
We ran one test case at one time in this chapter. To trigger the execution of many test case at one time, you can learn about Test Suites, Test Plans.
Congratulations! You have successfully completed the getting started tutorial!
Go to the next chapter to learn more about how to Debug and fix the test case failures.
You may now start exploring the other features in Testsigma, we recommend you to go through the same order that we have maintained in this portal menu section.