Once you have created a test case containing a number of test steps for execution, we may choose any of the available execution models such as Testsigma Lab, Hybrid, Sauce Labs or BrowserStack. We will review the process of setting up a Hybrid Execution in this article.

I. Set up the Testsigma Agent on your local PC

II. Create a Hybrid Execution

III. Run the Hybrid Execution

IV. Troubleshooting Hybrid Executions

I. Set up Testsigma Agent on your Local PC

Note: Skip this step if you have already configured Testsigma Agent.

Set up the Testsigma Agent on your local PC where tests are to be executed - Quick setup guide - Setup TestSigma Agent on your device for Hybrid Test Execution(WIndows/Mac/Linux)

II. Create a Hybrid Execution

Navigation: Test Development > Executions

On the Executions page, we can see a list of Executions created by us if any. We will create a new Hybrid Execution here.

1. Click on the Create button to create a new Execution as shown below:

2. Enter the details as specified below:

  • Automation Type: Select Automated / Manual Execution
  • Name: Enter a name for the Execution.
  • Description: Enter a meaningful description for the Execution elaborating about it.
  • Send Notification when: Select the execution states when you would like to be notified on selected notification channels(email, Slack).
  • Email Address: Enter the email addresses to be notified when the tests are performed.
  • Test Lab Type: Select the Test Lab Type from available ones(Testsigma Lab, Hybrid, Sauce Labs, BrowserStack & Private Grid).

Select Hybrid option to create a Hybrid Execution in this case.

  • Execution Type: Select the Execution Type from the available ones(Cross Browser Testing, Parallel Testing, & Custom Execution).

Select Cross Browser Testing which is the default option in this case.

Note: Under Execution Settings and Recovery options, the options are all self explanatory. Make changes only if necessary.

3. Click on +Select Test Suite button, check the Test Suites to be run in the Execution and click on Done to confirm.

4. Click on +Select Test Environment button, choose the required Test Environment(OS, Browser, Version Combo) for the Execution and click on Create to confirm. Click again to add more Test Environments as required.

Note: f you have not added a Local device to Systems earlier, you will get a notification to create a System. In that case, we need to add the local machine(PC, Laptop, or Mac) on which we are going to execute the tests to the list of Systems on your Testsigma Account. Please refer this article to add a local machine as System - How to add/edit/delete System?

After the necessary selections have been made, the Execution looks somewhat as shown below:

5. Click on Create button to create the Execution. Your Execution will be created and added to the list of Executions as shown below:

The execution is created and you can run the Tests now if the Testsigma Agent is configured on your local machine as in Step I - Set up the Testsigma Agent on your local PC.

III. Run the Hybrid Execution

Assuming you have already configured the Testsigma Agent as per the Section I. Set up the Testsigma Agent on your local PC,

1. Open the Testsigma Agent tab or Go to the Testsigma Agent page by going to the URL http://localhost:8080/agent

2. Click on the 'Register Agent' link and confirm the Agent is registered with your Testsigma Login credentials. If not, enter your Testsigma Login credentials there and click on Register.

3. Once registered, switch back to the Testsigma App and go to the Execution page. Click on Run button to start the execution and then go to Run Results to view the results.

3. Now, you may switch back to Testsigma Agent  and click on the 'Executions' link to confirm that the Executions are showing there.

IV. Troubleshooting Hybrid Executions

1. Executions not showing up in Testsigma Agent Executions page

If the current execution is not showing up in the Testsigma Agent > Executions page, please check the following:

a. Refresh the page once and check again.

b. Switch back to Testsigma App to see if the execution has failed. If yes, check the reason for failure.

2. Execution is in 'Queued' status for long time

In case the Execution is still showing 'Queued' status after 5 minutes, please check the following:

a. Confirm that the Testsigma Agent is not outdated. Please refresh the Testsigma Agent - Executions page to confirm there are no outdated agent alerts shown.

b. Confirm the IP and Port in the Testsigma Agent Dashboard page is same as IP and Port for the selected System(Check in Configuration > Systems) in Hybrid Execution.

Smart Test Automation!