Skip to content

Azure DevOps pipelines

Run elevaite365 scenarios from an Azure DevOps pipeline and get the results back as an Azure Test Plan.

The integration is three steps:

  1. Install the elevaite365 Scenario Execution extension
  2. Export your scenarios to a YAML file
  3. Create a project and pipeline in Azure DevOps

Two ways to reach elevaite365 from CI/CD

This extension is the quickest route for Azure DevOps. If you are on a different CI system, or want more control over the flow, use the External API directly.

Want results in Test Plans?

This page gets scenarios running from a pipeline. To push pass and fail results back into Azure DevOps Test Plans, also set up the Test Plans integration.

1. Install the extension

  1. Open the elevaite365 Scenario Execution extension on the Visual Studio Marketplace.
  2. Select Get it free.

The extension on the Visual Studio Marketplace

  1. Log in using your Microsoft credentials.
  2. Select the Azure DevOps organization where the extension will be installed.

Selecting the Azure DevOps organization

Admin privileges

Acquiring an extension needs admin rights on the organization. If you do not have them, the same screen lets you submit a request to your organization's admin.

2. Export scenarios to YAML

Create an API key

You need an elevaite365 API key for DevOps. If one already exists, skip to exporting.

  1. In elevaite365, select your organization name in the upper-right corner.
  2. Go to Organization Settings.

The Organization Settings menu item

  1. If no keys are listed, select Create New API Key.

The API Keys section of Organization Settings

  1. Enter a name for the key and click Create.

Naming the new API key

  1. Click the copy icon to copy the key.

Copying the generated key

You only see the key once

Save it somewhere secure immediately. The key cannot be retrieved again after you close this dialog. If you lose it, create a new one.

  1. Click Done.

Export the scenarios

  1. From the elevaite365 menu bar, select the Scenarios tab.

The Scenarios tab in the menu bar

  1. Select the checkboxes next to the scenarios you want to run in DevOps.
  2. Click the three dots in the upper right and select Export YAML (Azure).

Export YAML (Azure) in the scenarios menu

  1. Enter a pipeline name. This is optional.
  2. Select the API key.
  3. The selected scenarios appear in the dialog. Drag and drop them into the order you want them to execute.
  4. Select Export YAML.

The Export YAML dialog

  1. Open the downloaded YAML file in a text editor and copy the contents. You will paste this into Azure DevOps.

3. Create a project and pipeline

  1. Navigate to Azure DevOps.
  2. Create a project. Enter a project name and click Create project.

Creating an Azure DevOps project

  1. From the left sidebar select Pipelines, then Create Pipeline.

The Create Pipeline button

  1. Select Azure Repos Git.

Choosing where your code lives

  1. Select a repository.

Selecting a repository

  1. Select Starter pipeline, or Existing Azure Pipelines YAML file if you already have one.

Configuring the pipeline

  1. Paste the contents of the elevaite365 YAML file, replacing the existing pipeline YAML.

Reviewing the pipeline YAML

  1. Save.
  2. Select Run, and choose how the pipeline should execute, for example on a schedule or from a trigger.

When the pipeline runs, a Test Plan is created in Azure DevOps with the results.

For control over which plan and suite results land in, and over how tests map to Test Cases, configure the Test Plans integration.

Keeping the pipeline current

Re-export after changing scenarios

The YAML is a snapshot. If you update a scenario in elevaite365, or add a new one, export a fresh YAML file and replace the contents of your existing pipeline YAML in Azure DevOps. The pipeline will not pick up the change on its own.