Parallel steps

On this page

Still need help?

The Atlassian Community is here for you.

Ask the community

Parallel steps enable you to build and test faster, by running a set of self-contained steps at the same time.

Before you begin:

  • You can have a maximum of 10 parallel steps per account on the free plan.
  • There is a limit of 100 total number of steps you can run in a pipeline.

  • All environments in a parallel step set must be of the same type, so don’t try to mix production and test environment types in the same set.

  • The total number of build minutes used by a pipeline will not change if you make the steps parallel. You'll be able to see results sooner but the total build minutes used will calculate based on the total time taken on each step.

Steps

There are several ways in which you can use this feature, however, we recommend to follow these guidelines:

  1. Set an initial step to build the software.
  2. Add a set of parallel steps to test the software.
    If you are doing a single build step leading to multiple parallel testing steps, cache external build dependencies as much as possible in the first step, so you don't waste time doing it in each of your testing steps. Then, run all your tests concurrently, they can use cache.
  3. Deploying to multiple similar environments at the same time.
Parallel steps configuration example
pipelines:
  default:
    - step:          # non-parallel step
        script:
          - ./build.sh
    - parallel:      # these 2 steps will run in parallel
        - step:
            script:
              - ./integration-tests.sh --batch 1
        - step:
            script:
              - ./integration-tests.sh --batch 2
    - step:          # non-parallel step
        script:
          - ./deploy.sh

Default variables

If you want to do some fancy logic in your scripts, the following variables are available during the parallel steps:

  • BITBUCKET_PARALLEL_STEP - zero-based index of the current step in the group, e.g. 0, 1, 2, …
  • BITBUCKET_PARALLEL_STEP_COUNT - total number of steps in the group, e.g. 5.

Producing artifacts with parallel steps

Parallel steps can produce and consume artifacts, however, keep in mind the following:

  • Parallel steps can only use artifacts produced by previous steps, not by steps in the same parallel set.
  • Steps after the parallel set will get a combination of all files produced.
  • If parallel steps produce artifacts containing a file at the same location, conflicts are resolved on a per-file basis, the files generated by the latest step in the YAML file will win.

The image below shows how artifacts can be combined.

Image showing that latest versions of files take precedence


Check out the following page to learn more about using artifacts in steps.

Last modified on Aug 30, 2019

Was this helpful?

Yes
No
Provide feedback about this article
Powered by Confluence and Scroll Viewport.