Quarantining failing tests

There may be times when you want to prevent a failing test from causing the whole build to fail.

Possible scenarios where this may be useful include:

  • You want to build an artifact despite there being a failing test, but can't do this while the plan build is failing.
  • In test-driven development (TDD), a test will fail until the functionality is implemented - you want to quarantine all but the relevant tests.
  • A test may give unpredictable results, perhaps because of infrastructure issues or dependencies.
  • You want to remove a test from a build, but don't want to alter or delete the test source code because doing so could affect another Bamboo plan.

In Bamboo, you can temporarily disconnect any test's results from the plan build results by quarantining the test. The test is still run whenever the plan is built, but the test's results do not affect the plan's build results.

You can always restore a test's results to the build results when required, for example if the test is now passing.

All the quarantined tests for a plan are displayed on the Quarantined Tests tab of the plan summary. The status bar for each test shows the recent build history of the test.

To quarantine a failing test

You need plan administrator permission to quarantine a test.

  1. Choose Dashboard > All Plans > #buildresult to go to the build result where the test is failing.
  2. Click Quarantine for the failing test (in the 'Build Result Summary' screen).

To restore a quarantined test to a build

You need plan administrator permission to restore a test.

  1. Choose Dashboard and click on a plan to go to the plan's summary.
  2. Click the Quarantined Tests tab.
  3. Click Unleash for the test to be restored.

Screenshot: The quarantined tests for a plan, showing the Status bar.

Was this helpful?

Thanks for your feedback!

Why was this unhelpful?

10 Archived comments

  1. User avatar


    If you have one or more quarantined tests, the outcome of the task will be changed to success if there are no unquarantined tests failing.  This can be a problem because if there is a compilation failure, the task will still be reported as a success!  This is currently a bug in Bamboo.  

    Fortunately, there is a work around to this issue.  Instead of using a single task to perform your build and parse the test results, use the JUnit parser task to parse the test results.  This will ensure that compilation failures will still fail your build.

    26 Jun 2012
  2. User avatar

    Eric White

    Bamboo might not fail the build, but maven still does.  Can this feature integrate with maven?  If not, then it has limited usefulness.

    15 May 2013
  3. User avatar

    Donal Ward

    Can quarantine be configured in such a way that if a test case is put in quarantine, it will not be executed by any other bamboo plan? Is a way to send a test case to the quarantine even if did cause a build failure

    15 Jul 2013
  4. User avatar


    I think that permissions should be changed so it does not require an admin to quarantine tests. 

    20 Aug 2013
    1. User avatar


      I strongly agree:  developers should be able to quarantine a test.  On my project we never use this feature, even though it's intended to solve a problem we have all the time.  That's because developers are responsible for analyzing and fixing broken tests, and we have access to comment out a failed test but not to quarantine it.

      I wonder if Atlassian has really thought this through:  "In test-driven development (TDD), a test will fail until the functionality is implemented - you want to quarantine all but the relevant tests" and yet "You need plan administrator permission to quarantine a test."  Is it assumed that someone doing test-driven development generally has administrator permission?

      21 Aug 2013
    1. User avatar

      Tomas Vala

      Agreed. User can't even access sibling functions "Create JIRA issue" and "Link with JIRA issue" without admin permission, that's inconvenient to say the least.

      21 Feb 2014
      1. User avatar

        John Costello

        I strongly agree with this – test team members who are triaging test failures need to be able to create issues and link issues but they almost never need full administrator permissions (and sometimes should definitively not have them, for business-process-related compliance purposes).

        05 Nov 2014
      1. User avatar

        John Costello

        People who agree with us can help by voting for this issue:  BAM-15060 - Create JIRA Issue from failed test is only available to Plan Admins Open

        05 Nov 2014
  5. User avatar

    Jupp Müller

    It would be nice if there were notification options, ie sending a mail when a previously quarantined test that failed now passes.

    13 Aug 2014
  6. User avatar

    Andrew Bilukha

    We completely support the use case, where the ability to quarantine and take off the quarantine should be given to anyone with build run permissions.

    22 Jan 2015
Powered by Confluence and Scroll Viewport