Jira Data Center Performance

This document describes the performance tests conducted on Data Center within Atlassian and the results we found.

We aimed to test concurrent load - hoping that as we increased the number of users, we saw better overall performance compared to the same number of users in a server instance.

You can compare these data points to your own implementation to predict the type of results you might expect from implementing Data Center in your own organization.

We started our performance tests by determining what Jira Server's baseline number is. We determined this by putting Jira Server under different level of loads until we saw a sizable decrease in performance. We then installed Data Center onto the same hardware and ran the same set of performance tests. 

Further below you will find more detailed information on hardware specs, load statistics, response times, and our testing methodology.


tip/resting Created with Sketch.

With every Jira release, we now publish a performance and scaling report. See Jira performance and scale testing



Testing results summary

  • Under a high load, clustered Jira has improved performance overall.
  • Throughput and capacity show a near linear increase as nodes are added to the cluster.
  • Specific actions show varying improvement in response times. For details, please see Testing results for specific actions.
  • You might observe a different trend/behavior based on your configuration and usage. For details, please see What we tested.

Testing methodology and specifications

The following sections detail the testing environment and methodology we used in our performance tests.

How we tested

Our performance tests were all run on the same controlled isolated lab at Atlassian. For each test, the entire environment was reset and rebuilt. The testing environment included installing the following components:

  • Apache load balancer 
  • Postgres database and the required data
  • Clustered Jira on one, two, or four machines as required for the specific test
  • Chrome browser on 'x' number of machines as required to generate the load for the specific test

To run the test, we used a number of machines in the lab to generate load using scripted browsers and measuring the time taken to perform an action. An action here, means a complete user operation like adding comment. Each browser was scripted to perform an action from a predefined list of actions and immediately move on the to next action (i.e. zero think time). Please note that this resulted in each browser performing more tasks than would be possible by a real user and you should not interpret the number of browsers to be equal to the number of real world users. Each test was run for 20 minutes, after which statistics were collected.

What we tested

  • All tests used the same Postgres database containing:
    • 550 projects
    • 628 custom fields
    • 450,000 issues
    • 10,000 users in total
  • The mix of actions we included in the tests represented a sample of the most common user actions* representing three typical types of users: Issue Browser, Issue Creator and Project Manager. The table below show the ratio of actions performed by each of these users. These user-based actions were repeated until the test was completed.
Operation
Issue Browser
Issue Creator
Project Manager
View Dashboard551015
View Issue605510
Browse Project202020
Issue Search20200
Edit Issue252
Add Comment225
Search All101010
Search Large5510
Search Small5510

* The tests do not include admin actions as these are assumed to be relatively infrequent. 

Hardware

All performance tests were all run on the same controlled, isolated lab at Atlassian using the hardware listed below.

HardwareDescriptionHow many?

Rackform iServ R304.v3

CPU: 2 x Intel Xeon E5-2430L, 2.0GHz (6-Core, HT, 15MB Cache, 60W) 32nm

RAM: 48GB (6 x 8GB DDR3-1600 ECC Registered 2R DIMMs) Operating at 1600 MT/s Max

NIC: Dual Intel 82574L Gigabit Ethernet Controllers - Integrated

Controller: 8 Ports 3Gb/s SAS, 2 Ports 6Gb/s SATA, and 4 Ports 3Gb/s SATA via Intel C606 Chipset

PCIe 3.0 x16: Intel X540-T2 10GbE Dual-Port Server Adapter (X540) 10GBASE-T Cat 6A - RJ45

Fixed Drive: 240GB Intel 520 Series MLC (6Gb/s) 2.5" SATA SSD

Power Supply: 600W Power Supply with PFC - 80 PLUS Gold Certified

20

Arista DCS-7050T-36-R4PORT SFP+ REAR-TO-FRONT AIR 2XAC1
HP ProCurve Switch1810-48G 48 Port 10/100/1000 ports Web Managed Switch1

Hardware testing notes:

  • In order to quickly put more stress on the Jira nodes with less load, cluster nodes were set to use only 2 cores out of 6 from each CPU, thereby reducing its processing power to one-third.
  • For Jira instances being tested, 9 GB of memory was allocated to the JVM consistently across all tests. This may not be optimized for all cases but allowed for consistency and comparability between the tests. 
  • During the tests we did not observe high CPU or IO load on either the database or load balancer servers.
  • During the tests we did not observe running out of HTTP connections in the load balancer or connections to database.
  • The browser and servers are in the same location so there was very low latency between client and server.

Testing results for specific actions

The following tables show the relative performance of the various actions in the tests as the load increases for each Jira instance configuration: Jira Server (one node equivalent), two node Data Center, and four node Data Center. Each table shows the response time relative to the baseline response time which we determined to be Jira Server with six browsers. 

Average for all actions

BrowsersJira Server2 node4 node
6100.00%97.63%99.41%
12109.92%99.55%100.35%
18137.32%108.30%107.79%
24178.13%122.64%120.54%
36259.39%129.68%113.31%
48336.33%157.54%123.83%
60447.72%190.16%125.77%
72577.57%223.79%135.91%
84590.47%264.84%147.04%
96681.24%313.20%161.61%
120986.29%394.29%194.44%
1441067.97%483.54%231.73%

Edit Issue

BrowsersJira Server2 node4 node
6100.00%97.98%100.27%
12119.82%108.28%103.99%
18156.21%116.12%113.90%
24215.45%133.92%125.92%
36330.24%148.21%119.67%
48447.96%188.60%134.30%
60607.33%238.56%143.38%
72776.20%286.16%155.23%
84818.90%342.68%173.00%
961063.00%403.19%194.96%
1201598.56%565.08%244.13%
1441688.77%687.53%293.61%

Add Comment

BrowsersJira Server2 node4 node
6100.00%94.20%95.75%
12114.67%100.81%97.57%
18139.09%109.38%103.83%
24179.78%122.22%117.59%
36260.49%133.38%111.90%
48379.78%162.47%125.01%
60507.62%201.25%124.67%
72718.05%237.92%140.50%
84660.83%293.28%149.58%
96840.17%354.80%168.17%
1201381.26%469.93%204.08%
1441413.76%570.71%251.35%

Browse Project

BrowsersJira Server2 node4 node
6100.00%79.41%79.21%
12116.55%82.64%82.42%
18158.18%91.11%88.24%
24220.40%104.56%98.88%
36356.34%123.76%96.58%
48491.48%173.63%107.47%
60659.75%227.44%115.75%
72834.75%286.28%131.55%
84888.91%362.51%154.61%
96930.16%452.95%178.92%
1201442.93%571.17%238.08%
1441662.80%705.98%301.82%

Search that returns less than 50 issues

BrowsersJira Server2 node4 node
6100.00%100.82%100.61%
12113.41%104.47%104.06%
18140.66%113.85%112.05%
24182.50%127.73%124.44%
36275.71%137.37%116.22%
48358.93%171.67%129.92%
60488.90%207.66%128.43%
72614.09%247.31%146.45%
84622.33%296.83%159.23%
96757.55%352.28%175.98%
1201141.50%454.47%214.49%
1441300.34%557.60%258.20%

View Issue

BrowsersJira Server2 node4 node
6100.00%101.22%103.82%
12107.11%101.86%103.44%
18127.01%109.92%110.22%
24155.76%123.45%122.76%
36196.87%126.12%116.52%
48242.91%142.18%123.71%
60317.13%159.44%125.37%
72411.03%177.93%130.27%
84413.06%201.73%136.61%
96496.37%229.18%144.99%
120740.60%277.99%163.38%
144796.60%334.75%184.49%

Issue Search (search by issue ID)

BrowsersJira Server2 node4 node
6100.00%100.89%105.29%
12109.61%102.08%104.19%
18135.45%110.86%111.02%
24176.18%124.19%122.15%
36234.05%133.67%118.15%
48299.84%155.20%124.64%
60394.66%182.18%130.64%
72519.33%207.54%135.92%
84539.22%239.95%148.16%
96615.94%277.13%159.66%
120933.86%348.23%184.66%
1441030.52%418.95%214.84%

View Dashboard

BrowsersJira Server2 node4 node
6100.00%98.43%98.88%
12110.66%105.67%104.63%
18135.56%118.87%120.23%
24167.02%142.08%141.98%
36204.21%129.91%119.86%
48252.82%159.80%145.79%
60323.35%177.79%133.61%
72413.18%201.61%155.90%
84416.77%230.13%154.53%
96526.65%262.53%174.27%
120697.47%312.61%200.08%
144863.23%384.14%233.81%

Search that returns all issues

BrowsersJira Server2 node4 node
6100.00%96.34%98.07%
12113.79%102.10%101.99%
18151.62%112.81%111.22%
24207.04%130.05%127.50%
36367.99%140.95%117.32%
48487.86%180.38%131.27%
60682.55%239.24%131.74%
72872.30%289.60%146.17%
84899.12%354.19%161.70%
961097.92%435.01%184.08%
1201484.46%567.04%232.11%
1441665.42%731.34%293.27%

Search that returns more than 45,000 issues

BrowsersJira Server2 node4 node
6100.00%98.93%99.36%
12112.69%102.01%102.56%
18151.92%111.17%112.01%
24222.94%127.98%125.49%
36425.99%141.29%114.85%
48572.35%196.86%130.77%
60764.37%270.30%132.00%
72987.87%355.97%150.90%
84998.83%428.49%172.20%
961035.99%530.10%201.53%
1201314.94%698.98%275.21%
1441347.68%849.63%354.15%

Ready to get started? 

Get going with Data Center straight away.

Last modified on Aug 26, 2019

Was this helpful?

Yes
No
Provide feedback about this article
Powered by Confluence and Scroll Viewport.