Summary

When working with Aggregate Jobs some errors are shown:

Data source aggregate error

An error occurred during execution of SQL statement. 42804: UNION types boolean and character varying cannot be matched

OR

Data source aggregate error
An error occurred during execution of SQL statement. 42601: each UNION query must have the same number of columns

Diagnosis

A Data Source Aggregate job is a way to bring in data from multiple jobs at the same time. Each of these existing jobs must be from a similar data source, and the fields and attributes that are to be aggregated together must be the same.

Solution

When working with a Data Source Aggregated Job, we should not use individual data sources. Instead, these individual data sources should be ignored or disabled in the Data Manager and not treated as separate data sources.

Here's an example using Active Directory (AD):

• Consider an organization with multiple Active Directory (AD) instances, such as:
  • AD_Asia
  • AD_US
  • AD_Eur

If we import these instances separately using the cleanse and import process, they would be treated as three distinct data sources within the Data Manager. However, the goal is to aggregate them into a single AD data source.

Suggested Approach:

1.  Create separate Adapter jobs to extract data from each AD instance (AD_Asia, AD_US, AD_Eur).
2. Use an Aggregate job to combine the extracted data from all three sources into one unified AD data source.
3. Cleanse and import only the aggregated AD data source into the Data Manager.
4. Disable the individual AD data sources in the Data Manager to avoid duplication or conflicts. By following this approach, we ensure that only the aggregated data source is used for processing and maintaining data integrity and consistency.

How to disable a data source:

1. Access the link https://YOUR-SITE.atlassian.net/jira/servicedesk/assets/data-manager/#/basedata/datasource
2. Find the data source to be disabled and click the three dots.
3. Turn off the "Enabled" button.