Control-M for Dbt - Documentation for Helix Control-M Integrations

The DBT (Data Build Tool) job is a cloud-based computing platform that enables you to develop, test, schedule, document, and analyze data models.

Control-M for DBT enables you to do the following:

  • Connect to any DBT endpoint from a single computer with secure login, which eliminates the need to provide authentication.
  • Integrate DBT jobs with other Control-M jobs into a single scheduling environment.
  • Execute DBT jobs and override the predefined DBT job commands.
  • Monitor the status, results, and output of DBT jobs in the Monitoring domain.
  • Attach an SLA job to your DBT jobs.
  • Introduce all Control-M capabilities to Control-M for DBT including advanced scheduling criteria, complex dependencies, Resource Pools, Lock Resources, and variables.
  • Run 50 DBT jobs simultaneously per Agent.

Setting up Control-M for DBT

This procedure describes how to install the DBT plug-in, create a connection profile, and define a DBT job in Helix Control-M and Automation API.

Before you Begin

  • Verify that Automation API is installed, as described in Setting up the API.
  • Verify that Agent version 9.0.21.080 or later is installed.

Begin

  1. On the Agent host, set the Java environment variable by running one of the following commands through a command line:
    • Linux:
      • Bourne shell/bash: export BMC_INST_JAVA_HOME=<java_11_directory>
      • csh/tcsh: setenv BMC_INST_JAVA_HOME <java_11_directory>
    • Windows:  set BMC_INST_JAVA_HOME="<java_11_directory>"
  2. Run one of the following API commands:
    • For a fresh installation, use the provision image command:
      • Linux:  ctm provision image DBT_plugin.Linux
      • Windows: ctm provision image DBT_plugin.Windows
    • For an upgrade, use the following command:
      ctm provision agent::update
  3. Create a DBT connection profile in Helix Control-M or Automation API, as follows:
  4. Define a DBT job in Helix Control-M or Automation API, as follows:

Note

To remove this plug-in from an Agent, follow the instructions in Removing a Plug-in. The plug-in ID is DBT042023.

Sarah Jenkins

Sarah Jenkins

Senior Technology Editor & AI Specialist

Sarah Jenkins is a veteran tech journalist with over 12 years of experience covering artificial intelligence, mobile innovations, and digital ethics. Her insights have appeared in leading technology publications worldwide.

Share this article
Twitter Facebook Pinterest