Skip to main content

Datadog

This is a setup guide for the Datadog source connector which collects data from its API.

Prerequisites

An API key is required as well as an API application key. See the Datadog API and Application Keys section for more information.

Setup guide

Step 1: Set up the Datadog connector in Airbyte

For Airbyte Cloud:

  1. Log into your Airbyte Cloud account.
  2. In the left navigation bar, click Sources. In the top-right corner, click +new source.
  3. On the Set up the source page, enter the name for the Datadog connector and select Datadog from the Source type dropdown.
  4. Enter your api_key - Datadog API key.
  5. Enter your application_key - Datadog application key.
  6. Enter your query - Optional. Type your query to filter records when collecting data from Logs and AuditLogs stream.
  7. Enter your limit - Number of records to collect per request.
  8. Enter your start_date - Optional. Start date to filter records when collecting data from Logs and AuditLogs stream.
  9. Enter your end_date - Optional. End date to filter records when collecting data from Logs and AuditLogs stream.
  10. Enter your queries - Optional. Multiple queries resulting in multiple streams.
    1. Enter the name- Optional. Query Name.
    2. Select the data_source from dropdown - Optional. Supported data sources - metrics, cloud_cost, logs, rum.
    3. Enter the query- Optional. A classic query string. Example - "kubernetes_state.node.count{*}", "@type:resource @resource.status_code:>=400 @resource.type:(xhr OR fetch)"
  11. Click Set up source.

For Airbyte OSS:

  1. Navigate to the Airbyte Open Source dashboard.
  2. Set the name for your source.
  3. Enter your api_key - Datadog API key.
  4. Enter your application_key - Datadog application key.
  5. Enter your query - Optional. Type your query to filter records when collecting data from Logs and AuditLogs stream.
  6. Enter your limit - Number of records to collect per request.
  7. Enter your start_date - Optional. Start date to filter records when collecting data from Logs and AuditLogs stream.
  8. Enter your end_date - Optional. End date to filter records when collecting data from Logs and AuditLogs stream.
  9. Enter your queries - Optional. Multiple queries resulting in multiple streams.
    1. Enter the name- Required. Query Name.
    2. Select the data_source - Required. Supported data sources - metrics, cloud_cost, logs, rum.
    3. Enter the query- Required. A classic query string. Example - "kubernetes_state.node.count{*}", "@type:resource @resource.status_code:>=400 @resource.type:(xhr OR fetch)"
  10. Click Set up source.

Supported sync modes

The Datadog source connector supports the following sync modes:

FeatureSupported?
Full Refresh SyncYes
Incremental SyncYes
SSL connectionYes
NamespacesNo

Supported Streams

Reference

Config fields reference

Field
Type
Property name
string
api_key
string
application_key
string
query
string
start_date
string
site
string
end_date
integer
max_records_per_request
array<object>
queries

Changelog

Expand to review
VersionDatePull RequestSubject
1.0.62024-09-2846190Update dependencies
1.0.52024-09-2145771Update dependencies
1.0.42024-09-1445581Update dependencies
1.0.32024-09-0745297Update dependencies
1.0.22024-08-3144992Update dependencies
1.0.12024-08-2444706Update dependencies
1.0.02024-08-1944371Update CDK version and dependencies, remove parameters and migrate to inline schemas
0.4.152024-08-1744313Update dependencies
0.4.142024-08-1243741Update dependencies
0.4.132024-08-1043555Update dependencies
0.4.122024-08-0343141Update dependencies
0.4.112024-07-2742776Update dependencies
0.4.102024-07-2042341Update dependencies
0.4.92024-07-1341783Update dependencies
0.4.82024-07-1041416Update dependencies
0.4.72024-07-0941168Update dependencies
0.4.62024-07-0640985Update dependencies
0.4.52024-06-2540306Update dependencies
0.4.42024-06-2240063Update dependencies
0.4.32024-06-1337590Change last_records to last_record
0.4.22024-06-0439060[autopull] Upgrade base image to v1.2.1
0.4.12024-05-2038424[autopull] base image + poetry + up_to_date
0.4.02023-12-0430999Add monitors and service_level_objectives Streams
0.3.02023-08-2729885Migrate to low code
0.2.22023-07-1028089Additional stream and query details in response
0.2.12023-06-2826534Support multiple query streams and pulling data from different datadog sites
0.2.02023-06-2827784Add necessary fields to schemas
0.1.12023-04-2725562Update testing dependencies
0.1.02022-10-1818150New Source: Datadog