sink_overview.md

Sinks

Sinks are destinations for metadata.

In general, the sink will be defined in the recipe after the source like below.

source: ...

sink:
  type: <sink_type>
  config: ...

Types of Sinks

When configuring ingestion for DataHub, you're likely to be sending the metadata to DataHub over either one of the following.

• REST (datahub-rest)
• Kafka (datahub-kafka)

For debugging purposes or troubleshooting, the following sinks can be useful:

• Metadata File
• Console

Default Sink

Since acryl-datahub version >=0.8.33.2, the default sink is assumed to be a datahub-rest endpoint.