Snowbridge monitoring configuration

Snowbridge comes with configurable logging, pprof profiling, statsD statistics and Sentry integrations to ensure that you know what's going on.

Logging

Use the log_level parameter to specify the log level.

hclassets/docs/configuration/monitoring/log-level-example.hcl

loading...

View on GitHub

Sentry Configuration

hclassets/docs/configuration/monitoring/sentry-example.hcl

loading...

View on GitHub

StatsD stats receiver configuration

hclassets/docs/configuration/monitoring/statsd-example.hcl

loading...

View on GitHub

End-to-end latency configuration

Snowplow Enriched data only:

hclassets/docs/configuration/metrics/e2e-latency-example.hcl

loading...

View on GitHub

Metric definitions

Snowbridge sends the following metrics to statsd:

Metric	Definitions
target_success	Events successfully sent to the target.
target_failed	Events which failed to reach the target, and will be handled by the retry config. Retries which fail are also counted.
message_filtered	Events filtered out via transformation.
failure_target_success	Events we could not send to the target, which are not retryable, successfully sent to the failure target.
failure_target_failed	Events we could not send to the target, which are not retryable, which we failed to send to the failure target. In this scenario, Snowbridge will crash.
min_processing_latency	Min time between entering Snowbridge and write to target.
max_processing_latency	Max time between entering Snowbridge and write to target.
min_message_latency	Min time between entering the source stream and write to target.
max_message_latency	Max time between entering the source stream and write to target.
min_transform_latency	Min time between start and completion of transformation.
max_transform_latency	Max time between start and completion of transformation.
min_filter_latency	Min time between entering Snowbridge and being filtered out.
max_filter_latency	Max time between entering Snowbridge and being filtered out.
min_request_latency	Min time between starting request to target and finishing request to target.
max_request_latency	Max time between starting request to target and finishing request to target.
sum_request_latency	Sum of request times, use with target_request_count to calculate average request latency.
target_request_count	Number of requests sent to target, use with sum_request_latency to calculate average request latency.
min_e2e_latency	Min time between Snowplow collector tstamp and finishing request to target. Enabled via configuration - Snowplow enriched data only.
max_e2e_latency	Max time between Snowplow collector tstamp and finishing request to target. Enabled via configuration - Snowplow enriched data only.