Skip to main content

Snowbridge monitoring configuration

Snowbridge comes with configurable logging, pprof profiling, statsD statistics and Sentry integrations to ensure that you know what's going on.

Logging

Use the log_level parameter to specify the log level.

hclassets/docs/configuration/monitoring/log-level-example.hcl
loading...

Sentry Configuration

hclassets/docs/configuration/monitoring/sentry-example.hcl
loading...

StatsD stats receiver configuration

hclassets/docs/configuration/monitoring/statsd-example.hcl
loading...

End-to-end latency configuration

Snowplow Enriched data only:

hclassets/docs/configuration/metrics/e2e-latency-example.hcl
loading...

Metric definitions

Snowbridge sends the following metrics to StatsD:

MetricDescription
target_successEvents successfully sent to the target.
target_failedEvents that failed to reach the target and will be retried.
target_request_countNumber of requests successfully sent to the target.
message_filteredEvents filtered out via transformation.
failure_target_successInvalid events (not retryable) successfully sent to the failure target.
failure_target_failedInvalid events that failed to reach the failure target. Snowbridge crashes in this scenario.
min_processing_latencyMinimum time between entering Snowbridge and writing to the target.
max_processing_latencyMaximum time between entering Snowbridge and writing to the target.
min_message_latencyMinimum time between entering the source stream and writing to the target.
max_message_latencyMaximum time between entering the source stream and writing to the target.
min_transform_latencyMinimum time for a transformation to complete.
max_transform_latencyMaximum time for a transformation to complete.
min_filter_latencyMinimum time between entering Snowbridge and being filtered out.
max_filter_latencyMaximum time between entering Snowbridge and being filtered out.
min_request_latencyMinimum time for a target write request to complete.
max_request_latencyMaximum time for a target write request to complete.
min_e2e_latencyMinimum time between Snowplow collector timestamp and completing the target write. Enabled via configuration — Snowplow enriched data only.
max_e2e_latencyMaximum time between Snowplow collector timestamp and completing the target write. Enabled via configuration — Snowplow enriched data only.