Exploring failed events
📄️ Using S3 or GCS
When failed events are generated on your pipeline the raw event payload along with details about the failure are saved into file storage (S3 on AWS, GCS on Google Cloud).
📄️ Using Athena or BigQuery
Athena on AWS and BigQuery on GCP are tools that let you query your failed events, using the cloud storage files as a back-end data source.
📄️ Using Postgres
If you use the Postgres Loader (not recommended for large volume production use cases), you can load your failed events into Postgres.