Observability Overview
Observability in The Pipeline Framework is designed for distributed pipelines: you should be able to see what each step did, how long it took, and where failures occurred.
What You Get Out of the Box
- Metrics: Step timings, throughput, and failure counts
- Tracing: End-to-end request visibility across steps
- Logging: Structured logs with correlation identifiers
- Health Checks and In-flight Probe: Liveness, readiness and killswitch for orchestration
- Alerting: Dashboards and alert rules tuned for pipeline behavior
- Security Notes: Prevent accidental leakage of sensitive information
- Working with NewRelic OTel: Enabing OTel export to use NewRelic
- Test locally using LGMT: Enabling Prometheus metrics for Grafana dashboards on Quarkus LGTM stack