Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Important
This feature is in Beta.
Zerobus Ingest OTLP is a native OpenTelemetry Protocol (OTLP) endpoint built into the Zerobus Ingest service. It lets you push traces, logs, and metrics directly into Unity Catalog Delta tables using standard OpenTelemetry SDKs and collectors, without needing custom libraries.
To configure your OTLP client to send data to Zerobus Ingest, see Configure OpenTelemetry (OTLP) clients to send data to Unity Catalog.
Concepts
The following concepts are useful for understanding how Zerobus Ingest OTLP works.
OTLP compatibility
Zerobus Ingest OTLP implements the standard OTLP gRPC Collector services as defined by the OpenTelemetry specification. Any OTLP-compatible exporter (such as OpenTelemetry SDKs, the OpenTelemetry Collector, or other instrumentation libraries) can send data to this endpoint.
Supported signals
Zerobus Ingest OTLP exposes three OTLP/gRPC services, one per telemetry signal type:
| Signal | gRPC service path |
|---|---|
| Traces: Distributed trace spans with full support for events, links, and status. | /opentelemetry.proto.collector.trace.v1.TraceService/Export |
Logs: Log records with severity, body, and correlation to traces via trace_id and span_id. |
/opentelemetry.proto.collector.logs.v1.LogsService/Export |
| Metrics: All five OTLP metric types: Gauge, Sum, Histogram, ExponentialHistogram, and Summary. | /opentelemetry.proto.collector.metrics.v1.MetricsService/Export |
Partial success
Zerobus Ingest OTLP supports partial success as defined by the OTLP specification. If a request contains a mix of valid and invalid records, the valid records are ingested and the invalid records are rejected. The response includes the count of rejected records (rejected_spans, rejected_log_records, or rejected_data_points) and an error_message describing why.
Compression
Gzip compression is supported on all three OTLP services. Set the grpc-encoding header to gzip, or configure your OTLP exporter to use gzip compression.
Limitations
- Only the OTLP/gRPC (Protobuf) transport is supported. HTTP (Protobuf) is not yet supported.
- Each request targets one table, specified using the
x-databricks-zerobus-table-nameheader. To ingest traces, logs, and metrics, configure separate exporters pointing to different tables. - Tables must be created in advance with the correct schema. Zerobus Ingest does not create or modify tables.
- The default quota is 10,000 requests per second. If you require a higher quota, contact your Databricks representative.
- For a full list of Zerobus Ingest limitations, see Zerobus Ingest connector limitations.
Next steps
- Configure OpenTelemetry (OTLP) clients to send data to Unity Catalog — Python examples and OpenTelemetry Collector configuration.
- OpenTelemetry table reference for Zerobus Ingest — Table schemas and data mapping reference.
- Query OpenTelemetry data — Example SQL queries for spans, logs, and metrics.
- Zerobus Ingest connector limitations