Skip to main content

Shipper Conformance Matrix

The nightly Shipper Conformance workflow (.github/workflows/conformance.yaml) runs TestE2E_ConformanceMatrix in test/e2e/shippers with the e2e,e2e_matrix build tags. Each cell starts a LynxDB server and a pinned shipper container, sends a fixture through the shipper, and checks that every event arrives. The pull-request compatibility suite is smaller; nightly runs cover the broader matrix and report each cell separately.

Enforced cells​

CellCoverage
filebeat/8.15/noneElasticsearch bulk ingest, Filebeat 8 handshake.
fluent-bit/3.x/gzipElasticsearch output with gzip compression.
fluent-bit/3.x/logstash_formatLogstash_Format On, date suffix stripped from _source.
vector/0.40/zstd_bulkVector bulk mode with zstd compression.
vector/0.40/zstd_data_streamVector data stream mode through /_data_stream/{name}/_bulk.
otelcol/0.105/http_proto_gzipOTLP HTTP protobuf with gzip compression.
otelcol/0.105/grpc_gzipOTLP gRPC with gzip compression.
splunk-hec/curl/ackHEC event ingest plus /services/collector/ack polling.

Quarantine list​

These cells are listed in the test driver with t.Skip and a reason. Promoting a quarantined cell means removing the skip and proving it passes in the nightly workflow.

CellReason
filebeat/7.17/noneOlder Filebeat release, not enforced in the nightly run.
filebeat/8.10/noneIntermediate Filebeat release, not enforced in the nightly run.
filebeat/9.0/noneImage availability varies by registry state.
fluent-bit/2.x/gzipOlder Fluent Bit release, not enforced in the nightly run.
vector/0.30/zstd_bulkThe sink config of this Vector release differs from the fixture.
vector/0.45/zstd_bulkWaits for a pinned image in the registry.
vector/latest/zstd_bulklatest is intentionally tracked outside PR gates.
otelcol/0.95/http_proto_gzipThe collector config for this release is not validated.
otelcol/latest/http_proto_gziplatest is intentionally tracked outside PR gates.
splunk-uf/9.x/hecSplunk Universal Forwarder image requires license/bootstrap secrets in CI.

Local run​

The cells run shipper images through testcontainers, so Docker must be running.

make test-conformance