[EPIC] OpenTelemetry essentials for logs

[artherd42]

Context

Umbrella issue for evaluating OpenTelemetry to collect and process logs.

The Greenhouse catalogue provides plugins that install a well-defined log infrastructure. These are combined with documentation and scripts to enable user-friendly end-to-end monitoring of Kubernetes clusters with Opensearch using the OpenTelemetry standard. This issue describes the first steps for obtaining logs via the Opentelemetry collector.

Data Flow:

Tickets

• [opentelemetry] Create Plugin #34
• [opentelemetry] Container Logshipping #171
• [opentelemetry] Logforwarding from OpenTelemetry to OpenSearch #148

Acceptance criteria

1. Proof of concept for logs with OTEL
2. Decentralized architecture
3. Consider SAP Converged Cloud best practices
4. Plugin tests
5. Documentation