[Feature]: Proxy server should fix OpenTelemetry span kind

[stevapple]

The Feature

Correctly mark the "Received Proxy Server Request" span as SpanKind.SERVER, and optionally trace each downstream calls with a SpanKind.CLIENT OpenTelemetry span.

Motivation, pitch

In most OpenTelemetry systems, only "server" and "client" spans are considered as the starting point of a program. Currently LiteLLM Proxy Server emits all spans as "internal", which makes it dropped or hidden from the UI without explicit trace parent.

Marking the entry points (http receive) as server and the suspension points (http request) as client should resolve the problem.

Are you a ML Ops Team?

Yes

Twitter / LinkedIn details

No response