Add o11y features

[lindarr915]

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Our customers find it difficult to troubleshoot when the client response is not expected, getting "connection closed", etc. The operator needs to find the server/gateway logs to find out 4xx errors, for example, throttling or bad request.

Describe the feature you'd like
A clear and concise description of what you want to happen.

1. add otel features support tracing/auto instruments to support X-Ray or Application Signal on EKS
2. add test Dockerfile with ADOT/OTEL for faster local debugging

Additional context
Add any other context or screenshots about the feature request here.